Skip to content

Allow manual gateway scaling (drop feature flag) #4142

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
jvstme merged 1 commit into from
Aug 14, 2026
+1 −10
Merged

Allow manual gateway scaling (drop feature flag) #4142

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 0 additions & 1 deletion mkdocs/docs/concepts/gateways.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -172,7 +172,6 @@ $ dstack gateway list
!!! warning "Experimental"
Replicated gateways are an experimental feature and currently have limitations:

- Changing the number of replicas or redeploying replicas is not supported.
- HTTPS is only supported for AWS gateways with the `acm` [certificate type](#certificate). For other gateways, use an external load balancer for TLS termination.
- An unavailable gateway replica prevents any new services or service replicas from being added.
- All replicas are bound to the same backend and region.
Expand Down
5 changes: 1 addition & 4 deletions src/dstack/_internal/server/services/gateways/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -79,7 +79,6 @@
from dstack._internal.server.services.pipelines import PipelineHinterProtocol
from dstack._internal.server.services.plugins import apply_plugin_policies
from dstack._internal.server.utils.common import gather_map_async
from dstack._internal.settings import FeatureFlags
from dstack._internal.utils import crypto
from dstack._internal.utils.common import (
get_current_datetime,
Expand All @@ -89,9 +88,7 @@
from dstack._internal.utils.logging import get_logger

logger = get_logger(__name__)
_CONF_UPDATABLE_FIELDS = frozenset({"domain", "default"})
if FeatureFlags.GATEWAY_SCALING:
_CONF_UPDATABLE_FIELDS |= {"replicas"}
_CONF_UPDATABLE_FIELDS = frozenset({"domain", "default", "replicas"})


def switch_gateway_status(
Expand Down
5 changes: 0 additions & 5 deletions src/dstack/_internal/settings.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -47,8 +47,3 @@ class FeatureFlags:
"""If DSTACK_FF_CLI_PRINT_JOB_CONNECTION_INFO enabled, `dstack apply` command prints server-provided
IDE URL(s) and SSH command(s) before job logs (for dev-environments only).
"""
GATEWAY_SCALING = os.getenv("DSTACK_FF_GATEWAY_SCALING") is not None
"""Allows in-place update of gateway `replicas`.
Has limited applicability at the current stage — without a state sync mechanism, newly started
gateway replicas are not aware of existing services.
"""
Loading