Azure Local Has Two SDN Operating Models: Arc-Managed Networking Versus Full On-Premises SDN

Introduction

Azure Local networking becomes confusing when the same words appear in several different product contexts. Logical network, virtual network, network security group, load balancer, gateway, and Network Controller all sound familiar to anyone who has worked with Azure or VMware NSX. The names create an understandable expectation that the underlying capabilities and operating models will also be familiar.

That expectation is dangerous.

Microsoft now documents two distinct ways to operate software-defined networking on Azure Local: SDN enabled by Azure Arc and SDN managed through on-premises tools. These are not two interfaces controlling the same complete resource model. They have different Network Controller deployment models, different supported resources, different VM scopes, different management tools, and different operational dependencies. Microsoft explicitly identifies mixed management between the two as unsupported [1].

The architectural decision therefore cannot begin with a question such as, “Do we want to use the Azure portal or Windows Admin Center?” The correct starting question is, “Which networking services must the platform deliver, and which management plane is the organization prepared to operate?”

TL;DR

Azure Local offers two materially different SDN operating models.

SDN enabled by Azure Arc is designed for Azure Local VMs managed through Azure Resource Manager. It provides Azure-managed logical networks, VM network interfaces, and network security groups. Its Network Controller runs as a Failover Cluster service integrated into Azure Local lifecycle management. It does not provide virtual networks, Software Load Balancers, or VPN, GRE, and L3 gateways in the hyperconverged operating model covered here.

SDN managed by on-premises tools uses dedicated Network Controller VMs and can optionally add Software Load Balancer and gateway infrastructure. It supports logical networks, virtual networks, NSGs, load balancing, and VPN, GRE, or L3 gateway connections. It is managed through Windows Admin Center, PowerShell, SDN Express, and potentially System Center Virtual Machine Manager.

Choose Arc-managed SDN when VLAN-backed networks, Azure-managed VM resources, and basic NSG enforcement are sufficient. Choose on-premises SDN when the platform itself must provide overlays, tenant virtual networks, distributed network services, load balancing, or software gateways.

Neither model should be described as complete Azure networking on-premises. Azure-like names do not guarantee Azure-equivalent capabilities, APIs, service integrations, scale characteristics, or operational tooling.

Scope and Version Guardrails

This article focuses primarily on the hyperconverged Azure Local operating model represented in Microsoft’s core SDN comparison documentation.

The current support baselines are important:

  • SDN enabled by Azure Arc requires Azure Local 2506 or later with operating-system build 26100.xxxx or later [1].
  • SDN managed by on-premises tools is available for Azure Local 2311.2 or later [1].
  • Arc-managed SDN is enabled through a PowerShell lifecycle action and cannot currently be rolled back or disabled after enablement [2].
  • Multi-rack Azure Local 2511 and later introduces additional network-fabric and virtual-network resource paths. Those capabilities have their own requirements and should not be assumed to apply to every hyperconverged Azure Local deployment.
  • The term full on-premises SDN in this article means the Network Controller, SLB, and gateway-based Windows SDN stack. It does not mean full feature parity with Microsoft Azure or VMware NSX.

The last distinction matters. A resource called a virtual network on Azure Local is not automatically equivalent to an Azure VNet in service integration, routing, security, observability, or lifecycle behavior.

The Core Mental Model: Two Owners of Network State

The most useful way to understand the choice is to identify which control plane owns the authoritative network state.

The left side treats supported network objects as Azure-managed resources. The right side treats SDN as an on-premises infrastructure service.

That difference affects far more than where an administrator clicks. It determines resource scope, automation interfaces, lifecycle ownership, break-glass procedures, monitoring, support boundaries, and the skills the platform team must retain.

VLAN-Backed Logical Networks Are the Common Foundation

Both models support logical networks, but the term must be interpreted correctly.

A logical network is a logical representation of a physical network on which VMs can be provisioned. It carries information such as:

  • Address prefix
  • IP-allocation method
  • IP pool
  • Default gateway
  • DNS servers
  • VLAN ID
  • External virtual-switch association

In the common hyperconverged deployment pattern, a logical network projects an existing Layer 2 or Layer 3 network into the Azure Local VM-consumption layer. It does not automatically create an overlay, a tenant routing domain, a distributed router, a NAT service, or a software-defined edge [7][8].

Logical Network Versus Virtual Network

The distinction can be summarized this way:

PropertyLogical networkVirtual network
Primary purposeRepresent an existing physical or VLAN-backed networkCreate a software-defined tenant network
Underlay dependencyDirectly associated with physical VLAN and subnet designUses an HNV provider network as its underlay
Default gatewayUsually exists in the physical networkCan use SDN gateway and routing constructs
Address isolationVLAN and subnet basedOverlay-based tenant address space
Overlapping tenant addressesGenerally not a logical-network functionAn overlay use case where supported
Arc-managed hyperconverged supportYesNo
On-premises SDN supportYesYes
Equivalent to Azure VNetNoNo, despite similar naming

A logical network plus an NSG can provide useful segmentation and filtering. It still does not replace a routed virtual-network fabric.

SDN Enabled by Azure Arc

SDN enabled by Azure Arc is the Azure-managed model for network resources associated with Azure Local VMs.

Network Controller Deployment

The Network Controller is deployed as a Failover Cluster service rather than as a set of dedicated VMs. Azure Local’s orchestrator, also described as Lifecycle Manager, deploys and manages the service [2].

The enablement action uses PowerShell:

Add-EceFeature `
    -Name NC `
    -SDNPrefix "edge01" `
    -AcknowledgeMaintenanceWindow `
    -AcknowledgeDNSRecordCreation

The SDNPrefix becomes part of the Network Controller REST endpoint name. The DNS record and reserved address must be prepared correctly before enablement. The action also enables the Azure Virtual Filtering Platform extensions on the relevant virtual switch.

What successful execution should produce:

  • Network Controller services running as clustered resources
  • A resolvable Network Controller REST endpoint
  • VFP extensions enabled on the compute virtual switch
  • Existing Azure Local logical networks and NICs hydrated into Network Controller
  • Azure-managed network resources remaining visible through the Azure control plane

What can go wrong:

  • The prefix violates naming rules.
  • The REST endpoint DNS record points to the wrong address.
  • The required address is already in use.
  • A Network Controller deployed through on-premises tools already exists.
  • The operation is attempted without a production maintenance window.
  • Unsupported host-network intent combinations are in use.

Microsoft warns that enablement briefly disrupts VM networking while VFP policy is applied. It also states that the operation cannot currently be rolled back or disabled [2].

Supported Resource Scope

For the hyperconverged operating model, Arc-managed SDN supports:

  • Logical networks
  • Azure Local VM network interfaces
  • Network security groups
  • Network security rules
  • NSG association with logical networks
  • NSG association with Azure Local VM NICs

It does not support the following network resources in this operating model:

  • Virtual networks
  • Software Load Balancers
  • VPN gateways
  • GRE gateways
  • L3 gateways [1]

This is the first major place where Azure-style naming can mislead an architecture team. The presence of Azure Resource Manager, a custom location, logical networks, and NSGs does not mean Azure Load Balancer, Azure Firewall, Azure Virtual Network Gateway, Azure Route Server, Azure Network Manager, or the complete Azure VNet model has been projected into the datacenter.

Azure Local VM Scope

Arc-managed NSGs are scoped to Azure Local VMs. These are VMs created and managed through Azure client interfaces, including:

  • Azure portal
  • Azure CLI
  • Azure Resource Manager
  • Supported declarative resource templates

The network interface and logical network are Azure resources associated with the Azure Local custom location.

A VM created locally through Hyper-V Manager, Failover Cluster Manager, Windows Admin Center, or similar tools is an unmanaged VM from the Azure control-plane perspective. The Arc-managed NSG model is not intended to make locally created VMs part of the same policy scope automatically [1][9].

Management Interfaces

Arc-managed SDN has a deliberate management boundary:

InterfaceArc-managed role
Azure portalSupported creation and management interface
Azure CLISupported creation and management interface
ARM templatesSupported declarative interface
Terraform or AzAPIAvailable for supported projected resource types where documented
PowerShellUsed to enable the Network Controller integration
Windows Admin CenterNot a supported day-2 interface for Arc-managed SDN objects
SDN ExpressNot a supported day-2 interface for Arc-managed SDN objects
Direct Network Controller API changesUnsupported for Azure Local VM resources

PowerShell therefore has two different meanings in this discussion. It enables the Arc-integrated Network Controller, but the supported day-2 resource interfaces remain the Azure portal, Azure CLI, and Azure Resource Manager templates [1][2].

Example Arc-Managed Logical Network

The following example creates a static logical network using the CLI. The CLI retains stack-hci-vm in the command namespace even though the current product name is Azure Local.

$subscription       = "<subscription-id>"
$resourceGroup      = "rg-azurelocal-prod"
$customLocationId   = "<custom-location-resource-id>"
$location           = "eastus"
$logicalNetwork     = "lnet-app-prod"
$vmSwitchName       = '"ConvergedSwitch(management_compute_storage)"'
$addressPrefix      = "10.40.20.0/24"
$gateway            = "10.40.20.1"
$dnsServers         = "10.40.10.10 10.40.10.11"
$vlan               = "420"

az stack-hci-vm network lnet create `
    --subscription $subscription `
    --resource-group $resourceGroup `
    --custom-location $customLocationId `
    --location $location `
    --name $logicalNetwork `
    --vm-switch-name $vmSwitchName `
    --ip-allocation-method "Static" `
    --address-prefixes $addressPrefix `
    --gateway $gateway `
    --dns-servers $dnsServers `
    --vlan $vlan

The values must be changed to match the real external virtual switch, VLAN, subnet, DNS, gateway, custom location, and Azure region.

A successful command creates an Azure Resource Manager representation of the logical network and reconciles that resource with Azure Local. It does not configure the upstream switch, create the VLAN on the physical fabric, or add the subnet to an external router.

SDN Managed Through On-Premises Tools

The on-premises model is the broader Windows SDN stack. It uses dedicated infrastructure VMs and can be deployed incrementally.

Network Controller Deployment

Network Controller runs on dedicated VMs rather than as an Azure Local Failover Cluster service. It can be deployed with:

  • Windows Admin Center
  • SDN Express PowerShell scripts
  • System Center Virtual Machine Manager in supported designs

Once Network Controller is present, the organization can add Software Load Balancer and gateway infrastructure according to its service requirements [3][5][6].

This infrastructure has its own lifecycle:

  • Operating-system patching
  • Certificate maintenance
  • VM placement and availability
  • Infrastructure IP planning
  • Capacity monitoring
  • Backup and recovery procedures
  • Upgrade sequencing
  • Health validation
  • Troubleshooting and log collection

The additional capability is real, but so is the additional operational burden.

Network Controller Capabilities

Network Controller can manage:

  • Traditional VLAN-backed logical networks
  • Virtual networks and subnets
  • VM network interfaces
  • NSG and ACL policy
  • Microsegmentation
  • Quality-of-service policy
  • Virtual appliances
  • User-defined routing
  • Virtual-network peering
  • Overlay network policy [3][4]

An organization can deploy Network Controller without immediately deploying SLB or gateway VMs. This phased approach is useful when the initial requirement is VLAN-backed NSGs, QoS, or virtual-network policy rather than a complete software-defined edge.

Software Load Balancer

Software Load Balancer adds Layer 4 load-balancing and NAT services. It can support workloads connected to VLAN-backed logical networks and virtual networks [16].

The architecture includes SLB multiplexer VMs and host agents. BGP is used to advertise virtual IP addresses to the physical network.

Common services include:

  • Internal load balancing
  • External or public VIP load balancing
  • Inbound NAT
  • Outbound NAT
  • Health probes
  • TCP and UDP load balancing
  • Load balancing across multiple backend VMs

SLB is not an application-delivery controller and should not be treated as an automatic replacement for NSX Advanced Load Balancer, F5 BIG-IP, Citrix NetScaler, NGINX, or another Layer 7 platform.

Gateway Services

Gateway VMs provide connectivity between SDN virtual networks and external networks.

Supported connection types include:

  • Site-to-site IPsec VPN
  • GRE tunnels
  • L3 forwarding [3]

Gateway services depend on careful planning of:

  • HNV provider addresses
  • Provider VLAN
  • Gateway front-end and back-end interfaces
  • BGP autonomous-system numbers
  • External router peers
  • Public and private VIP ranges
  • GRE VIP ranges where needed
  • Active and redundant gateway capacity

A gateway is not merely a default-gateway field attached to a logical network. It is a stateful infrastructure service with its own VMs, routing state, capacity, redundancy, and external dependencies.

Capability Comparison

The following matrix reflects the hyperconverged operating model discussed in Microsoft’s two-method comparison.

CapabilitySDN enabled by Azure ArcSDN managed on-premisesArchitectural implication
VLAN-backed logical networksYesYesBoth can connect VMs to existing physical networks
Azure Local VM NIC resourcesYesNot the primary scopeArc-managed resources belong to Azure Local VM lifecycle
Hyper-V or SCVMM VM NIC managementNoYesOn-premises tools manage unmanaged VMs
NSGs on logical networksYesYesPolicy owner and VM scope differ
NSGs on individual NICsYes, for Azure Local VMsYes, for unmanaged VMsDo not cross the management boundary
Virtual networks and subnetsNoYesOverlay networking requires the on-premises model
Overlapping tenant address spacesNo native Arc-managed overlayPossible through supported HNV designsRequires provider-network planning
User-defined routingNo Arc-managed VNet constructSupported with virtual networksNot equivalent to an Azure route table
Virtual-network peeringNoSupportedRemains an on-premises SDN function
Software Load BalancerNoOptionalExternal ADC or physical load balancer is needed in Arc-only designs
Inbound and outbound NATNo SDN SLB serviceSupported with SLBExternal firewall or ADC may supply NAT in Arc-only designs
L3 gatewayNoOptionalPhysical routing remains authoritative in Arc-only designs
Site-to-site VPN gatewayNoOptionalUse external firewall/router in Arc-only designs
GRE gatewayNoOptionalRequires on-premises gateway infrastructure
BGP-advertised VIPsNo SDN SLBYesBGP fabric integration is a major design threshold
Azure portal managementYesNo for full on-premises SDN resourcesPortal visibility is not feature parity
Azure CLI managementYesNot the primary modelOn-premises automation uses PowerShell and controller interfaces
ARM templatesYesNo equivalent projection for full stackDifferent infrastructure-as-code pipelines
Windows Admin CenterUnsupported for Arc-managed SDN changesYesAvoid mixed authority
SDN ExpressUnsupported for Arc-managed SDN changesYesPrimarily deployment and on-premises operations
SCVMM integrationNoSupported where applicableRelevant for existing System Center estates
Arc Resource Bridge dependencyYes for Azure management projectionNot for local SDN object managementWorkload operation and cloud management availability differ
AKS on same Azure Local instanceYesRequires workload-specific validationAKS does not gain all SDN services automatically
NSGs on AKS logical networks or AKS NICsNoDo not assume supportKubernetes policy remains a separate control domain
Multicast workload supportNoValidate separatelyArc-managed SDN currently facilitates unicast traffic

Arc Resource Bridge Visibility Is Not the Same as Data-Plane Ownership

Azure Arc Resource Bridge provides the projection that allows Azure Resource Manager to manage supported resources on Azure Local. It connects Azure, the custom location, and the local resource providers used for VM and AKS lifecycle management [11][12].

For Arc-managed networking, this means the portal can show and manage supported logical networks, NICs, and NSGs as Azure resources.

For on-premises SDN, the Azure portal may still show the Azure Local instance and its Arc-enabled resources, but the complete Network Controller, SLB, gateway, virtual-network, and policy inventory is not transformed into an equivalent Azure networking resource model. Day-2 operations remain with the local management stack.

What Happens When Arc Resource Bridge Is Unavailable?

Existing workloads should continue to operate when Arc Resource Bridge is unavailable, but Azure can lose visibility and management capability for projected resources [12].

That creates an important operational consequence for Arc-managed SDN:

  • Existing VM traffic does not become dependent on every packet traversing Azure.
  • New Azure management operations can fail or become unavailable.
  • Portal and ARM visibility can become stale.
  • Local tools are not an approved alternative control plane for changing Arc-managed SDN resources.
  • A break-glass runbook must distinguish guest-network troubleshooting from unsupported control-plane modification.

Arc-managed does not mean that the data path is hairpinned through Azure. It means that Azure is the supported management authority for the projected network resources.

Mixed Management Is an Unsupported Architecture

The most important support rule is also one of the easiest to violate.

If Network Controller was deployed with on-premises tools, do not attempt to enable the Arc-managed model. If Network Controller was deployed through Add-EceFeature, do not attempt to deploy or manage the same SDN environment with Windows Admin Center or SDN Express [1][2].

Do not:

  • Enable Arc-managed SDN over an existing on-premises Network Controller.
  • Deploy on-premises Network Controller VMs after enabling the Arc-integrated controller.
  • Modify Arc-managed Azure Local VM NICs directly through Network Controller APIs.
  • Apply an on-premises-managed NSG to an Azure Local VM NIC.
  • Modify Arc-managed network objects through Windows Admin Center.
  • Treat Azure portal state and Network Controller state as independently editable copies.
  • Use a local command merely because it appears technically capable of changing the underlying switch.

The risk is not only configuration drift. Microsoft warns that unsupported direct modifications can place resources into bad or unrecoverable states [10].

A reliable operating model has one authoritative control plane, one supported reconciliation path, and one documented recovery boundary.

Managed and Unmanaged VMs Must Be Separated Deliberately

Azure Local can expose two different VM-management experiences:

Azure Local VMs

  • Created through Azure interfaces
  • Represented as Azure Resource Manager resources
  • Associated with a custom location
  • Managed through Azure role-based access control
  • In scope for Arc-managed NSGs

Unmanaged VMs

  • Created through local Hyper-V-oriented tools
  • Managed through Windows Admin Center, Hyper-V Manager, Failover Cluster Manager, PowerShell, or SCVMM
  • Not automatically represented by the same Azure VM resource model
  • In scope for on-premises SDN policy where supported

The distinction should appear in the platform design, naming standard, automation repositories, support model, and ownership matrix.

A VM should not silently move between management domains. Importing an unmanaged VM into an Azure-managed lifecycle is not equivalent to merely discovering it, and applying network policy from the wrong tool is not a supported shortcut.

IP Pools, DNS, Gateways, and Multiple NICs

Many production issues attributed to SDN are conventional IP-design failures that were hidden by automation.

IP-Pool Design

A logical network must reserve enough addresses for the workload lifecycle, not merely the initial VM count.

Plan for:

  • Current VM NICs
  • Deployment growth
  • Replacement or rolling-upgrade overlap
  • AKS control-plane and node addresses
  • Load-balancer address pools
  • Migration waves
  • Temporary coexistence
  • Reserved network devices
  • Monitoring or recovery appliances

Overlapping IP pools on the same VLAN are not permitted. IP exhaustion can prevent VM or AKS deployment even when compute and storage capacity remain available [7][13].

Immutable Logical-Network Properties

After a logical network is created, several properties cannot be modified in place, including:

  • Default gateway
  • IP pools
  • Address space
  • VLAN ID
  • Virtual-switch name [7][8]

Treat logical-network creation as a controlled infrastructure change. A typographical error can require creating a replacement network and moving workloads.

DNS

A workload logical network can carry DNS-server configuration. DNS changes may apply only to newly created VMs, depending on the resource and feature state. Existing guests may require manual changes [8].

DNS planning must include:

  • Forward and reverse resolution
  • Network Controller REST records
  • Azure Local management dependencies
  • Guest DNS configuration
  • AKS name resolution
  • Conditional forwarding between zones
  • Recovery-site and migration dependencies

DNS should never be treated as an optional text field added after the addressing plan is complete.

Default Gateways

In an Arc-managed logical network, the default gateway normally belongs to the physical network. Creating the logical network does not create that router.

In the on-premises virtual-network model, a software gateway can provide L3 connectivity between the tenant virtual network and external networks. That is a separate service from the logical network’s gateway field.

Multiple NICs

When an Azure Local VM receives multiple static NICs, each NIC can initially receive the logical network’s default gateway. Microsoft instructs administrators to remove the default gateway from secondary NICs to prevent:

  • Asymmetric routing
  • Packet loss
  • Unpredictable reply paths
  • Incorrect egress selection [1][10]

The normal enterprise design should provide:

  • One default route per guest
  • Explicit routes for secondary networks
  • Clear management, backup, storage, replication, or application-NIC roles
  • Guest-operating-system validation after provisioning
  • Firewall policy that recognizes the actual return path

A multi-NIC VM is not complete when all NIC resources show a successful provisioning state. Guest route validation is part of deployment acceptance.

AKS Networking Considerations

AKS on Azure Local adds another network domain. It should not be treated as ordinary VM networking with Kubernetes labels added.

AKS uses Azure Local logical networks to allocate addresses to the VMs that form the Kubernetes control plane and node pools. Static allocation is required because node addresses must remain stable through the cluster lifecycle [13][14].

Plan addresses for:

  • One address per control-plane or worker VM
  • One control-plane virtual IP per AKS cluster
  • Kubernetes service exposure
  • MetalLB or another load-balancer implementation
  • Cluster upgrades and node-pool growth
  • Temporary replacement nodes
  • Ingress controllers
  • External application endpoints

AKS Does Not Inherit the Full SDN Feature Set

Microsoft documents that AKS can run on an Azure Local instance where SDN enabled by Arc is configured. It also states that NSGs cannot be associated with the logical network used for AKS deployment or with AKS workload VM NICs [1].

The current AKS networking documentation further states that software-defined virtual networks and SDN-related features are not supported for AKS on Azure Local [13].

These statements are compatible when interpreted correctly:

  • AKS can coexist with Arc-enabled SDN on the same Azure Local instance.
  • AKS still consumes static logical-network addressing.
  • The AKS workload network is not brought under the Arc-managed NSG policy model.
  • Kubernetes NetworkPolicy, ingress controls, service exposure, and application load balancing remain separate Kubernetes design concerns.
  • A legacy guide for AKS on Windows Server should not be assumed to define the current support model for AKS on Azure Local.

Use a dedicated logical network and IP plan for AKS. Do not reuse a general-purpose Azure Local VM logical network merely because the VLAN and subnet appear suitable.

Hub and Spoke L3 Design

A hub-and-spoke design means different things in the two operating models.

Arc-Managed Hub and Spoke

Arc-managed logical networks do not supply native SDN L3 gateways or virtual-network peering. The hub therefore exists outside the Azure Local Arc-managed resource model.

Typical hub functions are supplied by:

  • Physical routers
  • Datacenter firewalls
  • A routed leaf-spine fabric
  • External network-virtualization platforms
  • Physical or virtual application-delivery controllers
  • Cloud connectivity appliances

The Azure Local logical networks become spoke attachment networks. Routing, NAT, VPN, route exchange, service insertion, and advanced firewalling remain external.

This pattern can be highly effective. It is often simpler than deploying full SDN when the enterprise already has a mature physical fabric and firewall platform.

On-Premises SDN Hub and Spoke

The on-premises model can place tenant workloads in virtual networks and use SDN gateways for external connectivity. Virtual-network peering and user-defined routing can participate in a software-defined topology [4].

However, this is not a direct recreation of Azure Virtual WAN or the complete Azure hub-and-spoke operating model. The organization still owns:

  • Gateway VM capacity
  • BGP sessions
  • Route propagation
  • Network Controller health
  • Provider-network addresses
  • Failover behavior
  • SLB and gateway certificates
  • Infrastructure VM lifecycle
  • External-fabric integration

The on-premises model provides more network services, but it also makes the Azure Local platform team responsible for operating those services.

Physical Network and BGP Integration

The physical network remains an architectural dependency in both models.

Arc-Managed Physical Integration

For Arc-managed VLAN-backed logical networks, the physical fabric must provide:

  • VLAN availability on every relevant host uplink
  • Correct trunk or access behavior
  • Subnet gateway
  • Inter-VLAN routing
  • North-south routing
  • MTU consistency
  • Redundancy
  • Reachability to DNS and required services

Arc-managed SDN does not create BGP peers simply because the network resource is visible in Azure.

On-Premises Full SDN Integration

The on-premises model introduces an HNV provider network for virtual networks. The provider network carries encapsulated tenant traffic and supplies connectivity for SLB and gateway infrastructure [4].

SLB and gateway services can require:

  • BGP-capable Layer 3 switches or routers
  • ECMP
  • Provider-address VLAN and subnet
  • SLB MUX provider addresses
  • Gateway provider addresses
  • Public and private VIP prefixes
  • GRE prefixes where used
  • Correct autonomous-system-number design
  • Sufficient MTU for encapsulated traffic

BGP is not required merely to create a VLAN-backed logical network with Network Controller. It becomes central when SLB, gateways, VIP advertisement, and overlay connectivity enter the design.

Migration from VMware NSX

An NSX migration should begin with service decomposition, not component-name matching.

The question is not, “What is the Azure Local equivalent of an NSX segment?” The better questions are:

  • Is the segment VLAN-backed or overlay-backed?
  • Does it rely on overlapping tenant addresses?
  • Where does its default gateway run?
  • Does it use distributed routing?
  • Which firewall rules depend on groups, tags, or identity?
  • Does it use NAT, load balancing, VPN, DHCP, or service insertion?
  • Which operational tools are required for troubleshooting?
  • Must the workload preserve its IP address during migration?

Practical NSX Mapping

NSX functionArc-managed targetOn-premises SDN targetMigration warning
VLAN-backed segmentLogical networkLogical networkValidate VLAN presence on all Azure Local hosts
Overlay segmentNo direct Arc-managed equivalentVirtual networkRequires HNV provider-network design
Distributed firewall ruleNSG where supportedNSG or ACL policyFeature semantics are not identical
Tier-0 routingExternal router or firewallSDN gateway plus physical fabricDo not map the name alone
Tier-1 routingExternal routed VLAN designVirtual-network routing designValidate routing and tenancy requirements
NSX Edge VPNExternal VPN applianceSDN VPN gatewayRebuild tunnels and validate failover
NSX Edge GREExternal routerSDN GRE gatewayEncryption and routing semantics differ
NSX load balancerExternal ADC or Kubernetes ingressSLB for Layer 4 use casesSLB does not replace Layer 7 services
NATExternal firewall or ADCSLB or gateway designInventory every rule and dependency
NSX groups and tagsAzure resource governance plus NSG rulesController ACL modelDynamic membership may require redesign
Traceflow and flow analyticsExternal observability stackSDN diagnostics and local toolingTroubleshooting workflow changes

Migration Sequence

A controlled migration should use the following phases.

Inventory the NSX service dependency

Export segments, gateways, routes, NAT, VPN, load-balancer pools, firewall policy, address groups, DHCP, DNS dependencies, and physical uplinks.

Classify each network

Place every network into one of four target patterns:

  • Existing VLAN mapped to an Arc-managed logical network
  • Existing VLAN mapped to an on-premises logical network
  • Overlay network redesigned as an on-premises virtual network
  • Network service moved to an external firewall, router, ADC, or Kubernetes layer

Select the Azure Local SDN operating model

Do this before deploying Network Controller. The choice is not safely deferred until after workload migration.

Build the physical prerequisites

Create VLANs, trunks, routes, gateway interfaces, DNS records, provider networks, BGP peers, and VIP ranges before moving production VMs.

Translate policy

Rebuild rules according to the target enforcement point. Do not convert an NSX distributed-firewall export into an NSG rule list without validating statefulness, priorities, scope, return traffic, and workload identity.

Test representative applications

Include multi-tier applications, multi-NIC VMs, backup traffic, monitoring, directory services, east-west flows, north-south publishing, and failure scenarios.

Preserve or change IP addresses deliberately

Azure Migrate requires a target logical network on Azure Local. Existing addresses can be preserved only when the target network, VLAN, routing, and policy support them [15].

Remove NSX dependencies only after validation

A VM booting on Azure Local is not evidence that the application has successfully exited NSX.

Operating Patterns

Pattern: Azure-Managed VLAN Consumption

Best fit: Enterprises that want Azure-managed VM lifecycle, familiar VLAN-backed connectivity, and NSG policy without operating a complete SDN edge.

Components:

  • Azure Local VMs
  • Arc Resource Bridge
  • Arc-managed logical networks
  • Arc-managed NICs
  • NSGs
  • Existing physical routers and firewalls
  • External load balancer where needed

Strengths:

  • Azure portal, CLI, and ARM workflows
  • Lower SDN infrastructure-VM overhead
  • Clear alignment with Azure Local VM management
  • Existing enterprise network services remain reusable

Tradeoffs:

  • No Arc-managed virtual networks
  • No Arc-managed SLB
  • No Arc-managed VPN, GRE, or L3 gateway
  • External platform remains responsible for routing and advanced services
  • Azure connectivity affects management availability

Pattern: On-Premises SDN Service Fabric

Best fit: Hosting platforms, complex multitenancy, overlay requirements, overlapping addresses, software gateways, and BGP-advertised VIPs.

Components:

  • Network Controller VMs
  • Optional SLB MUX VMs
  • Optional gateway VMs
  • HNV provider network
  • Logical and virtual networks
  • On-premises management tools
  • BGP-capable physical fabric

Strengths:

  • Broadest Azure Local SDN service set
  • Virtual networks and overlays
  • Integrated Layer 4 load balancing
  • VPN, GRE, and L3 gateway options
  • Phased deployment based on required services

Tradeoffs:

  • Additional infrastructure VMs
  • Separate patch, certificate, backup, and recovery lifecycle
  • No Azure portal operating model for the full stack
  • Greater BGP, IPAM, routing, and troubleshooting complexity
  • Higher skills and support burden

Pattern: Arc-Managed VMs with External Network Services

This is often the most practical enterprise compromise.

Use Arc-managed logical networks, NICs, and NSGs for VM consumption, while retaining a dedicated firewall, router, ADC, or fabric controller for:

  • Hub-and-spoke routing
  • NAT
  • VPN
  • Internet publishing
  • Layer 7 load balancing
  • Advanced firewall policy
  • Network telemetry
  • Cross-platform connectivity

This pattern avoids operating the full on-premises SDN stack while still preserving Azure-managed VM workflows.

Decision Tree

The decision should then be tested against VM-management scope:

  • Azure Local VMs point toward Arc-managed SDN.
  • Hyper-V or SCVMM-managed VMs point toward on-premises SDN.
  • A mixed estate requires explicit boundaries, not mixed control over the same resource.

Implementation and Validation Checklist

Architecture Decision

  • Identify whether the article’s hyperconverged scope matches the intended Azure Local deployment type.
  • Record the required Azure Local version and build.
  • Decide whether VMs will be Azure managed or locally managed.
  • Inventory required virtual-network, SLB, NAT, VPN, GRE, and L3 services.
  • Decide which system owns routing and firewalling.
  • Document whether overlapping tenant addresses are required.
  • Record the management tools the operations team will support.
  • Approve one Network Controller deployment method.

Physical Network

  • Confirm external virtual-switch names.
  • Create required VLANs on all host-facing switch ports.
  • Validate trunk and native-VLAN behavior.
  • Confirm gateway addresses and subnet routing.
  • Reserve logical-network IP pools.
  • Exclude DNS, gateway, infrastructure, and network-device addresses.
  • Validate MTU end to end.
  • Configure BGP and ECMP where SLB or gateways require them.
  • Reserve provider, public VIP, private VIP, and GRE ranges where applicable.

DNS and Certificates

  • Create or validate the Network Controller REST record.
  • Confirm forward and reverse resolution.
  • Verify certificate names and trust.
  • Document certificate renewal.
  • Test name resolution from every Azure Local host and management station.

Arc-Managed Enablement

  • Verify no on-premises Network Controller is installed.
  • Confirm the deployment uses a supported network-intent pattern.
  • Schedule a maintenance window.
  • Record existing logical networks and NICs.
  • Run the enablement action.
  • Validate Network Controller clustered resources.
  • Validate VFP extension state.
  • Confirm resource hydration.
  • Test portal, CLI, and ARM operations.
  • Confirm Windows Admin Center and SDN Express are excluded from the change procedure.

On-Premises Deployment

  • Decide whether Network Controller alone is sufficient.
  • Add SLB only when Layer 4 load balancing or NAT is required.
  • Add gateways only when VPN, GRE, or L3 forwarding is required.
  • Size and place infrastructure VMs.
  • Patch source images and deployed infrastructure VMs.
  • Configure backups and recovery procedures.
  • Validate Network Controller, SLB, and gateway health.
  • Test BGP advertisements and withdrawal.
  • Test active and redundant gateway behavior.
  • Test VIP health probes and backend removal.

Workload Validation

  • Create a representative VM on each logical network.
  • Test DNS, gateway, east-west, and north-south connectivity.
  • Validate NSG rule order and default behavior.
  • Test an empty NSG safely in a lab, since it denies inbound connectivity by default.
  • Test multiple NICs and remove secondary default gateways.
  • Validate guest routes after provisioning.
  • Validate live migration across every host.
  • Test Arc Resource Bridge loss without using unsupported local changes.
  • Test AKS control-plane, node, service, and load-balancer address allocation.
  • Record evidence for support handoff.

Common Misunderstandings

“It Is Managed from Azure, So It Must Have Azure VNet Features”

False. Arc-managed SDN for the hyperconverged model supports logical networks, NICs, and NSGs. Microsoft explicitly lists virtual networks, SLBs, and gateways as unsupported [1].

“An NSG Replaces the NSX Distributed Firewall”

Not by itself. Azure Local NSGs filter according to source and destination addresses, ports, protocols, and direction. An NSX operating model may also rely on groups, tags, identity, service insertion, contextual policy, distributed routing, and a richer troubleshooting ecosystem.

“A Logical Network Is an Overlay”

Usually false. A logical network commonly represents an existing VLAN-backed physical network. Overlay virtual networking is a separate capability.

“We Can Start with Windows Admin Center and Move to Arc Later”

Not by managing the same Network Controller deployment with both methods. The Network Controller deployment method is an architectural commitment, not a temporary UI preference.

“Arc Resource Bridge Is in the Data Path”

False. It is part of the management projection. Workload packets do not traverse Azure merely because the network resource is managed through Azure.

“AKS Can Use the Same NSGs as Azure Local VMs”

Not in the documented Arc-managed model. NSGs are not supported on the logical network used for AKS deployment or on AKS workload VM NICs [1].

“Full On-Premises SDN Recreates NSX”

False. It supplies a broader software-defined network stack, but the component model, APIs, policy semantics, routing design, service integrations, scale boundaries, and operating procedures remain different.

Conclusion

Azure Local does not have one SDN architecture with several interchangeable management interfaces. It has two operating models with different control planes and different capability boundaries.

SDN enabled by Azure Arc is the right choice when the enterprise wants Azure-managed VM consumption, VLAN-backed logical networks, and NSG enforcement without operating a complete software-defined edge. Its simplicity is valuable, but only when the missing virtual-network, load-balancing, NAT, VPN, GRE, and L3 gateway services are either unnecessary or supplied elsewhere.

SDN managed through on-premises tools is appropriate when Azure Local must provide its own overlays, tenant virtual networks, Layer 4 load balancing, NAT, or software gateways. Those capabilities come with infrastructure VMs, BGP integration, certificate management, patching, recovery, and a locally operated control plane.

The decision should therefore be made before Network Controller deployment and before NSX migration waves are designed. Start with the required network services, VM-management domain, physical-fabric integration, and acceptable management plane. Then choose one authoritative operating model and keep its resource ownership unambiguous.

Azure-like names are useful for learning, but they are not evidence of Azure-equivalent behavior. A logical network is not automatically a VNet. An NSG is not automatically an NSX distributed firewall. A Software Load Balancer is not an application-delivery controller. Arc visibility is not complete local network-service parity.

The strongest Azure Local design is not the one that enables the most SDN components. It is the one that assigns every network function to a clear control plane, a supported management path, and an operations team prepared to own it.

External References

[1] Microsoft: Software Defined Networking enabled by Azure Arc on Azure Local
Canonical URL: https://learn.microsoft.com/en-us/azure/azure-local/concepts/sdn-overview

[2] Microsoft: Enable SDN integration on Azure Local using PowerShell
Canonical URL: https://learn.microsoft.com/en-us/azure/azure-local/deploy/enable-sdn-integration

[3] Microsoft: Software defined networking managed by on-premises tools in Azure Local, version 23H2
Canonical URL: https://learn.microsoft.com/en-us/azure/azure-local/concepts/software-defined-networking-23h2

[4] Microsoft: Plan a Software Defined Networking infrastructure for Azure Local
Canonical URL: https://learn.microsoft.com/en-us/azure/azure-local/concepts/plan-software-defined-networking-infrastructure-23h2

[5] Microsoft: Deploy an SDN infrastructure using SDN Express for Azure Local
Canonical URL: https://learn.microsoft.com/en-us/azure/azure-local/deploy/sdn-express-23h2

[6] Microsoft: Deploy SDN managed by on-premises tools with Windows Admin Center for Azure Local
Canonical URL: https://learn.microsoft.com/en-us/azure/azure-local/deploy/sdn-wizard-23h2

[7] Microsoft: Create logical networks for Azure Local virtual machines enabled by Azure Arc
Canonical URL: https://learn.microsoft.com/en-us/azure/azure-local/manage/create-logical-networks

[8] Microsoft: Manage logical networks for Azure Local VMs enabled by Azure Arc
Canonical URL: https://learn.microsoft.com/en-us/azure/azure-local/manage/manage-logical-networks

[9] Microsoft: Create network security groups on Azure Local
Canonical URL: https://learn.microsoft.com/en-us/azure/azure-local/manage/create-network-security-groups

[10] Microsoft: FAQ for SDN enabled by Azure Arc on Azure Local
Canonical URL: https://learn.microsoft.com/en-us/azure/azure-local/concepts/sdn-frequently-asked-questions

[11] Microsoft: What is Azure Local VM management
Canonical URL: https://learn.microsoft.com/en-us/azure/azure-local/manage/azure-arc-vm-management-overview

[12] Microsoft: Azure Arc resource bridge overview
Canonical URL: https://learn.microsoft.com/en-us/azure/azure-arc/resource-bridge/overview

[13] Microsoft: AKS enabled by Azure Arc network requirements
Canonical URL: https://learn.microsoft.com/en-us/azure/aks/aksarc/network-system-requirements

[14] Microsoft: Create logical networks for Kubernetes clusters on Azure Local
Canonical URL: https://learn.microsoft.com/en-us/azure/aks/aksarc/aks-networks

[15] Microsoft: Review requirements for VMware VM migration to Azure Local
Canonical URL: https://learn.microsoft.com/en-us/azure/azure-local/migrate/migrate-vmware-requirements

[16] Microsoft: Manage Software Load Balancer for SDN managed by on-premises tools
Canonical URL: https://learn.microsoft.com/en-us/azure/azure-local/manage/load-balancers

Leave a Reply

Discover more from Digital Thought Disruption

Subscribe now to keep reading and get access to the full archive.

Continue reading