Old Dog Consulting

United Kingdom adrian@olddog.co.uk

Individual

United States of America je_drake@yahoo.com

Ciena

rrokui@ciena.com

NTT

Japan shunsuke.homma.ietf@gmail.com

Futurewei

United States of America kiran.ietf@gmail.com

Telefonica

Spain luismiguel.contrerasmurillo@telefonica.com

Nvidia

jefftant.ietf@gmail.com

rtg teas Network Slicing This document describes network slicing in the context of networks built from IETF technologies. It defines the term "IETF Network Slice" to describe this type of network slice and establishes the general principles of network slicing in the IETF context. The document discusses the general framework for requesting and operating IETF Network Slices, the characteristics of an IETF Network Slice, the necessary system components and interfaces, and the mapping of abstract requests to more specific technologies. The document also discusses related considerations with monitoring and security. This document also provides definitions of related terms to enable consistent usage in other IETF documents that describe or use aspects of IETF Network Slices.

Status of This Memo This document is not an Internet Standards Track specification; it is published for informational purposes. This document is a product of the Internet Engineering Task Force (IETF). It represents the consensus of the IETF community. It has received public review and has been approved for publication by the Internet Engineering Steering Group (IESG). Not all documents approved by the IESG are candidates for any level of Internet Standard; see Section 2 of RFC 7841. Information about the current status of this document, any errata, and how to provide feedback on it may be obtained at .

Copyright Notice Copyright (c) 2024 IETF Trust and the persons identified as the document authors. All rights reserved. This document is subject to BCP 78 and the IETF Trust's Legal Provisions Relating to IETF Documents () in effect on the date of publication of this document. Please review these documents carefully, as they describe your rights and restrictions with respect to this document. Code Components extracted from this document must include Revised BSD License text as described in Section 4.e of the Trust Legal Provisions and are provided without warranty as described in the Revised BSD License.

Table of Contents

• .  Introduction
• .  Background
• .  Terms and Abbreviations
  • .  Abbreviations
  • .  Core Terminology
• .  IETF Network Slice
  • .  Definition and Scope of IETF Network Slice
  • .  IETF Network Slice Service
    • .  Connectivity Constructs
    • .  Mapping Traffic Flows to Network Realizations
    • .  Ancillary CEs
• .  IETF Network Slice System Characteristics
  • .  Objectives for IETF Network Slices
    • .  Service Level Objectives
    • .  Service Level Expectations
  • .  IETF Network Slice Service Demarcation Points
  • .  IETF Network Slice Composition
• .  Framework
  • .  IETF Network Slice Stakeholders
  • .  Expressing Connectivity Intents
  • .  IETF Network Slice Controller (NSC)
    • .  IETF Network Slice Controller Interfaces
    • .  Management Architecture
• .  Realizing IETF Network Slices
  • .  An Architecture to Realize IETF Network Slices
  • .  Procedures to Realize IETF Network Slices
  • .  Applicability of ACTN to IETF Network Slices
  • .  Applicability of Enhanced VPNs to IETF Network Slices
  • .  Network Slicing and Aggregation in IP/MPLS Networks
  • .  Network Slicing and Service Function Chaining (SFC)
• .  Isolation in IETF Network Slices
  • .  Isolation as a Service Requirement
  • .  Isolation in IETF Network Slice Realization
• .  Management Considerations
• . Security Considerations
• . Privacy Considerations
• . IANA Considerations
• . Informative References
• .  Examples
  • .  Multi-Point to Point Service
  • .  Service Function Chaining and Ancillary CEs
  • .  Hub and Spoke
  • .  Layer 3 VPN
  • .  Hierarchical Composition of Network Slices
  • .  Horizontal Composition of Network Slices
• Acknowledgments
• Contributors
• Authors' Addresses

Introduction A number of use cases would benefit from a network service that supplements connectivity, such as that offered by a VPN service, with an assurance of meeting a set of specific network performance objectives. This connectivity and resource commitment is referred to as a "network slice" and is expressed in terms of connectivity constructs (see ) and service objectives (see ). Since the term "network slice" is rather generic and has wider or different interpretations within other standards bodies, the qualifying term "IETF" is used in this document to limit the scope of the network slices described to network technologies defined and standardized by the IETF. This document defines the concept of "IETF Network Slices" that provide connectivity coupled with a set of specific commitments of network resources between a number of endpoints (known as Service Demarcation Points (SDPs); see Sections and ) over a shared underlay network that utilizes IETF technology. The term "IETF Network Slice Service" is also introduced to describe the service requested by and provided to the service provider's customer. It is intended that the terms "IETF Network Slice" and "IETF Network Slice Service" be used only in this document. Other documents that need to indicate the type of network slice or network slice service described in this document can use the terms "RFC 9543 Network Slice" and "RFC 9543 Network Slice Service". This document also provides a general framework for requesting and operating IETF Network Slices. The framework is intended as a structure for discussing interfaces and technologies. Services that might benefit from IETF Network Slices include but are not limited to:

• 5G services (e.g., enhanced Mobile Broadband (eMBB), Ultra-Reliable and Low Latency Communications (URLLC), and massive Machine Type Communications (mMTC) -- see )
• Network wholesale services
• Network infrastructure sharing among operators
• Network Function Virtualization (NFV) connectivity and Data Center Interconnect

Further analysis of the needs of IETF Network Slice Service customers is provided in . IETF Network Slices are created and managed within the scope of one or more network technologies (e.g., IP, MPLS, and optical) that use an IETF-specified data plane and/or management/control plane. They are intended to enable a diverse set of applications with different requirements to coexist over a shared underlay network. A request for an IETF Network Slice Service is agnostic to the technology in the underlay network so as to allow customers to describe their network connectivity objectives in a common format, independent of the underlay technologies used. Many preexisting approaches to service delivery and traffic engineering already use mechanisms that can be considered as network slicing. For example, Virtual Private Networks (VPNs) have served the industry well as a means of providing different groups of users with logically isolated access to a common network. The common or base network that is used to support the VPNs is often referred to as an "underlay network", and the VPN is often called an "overlay network". An overlay network may, in turn, serve as an underlay network to support another overlay network. Note that it is conceivable that extensions to IETF technologies are needed in order to fully support all the capabilities that can be implemented with network slices. Evaluation of existing technologies, proposed extensions to existing protocols and interfaces, and creation of new protocols or interfaces are outside the scope of this document.

Background The concept of network slicing has gained traction, driven largely by needs surfacing from 5G (see , , and ). In , a Network Slice is defined as a "logical network that provides specific network capabilities and network characteristics", and a Network Slice Instance is defined as a "set of Network Function instances and the required resources (e.g. compute, storage and networking resources) which form a deployed Network Slice". According to , an end-to-end (E2E) network slice consists of three major types of network segments: Radio Access Network (RAN), Transport Network (TN), and Core Network (CN). An IETF Network Slice provides the required connectivity between different entities in RAN and CN segments of an end-to-end network slice, with a specific performance commitment (for example, serving as a TN slice). For each end-to-end network slice, the topology and performance requirement on a customer's use of an IETF Network Slice can be very different, which requires the underlay network to have the capability of supporting multiple different IETF Network Slices. While network slices are commonly discussed in the context of 5G, it is important to note that IETF Network Slices are a narrower concept with a broader usage profile and focus primarily on particular network connectivity aspects. Other systems, including 5G deployments, may use IETF Network Slices as a component to create entire systems and concatenated constructs that match their needs, including end-to-end connectivity. An IETF Network Slice could span multiple technologies and multiple administrative domains. Depending on the IETF Network Slice Service customer's requirements, an IETF Network Slice could be isolated from other, often concurrent, IETF Network Slices in terms of data, control, and management planes. The customer expresses requirements for a particular IETF Network Slice Service by specifying what is required rather than how the requirement is to be fulfilled. That is, the IETF Network Slice Service customer's view of an IETF Network Slice Service is an abstract one. Thus, there is a need to create logical network structures with required characteristics. The customer of such a logical network can require a level of isolation and performance that previously might not have been satisfied by overlay VPNs. Additionally, the IETF Network Slice Service customer might ask for some level of control to, e.g., customize the service paths in a network slice. This document specifies definitions and a framework for the provision of an IETF Network Slice Service. briefly indicates some candidate technologies for realizing IETF Network Slices.

Terms and Abbreviations

Abbreviations The following abbreviations are used in this document.

NSC:

Network Slice Controller

SDP:

Service Demarcation Point

SLA:

Service Level Agreement

SLE:

Service Level Expectation

SLI:

Service Level Indicator

SLO:

Service Level Objective

The meaning of these abbreviations is defined in greater detail in the remainder of this document.

Core Terminology The following terms are presented here to give context. Other terminology is defined in the remainder of this document.

Customer:

The requester of an IETF Network Slice Service. Customers may request monitoring of SLOs. A customer may be an entity such as an enterprise network or a network operator, an individual working at such an entity, a private individual contracting for a service, or an application or software component. A customer may be an external party (classically, a paying customer) or a division of a network operator that uses the service provided by another division of the same operator. Other terms that have been applied to the customer role are "client" and "consumer".

Provider:

The organization that delivers an IETF Network Slice Service. A provider is the network operator that controls the network resources used to construct the network slice (that is, the network that is sliced). The provider's network may be a physical network or a virtual network created within the operator's network or supplied by another service provider.

Customer Edge (CE):

The customer device that provides connectivity to a service provider. Examples include routers, Ethernet switches, firewalls, 4G/5G RAN or Core nodes, application accelerators, server load balancers, HTTP header enrichment functions (such as proxy components adding the Forwarded HTTP Extension Header ), and Performance Enhancing Proxies (PEPs). In some circumstances, CEs are provided to the customer and managed by the provider.

Provider Edge (PE):

The device within the provider network to which a CE is attached. A CE may be attached to multiple PEs, and multiple CEs may be attached to a given PE.

Attachment Circuit (AC):

A channel connecting a CE and a PE over which packets that belong to an IETF Network Slice Service are exchanged. An AC is, by definition, technology specific: that is, the AC defines how customer traffic is presented to the provider network. The customer and provider agree (for example, through configuration) on which values in which combination of Layer 2 (L2) and Layer 3 (L3) header and payload fields within a packet identify to which {IETF Network Slice Service, connectivity construct, and SLOs/SLEs} that packet is assigned. The customer and provider may agree to police or shape traffic, based on the specific IETF Network Slice Service including connectivity construct and SLOs/SLEs, on the AC in both the ingress (CE to PE) direction and egress (PE to CE) direction. This ensures that the traffic is within the capacity profile that is agreed upon in an IETF Network Slice Service. Excess traffic is dropped by default, unless specific out-of-profile policies are agreed upon between the customer and the provider. As described in , the AC may be part of the IETF Network Slice Service or may be external to it. Because SLOs and SLEs characterize the performance of the underlay network between a sending SDP and a set of receiving SDPs, the traffic policers and traffic shapers apply to a specific connectivity construct on an AC.

Service Demarcation Point (SDP):

The point at which an IETF Network Slice Service is delivered by a service provider to a customer. Depending on the service delivery model (see ), this may be a CE or a PE and could be a device, a software component, or an abstract virtual function supported within the provider's network. Each SDP must have a unique identifier (e.g., an IP address or Media Access Control (MAC) address) within a given IETF Network Slice Service and may use the same identifier in multiple IETF Network Slice Services. An SDP may be abstracted as a Service Attachment Point (SAP) for the purpose of generalizing the concept across multiple service types and representing it in management and configuration systems.

Connectivity Construct:

A set of SDPs together with a communication type that defines how traffic flows between the SDPs. An IETF Network Slice Service is specified in terms of a set of SDPs, the associated connectivity constructs, and the service objectives that the customer wishes to see fulfilled. Connectivity constructs may be grouped for administrative purposes.

IETF Network Slice IETF Network Slices are created to meet specific requirements, typically expressed as bandwidth, latency, latency variation, and other desired or required characteristics. Creation of an IETF Network Slice is initiated by a management system or other application used to specify network-related conditions for particular traffic flows in response to an actual or logical IETF Network Slice Service request. Once created, these slices can be monitored, modified, deleted, and otherwise managed. Applications and components will be able to use these IETF Network Slices to move packets between the specified endpoints of the service in accordance with specified characteristics. A clear distinction should be made between the "IETF Network Slice Service" and the IETF Network Slice:

IETF Network Slice Service:

The function delivered to the customer (see ). It is agnostic to the technologies and mechanisms used by the service provider.

IETF Network Slice:

The realization of the service in the provider's network achieved by partitioning network resources and by applying certain tools and techniques within the network (see Sections and ).

Definition and Scope of IETF Network Slice The term "Slice" refers to a set of characteristics and behaviors that differentiate one type of user traffic from another within a network. An IETF Network Slice is a logical partition of a network that uses IETF technology. An IETF Network Slice assumes that an underlay network is capable of changing the configurations of the network devices on demand, through in-band signaling, or via controllers. An IETF Network Slice enables connectivity between a set of SDPs with specific Service Level Objectives (SLOs) and Service Level Expectations (SLEs) (see ) over a common underlay network. The SLOs and SLEs characterize the performance of the underlay network between a sending SDP and a set of receiving SDPs. Thus, an IETF Network Slice delivers a service to a customer by meeting connectivity resource requirements and associated network capabilities such as bandwidth, latency, jitter, and network functions with other resource behaviors such as compute and storage availability. IETF Network Slices may be combined hierarchically so that a network slice may itself be sliced. They may also be combined sequentially so that various different networks can each be sliced and the network slices placed into a sequence to provide an end-to-end service. This form of sequential combination is utilized in some services such as in 3GPP's 5G network . It is intended that the term "IETF Network Slice" be used only in this document. Other documents that need to indicate the type of network slice described in this document can use the term "RFC 9543 Network Slice".

IETF Network Slice Service A service provider delivers an IETF Network Slice Service for a customer by realizing an IETF Network Slice in the underlay network. The IETF Network Slice Service is agnostic to the technology of the underlay network, and its realization may be selected based upon multiple considerations, including its service requirements and the capabilities of the underlay network. This allows an IETF Network Slice Service customer to describe their network connectivity and relevant objectives in a common format, independent of the underlay technologies used. The IETF Network Slice Service is specified in terms of a set of SDPs, a set of one or more connectivity constructs between subsets of these SDPs, and a set of SLOs and SLEs (see ) for each SDP sending to each connectivity construct. A communication type (Point-to-Point (P2P), Point-to-Multipoint (P2MP), or Any-to-Any (A2A)) is specified for each connectivity construct. That is, in a given IETF Network Slice Service:

• There may be one or more connectivity constructs of the same or different type.
• Each connectivity construct may be between a different subset of SDPs.
• Each sending SDP has its own set of SLOs and SLEs for a given connectivity construct, and the SLOs and SLEs in each set may be different.

Note that different connectivity constructs can be specified in the service request, but the service provider may decide how many connectivity constructs per IETF Network Slice Service it wishes to support such that an IETF Network Slice Service may be limited to one connectivity construct or may support many. An IETF Network Slice Service customer may provide IETF Network Slice Services to other customers in a mode sometimes referred to as "carrier's carrier" (see ). In this case, the relationship between IETF Network Slice Service providers may be internal to a commercial organization or may be external through service provision contracts. As noted in , network slices may be composed hierarchically or serially. provides a description of SDPs as endpoints in the context of IETF network slicing. For a given IETF Network Slice Service, the customer and provider agree, on a per-SDP basis, which end of the attachment circuit provides the SDP (i.e., whether the attachment circuit is inside or outside the IETF Network Slice Service). This determines whether the attachment circuit is subject to the set of SLOs and SLEs at the specific SDP. It is intended that the term "IETF Network Slice Service" be used only in this document. Other documents that need to indicate the type of network slice service described in this document can use the term "RFC 9543 Network Slice Service".

Connectivity Constructs The approach of specifying a Network Slice Service as a set of SDPs with connectivity constructs results in the following possible connectivity constructs:

• For a P2P connectivity construct, there is one sending SDP and one receiving SDP. This construct is like a private wire or a tunnel. All traffic injected at the sending SDP is intended to be received by the receiving SDP. The SLOs and SLEs apply at the sender (and implicitly, at the receiver).
• For a P2MP connectivity construct, there is only one sending SDP and more than one receiving SDP. This is like a P2MP tunnel or multi-access VLAN segment. All traffic from the sending SDP is intended to be received by all the receiving SDPs. There is one set of SLOs and SLEs that applies at the sending SDP (and implicitly, at all receiving SDPs).
• With an A2A connectivity construct, any sending SDP may send to any one receiving SDP or any set of receiving SDPs in the construct. There is an implicit level of routing in this connectivity construct that is not present in the other connectivity constructs because the provider's network must determine to which receiving SDPs to deliver each packet. This construct may be used to support P2P traffic between any pair of SDPs or to support multicast or broadcast traffic from one SDP to a set of other SDPs. In the latter case, whether the service is delivered using multicast within the provider's network or using "ingress replication" or some other means is out of scope of the specification of the service. A service provider may choose to support A2A constructs but to limit the traffic to unicast. The SLOs/SLEs in an A2A connectivity construct apply to individual sending SDPs regardless of the receiving SDPs, and there is no linkage between sender and receiver in the specification of the connectivity construct. A sending SDP may be "disappointed" if the receiver is over-subscribed. If a customer wants to be more specific about different behaviors from one SDP to another SDP, they should use P2P connectivity constructs.

A given sending SDP may be part of multiple connectivity constructs within a single IETF Network Slice Service, and the SDP may have different SLOs and SLEs for each connectivity construct to which it is sending. Note that a given sending SDP's SLOs and SLEs for a given connectivity construct apply between it and each of the receiving SDPs for that connectivity construct. An IETF Network Slice Service provider may freely make a deployment choice as to whether to offer a 1:1 relationship between an IETF Network Slice Service and connectivity construct or to support multiple connectivity constructs in a single IETF Network Slice Service. In the former case, the provider might need to deliver multiple IETF Network Slice Services to achieve the function of the second case.

Mapping Traffic Flows to Network Realizations A customer traffic flow may be unicast or multicast, and various network realizations are possible:

• Unicast traffic may be mapped to a P2P connectivity construct for direct delivery or to an A2A connectivity construct for the service provider to perform routing to the destination SDP. It would be unusual to use a P2MP connectivity construct to deliver unicast traffic because all receiving SDPs would get a copy, but this can still be done if the receivers are capable of dropping the unwanted traffic.
• A bidirectional unicast service can be constructed by specifying two P2P connectivity constructs. An additional SLE may specify fate-sharing in this case.
• Multicast traffic may be mapped to a set of P2P connectivity constructs, a single P2MP connectivity construct, or a mixture of P2P and P2MP connectivity constructs. Multicast may also be supported by an A2A connectivity construct. The choice clearly influences how and where traffic is replicated in the network. With a P2MP or A2A connectivity construct, it is the operator's choice whether to realize the construct with ingress replication, multicast in the core, P2MP tunnels, or hub-and-spoke. This choice should not change how the customer perceives the service.
• The concept of a Multipoint-to-Point (MP2P) service can be realized with multiple P2P connectivity constructs. Note that, in this case, the egress may simultaneously receive traffic from all ingresses. The SLOs at the sending SDPs must be set with this in mind because the provider's network is not capable of coordinating the policing of traffic across multiple distinct source SDPs. It is assumed that the customer, requesting SLOs for the various P2P connectivity constructs, is aware of the capabilities of the receiving SDP. If the receiver receives more traffic than it can handle, it may drop some and introduce queuing delays.
• The concept of a Multipoint-to-Multipoint (MP2MP) service can best be realized using a set of P2MP connectivity constructs but could be delivered over an A2A connectivity construct if each sender is using multicast. As with MP2P, the customer is assumed to be familiar with the capabilities of all receivers. A customer may wish to achieve an MP2MP service using a hub-and-spoke architecture where they control the hub; that is, the hub may be an SDP or an ancillary CE (see ), and the service may be achieved by using a set of P2P connectivity constructs to the hub and a single P2MP connectivity construct from the hub.

From the above, it can be seen that the SLOs of the senders define the SLOs for the receivers on any connectivity construct. In particular, the network may be expected to handle the traffic volume from a sender to all destinations. This extends to all connectivity constructs in an IETF Network Slice Service. Note that the realization of an IETF Network Slice Service does not need to map the connectivity constructs one-to-one onto underlying network constructs (such as tunnels). The service provided to the customer is distinct from how the provider decides to deliver that service. If a CE has multiple attachment circuits to PEs within a given IETF Network Slice Service and they are operating in single-active mode, then all traffic between the CE and its attached PEs transits a single attachment circuit; if they are operating in all-active mode, then traffic between the CE and its attached PEs is distributed across all of the active attachment circuits.

Ancillary CEs It may be the case that the set of SDPs that delimits an IETF Network Slice Service needs to be supplemented with additional senders or receivers within the network that are not customer sites. An additional sender could be, for example, an IPTV or DNS server either within the provider's network or attached to it, while an extra receiver could be, for example, a node reachable via the Internet. This is modeled in the Network Slicing architecture as a set of ancillary CEs that supplement the other SDPs in one or more connectivity constructs or that are linked by their own connectivity constructs. Note that an ancillary CE can either have a resolvable address (e.g., an IP address or MAC address), or it may be a placeholder (e.g., a named IPTV or DNS service or server) that is resolved within the provider's network when the IETF Network Slice Service is instantiated. Thus, an ancillary CE may be a node within the provider network (i.e., not a node at the edge of the customer's network). An example is a node that provides a service function. Another example is a node that acts as a hub. There will be times when the customer wishes to explicitly select one of these. Alternatively, an ancillary CE may be a service function at an unknown point in the provider's network. In this case, the function may be a placeholder that has its addresses resolved as part of the realization of the slice service. Appendices and give simple worked examples of the use of ancillary CEs that may aid understanding the concept.

IETF Network Slice System Characteristics The following subsections describe the characteristics of IETF Network Slices in addition to the list of SDPs, the connectivity constructs, and the technology of the ACs.

Objectives for IETF Network Slices An IETF Network Slice Service is defined in terms of quantifiable characteristics known as Service Level Objectives (SLOs) and unquantifiable characteristics known as Service Level Expectations (SLEs). SLOs are expressed in terms Service Level Indicators (SLIs) and together with the SLEs form the contractual agreement between service customer and service provider known as a Service Level Agreement (SLA). The terms are defined as follows:

Service Level Indicator (SLI):

A quantifiable measure of an aspect of the performance of a network. For example, it may be a measure of throughput in bits per second, or it may be a measure of latency in milliseconds.

Service Level Objective (SLO):

A target value or range for the measurements returned by observation of an SLI. For example, an SLO may be expressed as "SLI <= target" or "lower bound <= SLI <= upper bound". A customer can determine whether the provider is meeting the SLOs by performing measurements on the traffic.

Service Level Expectation (SLE):

An expression of an unmeasurable service-related request that a customer of an IETF Network Slice Service makes of the provider. An SLE is distinct from an SLO because the customer may have little or no way of determining whether the SLE is being met, but they still contract with the provider for a service that meets the expectation.

Service Level Agreement (SLA):

An explicit or implicit contract between the customer of an IETF Network Slice Service and the provider of the slice. The SLA is expressed in terms of a set of SLOs and SLEs that are to be applied for a given connectivity construct between a sending SDP and the set of receiving SDPs. The SLA may describe the extent to which divergence from individual SLOs and SLEs can be tolerated, and commercial terms as well as any consequences for violating these SLOs and SLEs.

Service Level Objectives SLOs define a set of measurable network attributes and characteristics that describe an IETF Network Slice Service. SLOs do not describe how an IETF Network Slice Service is implemented or realized in the underlying network layers. Instead, they are defined in terms of dimensions of operation (time, capacity, etc.), availability, and other attributes. An IETF Network Slice Service may include multiple connectivity constructs that associate sets of endpoints (SDPs). SLOs apply to a given connectivity construct and apply to a specific direction of traffic flow. That is, they apply to a specific sending SDP and the set of receiving SDPs.

Some Common SLOs SLOs can be described as "Directly Measurable Objectives"; they are always measurable. See for the description of Service Level Expectations, which are unmeasurable service-related requests sometimes known as "Indirectly Measurable Objectives". Objectives such as guaranteed minimum bandwidth, guaranteed maximum latency, maximum permissible delay variation, maximum permissible packet loss ratio, and availability are "Directly Measurable Objectives". Future specifications (such as IETF Network Slice Service YANG models) may precisely define these SLOs, and other SLOs may be introduced as described in . The definition of these objectives are as follows:

Guaranteed Minimum Bandwidth:

Minimum guaranteed bandwidth between two endpoints at any time. The bandwidth is measured in data rate units of bits per second and is measured unidirectionally.

Guaranteed Maximum Latency:

Upper bound of network latency when transmitting between two endpoints. The latency is measured in terms of network characteristics (excluding application-level latency). discusses one-way metrics.

Maximum Permissible Delay Variation:

Packet Delay Variation (PDV) as defined by is the difference in the one-way delay between sequential packets in a flow. This SLO sets a maximum value PDV for packets between two endpoints.

Maximum Permissible Packet Loss Ratio:

The ratio of packets dropped to packets transmitted between two endpoints over a period of time. See .

Availability:

The ratio of uptime to the sum of uptime and downtime, where uptime is the time the connectivity construct is available in accordance with all of the SLOs associated with it. Availability will often be expressed along with the time period over which the availability is measured and the maximum allowed single period of downtime.

Other Service Level Objectives Additional SLOs may be defined to provide additional description of the IETF Network Slice Service that a customer requests. These would be specified in further documents. If the IETF Network Slice Service is traffic-aware, other traffic-specific characteristics may be valuable including MTU, traffic type (e.g., IPv4, IPv6, Ethernet, or unstructured), or a higher-level behavior to process traffic according to user application (which may be realized using network functions).

Service Level Expectations SLEs define a set of network attributes and characteristics that describe an IETF Network Slice Service but are not directly measurable by the customer (e.g., diversity, isolation, and geographical restrictions). Even though the delivery of an SLE cannot usually be determined by the customer, the SLEs form an important part of the contract between customer and provider. Quite often, an SLE will imply some details of how an IETF Network Slice Service is realized by the provider, although most aspects of the implementation in the underlying network layers remain a free choice for the provider. For example, activating unicast or multicast capabilities to deliver an IETF Network Slice Service could be explicitly requested by a customer or could be left as an engineering decision for the service provider based on capabilities of the network and operational choices. SLEs may be seen as aspirational on the part of the customer, and they are expressed as behaviors that the provider is expected to apply to the network resources used to deliver the IETF Network Slice Service. Of course, over time, it is possible that mechanisms will be developed that enable a customer to verify the provision of an SLE, at which point it effectively becomes an SLO. An IETF Network Slice Service may include multiple connectivity constructs that associate sets of endpoints (SDPs). SLEs apply to a given connectivity construct and apply to specific directions of traffic flow. That is, they apply to a specific sending SDP and the set of receiving SDPs. However, being more general in nature than SLOs, SLEs may commonly be applied to all connectivity constructs in an IETF Network Slice Service.

Some Common SLEs SLEs can be described as "Indirectly Measurable Objectives"; they are not generally directly measurable by the customer. Security, geographic restrictions, maximum occupancy level, and isolation are example SLEs as follows.

Security:

A customer may request that the provider applies encryption or other security techniques to traffic flowing between SDPs of a connectivity construct within an IETF Network Slice Service. For example, the customer could request that only network links that have Media Access Control Security (MACsec) enabled are used to realize the connectivity construct. This SLE may include a request for encryption (e.g., ) between the two SDPs explicitly to meet the architectural recommendations in or for compliance with the HIPAA Security Rule or the PCI Data Security Standard . Whether or not the provider has met this SLE is generally not directly observable by the customer and cannot be measured as a quantifiable metric. Please see further discussion on security in .

Geographic Restrictions:

A customer may request that certain geographic limits are applied to how the provider routes traffic for the IETF Network Slice Service. For example, the customer may have a preference that its traffic does not pass through a particular country for political or security reasons. Whether or not the provider has met this SLE is generally not directly observable by the customer and cannot be measured as a quantifiable metric.

Maximal Occupancy Level:

The maximal occupancy level specifies the number of flows to be admitted and optionally a maximum number of countable resource units (e.g., IP or MAC addresses) an IETF Network Slice Service can consume. Because an IETF Network Slice Service may include multiple connectivity constructs, this SLE should state whether it applies to all connectivity constructs, a specified subset of them, or an individual connectivity construct. Again, a customer may not be able to fully determine whether this SLE is being met by the provider.

Isolation:

As described in , a customer may request that its traffic within its IETF Network Slice Service is isolated from the effects of other network services supported by the same provider. That is, if another service exceeds capacity or has a burst of traffic, the customer's IETF Network Slice Service should remain unaffected, and there should be no noticeable change to the quality of traffic delivered. In general, a customer cannot tell whether a service provider is meeting this SLE. They cannot tell whether the variation of an SLI is because of changes in the underlay network or because of interference from other services carried by the network. If the service varies within the allowed bounds of the SLOs, there may be no noticeable indication that this SLE has been violated.

Diversity:

A customer may request that different connectivity constructs use different underlay network resources. This might be done to enhance the availability of the connectivity constructs within an IETF Network Slice Service. While availability is a measurable objective (see ), this SLE requests a finer grade of control and is not directly measurable (although the customer might become suspicious if two connectivity constructs fail at the same time).

IETF Network Slice Service Demarcation Points As noted in , an IETF Network Slice provides connectivity between sets of SDPs with specific SLOs and SLEs. goes on to describe how the IETF Network Slice Service is composed of a set of one or more connectivity constructs that describe connectivity between the Service Demarcation Points (SDPs) across the underlay network. The characteristics of IETF Network Slice SDPs are as follows.

• An SDP is the point of attachment to an IETF Network Slice Service. As such, SDPs serve as the IETF Network Slice ingress/egress points.
• An SDP is identified by a unique identifier in the context of an IETF Network Slice Service customer.
• The provider associates each SDP with a set of provider-scope identifiers such as IP addresses, encapsulation-specific identifiers (e.g., VLAN tag and MPLS Label), interface/port numbers, node ID, etc.
• SDPs are mapped to endpoints of services/tunnels/paths within the IETF Network Slice during its initialization and realization.
  • A combination of the SDP identifier and SDP provider-network-scope identifiers define an SDP in the context of the Network Slice Controller (NSC) (see ).
  • The NSC will use the SDP provider-network-scope identifiers as part of the process of realizing the IETF Network Slice.

Note that an ancillary CE (see ) is the endpoint of a connectivity construct and so is an SDP in this discussion. For a given IETF Network Slice Service, the customer and provider agree where the SDP is located. This determines what resources at the edge of the network form part of the IETF Network Slice and are subject to the set of SLOs and SLEs for a specific SDP. shows different potential scopes of an IETF Network Slice that are consistent with the different SDP locations. For the purpose of this discussion and without loss of generality, the figure shows Customer Edge (CE) and Provider Edge (PE) nodes connected by Attachment Circuits (ACs). Notes after the figure give some explanations.

Positioning IETF Service Demarcation Points |<---------------------- (1) ---------------------->| | | | |<-------------------- (2) -------------------->| | | | | | | | |<----------- (3) ----------->| | | | | | | | | | | | |<-------- (4) -------->| | | | | | | | | | | | V V AC V V V V AC V V +-----+ | +-----+ +-----+ | +-----+ | |--------| | | |--------| | | CE1 | | | PE1 |. . . . . . . . .| PE2 | | | CE2 | | |--------| | | |--------| | +-----+ | +-----+ +-----+ | +-----+ ^ ^ ^ ^ | | | | | | | | Customer Provider Provider Customer Edge 1 Edge 1 Edge 2 Edge 2

Explanatory notes for are as follows:

1. If the CE is operated by the IETF Network Slice Service provider, then the edge of the IETF Network Slice may be within the CE. In this case, the IETF Network Slicing process may utilize resources from within the CE such as buffers and queues on the outgoing interfaces.
2. The IETF Network Slice may be extended as far as the CE to include the AC but not to include any part of the CE. In this case, the CE may be operated by the customer or the provider. Slicing the resources on the AC may require the use of traffic tagging (such as through Ethernet VLAN tags) or may require traffic policing at the AC link ends.
3. The SDPs of the IETF Network Slice are the customer-facing ports on the PEs. This case can be managed in a way that is similar to a port-based VPN: each port (AC) or virtual port (e.g., VLAN tag) identifies the IETF Network Slice and maps to an IETF Network Slice SDP.
4. Finally, the SDP may be within the PE. In this mode, the PE classifies the traffic coming from the AC according to information (such as the source and destination IP addresses, payload protocol and port numbers, etc.) in order to place it onto an IETF Network Slice.

The choice of which of these options to apply is entirely up to the network operator. It may limit or enable the provisioning of particular managed services, and the operator will want to consider how they want to manage CEs and what control they wish to offer the customer over AC resources. Note that shows a symmetrical positioning of SDPs, but this decision can be taken on a per-SDP basis through agreement between the customer and provider. In practice, it may be necessary to map traffic not only onto an IETF Network Slice but also onto a specific connectivity construct if the IETF Network Slice supports more than one with a source at the specific SDP. The mechanism used will be one of the mechanisms described above, dependent on how the SDP is realized. Finally, note (as described in ) that an SDP is an abstract endpoint of an IETF Network Slice Service and as such may be a device, interface, or software component. An ancillary CE () should also be thought of as an SDP.

IETF Network Slice Composition Operationally, an IETF Network Slice may be composed of two or more IETF Network Slices as specified below. Decomposed network slices are independently realized and managed.

Hierarchical (i.e., recursive) composition:

An IETF Network Slice can be further sliced into other network slices. Recursive composition allows an IETF Network Slice at one layer to be used by the other layers. This type of multi-layer vertical IETF Network Slice associates resources at different layers.

Sequential composition:

Different IETF Network Slices can be placed into a sequence to provide an end-to-end service. In sequential composition, each IETF Network Slice would potentially support different data planes that need to be stitched together.

Framework A number of IETF Network Slice Services will typically be provided over a shared underlay network infrastructure. Each IETF Network Slice consists of both the overlay connectivity and a specific set of dedicated network resources and/or functions allocated in a shared underlay network to satisfy the needs of the IETF Network Slice Service customer. In at least some examples of underlay network technologies, integration between the overlay and various underlay resources is needed to ensure the guaranteed performance requested for different IETF Network Slices. This section sets out the principal stakeholders in an IETF Network Slice and describes how the IETF Network Slice Service customer requests connectivity. It then introduces the IETF Network Slice Controller (the functional component responsible for receiving requests from customers and converting them into network configuration commands) and describes its interfaces.

IETF Network Slice Stakeholders An IETF Network Slice and its realization involve the following stakeholders.

Orchestrator:

An orchestrator is an entity that composes different services, resource, and network requirements. It interfaces with the IETF NSC when composing a complex service such as an end-to-end network slice.

IETF Network Slice Controller (NSC):

The NSC realizes an IETF Network Slice in the underlay network and maintains and monitors the run-time state of resources and topologies associated with it. A well-defined interface is needed to support interworking between different NSC implementations and different orchestrator implementations.

Network Controller:

The Network Controller is a form of network infrastructure controller that offers network resources to the NSC to realize a particular network slice. This may be an existing network controller associated with one or more specific technologies that may be adapted to the function of realizing IETF Network Slices in a network.

The IETF Network Slice Service customer and IETF Network Slice Service provider (see ) are also stakeholders. Clearly, the service provider operates the network that is sliced to provide the IETF Network Slice Service to the customer. The Network Controller and NSC are management components used by the service provider to operate their networks and deliver IETF Network Slice Services. As indicated in Figures and , the Orchestrator may be a component in the customer environment that requests and coordinates IETF Network Slice Services from one or more service providers. In other circumstances, however, the Orchestrator may be a component used by the service provider to request and administer IETF Network Slices to deliver them to customers or to construct an infrastructure to deliver other services to the customer.

Expressing Connectivity Intents An IETF Network Slice Service customer communicates with the NSC using the IETF Network Slice Service Interface. An IETF Network Slice Service customer may be a network operator who, in turn, uses the IETF Network Slice to provide a service for another IETF Network Slice Service customer. Using the IETF Network Slice Service Interface, a customer expresses requirements for a particular slice by specifying what is required rather than how that is to be achieved. That is, the customer's view of a slice is an abstract one. Customers normally have limited (or no) visibility into the provider network's actual topology and resource availability information. This should be true even if both the customer and provider are associated with a single administrative domain, in order to reduce the potential for adverse interactions between IETF Network Slice Service customers and other users of the underlay network infrastructure. The benefits of this model can include the following.

Security:

The underlay network components are less exposed to attack because the underlay network (or network operator) does not need to expose network details (topology, capacity, etc.) to the IETF Network Slice Service customers.

Layered Implementation:

The underlay network comprises network elements that belong to a different layer network than customer applications. Network information (advertisements, protocols, etc.) that a customer cannot interpret or respond to is not exposed to the customer. (Note that a customer should not rely on network information not exposed directly to the customer by the network operator, such as via the IETF Network Slice Service Interface.)

Scalability:

Customers do not need to know any information concerning network topology, capabilities, or state beyond that which is exposed via the IETF Network Slice Service Interface. This protects the customer site from having to hold and process extra information and from receiving frequent updates about the status of the network.

The general issues of abstraction in a Traffic Engineered (TE) network are described more fully in . This framework document does not assume any particular technology layer at which IETF Network Slices operate. A number of layers (including virtual L2, Ethernet, or IP connectivity) could be employed. Data models and interfaces are needed to set up IETF Network Slices, and specific interfaces may have capabilities that allow creation of slices within specific technology layers. Layered virtual connections are comprehensively discussed in other IETF documents. For instance, GMPLS-based networks are discussed in and , and Abstraction and Control of TE Networks (ACTN) is discussed in and . The principles and mechanisms associated with layered networking are applicable to IETF Network Slices. There are several IETF-defined mechanisms for expressing the need for a desired logical network. The IETF Network Slice Service Interface carries data either in a protocol-defined format or in a formalism associated with a modeling language. For instance:

• The Path Computation Element (PCE) Communication Protocol (PCEP) and GMPLS User-Network Interface (UNI) using RSVP-TE use a TLV-based binary encoding to transmit data.
• The Network Configuration Protocol (NETCONF) and RESTCONF Protocol use XML and JSON encoding.
• gRPC and gRPC Network Management Interface (gNMI) use a binary encoded programmable interface. ProtoBufs can be used to model gRPC and gNMI data.
• For data modeling, YANG may be used to model configuration and other data for NETCONF, RESTCONF, and gNMI, among others.

While several generic formats and data models for specific purposes exist, it is expected that IETF Network Slice management may require enhancement or augmentation of existing data models. Further, it is possible that mechanisms will be needed to determine the feasibility of service requests before they are actually made.

IETF Network Slice Controller (NSC) An IETF NSC takes requests for IETF Network Slice Services and implements them using a suitable underlay technology. An IETF NSC is the key component for control and management of the IETF Network Slice. It provides the creation/modification/deletion, monitoring, and optimization of IETF Network Slices in a multi-domain, multi-technology, and multi-vendor environment. The main task of an IETF NSC is to map abstract IETF Network Slice Service requirements to concrete technologies and establish required connectivity, ensuring that resources are allocated to the IETF Network Slice as necessary. The IETF Network Slice Service Interface is used for communicating details of an IETF Network Slice Service (configuration, selected policies, operational state, etc.) as well as information about status and performance of the IETF Network Slice. The details for this IETF Network Slice Service Interface are not in scope for this document, but further considerations of the requirements are discussed in . The controller provides the following functions.

• Exposes an IETF Network Slice Service Interface for creation/modification/deletion of the IETF Network Slices that are agnostic to the technology of the underlay network. This API communicates the Service Demarcation Points of the IETF Network Slice, SLO parameters (and possibly monitoring thresholds), applicable input selection (filtering), and various policies. If SLEs have been agreed between the customer and the network operator, and if they are supported for the IETF Network Slice Service, the API will also allow SLEs to be selected for the IETF Network Slice and will allow any associated parameters to be set. The API also provides a way to monitor the slice.
• Determines an abstract topology connecting the SDPs of the IETF Network Slice that meets criteria specified via the IETF Network Slice Service Interface. The NSC also retains information about the mapping of this abstract topology to underlay components of the IETF Network Slice as necessary to monitor IETF Network Slice status and performance.
• Supports "Mapping Functions" for the realization of IETF Network Slices. In other words, it will use the mapping functions that:
  • Map IETF Network Slice Service Interface requests that are agnostic to the technology of the underlay network to technology-specific network configuration interfaces.
  • Map filtering/selection information to entities in the underlay network so that those entities are able to identify which traffic is associated with which connectivity construct and IETF Network Slice.
  • Depending on the realization solution, map to entities in the underlay network according to how traffic should be treated to meet the SLOs and SLEs of the connectivity construct.
• Collects telemetry data (e.g., Operations, Administration, and Maintenance (OAM) results, statistics, states, etc.) via a network configuration interface for all elements in the abstract topology used to realize the IETF Network Slice.
• Evaluates the current performance against IETF Network Slice SLO parameters using telemetry data from the underlying realization of an IETF Network Slice (e.g., services, paths, and tunnels). Exposes this performance to the IETF Network Slice Service customer via the IETF Network Slice Service Interface. The IETF Network Slice Service Interface may also include the capability to provide notifications if the IETF Network Slice performance reaches threshold values defined by the IETF Network Slice Service customer.

IETF Network Slice Controller Interfaces The interworking and interoperability among the different stakeholders to provide common means of provisioning, operating, and monitoring the IETF Network Slices is enabled by the following communication interfaces (see ).

IETF Network Slice Service Interface:

An interface between a customer's higher-level operation system (e.g., a network slice orchestrator or a customer network management system) and an NSC. It is agnostic to the technology of the underlay network. The customer can use this interface to communicate the requested characteristics and other requirements for the IETF Network Slice Service, and an NSC can use the interface to report the operational state of an IETF Network Slice Service to the customer. More discussion of the functionalities for the IETF Network Slice Service Interface can be found in .

Network Configuration Interface:

An interface between an NSC and network controllers. It is technology specific and may be built around the many network models already defined within the IETF.

These interfaces can be considered in the context of the Service Model and Network Service Model described in and, together with the Device Configuration Interface used by the Network Controllers, provides a consistent view of service delivery and realization.

Interfaces of the IETF Network Slice Controller +------------------------------------------+ | Customer higher-level operation system | | (e.g., E2E network slice orchestrator, | | customer network management system) | +------------------------------------------+ A | IETF Network Slice Service Interface V +------------------------------------------+ | IETF Network Slice Controller (NSC) | +------------------------------------------+ A | Network Configuration Interface V +------------------------------------------+ | Network Controllers | +------------------------------------------+

IETF Network Slice Service Interface The IETF Network Slice Controller provides an IETF Network Slice Service Interface that allows customers to manage IETF Network Slice Services. Customers operate on abstract IETF Network Slice Services, with details related to their realization hidden. The IETF Network Slice Service Interface is also independent of the type of network functions or services that need to be connected, i.e., it is independent of any specific storage, software, protocol, or platform used to realize physical or virtual network connectivity or functions in support of IETF Network Slices. The IETF Network Slice Service Interface uses protocol mechanisms and information passed over those mechanisms to convey desired attributes for IETF Network Slices and their status. The information is expected to be represented as a well-defined data model and should include at least SDP and connectivity information, SLO/SLE specification, and status information.

Management Architecture The management architecture described in may be further decomposed as shown in . This should also be seen in the context of the component architecture shown in and corresponds to the architecture in . Note that the customer higher-level operation system of and the Network Slice Orchestrator of may be considered equivalent to the Service Management & Orchestration (SMO) of .

Interface of IETF Network Slice Management Architecture -------------- | Network | | Slice | | Orchestrator | -------------- | IETF Network Slice | Service Request | Customer view ....|................................ -v------------------- Operator view |Controller | | ------------ | | | IETF | | | | Network | |--> Virtual Network | | Slice | | | | Controller | | | | (NSC) | | | ------------ | ..| | Network |............ | | Configuration | Underlay Network | v | | ------------ | | | Network | | | | Controller | | | | (NC) | | | ------------ | --------------------- | Device Configuration v

Realizing IETF Network Slices Realization of IETF Network Slices is a mapping of the definition of the IETF Network Slice to the underlying infrastructure and is necessarily technology specific and achieved by an NSC over the Network Configuration Interface. Details of how realizations may be achieved is out of scope of this document; however, this section provides an overview of the components and processes involved in realizing an IETF Network Slice.

An Architecture to Realize IETF Network Slices The architecture described in this section is deliberately at a high level. It is not intended to be prescriptive: implementations and technical solutions may vary freely. However, this approach provides a common framework that other documents may reference in order to facilitate a shared understanding of the work. shows the architectural components of a network managed to provide IETF Network Slices. The customer's view is of individual IETF Network Slice Services with their SDPs and connectivity constructs. Requests for IETF Network Slice Services are delivered to an NSC. shows, without loss of generality, the CEs, ACs, and PEs that exist in the network. The SDPs are not shown and can be placed in any of the ways described in .

Architecture of an IETF Network Slice -- -- -- |CE| |CE| |CE| -- -- -- AC : AC : AC : ---------------------- ------- ( |PE|....|PE|....|PE| ) ( IETF ) IETF Network ( --: -- :-- ) ( Network ) Slice Service ( :............: ) ( Slice ) Request ( IETF Network Slice ) ( ) Customer v ---------------------- ------- View v ............................\........./............... v \ / Provider v >>>>>>>>>>>>>>> Grouping/Mapping v v View v ^ ----------------------------------------- v ^ ( |PE|.......|PE|........|PE|.......|PE| ) --------- ( --: -- :-- -- ) | | ( :...................: ) | NSC | ( Network Resource Partition ) | | ----------------------------------------- | | ^ | |>>>>> Resource Partitioning | --------- of Filtered Topology | v v | v v ----------------------------- -------- v v (|PE|..-..|PE|... ..|PE|..|PE|) ( ) v v ( :-- |P| -- :-: -- :-- ) ( Filter ) v v ( :.- -:.......|P| :- ) ( Topology ) v v ( |P|...........:-:.......|P| ) ( ) v v ( - Filtered Topology ) -------- v v ----------------------------- ^ v >>>>>>>>>>>> Topology Filter ^ / v ...........................\............../........... v \ / Underlay ---------- \ / (Physical) | | \ / Network | Network | ---------------------------------------------- |Controller| ( |PE|.....-.....|PE|...... |PE|.......|PE| ) | | ( -- |P| -- :-...:-- -..:-- ) ---------- ( : -:.............|P|.........|P| ) v ( -......................:-:..- - ) >>>>>>> ( |P|.........................|P|......: ) Program the ( - - ) Network ----------------------------------------------

The network itself (at the bottom of ) comprises an underlay network. This could be a physical network but may be a virtual network. The underlay network is provisioned through network controllers that may, themselves, utilize device controllers. The underlay network may optionally be filtered or customized by the network operator to produce a number of network topologies that we call "Filtered Topologies". Customization is just a way of selecting specific resources (e.g., nodes and links) from the underlay network according to their capabilities and connectivity in the underlay network. Filtering and customization are configuration options or operator policies that preselect links and nodes with certain performance characteristics to enable easier construction of Network Resource Partitions (NRPs; see below) that can reliably support specific IETF Network Slice SLAs, for example, preselection of links with certain security characteristics, preselection of links with specific geographic properties, or mapping to colored topologies. The resulting topologies can be used as candidates to host IETF Network Slices and provide a useful way for the network operator to know in advance that all of the resources they are using to plan an IETF Network Slice would be able to meet specific SLOs and SLEs. The creation of a Filtered Topology could be an offline planning activity or could be performed dynamically as new demands arise. The use of Filtered Topologies is entirely optional in the architecture, and IETF Network Slices could be hosted directly on the underlay network. Recall that an IETF Network Slice is a service requested by and/or provided for the customer. The IETF Network Slice Service is expressed in terms of one or more connectivity constructs. An implementation or operator is free to limit the number of connectivity constructs in an IETF Network Slice to exactly one. Each connectivity construct is associated within the IETF Network Slice Service request with a set of SLOs and SLEs. The set of SLOs and SLEs does not need to be the same for every connectivity construct in the IETF Network Slice, but an implementation or operator is free to require that all connectivity constructs in an IETF Network Slice have the same set of SLOs and SLEs. An NRP is a subset of the buffer/queuing/scheduling resources and associated policies on each of a connected set of links in the underlay network (for example, as achieved in ). The connected set of links could be the entire set of links with all of their buffer/queuing/scheduling resources and behaviors in the underlay network, and in this case, there would be just one NRP supported in the underlay network. The amount and granularity of resources allocated in an NRP is flexible and depends on the operator's policy. Some NRP realizations may build NRPs with dedicated topologies, while other realizations may use a shared topology for multiple NRPs. Realizations of an NRP may be built on a range of existing or new technologies, and this document does not constrain solution technologies. One or more connectivity constructs from one or more IETF Network Slices are mapped to an NRP. A single connectivity construct is mapped to only one NRP (that is, the relationship is many to one). Thus, all traffic flows in a connectivity construct assigned to an NRP are assigned to that NRP. Further, all PEs connected by a connectivity construct must be present in the NRP to which that connectivity construct is assigned. An NRP may be chosen to support a specific connectivity construct because of its ability to support a specific set of SLOs and SLEs, its ability to support particular connectivity constructs, or any administrative or operational reason. An implementation or operator is free to map each connectivity construct to a separate NRP, although there may be scaling implications depending on the solution implemented. Thus, the connectivity constructs from one slice may be mapped to one or more NRPs. By implication from the above, an implementation or operator is free to map all the connectivity constructs in a slice to a single NRP and to not share that NRP with connectivity constructs from another slice. An NRP may use work-conserving schedulers, non-work-conserving schedulers, or both (see ) according to the function that it needs to deliver. The choice of how network resources are allocated and managed for an NRP, and whether a work-conserving scheduling approach or a non-work-conserving scheduling approach is adopted, is technology specific: an implementation or operator is free to choose the set of techniques for NRP realization. The process of determining the NRP may be made easier if the underlay network topology is first filtered into a Filtered Topology in order to be aware of the subset of network resources that are suitable for specific NRPs. In this case, each Filtered Topology is treated as an underlay network on which NRPs can be constructed. The stage of generating Filtered Topologies is optional within this framework. The steps described here can be applied in a variety of orders according to implementation and deployment preferences. Furthermore, the steps may be iterative so that the components are continually refined and modified as network conditions change and as service requests are received or relinquished, and even the underlay network could be extended if necessary to meet the customers' demands.

Procedures to Realize IETF Network Slices There are a number of different technologies that can be used in the underlay, including physical connections, MPLS, Time-Sensitive Networking (TSN), Flex-E, etc. An IETF Network Slice can be realized in a network, using specific underlay technology or technologies. The creation of a new IETF Network Slice will be realized with the following steps:

1. An NSC exposes the network slicing capabilities that it offers for the network it manages so that the customer can determine whether to request services and what features are in scope.
2. The customer may issue a request to determine whether a specific IETF Network Slice Service could be supported by the network. An NSC may respond indicating a simple yes or no and may supplement a negative response with information about what it could support were the customer to change some requirements.
3. The customer requests an IETF Network Slice Service. An NSC may respond that the slice has or has not been created and may supplement a negative response with information about what it could support were the customer to change some requirements.
4. When processing a customer request for an IETF Network Slice Service, an NSC maps the request to the network capabilities and applies provider policies before creating or supplementing the NRP.

Regardless of how an IETF Network Slice is realized in the network (e.g., using tunnels of different types), the definition of the IETF Network Slice Service does not change at all. The only difference is how the slice is realized. The following sections briefly introduce how some existing architectural approaches can be applied to realize IETF Network Slices.

Applicability of ACTN to IETF Network Slices Abstraction and Control of TE Networks (ACTN) is a management architecture and toolkit used to create virtual networks (VNs) on top of a TE underlay network. The VNs can be presented to customers for them to operate as private networks. In many ways, the function of ACTN is similar to IETF network slicing. Customer requests for connectivity-based overlay services are mapped to dedicated or shared resources in the underlay network in a way that meets customer guarantees for SLOs and for separation from other customers' traffic. describes the function of ACTN as collecting resources to establish a logically dedicated virtual network over one or more TE networks. Thus, in the case of a TE-enabled underlay network, the ACTN VN can be used as a basis to realize IETF network slicing. While the ACTN framework is a generic VN framework that can be used for VN services beyond the IETF Network Slice, it is also a suitable basis for delivering and realizing IETF Network Slices. Further discussion of the applicability of ACTN to IETF Network Slices, including a discussion of the relevant YANG models, can be found in .

Applicability of Enhanced VPNs to IETF Network Slices An enhanced VPN is designed to support the needs of new applications, particularly applications that are associated with 5G services. The approach is based on existing VPN and TE technologies but adds characteristics that specific services require over and above those previously associated with VPN services. An enhanced VPN can be used to provide enhanced connectivity services between customer sites and can be used to create the infrastructure to underpin an IETF Network Slice Service. It is envisaged that enhanced VPNs will be delivered using a combination of existing, modified, and new networking technologies. describes the framework for enhanced VPN services.

Network Slicing and Aggregation in IP/MPLS Networks Network slicing provides the ability to partition a physical network into multiple logical networks of varying sizes, structures, and functions so that each slice can be dedicated to specific services or customers. The support of resource preemption between IETF Network Slices is deployment specific. Many approaches are currently being worked on to support IETF Network Slices in IP and MPLS networks with or without the use of Segment Routing. Most of these approaches utilize a way of marking packets so that network nodes can apply specific routing and forwarding behaviors to packets that belong to different IETF Network Slices. Different mechanisms for marking packets have been proposed (including using MPLS labels and Segment Routing segment IDs), and those mechanisms are agnostic to the path control technology used within the underlay network. These approaches are also sensitive to the scaling concerns of supporting a large number of IETF Network Slices within a single IP or MPLS network and so offer ways to aggregate the connectivity constructs of slices (or whole slices) so that the packet markings indicate an aggregate or grouping where all of the packets are subject to the same routing and forwarding behavior. At this stage, it is inappropriate to cite any of these proposed solutions that are currently work in progress and not yet adopted as IETF work.

Network Slicing and Service Function Chaining (SFC) A customer may request an IETF Network Slice Service that involves a set of service functions (SFs) together with the order in which these SFs are invoked. Also, the customer can specify the service objectives to be met by the underlay network (e.g., one-way delay to cross a service function path, one-way delay to reach a specific SF). These SFs are considered as ancillary CEs and are possibly placeholders (i.e., the SFs are identified, but not their locators). Service Function Chaining (SFC) techniques can be used by a provider to instantiate such an IETF Network Slice Service. An NSC may proceed as follows.

• Expose a set of ancillary CEs that are hosted in the underlay network.
• Capture the SFC requirements (including traffic performance metrics) from the customer. One or more service chains may be associated with the same IETF Network Slice Service as connectivity constructs.
• Execute an SF placement algorithm to decide where to locate the ancillary CEs in order to fulfill the service objectives.
• Generate SFC classification rules to identify part of the slice traffic that will be bound to an SFC. These classification rules may be the same as or distinct from the identification rules used to bind incoming traffic to the associated IETF Network Slice. An NSC also generates a set of SFC forwarding policies that govern how the traffic will be forwarded along a Service Function Path (SFP).
• Identify the appropriate Classifiers in the underlay network and provision them with the classification rules. Likewise, an NSC communicates the SFC forwarding policies to the appropriate Service Function Forwarders (SFFs).

The provider can enable an SFC data plane mechanism, such as those described in , , or .

Isolation in IETF Network Slices

Isolation as a Service Requirement An IETF Network Slice Service customer may request that the IETF Network Slice delivered to them is such that changes to other IETF Network Slices or to other services do not have any negative impact on the delivery of the IETF Network Slice. The IETF Network Slice Service customer may specify the extent to which their IETF Network Slice Service is unaffected by changes in the provider network or by the behavior of other IETF Network Slice Service customers. The customer may express this via an SLE it agrees with the provider. This concept is termed "isolation". In general, a customer cannot tell whether a service provider is meeting an isolation SLE. If the service varies such that an SLO is breached, then the customer will become aware of the problem, and if the service varies within the allowed bounds of the SLOs, there may be no noticeable indication that this SLE has been violated.

Isolation in IETF Network Slice Realization Isolation may be achieved in the underlay network by various forms of resource partitioning, ranging from dedicated allocation of resources for a specific IETF Network Slice to sharing of resources with safeguards. For example, traffic separation between different IETF Network Slices may be achieved using VPN technologies, such as L3VPN, L2VPN, EVPN, etc. Interference avoidance may be achieved by network capacity planning, allocating dedicated network resources, traffic policing or shaping, prioritizing in using shared network resources, etc. Finally, service continuity may be ensured by reserving backup paths for critical traffic and dedicating specific network resources for a selected number of IETF Network Slices.

Management Considerations IETF Network Slice realization needs to be instrumented in order to track how it is working, and it might be necessary to modify the IETF Network Slice as requirements change. Dynamic reconfiguration might be needed. The various management interfaces and components are discussed in .

Security Considerations This document specifies terminology and has no direct effect on the security of implementations or deployments. In this section, a few of the security aspects are identified.

Conformance to security constraints:

Specific security requests from customer-defined IETF Network Slice Services will be mapped to their realization in the underlay networks. Underlay networks will require capabilities to conform to customer's requests as some aspects of security may be expressed in SLEs.

IETF NSC authentication:

Underlay networks need to be protected against attacks from an adversary NSC as this could destabilize overall network operations. An IETF Network Slice may span different networks; therefore, an NSC should have strong authentication with each of these networks. Furthermore, both the IETF Network Slice Service Interface and the Network Configuration Interface need to be secured with a robust authentication and authorization mechanism and associated auditing mechanism.

Specific isolation criteria:

The nature of conformance to isolation requests means that it should not be possible to attack an IETF Network Slice Service by varying the traffic on other services or slices carried by the same underlay network. In general, isolation is expected to strengthen the IETF Network Slice security.

Data confidentiality and integrity of an IETF Network Slice:

An IETF Network Slice might include encryption and other security features as part of the service (for example, as SLEs). However, a customer wanting to guarantee that their data is secure from inspection or modification as it passes through the network of the operator that provides the IETF Network Slice Service will need to provision their own security solutions (e.g., with IPsec) or send only already otherwise-encrypted traffic through the slice.

See on 5G network slice security for discussion relevant to this section. IETF Network Slices might use underlying virtualized networking. All types of virtual networking require special consideration to be given to the separation of traffic between distinct virtual networks, as well as some amount of protection from effects of traffic use of underlay network (and other) resources from other virtual networks sharing those resources. For example, if a service requires a specific upper bound on latency, then that service could be degraded with added delay caused by the processing of packets from another service or application that shares the same network resources. Thus, without careful planning or traffic policing, it may be possible to attack an IETF Network Slice Service simply by increasing the traffic on another service in the network. Similarly, in a network with virtual functions, noticeably impeding access to a function used by another IETF Network Slice (for instance, compute resources) can be just as service-degrading as delaying physical transmission of associated packet in the network. Again, careful planning and policing of service demands may mitigate such attacks. Both of these forms of attack may also be mitigated by reducing the access to information about how IETF Network Slice Services are supported in a network.

Privacy Considerations Privacy of IETF Network Slice Service customers must be preserved. It should not be possible for one IETF Network Slice Service customer to discover the presence of other customers, nor should sites that are members of one IETF Network Slice be visible outside the context of that IETF Network Slice. In this sense, it is of paramount importance that the system uses the privacy protection mechanism defined for the specific underlay technologies that support the slice, including in particular those mechanisms designed to preclude acquiring identifying information associated with any IETF Network Slice Service customer.

IANA Considerations This document has no IANA actions.

Informative References Old Dog Consulting Independent Huawei Technologies Old Dog Consulting Network abstraction is a technique that can be applied to a network domain to obtain a view of potential connectivity across the network by utilizing a set of policies to select network resources. Network slicing is an approach to network operations that builds on the concept of network abstraction to provide programmability, flexibility, and modularity. It may use techniques such as Software Defined Networking (SDN) and Network Function Virtualization (NFV) to create multiple logical or virtual networks, each tailored for a set of services that share the same set of requirements. Abstraction and Control of Traffic Engineered Networks (ACTN) is described in RFC 8453. It defines an SDN-based architecture that relies on the concept of network and service abstraction to detach network and service control from the underlying data plane. This document outlines the applicability of ACTN to network slicing in a Traffic Engineered (TE) network that utilizes IETF technologies. It also identifies the features of network slicing not currently within the scope of ACTN, and indicates where ACTN might be extended. Work in Progress Huawei University of Surrey China Mobile KDDI Corporation Samsung This document describes the framework for NRP-based Enhanced Virtual Private Networks (VPNs) to support the needs of applications with specific traffic performance requirements (e.g., low latency, bounded jitter). NRP-based Enhanced VPNs leverage the VPN and Traffic Engineering (TE) technologies and adds characteristics that specific services require beyond those provided by conventional VPNs. Typically, an NRP-based enhanced VPN will be used to underpin network slicing, but could also be of use in its own right providing enhanced connectivity services between customer sites. This document also provides an overview of relevant technologies in different network layers, and identifies some areas for potential new work. Work in Progress Google Google Google Google Google Google This document describes the gRPC Network Management Interface (gNMI), a network management protocol based on the gRPC framework. gNMI supports retrieval and manipulation of state from network elements where the data is represented by a tree structure, and addressable by paths. The gNMI service defines operations for configuration management, operational state retrieval, and bulk data collection via streaming telemetry. The authoritative gNMI specification is maintained at [GNMI-SPEC]. Work in Progress HHS IEEE ETSI V1.1.1 NGMN Alliance NGMN O-RAN O-RAN.WG1 v06.00 PCI Security Standards Council Huawei Technologies KDDI Corporation China Telecom China Mobile China Mobile This document describes the mechanism to associate network resources to Segment Routing Identifiers (SIDs). Such SIDs are referred to as resource-aware SIDs in this document. The resource-aware SIDs retain their original forwarding semantics, but with the additional semantics to identify the set of network resources available for the packet processing and forwarding action. The resource-aware SIDs can therefore be used to build SR paths or virtual networks with a set of reserved network resources. The proposed mechanism is applicable to both segment routing with MPLS data plane (SR-MPLS) and segment routing with IPv6 data plane (SRv6). Work in Progress This document proposes an informal management model of Differentiated Services (Diffserv) routers for use in their management and configuration. This model defines functional datapath elements (e.g., classifiers, meters, actions, marking, absolute dropping, counting, multiplexing), algorithmic droppers, queues and schedulers. It describes possible configuration parameters for these elements and how they might be interconnected to realize the range of traffic conditioning and per-hop behavior (PHB) functionalities described in the Diffserv Architecture. This memo provides information for the Internet community. Generalized Multiprotocol Label Switching (GMPLS) defines both routing and signaling protocols for the creation of Label Switched Paths (LSPs) in various switching technologies. These protocols can be used to support a number of deployment scenarios. This memo addresses the application of GMPLS to the overlay model. [STANDARDS-TRACK] This document describes an updated version of the Encapsulating Security Payload (ESP) protocol, which is designed to provide a mix of security services in IPv4 and IPv6. ESP is used to provide confidentiality, data origin authentication, connectionless integrity, an anti-replay service (a form of partial sequence integrity), and limited traffic flow confidentiality. This document obsoletes RFC 2406 (November 1998). [STANDARDS-TRACK] This document describes a method by which a Service Provider may use an IP backbone to provide IP Virtual Private Networks (VPNs) for its customers. This method uses a "peer model", in which the customers' edge routers (CE routers) send their routes to the Service Provider's edge routers (PE routers); there is no "overlay" visible to the customer's routing algorithm, and CE routers at different sites do not peer with each other. Data packets are tunneled through the backbone, so that the core routers do not need to know the VPN routes. [STANDARDS-TRACK] Generalized Multiprotocol Label Switching (GMPLS) has been developed by the IETF to facilitate the establishment of Label Switched Paths (LSPs) in a variety of data plane technologies and across several architectural models. The ITU-T has specified an architecture for the control of Automatically Switched Optical Networks (ASON). This document provides a lexicography for the interpretation of GMPLS terminology within the context of the ASON architecture. It is important to note that GMPLS is applicable in a wider set of contexts than just ASON. The definitions presented in this document do not provide exclusive or complete interpretations of GMPLS concepts. This document simply allows the GMPLS terms to be applied within the ASON context. This memo provides information for the Internet community. Most of the initial efforts to utilize Generalized MPLS (GMPLS) have been related to environments hosting devices with a single switching capability. The complexity raised by the control of such data planes is similar to that seen in classical IP/MPLS networks. By extending MPLS to support multiple switching technologies, GMPLS provides a comprehensive framework for the control of a multi-layered network of either a single switching technology or multiple switching technologies. In GMPLS, a switching technology domain defines a region, and a network of multiple switching types is referred to in this document as a multi-region network (MRN). When referring in general to a layered network, which may consist of either single or multiple regions, this document uses the term multi-layer network (MLN). This document defines a framework for GMPLS based multi-region / multi-layer networks and lists a set of functional requirements. This memo provides information for the Internet community. This document specifies the Path Computation Element (PCE) Communication Protocol (PCEP) for communications between a Path Computation Client (PCC) and a PCE, or between two PCEs. Such interactions include path computation requests and path computation replies as well as notifications of specific states related to the use of a PCE in the context of Multiprotocol Label Switching (MPLS) and Generalized MPLS (GMPLS) Traffic Engineering. PCEP is designed to be flexible and extensible so as to easily allow for the addition of further messages and objects, should further requirements be expressed in the future. [STANDARDS-TRACK] YANG is a data modeling language used to model configuration and state data manipulated by the Network Configuration Protocol (NETCONF), NETCONF remote procedure calls, and NETCONF notifications. [STANDARDS-TRACK] The Network Configuration Protocol (NETCONF) defined in this document provides mechanisms to install, manipulate, and delete the configuration of network devices. It uses an Extensible Markup Language (XML)-based data encoding for the configuration data as well as the protocol messages. The NETCONF protocol operations are realized as remote procedure calls (RPCs). This document obsoletes RFC 4741. [STANDARDS-TRACK] This document defines an HTTP extension header field that allows proxy components to disclose information lost in the proxying process, for example, the originating IP address of a request or IP address of the proxy on the user-agent-facing interface. In a path of proxying components, this makes it possible to arrange it so that each subsequent component will have access to, for example, all IP addresses used in the chain of proxied HTTP requests. This document also specifies guidelines for a proxy administrator to anonymize the origin of a request. This document describes an architecture for the specification, creation, and ongoing maintenance of Service Function Chains (SFCs) in a network. It includes architectural concepts, principles, and components used in the construction of composite services through deployment of SFCs, with a focus on those to be standardized in the IETF. This document does not propose solutions, protocols, or extensions to existing protocols. This memo defines a metric for one-way delay of packets across Internet paths. It builds on notions introduced and discussed in the IP Performance Metrics (IPPM) Framework document, RFC 2330; the reader is assumed to be familiar with that document. This memo makes RFC 2679 obsolete. This memo defines a metric for one-way loss of packets across Internet paths. It builds on notions introduced and discussed in the IP Performance Metrics (IPPM) Framework document, RFC 2330; the reader is assumed to be familiar with that document. This memo makes RFC 2680 obsolete. In Traffic-Engineered (TE) systems, it is sometimes desirable to establish an end-to-end TE path with a set of constraints (such as bandwidth) across one or more networks from a source to a destination. TE information is the data relating to nodes and TE links that is used in the process of selecting a TE path. TE information is usually only available within a network. We call such a zone of visibility of TE information a domain. An example of a domain may be an IGP area or an Autonomous System. In order to determine the potential to establish a TE path through a series of connected networks, it is necessary to have available a certain amount of TE information about each network. This need not be the full set of TE information available within each network but does need to express the potential of providing TE connectivity. This subset of TE information is called TE reachability information. This document sets out the problem statement for the exchange of TE information between interconnected TE networks in support of end-to-end TE path establishment and describes the best current practice architecture to meet this problem statement. For reasons that are explained in this document, this work is limited to simple TE constraints and information that determine TE reachability. YANG is a data modeling language used to model configuration data, state data, Remote Procedure Calls, and notifications for network management protocols. This document describes the syntax and semantics of version 1.1 of the YANG language. YANG version 1.1 is a maintenance release of the YANG language, addressing ambiguities and defects in the original specification. There are a small number of backward incompatibilities from YANG version 1. This document also specifies the YANG mappings to the Network Configuration Protocol (NETCONF). This document describes an HTTP-based protocol that provides a programmatic interface for accessing data defined in YANG, using the datastore concepts defined in the Network Configuration Protocol (NETCONF). This document describes a Network Service Header (NSH) imposed on packets or frames to realize Service Function Paths (SFPs). The NSH also provides a mechanism for metadata exchange along the instantiated service paths. The NSH is the Service Function Chaining (SFC) encapsulation required to support the SFC architecture (defined in RFC 7665). The IETF has produced many modules in the YANG modeling language. The majority of these modules are used to construct data models to model devices or monolithic functions. A small number of YANG modules have been defined to model services (for example, the Layer 3 Virtual Private Network Service Model (L3SM) produced by the L3SM working group and documented in RFC 8049). This document describes service models as used within the IETF and also shows where a service model might fit into a software-defined networking architecture. Note that service models do not make any assumption of how a service is actually engineered and delivered for a customer; details of how network protocols and devices are engineered to deliver a service are captured in other modules that are not exposed through the interface between the customer and the provider. Traffic Engineered (TE) networks have a variety of mechanisms to facilitate the separation of the data plane and control plane. They also have a range of management and provisioning protocols to configure and activate network resources. These mechanisms represent key technologies for enabling flexible and dynamic networking. The term "Traffic Engineered network" refers to a network that uses any connection-oriented technology under the control of a distributed or centralized control plane to support dynamic provisioning of end-to- end connectivity. Abstraction of network resources is a technique that can be applied to a single network domain or across multiple domains to create a single virtualized network that is under the control of a network operator or the customer of the operator that actually owns the network resources. This document provides a framework for Abstraction and Control of TE Networks (ACTN) to support virtual network services and connectivity services. This document provides an information model for Abstraction and Control of TE Networks (ACTN). This document describes how to use a Service Function Forwarder (SFF) Label (similar to a pseudowire label or VPN label) to indicate the presence of a Service Function Chaining (SFC) Network Service Header (NSH) between an MPLS label stack and the packet original packet/ frame. This allows SFC packets using the NSH to be forwarded between SFFs over an MPLS network, and to select one of multiple SFFs in the destination MPLS node. This document defines a YANG data model for representing an abstract view of the provider network topology that contains the points from which its services can be attached (e.g., basic connectivity, VPN, network slices). Also, the model can be used to retrieve the points where the services are actually being delivered to customers (including peer networks). This document augments the 'ietf-network' data model defined in RFC 8345 by adding the concept of Service Attachment Points (SAPs). The SAPs are the network reference points to which network services, such as Layer 3 Virtual Private Network (L3VPN) or Layer 2 Virtual Private Network (L2VPN), can be attached. One or multiple services can be bound to the same SAP. Both User-to-Network Interface (UNI) and Network-to-Network Interface (NNI) are supported in the SAP data model. This document describes the integration of the Network Service Header (NSH) and Segment Routing (SR), as well as encapsulation details, to efficiently support Service Function Chaining (SFC) while maintaining separation of the service and transport planes as originally intended by the SFC architecture. Combining these technologies allows SR to be used for steering packets between Service Function Forwarders (SFFs) along a given Service Function Path (SFP), whereas the NSH is responsible for maintaining the integrity of the service plane, the SFC instance context, and any associated metadata. This integration demonstrates that the NSH and SR can work cooperatively and provide a network operator with the flexibility to use whichever transport technology makes sense in specific areas of their network infrastructure while still maintaining an end-to-end service plane using the NSH. 3GPP 3GPP 3GPP Release 14 Telefonica NTT Telefonica Microsoft NTT-East This document analyses the needs of potential customers of network slices realized with IETF techniques in several use cases, identifies the functionalities for the IETF Network Slice Service Interface of an IETF Network Slice Controller to satisfy such requests. This document is intended to provide motivation and support for work on YANG models for the IETF Network Slice Service interface. Work in Progress

Examples This appendix contains realization examples. This is not intended to be a complete set of possible deployments, nor does it provide definitive ways to realize these deployments. The examples shown here must not be considered to be normative. The descriptions of terms and concepts in the body of the document take precedence.

Multi-Point to Point Service As described in , an MP2P service can be realized with multiple P2P connectivity constructs. shows a simple MP2P service where traffic is sent from any of CE1, CE2, and CE3 to the receiver, which is CE4. The service comprises three P2P connectivity constructs: CE1-CE4, CE2-CE4, and CE3-CE4.

Example MP2P Service with P2P Connections CE1 ___|________ / \ \ ( \______ ) ( \) CE2---(--------------)---CE4 ( _______/) ( / ) \___|________/ | CE3

Service Function Chaining and Ancillary CEs introduces the concept of ancillary CEs. shows a simple example of IETF Network Slices with connectivity constructs that are used to deliver traffic from CE1 to CE3, taking in a service function along the path.

Example with Ancillary CEs CE1 CE2 CE3 xo* * * *ox ____xo*_________*_*_________*ox____ _/ xo* * * *ox \_ / xo*********** ***********ox \ ( xo ox ) ( xooooooooo(ACE1)oooooooooox ) ( x x ) ( x ------------------ x ) ( x | Service Function | x ) ( x | ....(ACE2).... | x ) ( x | : : | x ) ( xxxx.:....(ACE3)....:.xxxxx ) ( | : : | ) ( | ....(ACE4).... | ) ( | | ) ( ------------------ ) ( ) \_ Operator Network _/ \___________________________________/

A customer may want to utilize a service where traffic is delivered from CE1 to CE3, including a service function sited within the customer's network at CE2. To achieve this, the customer may request an IETF Network Slice Service comprising two P2P connectivity constructs: CE1-CE2 and CE2-CE3 (represented with "*" in ). Alternatively, the service function for the same CE1 to CE3 flow may be hosted at a node within the network operator's infrastructure. This is an ancillary CE in the IETF Network Slice Service that the customer requests. This service contains two P2P connectivity constructs: CE1-ACE1 and ACE1-CE3 (represented with "o" in ). How the customer knows of the existence of the ancillary CE and the service functions it offers is a matter for agreement between the customer and the network operator. Finally, it may be that the customer knows that the network operator is able to provide the service function but does not know the location of the ancillary CE at which the service function is hosted. Indeed, it may be that the service function is hosted at a number of ancillary CEs (ACE2, ACE3, and ACE4 in ); the customer may know the identities of the ancillary CEs but be unwilling or unable to choose one, or the customer may not know about the ancillary CEs. In this case, the IETF Network Slice Service request contains two P2P connectivity constructs: CE1-ServiceFunction and ServiceFunction-CE3 (represented with "x" in ). It is left as a choice for the network operator as to which ancillary CE to use and how to realize the connectivity constructs.

Hub and Spoke Hub and spoke is a popular way to realize A2A connectivity in support of multiple P2P traffic flows (where the hub performs routing) or P2MP flows (where the hub is responsible for replication). In many cases, it is the network operator's choice whether to use hub and spoke to realize a mesh of P2P connectivity constructs or P2MP connectivity constructs; this is entirely their business as the customer is not aware of how the connectivity constructs are supported within the network. However, it may be the case that the customer wants to control the behavior and location of the hub. In this case, the hub appears as an ancillary CE as shown in . For the P2P mesh case, the customer does not specify a mesh of P2P connectivity constructs (such as CE1-CE2, CE1-CE3, CE2-CE3, and the equivalent reverse direction connectivity) but connects each CE to the hub with P2P connectivity constructs (as CE1-Hub, CE2-Hub, CE3-Hub, and the equivalent reverse direction connectivity). This scales better in terms of provisioning compared to a full mesh but requires that the hub is capable of routing traffic between connectivity constructs. For the P2MP case, the customer does not specify a single P2MP connectivity construct (in this case, CE3-{CE1+CE2}) but requests three P2P connectivity constructs (as CE3-Hub, Hub-CE1, and Hub-CE2). It is the hub's responsibility to replicate the traffic from CE3 and send it to both CE1 and CE2.

Example Hub and Spoke under Customer Control ------------ CE1 | Hub | CE2 || ------------ || ___||_____||__||__||_____||___ / || || || || || \ ( ====== || ====== ) ( || ) ( || ) \______________||______________/ || CE3

Layer 3 VPN Layer 3 VPNs are a common service offered by network operators to their customers. They may be modeled as an A2A service but are often realized as a mesh of P2P connections, or if multicast is supported, they may be realized as a mesh of P2MP connections. shows an IETF Network Slice Service with a single A2A connectivity construct between the SDPs CE1, CE2, CE3, and CE4. It is a free choice how the network operator realizes this service. They may use a full mesh of P2P connections, a hub-and-spoke configuration, or some combination of these approaches.

Example L3VPN Service CE1 CE2 ____|_______________|____ / :...............: \ ( :. . : ) ( : ...... . : ) ( : ..... : ) ( : .... . : ) ( : . .... : ) ( : . . : ) ( :...............: ) \____:_______________:____/ | | CE3 CE4

Hierarchical Composition of Network Slices As mentioned in , IETF Network Slices may be arranged hierarchically. There is nothing special or novel about such an arrangement, and it models the hierarchical arrangement of services of virtual networks in many other environments. As shown in , an Operator's Controller (NSC) that is requested to provide an IETF Network Slice Service for a customer may, in turn, request an IETF Network Slice Service from another carrier. The Operator's NSC may manage and control the underlay IETF Network Slice by modifying the requested connectivity constructs and changing the SLAs. The customer is entirely unaware of the hierarchy of slices, and the underlay carrier is entirely unaware of how its slice is being used. This stacking of IETF Network Slice constructs is not different to the way virtual networks may be arranged.

Example Hierarchical Arrangement of IETF Network Slices -------------- | Network | | Slice | | Orchestrator | -------------- | IETF Network Slice | Service Request | Customer view ....|................................ -v---------------- Operator view |Controller | | ------------ | | | IETF | | | | Network |---|--- | | Slice | | | | | Controller | | | | | (NSC) | | | | ------------ | | ------------------ | | IETF Network Slice | Service Request | .........................|..................... ----------v------- Carrier view |Controller | | ------------ | | | IETF | | | | Network | | | | Slice | | | | Controller | | | | (NSC) | | | ------------ | ....| | Network |............ | | Configuration | Underlay Network | v | | ------------ | | | Network | | | | Controller | | | | (NC) | | | ------------ | ------------------ | Device Configuration v

In this case, the network hierarchy may also be used to provide connectivity between points in the higher-layer network, as shown in . Here, an IETF Network Slice may be requested of the lower-layer network to provide the desired connectivity constructs to supplement the connectivity in the higher-layer network where this connectivity might be presented as a virtual link.

Example Hierarchical Arrangement of IETF Network Slices to Bridge Connectivity CE1 CE2 | | | | _|_________________________________________|_ ( : : ) ( :.............. ..............: ) (_______________:_____________:_______________) __|_____________|__ ( : : ) ( :.............: ) (___________________)

Horizontal Composition of Network Slices It may be that end-to-end connectivity is achieved using a set of cooperating networks as described in . For example, there may be multiple interconnected networks that provide the required connectivity as shown in . The networks may utilize different technologies and may be under separate administrative control.

Example Customer View of Interconnected Networks Providing End-to-End Connectivity CE1 CE2 | | SDP1 SDP2 | | _|____ ______ ______ ____|_ ( ) ( ) ( ) ( ) ( )---( )---( )---( ) (______) (______) (______) (______)

In this scenario, the customer (represented by CE1 and CE2) may request an IETF Network Slice Service connecting the CEs. The customer considers the SDPs at the edge (shown as SDP1 and SDP2 in ) and might not be aware of how the end-to-end connectivity is composed. However, because the various networks may be of different technologies and under separate administrative control, the networks are sliced individually, and coordination is necessary to deliver the desired connectivity. The Network-to-Network Interfaces (NNIs) are present as SDPs for the IETF Network Slices in each network, so that each network is individually sliced. In the example in , this is illustrated as network 1 (N/w1) being sliced between SDP1 and SDPX, N/w2 being sliced between SDPY and SDPU, etc. The coordination activity involves binding the SDPs, and hence the connectivity constructs, to achieve end-to-end connectivity with the required SLOs and SLEs. In this way, simple and complex end-to-end connectivity can be achieved with a variety of connectivity constructs in the IETF Network Slices of different networks "stitched" together.

Example Delivery of an End-to-End IETF Network Slice with Interconnected Networks CE1 CE2 | | SDP1 SDP2 | | _|____ ______ ______ ____|_ ( ) SDPX ( ) SDPU ( ) SDPS ( ) ( N/w1 )------( N/w2 )------( N/w3 )------( N/w4 ) (______) SDPY (______) SDPV (______) SDPT (______)

The controller/coordinator relationship is shown in .

Example Relationship of IETF Network Slice Coordination -------------- | Network | | Slice | | Orchestrator | -------------- | IETF Network Slice | Service Request | Customer view ....|................................ -v---------------- Coordinator view |Coordinator | | | ------------------ | |_________________ | | | | ....|....................... ....|..................... -v-------------- -v-------------- |Controller1 | Operator1 |Controller2 | Operator2 | ------------ | | ------------ | | | IETF | | | | IETF | | | | Network | | | | Network | | | | Slice | | | | Slice | | | | Controller | | | | Controller | | | | (NSC) | | | | (NSC) | | | ------------ | | ------------ | ....| | Network |............ | | Network |............ | | Config | Underlay1 | | Config | Underlay2 | v | | v | | ------------ | | ------------ | | | Network | | | | Network | | | | Controller | | | | Controller | | | | (NC) | | | | (NC) | | | ------------ | | ------------ | ---------------- ---------------- | Device Configuration v

Acknowledgments The entire TEAS Network Slicing design team and everyone participating in related discussions has contributed to this document. Some text fragments in the document have been copied from the , for which we are grateful. Significant contributions to this document were gratefully received from the contributing authors listed in the "" section. In addition, we would like to also thank those others who have attended one or more of the design team meetings, including the following people not listed elsewhere:

Further useful comments were received from , , , , , , , , , , , , , , , , , , , and . This work is partially supported by the European Commission under Horizon 2020 grant agreement number 101015857 Secured autonomic traffic management for a Tera of SDN flows (Teraflow).

Contributors The following people contributed substantially to the content of this document and should be considered coauthors. was the original editor of the foundation documents. Retired Ericsson

jari.arkko@piuha.net

Orange

mohamed.boucadair@orange.com

Huawei

India dhruv.ietf@gmail.com

Huawei

jie.dong@huawei.com

Volta Networks

xufeng.liu.ietf@gmail.com

Authors' Addresses Old Dog Consulting

United Kingdom adrian@olddog.co.uk

Individual

United States of America je_drake@yahoo.com

Ciena

rrokui@ciena.com

NTT

Japan shunsuke.homma.ietf@gmail.com

Futurewei

United States of America kiran.ietf@gmail.com

Telefonica

Spain luismiguel.contrerasmurillo@telefonica.com

Nvidia

jefftant.ietf@gmail.com