draft-kishjac-bmwg-evpntest-08.txt   draft-kishjac-bmwg-evpntest-09.txt 
INTERNET-DRAFT Kishore Tiruveedhula
Intended Status: Informational Sudhin Jacob
Expires: October 7,2018 Juniper Networks
February 26,2018
INTERNET-DRAFT Kishore Tiruveedhula Benchmarking Methodology for EVPN and PBB-EVPN
Intended Status:Standard Sudhin Jacob draft-kishjac-bmwg-evpntest-09
Expires: March 7,2018 Juniper Networks
October 6,2017
Benchmarking Methodology for EVPN and PBB-EVPN
draft-kishjac-bmwg-evpntest-08
Abstract Abstract
This document defines the methodologies for benchmarking performance This document defines methodologies for benchmarking EVPN and PBB-EVPN performance.
of EVPN and PBB-EVPN.EVPN is defined in RFC 7432.It is being deployed EVPN is defined in RFC 7432, and is being deployed in Service Provider networks.
in provider network.This document provides the benchmarking This document specifically covers methodologies for benchmarking EVPN/PBB-EVPN
methodologies for EVPN/PBB-EVPN convergence,data plane,control plane convergence, data plane performance, control plane performance.
learning of mac.
Status of this Memo Status of this Memo
This Internet-Draft is submitted in full conformance with the This Internet-Draft is submitted in full conformance with the
provisions of BCP 78 and BCP 79. provisions of BCP 78 and BCP 79.
Internet-Drafts are working documents of the Internet Engineering Internet-Drafts are working documents of the Internet Engineering
Task Force (IETF). Note that other groups may also distribute Task Force (IETF). Note that other groups may also distribute
working documents as Internet-Drafts. The list of current Internet- working documents as Internet-Drafts. The list of current Internet-
Drafts is at http://datatracker.ietf.org/drafts/current/. Drafts is at http://datatracker.ietf.org/drafts/current/.
Internet-Drafts are draft documents valid for a maximum of six Internet-Drafts are draft documents valid for a maximum of six
months and may be updated, replaced, or obsoleted by other months and may be updated, replaced, or obsoleted by other
documents at any time. It is inappropriate to use Internet-Drafts documents at any time. It is inappropriate to use Internet-Drafts
as reference material or to cite them other than as "work in as reference material or to cite them other than as "work in
progress." progress."
This Internet-Draft will expire on March 7,2018. This Internet-Draft will expire on October 7, 2018.
Copyright and License Notice Copyright and License Notice
Copyright (c) 2016 IETF Trust and the persons identified as the Copyright (c) 2017 IETF Trust and the persons identified as the
document authors. All rights reserved. document authors. All rights reserved.
This document is subject to BCP 78 and the IETF Trust's Legal This document is subject to BCP 78 and the IETF Trust's Legal
Provisions Relating to IETF Documents Provisions Relating to IETF Documents
(http://trustee.ietf.org/license-info) in effect on the date of (http://trustee.ietf.org/license-info) in effect on the date of
publication of this document. Please review these documents publication of this document. Please review these documents
carefully, as they describe your rights and restrictions with respect carefully, as they describe your rights and restrictions with
to this document. Code Components extracted from this document must respect to this document. Code Components extracted from this
include Simplified BSD License text as described in Section 4.e of document must include Simplified BSD License text as described in
the Trust Legal Provisions and are provided without warranty as Section 4.e of the Trust Legal Provisions and are provided without
described in the Simplified BSD License. warranty as described in the Simplified BSD License.
INTERNET DRAFT <draft-kishjac-bmwg-evpntest-08> <October 7,2017>
to this document. Code Components extracted from this document must
include Simplified BSD License text as described in Section 4.e of
the Trust Legal Provisions and are provided without warranty as
described in the Simplified BSD License.
Table of Contents
1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . 4
1.1 Terminology . . . . . . . . . . . . . . . . . . . . . . . . 4
2.Test Topology . . . . . . . . . . . . . . . . . . . . . . . . . 4
2.1 Terminologies . . . . . . . . . . . . . . . . . . . . . . . 5
3. Network . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
3.1 PBB-EVPN Network Setup . . . . . . . . . . . . . . . . . . 5
4. Test Procedure . . . . . . . . . . . . . . . . . . . . . . . . 6
5 Test Cases . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
5.1.1 To check the time taken to learn the mac address in
DUT . . . . . . . . . . . . . . . . . . . . . . . . . . 7
5.1.2. To check the time taken to learn X macs from remote
peer by DUT . . . . . . . . . . . . . . . . . . . . . 9
5.1.3. To check the time taken to flush the local entry due
to CE link failure . . . . . . . . . . . . . . . . . . 10
5.1.4. To check the time taken by DUT to flush X routes
learned from remote PE after R1 traffic generator link failure . 11
5.1.5. To measure the mac ageing time. . . . . . . . . . . . 12
5.1.6. To check the time taken by DUT to age X routes
learned from remote PE after stopping the traffic at remote PE. . 14
5.1.7. To check the time taken by DUT to learn X routes
from local and X from remote and measure the time of flood from DUT. . 15
5.1.8. To measure the time taken to elect a new DF by
adding a a MHPE. . . . . . . . . . . . . . . . . . . . 16
5.2 High Availability . . . . . . . . . . . . . . . . . . . 18
5.2.1 To check the whether there is traffic loss due to
routing engine failover for redundancy test. . . . . . 18
5.3 ARP/ND Scaling . . . . . . . . . . . . . . . . . . . . . . 19
6. Scale . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
6.1. To Scale the DUT to N EVI and clear bgp in DUT with out
traffic. . . . . . . . . . . . . . . . . . . . . . . . . . 20
6.2. To Scale the DUT to N EVI and clear bgp in DUT with
traffic.Measure the convergence time . . . . . . . . . . . 22
7. Soak Test . . . . . . . . . . . . . . . . . . . . . . . . . . 23
7.1. To Scale the DUT to N EVI in DUT with traffic and run
the set up for 24hrs . . . . . . . . . . . . . . . . . . . 23
8. Acknowledgements . . . . . . . . . . . . . . . . . . . . . . . 25
9. IANA Considerations . . . . . . . . . . . . . . . . . . . . . 25
10. Security Considerations . . . . . . . . . . . . . . . . . . . 25
INTERNET DRAFT <draft-kishjac-bmwg-evpntest-08> <October 7,2017>
11 References . . . . . . . . . . . . . . . . . . . . . . . . . . 25 Contents
11.1 Normative References . . . . . . . . . . . . . . . . . . . 25 1. Introduction ............................................... 4
11.2 Informative References . . . . . . . . . . . . . . . . . . 25
Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . . . 26
INTERNET DRAFT <draft-kishjac-bmwg-evpntest-08> <October 7,2017> 1.1 Terminologies ............................................... 5
1 Introduction 2. Test Topology................................................. 6
EVPN which is defined in RFC7432 which describes procedures for 3. Network....................................................... 8
BGP MPLS-based Ethernet VPNs(EVPN).This document defines the
methodologies for benchmarking performance of EVPN.EVPN has been
implemented with many varying designs in order to achieve their
intended network functionality.The scope of this document is to
provide methodologies for benchmarking evpn data,control plane mac
learning,mac flush,mac ageing,convergence,high availability,scale.
The methodologies defined for evpn can be used for benchmarking the
performance of PBB-EVPN.PBB-EVPN is defined in RFC 7623.It is
being deployed in provider network.The difference between PBB-EVPN
and EVPN is the former learns the customer mac in data plane the
later learns in control plane.
1.1 Terminology 4. PBB-EVPN Network Setup........................................ 8
The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL 5 Test Cases..................................................... 10
NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL"
in this document are to be interpreted as described in RFC 2119
[RFC2119].
2.Test Topology 5.1.1 To Record the time taken to learn the MAC address in DUT... 10
Topology Diagram 5.1.2. To Record the time taken to learn remote MACs in DUT which is
advertised by remote peer........................................ 13
Topology Diagram 5.1.3. To Record the time taken to flush the local entry
due to CE link Failure and measure the relearning rate of MACs... 15
| RT (Traffic Generator layer 2 traffic send to each sub interface it serve as sender and Reciever) 5.1.4. To Record the time taken by DUT to flush MACs learned from
+----------+ R1 during R1 traffic generator link failure ........................17
| |
| R1 |
| |
+----------+
|
|
+----------+
| |
| RR |
| |
+----------+-------------|
| |
| |
+----------+ +-----------+
| | | MHPE2 |
| DUT | | |
| MHPE1 | | |
+----------+ +-----------+
| |
+----------+------------ DUT and MHPE2 are running in Single Active mode
| |
| CE |
| |
+----------+------------ Traffic Generator
RT (Traffic Generator layer 2 traffic send to each sub interface it serve as sender and Reciever)
Topology Diagram 5.1.5. To measure the MAC aging time...............................19
Figure 1 5.1.6. To Record the time taken by DUT to age X routes learned from
remote PE after stopping the traffic at remote PE.................. 20
INTERNET DRAFT <draft-kishjac-bmwg-evpntest-08> <October 7,2017> 5.1.7. To Record the time taken by DUT to learn routes from
local and remote................................................... 23
2.1 Terminologies 5.2 High Availability ........................................ 25
MHPE Multi homed Provide Edge router. 5.2.1 To Record the whether there is traffic loss due to
routing engine fail-over for redundancy test....................... 25
RR Route Reflector 5.3 ARP/ND Scaling 27
CE Customer Router/Devices 6. Scale 28
PE2 Provider Edge router 2 6.1. To Scale the DUT to N EVI and clear BGP in DUT without traffic. .28
AA EVPN Terminologies AA All-Active 6.2. To Scale the DUT to N EVI and clear BGP in DUT with traffic.
Measure the convergence time........................................ 29
SA EVPN Terminologies SA Single-Active 7. Soak Test 31
RT Router Tester 7.1. To Scale the DUT to N EVI in DUT with traffic and
run the set up for 24hrs ........................................... 31
3. Network 8. Acknowledgments 33
The network consists of 5 routers and 2 traffic generator 9. IANA Considerations............................................ 33
ports.DUT is acting as one of the MHPE to CE.The RR is acting as
route reflector and core router.R1 is a Single home router running
evpn. All four routers except CE are running mpls,bgp emulating a
provider scenario.CE is a dual home connected to DUT and MHPE2.The
testing will be done on DUT in order to bench mark the service. DUT
and the MHPE2 is running EVPN with SA/AA, CE will be configured
with layer 2 bridge.In AA EVPN there will be LAG running from CE to
both MHPE's.The DUT and other PE's will be running X EVI's (EVPN
instances) on X sub interfaces.The traffic generator will be
connected to R1 and the CE, which is capable of sending layer 2
frames.The traffic will be send either uni directional or bi
directional based on the benchmark parameters to be measured.
3.1 PBB-EVPN Network Setup 10. Security Considerations 33
The network consists of 5 routers and 2 traffic generator 11 References 33
ports.DUT is acting as one of the MHPE to CE.The RR is acting as
route reflector and core router.R1 is a Single home router running
pbbevpn. All four routers except CE are running mpls,bgp emulating
a provider scenario.CE is a dual home connected to DUT and
MHPE2.DUT and MHPE2 is running PBB-EVPN with SA/AA with CE.CE will
be configured with layer 2 bridge.In AA PBB-EVPN there will be LAG
running from CE to both MHPE's.The DUT and other PE's will be
running X EVI's (PBB-EVPN instances) on X sub interfaces.The
traffic generator will be connected to R1 and the CE, which is
capable of sending layer 2 frames.The traffic will be send either
uni directional or bi directional based on the benchmark parameters
to be measured.
INTERNET DRAFT <draft-kishjac-bmwg-evpntest-08> <October 7,2017> 11.1 Normative References 33
4. Test Procedure 11.2 Informative References 34
The test defined to bench mark the performance of EVPN mac learning Authors' Addresses 35
in control pland and data plane. Mac flush,High Availability,
convergence time in link failures,scale scenarios.
4.1 MAC Learning in Control plane and Data Plane 1. Introduction
The MAC will be learned in data plane and control plane, test is to EVPN is defined in RFC7432 which describes procedures for
measure the time taken to learn the "X" number of mac's in time "T" BGP MPLS-based Ethernet VPNs(EVPN).This document defines the
sec. The data plane learning will from the locally connected methodologies for benchmarking performance of EVPN. The scope of
interface. The control plane learning is through BGP advertisements this document is to provide methodologies for benchmarking EVPN
from the remote PE. Let the local learning time be "T" and control data, control plane MAC learning, MAC flush ,MAC aging,
plane learning time be "T'". The data plane mac learning can be convergence, high availability, scale.
measured using the parameters defined in RFC 2889 section 5.8. The methodologies defined for EVPN can be used for benchmarking the
performance of PBB-EVPN.PBB-EVPN is defined in RFC 7623.It is
being deployed in provider network. The difference between PBB-EVPN
and EVPN is the former learns the customer MAC in data plane the
later learns in control plane.
4.2 MAC flush for locally learned and remote learned MAC Conventions used in this document
The time taken to flush the "X" locally learned mac, let it be "T1" The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL
sec, once the traffic is stopped. The time taken to flush the remote NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL"
mac which is learned by control plane let it be "X" macs.The time in this document are to be interpreted as described in RFC 2119
taken to flush the "X" remote macs, which is measured as "T2" sec. [RFC2119].
4.3 High Availability 1.1 Terminologies
The traffic is flowing bi direction. The bgp is converged,consider MHPE Multi homed Provide Edge router.
there are "X" numbers of macs learned locally and remotely.
Then traffic is flowing at "P" packets per sec. The traffic generator
is measuring the Tx and Rx packets, while the routing engine fail over there
should not any packet loss the router tester must show both "P"
packet per seconds.
4.4 Convergence Time RR Route Reflector
During any events like link failure, hard reset measure the time P Provider Router
taken to learn "X" mac's locally and remotely.
4.5 Scale CE Customer Router/Devices/Switch
This is to measure the performance of DUT in scaling to "X" EVPN MHPE2 Multi homed Provider Edge router 2
instances. The measured parameters are CPU usage, memory
leak,crashes.
INTERNET DRAFT <draft-kishjac-bmwg-evpntest-08> <October 7,2017> MHPE1 Multi homed Provider Edge router 1
4.6 SOAK SHPE3 Single homed Provider Edge Router 3
This test is used to measure the performance of DUT over a period of AA EVPN Terminologies AA All-Active
time,with scaled configuration and traffic over a period of time
"T'". In each interval "t1" the parameters measured are CPU usage,
memory usage and crashes.
4.7 Measurement Statistics SA EVPN Terminologies SA Single-Active
The test is repeated for "N" times and the value is taken by RT Router Tester
averaging the values.
5 Test Cases Sub Interface Each physical Interfaces is subdivided in to
Logical units.
The following tests are conducted to measure mac learning of local as EVI EVPN Instances which will be running on sub interface or
well as remote. physical port of the provider Edge routers.
5.1.1 To check the time taken to learn the mac address in DUT
Objective: DF Designated Forwarder
To check the time taken to learn the mac address locally and time ESI Ethernet Segment Identifier
taken to send the locally learned routes to peers.
a. Send X unicast frames from CE to MHPE1(DUT) working in SA 2. Test Topology
mode with different source and destination address, where DUT is
the DF so that it can forward the traffic.Measure the time
taken to learn these mac in forwarding table and in control plane.
The data plane learning is measured using RFC 2889 section 5.8.
Sending frames to the limit of bridge domain of particular EVI.
Measure the time taken to learn all X mac in data plane/hardware.
The Range of MAC is known from RT and this is verified in DUT.
b. Measure the time taken to send these X type 2 routes from EVPN/PBB-EVPN Running in SA mode:
DUT to its peers. Figure 1
Procedure: +-------------+
| |
| |
| R1(SHPE1)|
| | + sub interfaces
| | +---------------------------------+
+-----+-------+ Router Tester (IXIA/Spirent) sending
| layer 2 bi directional traffic which acts as sender/receiver
|
|
|
+-------------+
| ++ |
| |
| RR/P |
| |
| |
+---+-------------+----+
| |
| |
| |
+-----+-------+ +-----+-------+
| | | |
| MHPE1(DUT) | |
| | | MHPE2 |
| | | |
| | | |
| | +------+------+
+-------------+ |
| |
| +---------+
+-------+-------------+
| |
| CE1 |
| bridge domain | sub interfaces
| +-------------------------------+
| |
+---------------------+ Router Tester (IXIA/Spirent) Sending bi
directional layer 2 traffic with different VLAN acts as sender/receiver
Configure EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are 3. Network
running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and
DUT.Once the bgp comes up check the DUT evpn table.For MH PE ESI must
INTERNET DRAFT <draft-kishjac-bmwg-evpntest-08> <October 7,2017> The network consists of 5 routers and 2 traffic generator ports.
The traffic generator ports are connected to R1 and CE, these RT port
will be sending uni directional or bi directional for different vlans
depends on the test scenario.R1 is also termed as SHPE3 which is a
single homed router is running EVPN services. DUT(MHPE1) and MHPE2 are
running multihoming EVPN services, the CE acts as a bridge which will
send the layer 2 traffic to both DUT and MHPE2. RR is the router
reflector which is also acting as provider router. All four
routers(MHPE1,MHPE2,RR,R1) except CE are running MPLS,BGP emulating a
Service provider scenario. CE is a dual home connected to DUT and
MHPE2.The testing will be done on DUT in order to bench mark the EVPN
service. DUT and the MHPE2 are running EVPN with SA/AA, In AA EVPN
service there will be LAG running between interfaces of CE, DUT and
MHPE2 .The DUT and other PE's will be running N EVI's (EVPN instances)
on <X> sub interfaces.
be configured per IFD/Interface.Using RT (traffic generator) to 4. PBB-EVPN Network Setup
send the traffic to the CE. The traffic is unidirectional.Since CE
is working in bridge mode,frames will be send to ingress sub
interface of DUT.
Measurement The network consists of 5 routers and 2 traffic generator ports.
The traffic generator ports are connected to R1 and CE, these ports
will be sending bi directional or uni directional layer 2 traffic for
different vlans depending up on the various test scenarios.
R1 is also termed as SHPE3 which is a single homed router is running
PBB-EVPN services. DUT(MHPE1) and MHPE2 are running multihoming PBB-
EVPN services ,the CE acts as a bridge which will send the layer 2
traffic to both DUT and MHPE2. RR is the router reflector which is
also acting as provider router. All four routers(MHPE1,MHPE2,RR,R1)
except CE are running MPLS,BGP emulating a Service provider
scenarios. CE is a dual home connected to DUT and MHPE2.The testing will
be done on DUT in order to bench mark the PBB-EVPN service. DUT and
the MHPE2 are running PBB-EVPN with SA/AA, In AA PBB-EVPN service
there will be LAG running between the interfaces of CE, DUT and MHPE2.
The DUT and other PE's will be running <X> EVI's (PBB-EVPN instances)
on <X> sub interfaces.
The DUT mac table must learn the X macs in data plane in T time 5 Test Cases
frame.The DUT must send type 2 routes to remote router in T' time
frame.Repeat the test and plot the data.The data plane measurement
is taken by considering DUT as black box the range of X mac is
known from RT and the same is learned in DUT, the time to learn
that is measured.
PBB-EVPN To check the time taken to learn the mac address in DUT The following tests are conducted to measure the time taken to learn
the <X> number of MAC's locally in EVI is "T"sec. The data plane
learning of MAC will happen locally from connected interface. The
control plane learning of MAC is through BGP advertisements from the
remote PE(SHPE3). The control plane learning of <X> MAC, the time
taken will be "T'". The data plane MAC learning can be measured using
the parameters defined in RFC 2889 section 5.8.
Objective: 5.1.1 To Record the time taken to learn the MAC address in DUT
To check the time taken to learn the mac address locally. Objective:
a. Send X unicast frames from CE to MHPE1(DUT) working in SA To Record the time taken to learn the MAC address locally and
mode with different source and destination address, where DUT is time taken to send these local learned MAC routes to peers.
the DF so that it can forward the traffic. Measure the time
taken to learn these mac in forwarding table.The data plane
learning is measured using RFC 2889 section 5.8.Sending frames to
the limit of bridge domain of particular EVI.Measure the time
taken to learn all X mac in data plane/hardware.The Range of
MAC is known from RT and this is verified in DUT.
Procedure: a. Send <X> unicast frames from CE to MHPE1(DUT) working in SA
mode with different source and destination address. Measure the time
taken to learn these MAC in forwarding table and in control plane.
The data plane learning is measured using RFC 2889 section 5.8.
Sending frames to the limit of bridge domain of particular EVI.
Measure the time taken to learn all <X> MAC in data plane/hardware.
The Range of MAC is known from RT and this is verified in DUT.
Configure PBB-EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are b. Measure the time taken to send these <X> type 2 routes from
running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and DUT to its peers.
DUT.Once the bgp comes up check the DUT evpn table.For MH PE ESI must
be configured per IFD/Interface.Using RT (traffic generator) to
send the traffic to the routers.
INTERNET DRAFT <draft-kishjac-bmwg-evpntest-08> <October 7,2017> Procedure:
Measurement Configure EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are
running MPLS,BGP,RR is acting as route reflector to R1,MHPE2 and
DUT.For MH PE ESI must be configured per IFD/Interface. Using RT
(traffic generator)to send the traffic to the CE. The traffic is
unidirectional. Since CE is working in bridge mode, frames will be
send to ingress sub interface of DUT. The BGP must be established in
R1,MHPE1(DUT),RR,MHPE2.
The DUT mac table must learn the X macs in data plane in T time Measurement
frame. Repeat the test and plot the data.The data plane measurement
is taken by considering DUT as black box the range of X mac is
known from RT and the same is learned in DUT, the time to learn
that is measured.
5.1.2. To check the time taken to learn X macs from remote peer by DUT The DUT EVPN MAC table must learn the <X> MACs in data plane in T
Time frame. The DUT must send <X> type 2 routes to remote router in T'
Time frame. Repeat the test and plot the data. The data plane
measurement is taken by considering DUT as black box the range
of X MAC is known from RT and the same is learned in DUT, the time
to learn that is measured.
Objective: The test is repeated for "N" times and the value is taken by
averaging the values.
Send X frames with different SA and DA to DUT from R1 using PBB-EVPN To Record the time taken to learn the MAC address in DUT
traffic generator. Measure the time taken to learn these X
macs from remote peer and program the mac address table.
Procedure: Objective:
Configure EVPN EVI in R1,MHPE2,DUT. All 4 routers except CE are To Record the time taken to learn the MAC address locally.
running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and
DUT.Once the bgp comes up check the DUT evpn table. For MH PE ESI
must be configured per IFD/Interface.Using RT(traffic generator)
send the traffic to R1.The traffic is uni directional.There wont
be any traffic flow from CE to DUT during this test.
Measurement: a. Send <X> unicast frames from CE to MHPE1(DUT) working in SA
mode with different source and destination address. Measure the time
taken to learn these MACs in forwarding table. The data plane
learning is measured using RFC 2889 section 5.8.Sending frames to
the limit of bridge domain of particular EVI. Measure the time
taken to learn all <X> MAC in data plane/hardware. The Range of
MAC is known from RT and this is verified in DUT.
The DUT mac table must learn the X mac address in T time frame. Procedure:
Repeat these test and plot the data.
PBB-EVPN To check the time taken to learn X mac's from remote peer Configure PBB-EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE
by DUT. are running MPLS,BGP,RR is acting as route reflector to R1,MHPE2
and DUT. Once the BGP comes up. Record the DUT PBB-EVPN table. For MH
PE ESI must be configured per IFD/Interface. From RT (traffic
generator) send the traffic to the DUT. The BGP must be established in
R1,MHPE1(DUT),RR,MHPE2. The traffic is unidirectional. Since CE is
working in bridge mode, frames will be send to ingress sub interface
of DUT.
Objective: Measurement
Send X frames with different SA and DA to DUT from R1 using The DUT MAC table must learn the <X> MACs in data plane in T time
traffic generator.Measure the time taken to learn these X macs from frame. Repeat the test and plot the data. The data plane measurement
remote peer and program the mac address table. is taken by considering DUT as black box the range of <X> MAC is
known from RT and the same is learned in DUT, the time to learn
<X> MAC is measured. The test is repeated for "N" times and the value
is taken by averaging the values.
Procedure: 5.1.2. To Record the time taken to learn remote MACs in DUT
which is advertised by remote peer
Configure PBB-EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are Objective:
running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and
INTERNET DRAFT <draft-kishjac-bmwg-evpntest-08> <October 7,2017> Send <X> frames with different SA and DA to R1 from RT
Measure the time taken to learn these <X> MACs from remote peer in
DUT and program the EVPN MAC address table. The DUT and MHPE2 are
running SA mode.
DUT.Once the bgp comes up check the DUT pbb-evpn table. For MHPE ESI Procedure:
must be configured per IFD/Interface.Using RT(traffic generator)
send the traffic to R1. The traffic is uni directional. There wont
be any traffic flow from CE to DUT during this test.
Measurement: Configure EVPN EVI in R1,MHPE2,DUT. All 4 routers except CE are
running MPLS,BGP,RR is acting as route reflector to R1,MHPE2 and
DUT. Record the DUT EVPN table. For MH PE ESI must be configured
per IFD/Interface. Using RT(traffic generator) send the traffic to
R1.The traffic is uni directional. There wont be any traffic flow from
CE to DUT during this test. The BGP must be in established state. The
MACS learned in R1 will be advertised to DUT by BGP.
The DUT mac table must learn the X mac address in T time frame. Measurement:
Repeat these test and plot the data.
The following test cases are executed to measure the time taken to The DUT MAC table must learn the <X> MAC address in T time frame.
flush the mac table in case of an event Repeat these test and plot the data. The test is repeated for "N"
times and the value is taken by averaging the values.
5.1.3. To check the time taken to flush the local entry due to CE link PBB-EVPN To Record the time taken to learn <X> MAC's from remote
failure and measure the relearning rate of X macs peer by DUT.
Objective: Objective:
Send X frames with different SA and DA to DUT from CE using Send <X> frames with different SA and DA to R1 from RT. Measure the
traffic generator.Wait for a while to learn all X mac address. time taken to learn these <X> MACs from remote peer and program the
Then fail the DUT CE link and measure the time taken to flush these MAC address table of the DUT. DUT and MHPE2 are running SA mode.
X macs from the mac table and from control plane.
Procedure: Procedure:
Configure EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are Configure PBB-EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are
running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and DUT. running MPLS,BGP,RR is acting as route reflector to R1,MHPE2 and
Once the bgp comes up check the DUT evpn table. For MH PE ESI must DUT. Record the DUT PBB-EVPN table. For MHPE ESI must be configured
be configured per IFD/Interface. Using RT(traffic generator) to send per IFD/Interface. Using RT(traffic generator) send the traffic to R1.
the traffic to the routers.In this traffic will be only send from The traffic is uni directional. There wont be any traffic flow from CE
CE. to DUT during this test. The BGP must be in established state.
Measurement: Measurement:
Measure the time taken for flushing these X mac address. The DUT MAC table must learn the <X> MAC address in T time frame.
Measure the time taken to relearn the X macs in other PE.Repeat Repeat these test and plot the data. The test is repeated for "N"
the test and plot the data. times and the value is taken by averaging the values.
PBB-EVPN To check the time taken to flush the local entry due to CE link failure 5.1.3. To Record the time taken to flush the local entry due to CE link
Failure and measure the relearning rate of MACs
Objective: Objective:
Send X frames with different SA and DA to DUT from CE using Send <X> frames with different SA and DA to DUT from CE using
traffic generator.Wait for a while to learn all X mac address.Then traffic generator. Wait till the MHPE2 learns all <X> MAC address.
Then fail the MHPE2 CE link and measure the time taken to flush these
<X> MACs from the EVPN MAC table and the time taken to relearn it.
The DUT and MHPE2 are running SA mode. In this scenario MHPE2 is the
Designated forwarder which learns mac and advertises to DUT.
INTERNET DRAFT <draft-kishjac-bmwg-evpntest-08> <October 7,2017> Procedure:
fail the DUT CE link and measure the time taken to flush these X Configure EVPN EVI in R1,MHPE2,DUT. All 4 routers except CE are
macs from the mac table.Measure the time taken to relearn. running MPLS,BGP,RR is acting as route reflector to R1,MHPE2 and DUT.
Once the BGP is established. Record the DUT EVPN table. For MH PE ESI
must be configured per IFD/Interface. Using RT(traffic generator)
send the traffic. In this scenario traffic will be only send from CE
side.
Procedure: Measurement:
Configure PBB-EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are Measure the time taken for flushing these <X> MAC address. Measure
running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and the time taken to relearn the <X> MACs in DUT. Repeat the test
DUT. Once the bgp comes up check the DUT pbb-evpn table. For MH PE and plot the data.
ESI must be configured per IFD/Interface. Using RT(traffic
generator) to send the traffic to the routers.In this traffic will
be only send from CE.
Measurement: PBB-EVPN To Record the time taken to flush the local entry due to CE link failure
The DUT mac table must learn the X mac address and measure the Objective:
time taken for flushing these X mac address.Measure the time taken to relearn these
X macs.
5.1.4. To check the time taken by DUT to flush X routes learned from Send <X> frames with different SA and DA to DUT from CE using
remote PE after R1 traffic generator link failure traffic generator. Wait till the MHPE2 learn all <X> MAC address. Then
fail the MHPE2 CE link and measure the time taken to flush these <X>
MACs from the PBB-EVPN MAC table. Measure the time taken to relearn
<X> MACS. The DUT and MHPE2 are running SA mode.
Objective: Procedure:
Send X frames with different SA and DA to DUT from R1 using Configure PBB-EVPN EVI in R1,MHPE2,DUT. All 4 routers except CE are
traffic generator.Bring down the link between R1 and traffic running MPLS,BGP,RR is acting as route reflector to R1,MHPE2 and
generator.Then measure the time taken to flush the DUT mac address DUT. Once the BGP is established. Record the DUT PBB-EVPN table.
table. For MH PE ESI must be configured per IFD/Interface. Using RT(traffic
generator) send the traffic to the CE. The traffic is uni
directional
Procedure: Measurement:
Configure EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are The DUT MAC table must learn the <X> MAC address and measure the
running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and time taken for flushing these X MAC address. Measure the time taken
DUT.Once the bgp comes up check the DUT evpn table.For MH PE ESI must to relearn these <X> MACs in DUT. Repeat the test and plot the data.
be configured per IFD/Interface. Using RT(traffic generator) to
send the traffic to the R1.There wont be any traffic flowing to CE
from RT.
Measurement: 5.1.4. To Record the time taken by DUT to flush MACs learned from R1 during R1
traffic generator link failure
Measure the time taken to flush X remote routes from mac table Objective:
of DUT.Repeat the test and plot the data.
INTERNET DRAFT <draft-kishjac-bmwg-evpntest-08> <October 7,2017> Send <X> frames with different SA and DA to DUT from R1 using traffic
generator. Bring down the link between R1 and traffic generator. Then
measure the time taken to flush the DUT EVPN MAC table. The DUT and
MHPE2 are running SA mode.
PBB-EVPN To check the time taken by DUT to flush X macs learned Procedure:
from remote PE after R1 traffic generator link failure
Objective: Configure EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are
running MPLS,BGP,RR is acting as route reflector to R1,MHPE2 and
DUT. Once the BGP is established Record the DUT EVPN table. For MHPE
ESI must be configured per IFD/Interface. Using RT(traffic generator)
send the traffic to R1.There wont be any traffic flowing to CE from
RT.
Send X frames with different SA and DA to DUT from R1 using Measurement:
traffic generator.Bring down the link between R1 and traffic
generator.Then measure the time taken to flush the DUT mac address
table.The remote macs will be learned by Data plane,but the B-MAC
will be learned by control plane.
Procedure: Measure the time taken to flush <X> remote MACs from EVPN MAC table
of DUT. Repeat the test and plot the data.
Configure PBB-EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are PBB-EVPN To Record the time taken by DUT to flush MACs learned
running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and from R1 during R1 traffic generator link failure
DUT. Once the bgp comes up check the DUT pbb-evpn table.For MH PE
ESI must be configured per IFD/Interface. Using RT(traffic
generator) to send the traffic to the routers.In this traffic will
be only send from CE.
Measurement: Objective:
Measure the time taken to flush X remote macs from mac table of Send <X> frames with different SA and DA to DUT from R1 using
DUT. traffic generator. Bring down the link between R1 and traffic
generator. Then measure the time taken to flush the DUT PBB-EVPN MAC
address table. The remote MACs will be learned by Data plane, but the
B-MAC will be learned by control plane. The DUT and MHPE2 are running
SA mode.
The following test cases are executed to measure the mac ageing in Procedure:
locally learned and remote mac learned by control plane.
5.1.5. To measure the mac ageing time. Configure PBB-EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are
running MPLS,BGP,RR is acting as route reflector to R1,MHPE2 and
DUT. Once the BGP is established Record the DUT PBB-EVPN MAC table.
For MHPE ESI must be configured per IFD/Interface. Using RT(traffic
generator) send the traffic to R1.In this scenario traffic will
be flowing only from R1.
Objective: Measurement:
Send X frames with different SA and DA to DUT from CE using Measure the time taken to flush <X> remote MACs from PBB-EVPN MAC
traffic generator.Wait to learn all X mac address.Then stop the table of DUT. Repeat the test and plot the data.
traffic.Wait to see how long it takes to flush these mac entries
due to ageing.
Procedure: 5.1.5. To measure the MAC ageing time.
Configure EVPN EVI in R1,MHPE2,DUT. All 4 routers except CE are Objective:
INTERNET DRAFT <draft-kishjac-bmwg-evpntest-08> <October 7,2017> Send <X> frames with different SA and DA to DUT from CE using
traffic generator. Wait till <X> MAC address are learned. Then stop
the traffic. Record the time taken to flush <X> MACS from DUT EVPN
MAC table due to ageing. The DUT and MHPE2 are running SA mode.
running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and Procedure:
DUT.Once the bgp comes up check the DUT evpn table. For MH PE ESI
must be configured per IFD/Interface.Using RT(traffic generator) to
send the traffic to the routers.The traffic will be flowing from CE
to DUT.There wont be any traffic from R1.
Measurement: Configure EVPN EVI in R1,MHPE2,DUT. All 4 routers except CE are
running MPLS,BGP,RR is acting as route reflector to R1,MHPE2 and
DUT .Once the BGP is established. Record the DUT EVPN table. For MHPE
ESI must be configured per IFD/Interface. Using RT(traffic generator),
send the traffic to the DUT. The traffic will be flowing from CE
to DUT. There wont be any traffic from R1.
Measure the time taken to flush X mac address due to ageing.Repeat Measurement:
the test and plot the data.
PBB-EVPN To measure the mac ageing time. Measure the time taken to flush <X> MAC address due to ageing. Repeat
the test and plot the data.
Objective: PBB-EVPN To measure the MAC ageing time.
Send X frames with different SA and DA to DUT from CE using Objective:
traffic generator.Wait to learn all X mac address.Then stop the
traffic.Wait to see how long it takes to flush these mac entries
due to ageing.
Procedure: Send X frames with different SA and DA to DUT from CE using
traffic generator. Wait till <X> MAC address are learned in DUT PBB-
EVPN MAC table. Then stop the traffic. Record the time taken to flush
<X> MAC entries due to ageing. The DUT and MHPE2 running in SA mode
Configure PBB-EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are Procedure:
running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and
DUT.Once the bgp comes up check the DUT mac table. For MH PE ESI
must be configured per IFD/Interface. Using RT(traffic generator) to
send the traffic to the routers.
Measurement: Configure PBB-EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are
running MPLS,BGP,RR is acting as route reflector to R1,MHPE2 and
DUT.Once the BGP is established. Record the DUT PBB-EVPN MAC table.
For MH PE ESI must be configured per IFD/Interface. Using RT(traffic
generator) send the traffic to the DUT. The traffic is uni directional
flowing from CE to DUT.
The DUT mac table must learn the X mac address, measure the time Measurement:
taken for flushing these X mac address due to ageing.
INTERNET DRAFT <draft-kishjac-bmwg-evpntest-08> <October 7,2017> Measure the time taken to flush <X> MAC address due to ageing. Repeat
the test and plot the data.
5.1.6. To check the time taken by DUT to age X routes learned from 5.1.6. To Record the time taken by DUT to age X routes learned from
remote PE after stopping the traffic at remote PE. remote PE after stopping the traffic at remote PE.
Objective: Objective:
Send X frames with different SA and DA to DUT from R1 using Send X frames with different SA and DA to DUT from R1 using
traffic generator.After stopping the traffic at remote PE R1 traffic generator. Stop the traffic at remote PE R1.
traffic generator due to mac ageing it will withdraw its routes from Due to MAC ageing R1 will withdraw its routes from DUT and MHPE2.
remote PE's.Measure the time taken to remove these macs from DUT Measure the time taken to remove these MACs from DUT EVPN MAC
mac table. table. DUT and MHPE2 are running in SA mode
Procedure: Procedure:
Configure EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are Configure EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are
running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and running MPLS,BGP,RR is acting as route reflector to R1,MHPE2 and
DUT.Once the bgp comes up check the DUT evpn table.For MH PE ESI must DUT. Once the BGP is established. Record the DUT EVPN table. For MH
be configured per IFD/Interface.Using RT(traffic generator) to send PE ESI must be configured per IFD/Interface. Using RT(traffic
the traffic to R1.There wont be any traffic from CE. generator) send the traffic to R1.There wont be any traffic from
CE.
Measurement: Measurement:
Measure the time taken to flush X remote macs from mac table of Measure the time taken to flush <X> remote MACs learned in DUT EVPN
DUT due to ageing.Repeat the test and plot the data. MAC table due to ageing. Repeat the test and plot the data.
PBB-EVPN To check the time taken by DUT to age X mac from remote PBB-EVPN To Record the time taken by DUT to age <X> MAC from remote
PE after stopping the traffic at remote PE. PE after stopping the traffic at remote PE.
Objective: Objective:
Send X frames with different SA and DA to DUT from R1 using
traffic generator.After stopping the traffic at remote PE(R1) traffic
generator.Measure the time taken to remove these macs from DUT mac
table.
Procedure:
Configure PBB-EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are
running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and
DUT.Once the bgp comes up check the DUT mac table.For MH PE ESI must
be configured per IFD/Interface.Using RT(traffic generator) to
send the traffic to the routers.
Measurement:
Measure the time taken to flush the remote macs from mac table of
DUT due to ageing.
INTERNET DRAFT <draft-kishjac-bmwg-evpntest-08> <October 7,2017>
The following tests are executed to measure the convergence time in
case of an event or by lerning the mac without any external trigger.
5.1.7. To check the time taken by DUT to learn X routes from local and
X from remote and measure the time of flood from DUT.
Objective:
Send X frames with different SA and DA to DUT from R1 using
traffic generator.Send X frames with different SA and DA from
traffic generator connected to CE.The SA and DA of flows must be
complimentary to have unicast flows.Measure the time taken by the
DUT to learn 2X in mac table and in control plane.Measure the flood
time period of DUT.
Procedure:
Configure EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are
running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and
DUT.Once the bgp comes up check the DUT evpn table. For MH PE ESI
must be configured per IFD/Interface.Using RT(traffic generator) to
send the traffic to the routers.The traffic is bi directional.
Measurement:
Measure the time taken to learn 2X routes in control and mac
address table in DUT and measure the flood time of DUT.Repeat the
test and plot the data.
PBB-EVPN To check the time taken by DUT to learn X macs from
local and X from remote and measure the time of flood from
DUT.
Objective:
Send X frames with different SA and DA to DUT from R1 using
traffic generator. Send X frames with different SA and DA from
traffic generator connected to CE.The SA and DA of flows must be
complimentary to have unicast flows.Measure the time taken by the
DUT to learn 2X in mac table.Measure the flood time period of DUT.
INTERNET DRAFT <draft-kishjac-bmwg-evpntest-08> <October 7,2017>
Procedure:
Configure PBB-EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are
running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and
DUT.Once the bgp comes up check the DUT evpn table.For MH PE ESI
must be configured per IFD/Interface.Using RT(traffic generator) to
send the traffic to the routers.
Measurement: Send <X> frames with different SA and DA to DUT from R1 using
traffic generator. Stop the traffic at remote PE(R1).Measure the
time taken to remove these remote MACs from DUT PBB-EVPN MAC
table. The DUT and MHPE2 are running in SA mode.
Measure the time taken to learn 2X mac address table in DUT. and Procedure:
measure the flood time of DUT.Repeat the test and plot the data.
5.1.8. To measure the time taken to elect a new DF by adding a a MHPE. Configure PBB-EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are
running MPLS,BGP,RR is acting as route reflector to R1,MHPE2 and
DUT. Once the BGP is established. Record the DUT MAC table. For MH
PE ESI must be configured per IFD/Interface. Using RT(traffic
Generator) send the traffic to R1. There is no traffic from CE side.
Objective: Measurement:
Send X frames from CE to DUT from traffic generator with Measure the time taken to flush the <X> remote MACs from DUT PBB-
different SA and DA.Wait to learn all X mac address.Then add a new EVPN MAC table due to ageing. Repeat the test and plot the data.
router configured with evpn to the same ethernet segment.Configure
same ESI value which is configured in DUT and in MHPE1 on IFD.Then
the new DF election take place during that time there should not be
any loop and measure the time taken to come up the new DF.Measure
the time taken to elect the new DF.
Procedure: 5.1.7. To Record the time taken by DUT to learn routes from local and remote.
Configure EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are Objective:
running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and
DUT.Once the bgp comes up check the DUT evpn table.For MHPE ESI
must be configured per IFD/Interface.Using RT(traffic generator) to
send the traffic to the routers.
Measurement: Send <X> frames with different SA and DA to DUT from R1 using
traffic generator. Send <X> frames with different SA and DA from
traffic generator connected to CE. The SA and DA of flows must be
complimentary to have unicast flows. Measure the time taken by
the DUT to learn 2X in EVPN MAC. DUT and MHPE2 are running in
SA mode.
Measure the time taken for new DF election in DUT and there should Procedure:
INTERNET DRAFT <draft-kishjac-bmwg-evpntest-08> <October 7,2017> Configure EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are
running MPLS,BGP,RR is acting as route reflector to R1,MHPE2 and
DUT. Once the BGP is established. Record the DUT EVPN table. For MH
PE ESI must be configured per IFD/Interface. Using RT(traffic
generator) send the traffic to the routers. The traffic is bi
directional.
not be any loop or forwarding the BUM traffic back to the same Measurement:
segment.
PBB-EVPN To measure the time taken to elect a new DF by adding a a Measure the time taken to learn <2X> MAC address in DUT EVPN MAC
MHPE. table. Repeat the test and plot the data.
Objective: PBB-EVPN To Record the time taken by DUT to learn <X> MACs from
local and <X> from remote.
Send X frames from CE to DUT from traffic generator with Objective:
different SA and DA.Wait to learn all X mac address.Then add a new
router to the same Ethernet segment by configuring the same ESI
value configured in DUT,MHPE2 in IFD.Then the new DF election take
place during that time there should not be any loop and measure the
time taken to come up the new DF.Measure the time taken to elect
the new DF.
Procedure: Send X frames with different SA and DA to DUT from R1 using
traffic generator. Send <X> frames with different SA and DA from
traffic generator connected to CE. The SA and DA of flows must be
complimentary to have unicast flows. Measure the time taken by the
DUT to learn 2X in MAC table. DUT and MHPE2 are running in SA mode.
Configure PBB-EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are Procedure:
running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and
DUT.Once the bgp comes up check the DUT evpn table. For MH PE ESI
must be configured per IFD/Interface. Using RT(traffic generator) to
send the traffic to the routers.
Measurement: Configure PBB-EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are
running MPLS,BGP,RR is acting as route reflector to R1,MHPE2 and
DUT. Once the BGP is established. Record the DUT EVPN table.For MH
PE ESI must be configured per IFD/Interface. Using RT(traffic
generator) send the traffic to the routers.
Measure the time taken for new DF election in DUT and there should Measurement:
not be any loop or forwarding the BUM traffic back to the same
segment.
INTERNET DRAFT <draft-kishjac-bmwg-evpntest-08> <October 7,2017> Measure the time taken to learn 2X MAC address table in DUT PBB-EVPN
MAC table. Repeat the test and plot the data.
5.2 High Availability 5.2 High Availability
These tests are conducted to check after an event there wont be 5.2.1 To Record the whether there is traffic loss due to routing engine
any change in functionality. failover for redundancy test.
5.2.1 To check the whether there is traffic loss due to routing engine
failover for redundancy test.
Objective:
Send X frames from CE to DUT from traffic generator with
different SA and DA. Send X frames from traffic generator to R1
with different SA and DA so that 2X mac address will be learned in
DUT. There is a bi directional traffic flow with X pps in each
direction. Then do a routing engine failover.
Procedure: Objective:
Configure EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are Send <X> frames from CE to DUT from traffic generator with different
running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and SA and DA. Send <X> frames from traffic generator to R1 with different
DUT.Once the bgp comes up check the DUT evpn table.For MH PE ESI must SA and DA so that <2X> MAC address will be learned in DUT. There is a
be configured per IFD/Interface.Using RT(traffic generator) to send bi directional traffic flow with X pps in each direction. Then do a
the traffic to the routers. routing engine failover.
Measurement: Procedure:
There should be 0 traffic loss which is the ideal case,No Configure EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are
change in the DF role.No withdraw of any routes. running MPLS,BGP,RR is acting as route reflector to R1,MHPE2 and
DUT. Once the BGP is established. Record the DUT EVPN table. For MH PE
ESI must be configured per IFD/Interface. Using RT(traffic generator)
Send bi directional to the routers.
PBB-EVPN To check the whether there is traffic loss due to routing Measurement:
engine failover for redundancy test.
Objective: There should be 0 traffic loss which is the ideal case, No change in
the DF role. DUT should not withdraw any routes. Repeat the test and
plot the graph.
Send X frames from CE to DUT from traffic generator with PBB-EVPN To Record the whether there is traffic loss due to routing
different SA and DA.Send X frames from traffic generator to R1 with engine failover for redundancy test.
different SA and DA so that 2X mac address will be learned in DUT.
There is a bi directional traffic flow with X pps in each
direction.Then do a routing engine failover.
Procedure: Objective:
Configure PBB-EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are Send <X> frames to DUT with different SA and DA from CE using
the traffic generator. Send <X> frames from traffic generator to
R1 with different SA and DA so that <2X> MAC address will be learned
in DUT. There is a bi directional traffic flow with <X> pps in each
direction. Then do a routing engine failover.
INTERNET DRAFT <draft-kishjac-bmwg-evpntest-08> <October 7,2017> Procedure:
running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and Configure PBB-EVPN EVI in R1,MHPE2,DUT. All 4 routers except CE are
DUT.Once the bgp comes up check the DUT evpn table.For MH PE ESI must running MPLS,BGP,RR is acting as route reflector to R1,MHPE2 and
be configured per IFD/Interface. Using RT(traffic generator) to DUT. Once the BGP is established. Record the DUT PBB-EVPN table. For
send the traffic to the routers. MH PE ESI must be configured per IFD/Interface. Using RT(traffic
generator) send the traffic to the routers.
Measurement: Measurement:
There should be 0 packet loss loss which is a ideal case,No change There should be 0 packet loss which is the ideal case, No change
in the DF role. No withdraw of any routes. in the DF role. There should not be any withdraw of routes from DUT.
5.3 ARP/ND Scaling 5.3 ARP/ND Scaling
These tests are conducted to check the scaling parameter of arp/ND These tests are conducted to Record the scaling parameter of arp/ND
of the DUT. of the DUT.
EVPN: To check the ARP/ND scale of the DUT when the gateway is EVPN: To Record the ARP/ND scale of the DUT with gateway IRB
configured. configured.
Objective: Objective:
Send X arp/icmpv6 request from RT to DUT,that with different
sender ip/ipv6 address to the same target gateway ip address.
Procedure: Send <X> arp/icmpv6 request from RT to DUT with different sender
ip/ipv6 address to the same target gateway ip address. Measure whether
<X> MAC+IPv4 address/MAC+IPv6 address of the hosts are learned in DUT.
Configure EPN EVI in R1,MHPE2,DUT.All 4 routers except CE are Procedure:
running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and
DUT.Once the bgp comes up check the DUT evpn table.For MH PE ESI must
be configured per IFD/Interface. Using RT(traffic generator) to
send the arp request to the DUT which has gateway configured.
Measurement: Configure EPN EVI in R1,MHPE2,DUT.All 4 routers except CE are
running MPLS,BGP,RR is acting as route reflector to R1,MHPE2 and
DUT. Once the BGP is established. Record the DUT EVPN table. For MH PE
ESI must be configured per IFD/Interface. Using RT(traffic
generator) send arp/ICMPv6 request to the DUT which has gateway
configured.
The DUT must learn X mac+ip/mac+ipv6 and it must advertise the X Measurement:
mac+ip/ mac+ipv6 to the remote router.
INTERNET DRAFT <draft-kishjac-bmwg-evpntest-08> <October 7,2017> The DUT must learn <X> MAC+IPV4/MAC+IPv6 and it must advertise the X
MAC+IPV4/MAC+IPV6 to the remote router.
6. Scale 6. Scale
6.1. To Scale the DUT to N EVI and clear bgp in DUT with out traffic.
Objective:
INTERNET DRAFT <draft-kishjac-bmwg-evpntest-08> <October 7,2017>
The main purpose of the test the DUT performance to scale N EVI's. 6.1. To Scale the DUT to N EVI and clear BGP in DUT without traffic.
Then clear bgp neighbor. There should not be any loss of routes or
any crashes.
Procedure: Objective:
Configure EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are The DUT, MHPE2 and R1 are scaled to "N" EVI. Clear BGP neighbors of
running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and the DUT. Once the adjacency is established in DUT. Measure the routes
DUT.Once the bgp comes up check the DUT evpn table.For MHPE,DUT ESI received from remote routers MHPE2 and R1 for <N> EVIs in the DUT.
must be configured per IFD/Interface. Using RT(traffic generator)
to send the traffic to the routers.
Measurement Procedure:
There should not be any loss of route types 1,2,3 and 4 in DUT. Configure EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are
running MPLS,BGP,RR is acting as route reflector to R1,MHPE2 and
DUT. Once the BGP is established. Record the DUT EVPN table. For
MHPE,DUT ESI must be configured per IFD/Interface.
PBB-EVPN To Scale the DUT to N PBB-EVPN instances and clear bgp in Measurement
DUT without traffic.
Objective: There should not be any loss of route types 1,2,3 and 4 in DUT. DUT
Must relearn all type 1,2,3 and 4 from remote routers.
The main purpose of the test the DUT performance to scale N PBB- PBB-EVPN To Scale the DUT to N PBB-EVPN instances and clear BGP in
EVPN instances.Then clear bgp neighbor.There should not be any loss DUT without traffic.
of routes or any crashes.
Procedure: Objective:
Configure PBB-EVPN instances in R1,MHPE2,DUT.All 4 routers except The DUT, MHPE2 and R1 are scaled to "N" PBB-EVI. Clear BGP
CE are running mpls,bgp,RR is acting as route reflector to R1,MHPE2 neighbors of the DUT. Once the adjacency is established in DUT.
and DUT.Once the bgp comes up check the DUT evpn table.For MH PE Measure the routes received from remote routers MHPE2 and R1 for <N>
ESI must be configured per IFD/Interface.Using RT(traffic EVIs in the DUT.
generator) to send the traffic to the routers.
Measurement Procedure:
There should not be any loss of route types 2,3 and 4 in DUT. Configure "N" PBB-EVPN instances in R1,MHPE2,DUT.All 4 routers except
CE are running MPLS,BGP,RR is acting as route reflector to R1,MHPE2
and DUT. Once is established. Record the DUT PBB-EVPN table. For MH
PE ESI must be configured per IFD/Interface.
INTERNET DRAFT <draft-kishjac-bmwg-evpntest-08> <October 7,2017> Measurement
6.2. To Scale the DUT to N EVI and clear bgp in DUT with There should not be any loss of route types 2,3 and 4 in DUT. The DUT
traffic.Measure the convergence time must relearn all type 2,3 and 4 routes from remote routers.
Objective: 6.2. To Scale the DUT to N EVI and clear BGP in DUT with traffic.
Measure the convergence time
The main purpose of the test the DUT performance to scale N EVI's Objective:
with traffic. Then clear bgp neighbor.There should not be any loss
of routes or any crashes. Send F frames from CE to DUT from
traffic generator with different SA and DA for N EVI's. Send F
frames from traffic generator to R1 with different SA and DA for N
EVI's.so that 2F number of mac address will be learned in DUT.
There is a bi directional traffic flow with F pps in each
direction. Then clear the bgp nei in DUT after the bgp comes up and
started learning the routes, measure the time taken to learn all
2F mac routes.
Procedure: Scale <N> EVI's in DUT,R1 and MHPE2.Send F frames to DUT from CE using
traffic generator with different SA and DA for N EVI's. Send <F>
frames from traffic generator to R1 with different SA and DA.
There will be <2F> number of MAC address will be learned in DUT EVPN
MAC table. There is a bi directional traffic flow with F pps in each
direction. Then clear the BGP neighbors in the DUT. Once the adjacency
is restored in DUT. Measure the time taken to learn all <2F> MAC
address in DUT MAC table.
Configure EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are Procedure:
running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and
DUT.Once the bgp comes up check the DUT evpn table.For MH PE ESI must
be configured per IFD/Interface. Using RT(traffic generator) to
send the traffic to the routers.
Measurement: Configure EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are
running MPLS,BGP,RR is acting as route reflector to R1,MHPE2 and
DUT. Once the BGP is established. Record the DUT EVPN table. For MH
PE ESI must be configured per IFD/Interface. Using RT(traffic
generator)send the traffic to the routers.
The DUT must learn all 2F mac address.Measure the time taken to Measurement:
learn 2F mac in DUT, measure the flood traffic time "t" of DUT
PBB-EVPN To Scale the DUT to "N" PBB-EVPN instances and clear bgp The DUT must learn all <2F> MAC address. Measure the time taken to
in DUT with traffic.Measure the convergence time learn 2F MAC in DUT, measure the flood traffic time "t" of DUT
Objective: PBB-EVPN To Scale the DUT to "N" PBB-EVPN instances and clear BGP
in DUT with traffic. Measure the convergence time
The main purpose of the test the DUT performance to scale N pbb- Objective:
evpn instances with traffic.Then clear bgp neighbor.There should
not be any loss of routes or any crashes.Send F frames from CE to
DUT from traffic generator with different SA and DA for N pbb-evpn
instances.Send F frames from traffic generator to R1 with different
SA and DA for N pbb-evpn instances.so that F mac address will be
learned in DUT.There is a bi directional traffic flow with F pps in
each direction.Then clear the bgp nei in DUT after the bgp comes up
and started learning the routes, measure the time taken to learn
all 2F macs in DUT.
INTERNET DRAFT <draft-kishjac-bmwg-evpntest-08> <October 7,2017> Scale <N> PBB-EVI's in DUT,R1 and MHPE2.Send <F> frames to DUT from CE
using traffic generator with different SA and DA for N EVI's. Send <F>
frames from traffic generator to R1 with different SA and DA.
There will be <2F> number of MAC address will be learned in DUT PBB-
EVPN MAC table. There is a bi directional traffic flow with F pps in
each direction. Then clear the BGP neighbors in the DUT. Once the
adjacency is restored in DUT. Measure the time taken to learn all <2F>
MAC address in DUT PBB-MAC table.
Procedure: Procedure:
Configure PBB-EVPN instances in R1,MHPE2,DUT.All 4 routers except Configure PBB-EVPN instances in R1,MHPE2,DUT.All 4 routers except
CE are running mpls,bgp,RR is acting as route reflector to R1,MHPE2 CE are running MPLS,BGP,RR is acting as route reflector to R1,MHPE2
and DUT.Once the bgp comes up check the DUT evpn table.For MH PE and DUT. Once BGP is established. Record the DUT EVPN table. For MH
ESI must be configured per IFD/Interface. Using RT(traffic PE ESI must be configured per IFD/Interface. Using RT(traffic
generator) to send the traffic to the routers. generator) send the traffic to the routers.
Measurement: Measurement:
The DUT must learn all 2F mac address.Measure the time taken The DUT must learn all 2F MAC address. Measure the time taken
to learn 2F mac in DUT, measure the flood traffic time "t" of DUT to learn 2F MAC in DUT, measure the flood traffic time "t" of DUT
7. Soak Test 7. Soak Test
7.1. To Scale the DUT to N EVI in DUT with traffic and run the set up 7.1. To Scale the DUT to N EVI in DUT with traffic and run the set up for 24hrs
for 24hrs
Objective:
The main purpose of the test the DUT performance to scale N EVI's Objective:
with traffic. Then clear bgp neighbor. There should not be any
loss of routes or any crashes. Send F frames from CE to DUT from
traffic generator with different SA and DA for N EVI's. Send F
frames from traffic generator to R1 with different SA and DA for N
EVI's.so that 2F mac address will be learned in DUT. There is a bi
directional traffic flow with F pps in each direction.Keep the
setup up and running for 24 hrs,take hourly CPU utilization,memory
usage.
Procedure: Scale <N> EVIs in DUT,R1 and MHPE2.Send F frames to DUT from CE using
traffic generator with different SA and DA for N EVI's. Send <F>
frames from traffic generator to R1 with different SA and DA.
There will be <2F> number of MAC address will be learned in DUT EVPN
MAC table. There is a bi directional traffic flow with F pps in each
direction. The DUT must run with traffic for 24 hours, every hour
check for memory leak, crash.
.
Configure EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are Procedure:
running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and
DUT.Once the bgp comes up check the DUT evpn table.For MH PE ESI must
be configured per IFD/Interface. Using RT(traffic generator) to
send the traffic to the routers.
Measurement: Configure EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are
running MPLS,BGP,RR is acting as route reflector to R1,MHPE2 and
DUT. Once the BGP is established. Record the DUT EVPN table. For MH
PE ESI must be configured per IFD/Interface. Using RT(traffic
generator) send the traffic to the routers.
Take the hourly reading of CPU,process memory.There should not be Measurement:
any leak,crashes,CPU spikes.
INTERNET DRAFT <draft-kishjac-bmwg-evpntest-08> <October 7,2017> Take the hourly reading of CPU, process memory. There should not be
any leak, crashes, CPU spikes.
PBB-EVPN To Scale the DUT to N PBB-EVPN instances in DUT with PBB-EVPN To Scale the DUT to N PBB-EVPN instances in DUT with traffic
traffic and run the set up for 24hrs and run the set up for 24hrs
Objective: Objective:
The main purpose of the test the DUT performance to scale N EVI's Scale <N> PBB-EVI's in DUT,R1 and MHPE2.Send <F> frames to DUT from CE
with traffic. Then clear bgp neighbor. There should not be any using traffic generator with different SA and DA for N EVI's. Send <F>
loss of routes or any crashes. Send F frames from CE to DUT from frames from traffic generator to R1 with different SA and DA. There
traffic generator with different SA and DA for N EVI's. Send F will be <2F> number of MAC address will be learned in DUT PBB-EVPN MAC
frames from traffic generator to R1 with different SA and DA for N table. There is a bi directional traffic flow with <F> pps in each
EVI's.so that 2F mac address will be learned in DUT. There is a bi direction. The DUT must run with traffic for 24 hours, every hour
directional traffic flow with F pps in each direction.Keep the check the memory leak, crashes.
setup up and running for 24 hrs,take hourly CPU utilization,memory
usage.
Procedure: Procedure:
Configure PBB-EVPN instances in R1,MHPE2,DUT.All 4 routers except Configure <N> PBB-EVPN instances in R1, MHPE2, DUT. All 4 routers
CE are running mpls,bgp,RR is acting as route reflector to R1,MHPE2 except CE are running MPLS,BGP,RR is acting as route reflector to
and DUT.Once the bgp comes up check the DUT evpn table.For MH PE R1,MHPE2 and DUT. Once the BGP comes up Record the DUT EVPN table.
ESI must be configured per IFD/Interface. Using RT(traffic for MH PE ESI must be configured per IFD/Interface. Using RT(traffic
generator) to send the traffic to the routers. generator)send the traffic to the routers.
Measurement: Measurement:
Take the hourly reading of CPU,process memory.There should not be Take the hourly reading of CPU process, memory usages. There should
any leak,crashes,CPU spikes. not be any memory leak, crashes, CPU spikes.
INTERNET DRAFT <draft-kishjac-bmwg-evpntest-08> <October 7,2017> 8. Acknowledgments
8. Acknowledgements We would like to thank Fioccola Giuseppe of Telecom Italia
reviewing our draft and commenting it. We would like to thank Sarah
Banks, the work group chair for guiding us in this draft.
We would like to thank Fioccola Giuseppe of Telecom Italia
reviewing our draft and commenting it.
9. IANA Considerations 9. IANA Considerations
This memo includes no request to IANA. This memo includes no request to IANA.
10. Security Considerations 10. Security Considerations
There is no additional consideration from RFC 6192. There is no additional consideration from RFC 6192.
11 References 11 References
11.1 Normative References 11.1 Normative References
[RFC2119] Bradner, S., "Key words for use in RFCs to [RFC2119] Bradner, S., "Key words for use in RFCs to
Indicate Requirement Levels", BCP 14, RFC 2119, Indicate Requirement Levels", BCP 14, RFC 2119,
DOI 10.17487/RFC2119, June 1997,<http://www.rfc- DOI 10.17487/RFC2119, June 1997,<http://www.rfc-
editor.org/info/rfc2119>. editor.org/info/rfc2119>.
[RFC2544] Bradner, S. and J. McQuaid, "Benchmarking [RFC2544] Bradner, S. and J. McQuaid, "Benchmarking
Methodology for Network Interconnect Devices", RFC Methodology for Network Interconnect Devices", RFC
2544,DOI 10.17487/RFC2544, June 1999,<http://www.rfc- 2544,DOI 10.17487/RFC2544, June 1999,<http://www.rfc-
editor.org/info/rfc2544>. editor.org/info/rfc2544>.
[RFC2889] R.Mandeville and J. Perser "Benchmarking Methodology [RFC2889] R.Mandeville and J. Perser "Benchmarking
for LAN Switching Devices" Methodology for LAN Switching Devices"
11.2 Informative References 11.2 Informative References
[RFC7432] Sajassi, A., Ed., Aggarwal, R., Bitar, N., [RFC7432] Sajassi, A., Ed., Aggarwal, R., Bitar, N.,
Isaac, A.,Uttaro, J., Drake, J., and W.Henderickx, Isaac, A.,Uttaro, J., Drake, J., and W.Henderickx,
"BGP MPLS-Based Ethernet VPN", "BGP MPLS-Based Ethernet VPN",
RFC 7432, DOI 10.17487/RFC7432, February RFC 7432, DOI 10.17487/RFC7432, February
2015, <http://www.rfc-editor.org/info/rfc7432>. 2015, <http://www.rfc-editor.org/info/rfc7432>.
[RFC7623] Sajassi, A., Ed., Aggarwal, R., Bitar, N., [RFC7623] Sajassi, A., Ed., Aggarwal, R., Bitar, N.,
Isaac, A.,J., Drake, J., and W. Henderickx, Isaac, A.,J., Drake, J., and W. Henderickx,
" Provider Backbone Bridging Combined with Ethernet " Provider Backbone Bridging Combined with Ethernet
VPN(PBB-EVPN)",RFC 7623,10.17487/RFC7623,September 2015 VPN(PBB-EVPN)",RFC 7623,10.17487/RFC7623,September 2015
<http://www.rfc-editor.org/info/rfc7623>. <http://www.rfc-editor.org/info/rfc7623>.
INTERNET DRAFT <draft-kishjac-bmwg-evpntest-08> <October 7,2017>
Authors' Addresses Authors' Addresses
Appendix A. Appendix Appendix A. Appendix
Authors' Addresses Authors' Addresses
Sudhin Jacob (editor) Sudhin Jacob (editor)
Juniper Networks Juniper Networks
Bangalore Bangalore
India India
 End of changes. 241 change blocks. 
728 lines changed or deleted 610 lines changed or added

This html diff was produced by rfcdiff 1.46. The latest version is available from http://tools.ietf.org/tools/rfcdiff/