--- 1/draft-ietf-bmwg-evpntest-06.txt 2021-02-02 03:13:10.027521272 -0800
+++ 2/draft-ietf-bmwg-evpntest-07.txt 2021-02-02 03:13:10.055521634 -0800
@@ -1,18 +1,18 @@
Internet Engineering Task Force S. Jacob, Ed.
Internet-Draft K. Tiruveedhula
Intended status: Informational Juniper Networks
-Expires: February 8, 2021 August 7, 2020
+Expires: August 6, 2021 February 2, 2021
Benchmarking Methodology for EVPN and PBB-EVPN
- draft-ietf-bmwg-evpntest-06
+ draft-ietf-bmwg-evpntest-07
Abstract
This document defines methodologies for benchmarking EVPN and PBB-
EVPN performance. EVPN is defined in RFC 7432, and is being deployed
in Service Provider networks. Specifically, this document defines
the methodologies for benchmarking EVPN/PBB-EVPN convergence, data
plane performance, and control plane performance.
Status of This Memo
@@ -23,25 +23,25 @@
Internet-Drafts are working documents of the Internet Engineering
Task Force (IETF). Note that other groups may also distribute
working documents as Internet-Drafts. The list of current Internet-
Drafts is at https://datatracker.ietf.org/drafts/current/.
Internet-Drafts are draft documents valid for a maximum of six months
and may be updated, replaced, or obsoleted by other documents at any
time. It is inappropriate to use Internet-Drafts as reference
material or to cite them other than as "work in progress."
- This Internet-Draft will expire on February 8, 2021.
+ This Internet-Draft will expire on August 6, 2021.
Copyright Notice
- Copyright (c) 2020 IETF Trust and the persons identified as the
+ Copyright (c) 2021 IETF Trust and the persons identified as the
document authors. All rights reserved.
This document is subject to BCP 78 and the IETF Trust's Legal
Provisions Relating to IETF Documents
(https://trustee.ietf.org/license-info) in effect on the date of
publication of this document. Please review these documents
carefully, as they describe your rights and restrictions with respect
to this document. Code Components extracted from this document must
include Simplified BSD License text as described in Section 4.e of
the Trust Legal Provisions and are provided without warranty as
@@ -165,21 +165,21 @@
Single-Active Redundancy Mode: When a single PE (among all the PEs
attached to an Ethernet segment) is the only PE allowed to forward
traffic to/from a given Ethernet segment for a given VLAN, then that
Ethernet segment is defined to be operating in Single-Active
redundancy mode.
2. Test Topology
There are five routers in the Test setup. SHPE3, RR/P, MHPE1 and
MHPE2 emulating a service provider network. CE is a customer device
- connected to MHPE1 and MHPE2; it is configured with bridge domains in
+ connected to MHPE1 and MHPE2. it is configured with bridge domains in
multiple VLANS. The traffic generator is connected to the CE and
SHPE3. The MHPE1 acts as DUT. The traffic generator will be used as
sender and receiver of traffic. The test measurements are taken from
the DUT. MHPE1 and MHPE2 are multi-homed routers connected to CE
running single active mode. The traffic generator will be generating
traffic at 10% of the line rate.
+----------------+ +---------------------------+
| | | |
| | |Traffic Generator sender/ |
@@ -289,91 +289,94 @@
vlans are configured on MHPE1,MHPE2,SHPE3. traffic generator is
connected to CE. the traffic generator acts as sender or receiver of
traffic.
Depending up on the test scenarios the traffic generators will be
used to generate uni directional or bi directional flows.
The above configuration will be serving as the base configuration for
all test cases.
+ The X is used as variable to denote scale factor of the testing
+ parameters.It must be in the multiples of 100.
+
3. Test Cases for EVPN Benchmarking
3.1. Data Plane MAC Learning
Objective:
Measure the time taken to learn the Data Plane MAC in DUT.
Topology : Topology 1
Procedure:
The data plane MAC learning can be measured using the parameters
defined in RFC 2889 section 5.8.
Confirm the DUT is up and running with EVPN.
- Traffic generator connected to CE must send frames with "X" different
+ Traffic generator connected to CE must send frames with X different
source and destination MAC address for one vlan, the same vlan must
be present in all the devices except RR.
- Send "X" unicast frames from CE to MHPE1(DUT) for one EVPN instance
+ Send X unicast frames from CE to MHPE1(DUT) for one EVPN instance
working in SA mode.
- The DUT will learn these "X" MAC in data plane.
+ The DUT will learn these X MAC in data plane.
Measurement :
- Measure the time taken to learn "X" MAC locally in DUT evpn MAC
- table. The data plane measurement is taken by considering DUT as
- black box. The range of MAC are known from traffic generator, the
- same must be learned in DUT, the time taken to learn "X" MAC is
- measured. The measurement is carried out using external server which
- polls the DUT using automated scripts.
+ Measure the time taken to learn X MAC locally in DUT evpn MAC table.
+ The data plane measurement is taken by considering DUT as black box.
+ The range of MAC are known from traffic generator, the same must be
+ learned in DUT, the time taken to learn X MAC is measured. The
+ measurement is carried out using external server which polls the DUT
+ using automated scripts.
- The test is repeated for "N" times and the values are collected. The
+ The test is repeated for N times and the values are collected. The
MAC learning rate is calculated by averaging the values obtained from
- "N" samples. "N" is an arbitrary number to get a sufficient sample.
- The time measured for each sample is denoted by T1,T2...Tn.
+ N samples. N is an arbitrary number to get a sufficient sample. The
+ time measured for each sample is denoted by T1,T2...Tn.
MAC learning rate = (T1+T2+..Tn)/N
3.2. Control Plane MAC Learning
Objective:
Measure the time taken to learn the control plane MAC.
Topology : Topology 1
Procedure:
Confirm the DUT is up and running with EVPN.
- Traffic generator connected to SHPE3 must send frames with "X"
+ Traffic generator connected to SHPE3 must send frames with X
different source and destination MAC address for one vlan, the same
vlan must be present in all the devices except RR.
Ensure the frames must be destined to one EVPN instance.
- The DUT will learn these "X" MAC in control plane.
+ The DUT will learn these X MAC in control plane.
Measurement :
- Measure the time taken by the DUT to learn the "X" MAC in the data
- plane. The test is repeated for "N" times and the values are
+ Measure the time taken by the DUT to learn the X MAC in the data
+ plane. The test is repeated for N times and the values are
collected. The remote MAC learning rate is calculated by averaging
- the values obtained from "N" samples. "N" is an arbitrary number to
- get a sufficient sample. The time measured for each sample is
- denoted by T1,T2...Tn. The measurement is carried out using external
- server which polls the DUT using automated scripts.
+ the values obtained from N samples. N is an arbitrary number to get
+ a sufficient sample. The time measured for each sample is denoted by
+ T1,T2...Tn. The measurement is carried out using external server
+ which polls the DUT using automated scripts.
MAC learning rate = (T1+T2+..Tn)/N
3.3. MAC Flush-Local Link Failure and Relearning
Objective:
Measure the time taken to flush the Data Plane MAC and the time taken
to relearn the same amount of MAC.
@@ -385,31 +388,31 @@
Send X frames with X different source and destination MAC addresses
to DUT from CE using traffic generator for one vlan.
Ensure the DUT learns all X MAC addresses in data plane.
Fail the DUT-CE link and measure the time taken to flush these X MAC
from the EVPN MAC table.
Bring up the link which was made Down(the link between DUT and CE).
- Measure time taken by the DUT to relearn these "X" MAC.
+ Measure time taken by the DUT to relearn these X MAC.
The DUT and MHPE2 are running SA mode.
Measurement :
Measure the time taken for flushing these X MAC addresses. Measure
the time taken to relearn these X MAC in DUT. The test is repeated
- for "N" times and the values are collected. The flush and the
- relearning time is calculated by averaging the values obtained by "N"
- samples. "N" is an arbitrary number to get a sufficient sample. The
+ for N times and the values are collected. The flush and the
+ relearning time is calculated by averaging the values obtained by N
+ samples. N is an arbitrary number to get a sufficient sample. The
time measured for each sample is denoted by T1,T2...Tn. The
measurement is carried out using external server which polls the DUT
using automated scripts.
Flush rate = (T1+T2+..Tn)/N
Relearning rate = (T1+T2+..Tn)/N
3.4. MAC Flush-Remote Link Failure and Relearning.
@@ -430,33 +433,33 @@
Bring down the link between SHPE3 and traffic generator.
SHPE3 will withdraw the routes from DUT due to link failure.
Measure the time taken to flush the DUT EVPN MAC table. The DUT and
MHPE2 are running SA mode.
Bring up the link which was made Down(the link between SHPE3 and
traffic generator).
- Measure time taken by the DUT to relearn these "X" MAC from control
+ Measure time taken by the DUT to relearn these X MAC from control
plane.
Measurement :
Measure the time taken to flush X remote MAC from EVPN MAC table of
the DUT. Measure the time taken to relearn these X MAC in DUT. The
- test is repeated for "N" times and the values are collected. The
- flush rate is calculated by averaging the values obtained by "N"
- samples. "N" is an arbitrary number to get a sufficient sample. The
- time measured for each sample is denoted by T1,T2...Tn. The
- measurement is carried out using external server which polls the DUT
- using automated scripts.
+ test is repeated for N times and the values are collected. The flush
+ rate is calculated by averaging the values obtained by N samples. N
+ is an arbitrary number to get a sufficient sample. The time measured
+ for each sample is denoted by T1,T2...Tn. The measurement is carried
+ out using external server which polls the DUT using automated
+ scripts.
Flush rate = (T1+T2+..Tn)/N
Relearning rate = (T1+T2+..Tn)/N
3.5. MAC Aging
Objective:
To measure the MAC aging time.
@@ -478,26 +481,25 @@
timers for aging.
Measure the time taken to flush X MAC from DUT EVPN MAC table due to
aging.
The DUT and MHPE2 are running SA mode.
Measurement :
Measure the time taken to flush X MAC addresses due to aging. The
- test is repeated for "N" times and the values are collected. The
- aging is calculated by averaging the values obtained by "N" samples.
- "N" is an arbitrary number to get a sufficient sample. The time
- measured for each sample is denoted by T1,T2...Tn. The measurement
- is carried out using external server which polls the DUT using
- automated scripts.
+ test is repeated for N times and the values are collected. The aging
+ is calculated by averaging the values obtained by N samples. N is an
+ arbitrary number to get a sufficient sample. The time measured for
+ each sample is denoted by T1,T2...Tn. The measurement is carried out
+ using external server which polls the DUT using automated scripts.
Aging time for X MAC in sec = (T1+T2+..Tn)/N
3.6. Remote MAC Aging
Objective:
Measure the control plane learned MAC aging time.
Topology : Topology 1
@@ -516,26 +519,26 @@
timers for aging.
Measure the time taken to flush X MAC from DUT EVPN MAC table due to
aging.
The DUT and MHPE2 are running SA mode.
Measurement :
Measure the time taken to flush X remote MAC learned in DUT EVPN MAC
- table due to aging. The test is repeated for "N" times and the
- values are collected. The aging is calculated by averaging the
- values obtained by "N" samples. "N" is an arbitrary number to get a
- sufficient sample. The time measured for each sample is denoted by
- T1,T2...Tn. The measurement is carried out using external server
- which polls the DUT using automated scripts.
+ table due to aging. The test is repeated for N times and the values
+ are collected. The aging is calculated by averaging the values
+ obtained by N samples. N is an arbitrary number to get a sufficient
+ sample. The time measured for each sample is denoted by T1,T2...Tn.
+ The measurement is carried out using external server which polls the
+ DUT using automated scripts.
Aging time for X MAC in sec = (T1+T2+..Tn)/N
3.7. Control and Data plane MAC Learning
Objective:
To record the time taken to learn both local and remote MAC.
Topology : Topology 1
@@ -553,23 +556,23 @@
The source and destination addresses of flows must be complimentary
to have unicast flows.
Measure the time taken by the DUT to learn 2X in EVPN MAC table.
DUT and MHPE2 are running in SA mode.
Measurement :
Measure the time taken to learn 2X MAC addresses in DUT EVPN MAC
- table. The test is repeated for "N" times and the values are
+ table. The test is repeated for N times and the values are
collected. The MAC learning time is calculated by averaging the
- values obtained by "N" samples. "N" is an arbitrary number to get a
+ values obtained by N samples. N is an arbitrary number to get a
sufficient sample. The time measured for each sample is denoted by
T1,T2...Tn. The measurement is carried out using external server
which polls the DUT using automated scripts
MAC learning rate = (T1+T2+..Tn)/N
3.8. High Availability.
Objective:
@@ -593,27 +596,27 @@
Ensure the DUT learn 2X MAC.
Then do a routing engine fail-over.
Measurement :
The expectation of the test is 0 traffic loss with no change in the
DF role. DUT should not withdraw any routes. But in cases where the
DUT is not property synchronized between master and standby, due to
that packet loss are observed. In that scenario the packet loss is
- measured.The test is repeated for "N" times and the values are
+ measured.The test is repeated for N times and the values are
collected. The packet loss is calculated by averaging the values
- obtained by "N" samples. "N" is an arbitrary number to get a
- sufficient sample. The time measured for each sample is denoted by
- T1,T2...Tn. The measurement is carried out using external server
- which polls the DUT using automated scripts to ensure the DUT learned
- 2X MAC. The packet drop is measured using traffic generator.
+ obtained by N samples. N is an arbitrary number to get a sufficient
+ sample. The time measured for each sample is denoted by T1,T2...Tn.
+ The measurement is carried out using external server which polls the
+ DUT using automated scripts to ensure the DUT learned 2X MAC. The
+ packet drop is measured using traffic generator.
Packet loss in sec with 2X MAC addresses = (T1+T2+..Tn)/N
3.9. ARP/ND Scale
Measure the DUT scaling limit of ARP/ND.
Objective:
Measure the ARP/ND scale of the DUT.
@@ -633,23 +636,23 @@
provide edge routers which have same EVPN configurations.
The value of X must be increased at a incremental value of 5% of X,
till the limit is reached. The limit is where the DUT cant learn any
more type 2 MAC+ip/MAC+ipv6.The test must be separately conducted for
arp and ND.
Measurement :
Measure the scale limit of type 2 MAC+ip/MAC+ipv6 route which DUT can
- learn. The test is repeated for "N" times and the values are
+ learn. The test is repeated for N times and the values are
collected. The scale limit is calculated by averaging the values
- obtained by "N" samples for both MAC+ip and MAC+ipv6. "N" is an
+ obtained by N samples for both MAC+ip and MAC+ipv6. N is an
arbitrary number to get a sufficient sample. The scale value
obtained by each sample be v1,v2..vn. The measurement is carried out
using external server which polls the DUT using automated scripts to
find the scale limit of MAC+ipv4/MAC+ipv6.
Scale limit for MAC+ip = (v1+v2+..vn)/N
Scale limit for MAC+ipv6 = (v1+v2+..vn)/N
3.10. Scaling of Services
@@ -657,23 +660,23 @@
Objective:
Measure the scale of EVPN instances that a DUT can hold.
Topology : Topology 1
Procedure:
Confirm the DUT is up and running with EVPN.
- The DUT, MHPE2 and SHPE3 are scaled to "N" EVI.
+ The DUT, MHPE2 and SHPE3 are scaled to N EVI.
- Ensure routes received from MHPE2 and SHPE3 for "N" EVI in the DUT.
+ Ensure routes received from MHPE2 and SHPE3 for N EVI in the DUT.
Then increment the scale of N by 5% of N till the limit is reached.
The limit is where the DUT cant learn any EVPN routes from its peers.
Measurement :
There should not be any loss of route types 1,2,3 and 4 in DUT. DUT
must relearn all type 1, 2, 3 and 4 from remote routers. The DUT
must be subjected to various values of N to find the optimal scale
@@ -710,23 +712,23 @@
Then clear the BGP neighbors in the DUT.
Once the BGP session is in established state in DUT.
Measure the time taken to learn 2X MAC address in DUT MAC table.
Measurement :
The DUT must learn 2X MAC addresses. Measure the time taken to learn
- 2X MAC in DUT. The test is repeated for "N" times and the values are
+ 2X MAC in DUT. The test is repeated for N times and the values are
collected. The convergence time is calculated by averaging the
- values obtained by "N" samples. "N" is an arbitrary number to get a
+ values obtained by N samples. N is an arbitrary number to get a
sufficient sample.The time measured for each sample is denoted by
T1,T2...Tn. The measurement is carried out using external server
which polls the DUT using automated scripts.
Time taken to learn 2X MAC in DUT = (T1+T2+..Tn)/N
3.12. SOAK Test.
Objective:
@@ -776,74 +779,74 @@
Objective:
Measure the time taken to learn the Data Plane MAC in DUT.
Topology : Topology 1
Procedure:
Confirm the DUT is up and running with PBB-EVPN.
- Traffic generator connected to CE must send frames with "X" different
+ Traffic generator connected to CE must send frames with X different
source and destination MAC address for one vlan, the same vlan must
be present in all the devices except RR.
- Send "X" unicast frames from CE to MHPE1(DUT) for one PBB-EVPN
- instance working in SA mode.
+ Send X unicast frames from CE to MHPE1(DUT) for one PBB-EVPN instance
+ working in SA mode.
- The DUT will learn these "X" MAC in data plane.
+ The DUT will learn these X MAC in data plane.
Measurement :
- Measure the time taken to learn "X" MAC locally in DUT PBB-EVPN MAC
+ Measure the time taken to learn X MAC locally in DUT PBB-EVPN MAC
table. The data plane measurement is taken by considering DUT as
black box. The range of MAC are known from traffic generator,the
- same must be learned in DUT, the time taken to learn "X" MAC is
+ same must be learned in DUT, the time taken to learn X MAC is
measured.The measurement is carried out using external server which
polls the DUT using automated scripts.
- The test is repeated for "N" times and the values are collected. The
+ The test is repeated for N times and the values are collected. The
MAC learning rate is calculated by averaging the values obtained from
- "N" samples. "N" is an arbitrary number to get a sufficient sample.
- The time measured for each sample is denoted by T1,T2...Tn.
+ N samples. N is an arbitrary number to get a sufficient sample. The
+ time measured for each sample is denoted by T1,T2...Tn.
MAC learning rate = (T1+T2+..Tn)/N
4.2. Data Plane Remote MAC Learning
Objective:
To Record the time taken to learn the remote MAC.
Topology : Topology 1
Procedure:
Confirm the DUT is up and running with PBB-EVPN.
- Traffic generator connected to SHPE3 must send frames with "X"
+ Traffic generator connected to SHPE3 must send frames with X
different source and destination MAC address for one vlan, the same
vlan must be present in all the devices except RR.
Ensure the frames must be destined to one PBB-EVPN instance.
- The DUT will learn these "X" MAC in data plane.
+ The DUT will learn these X MAC in data plane.
Measurement :
- Measure the time taken by the DUT to learn the "X" MAC in the data
- plane. The test is repeated for "N" times and the values are
+ Measure the time taken by the DUT to learn the X MAC in the data
+ plane. The test is repeated for N times and the values are
collected. The remote MAC learning rate is calculated by averaging
- the values obtained from "N" samples. "N" is an arbitrary number to
- get a sufficient sample. The time measured for each sample is
- denoted by T1,T2...Tn. The measurement is carried out using external
- server which polls the DUT using automated scripts.
+ the values obtained from N samples. N is an arbitrary number to get
+ a sufficient sample. The time measured for each sample is denoted by
+ T1,T2...Tn. The measurement is carried out using external server
+ which polls the DUT using automated scripts.
MAC learning rate = (T1+T2+..Tn)/N
4.3. MAC Flush-Local Link Failure
Objective:
Measure the time taken to flush the locally learned MAC and the time
taken to relearn the same amount of MAC.
@@ -855,31 +858,31 @@
Send X frames with X different source and destination MAC addresses
to DUT from CE using traffic generator for one vlan.
Ensure the DUT learns all X MAC addresses in data plane.
Fail the DUT-CE link and measure the time taken to flush these X MAC
from the PBB-EVPN MAC table.
Bring up the link which was made Down(the link between DUT and
- CE).Measure time taken by the DUT to relearn these "X" MAC.
+ CE).Measure time taken by the DUT to relearn these X MAC.
The DUT and MHPE2 are running SA mode.
Measurement :
Measure the time taken for flushing these X MAC addresses. Measure
the time taken to relearn these X MAC in DUT. The test is repeated
- for "N" times and the values are collected. The flush and the
- relearning time is calculated by averaging the values obtained by "N"
- samples. "N" is an arbitrary number to get a sufficient sample. The
+ for N times and the values are collected. The flush and the
+ relearning time is calculated by averaging the values obtained by N
+ samples. N is an arbitrary number to get a sufficient sample. The
time measured for each sample is denoted by T1,T2...Tn. The
measurement is carried out using external server which polls the DUT
using automated scripts.
Flush rate = (T1+T2+..Tn)/N
Relearning rate = (T1+T2+..Tn)/N
4.4. MAC Flush-Remote Link Failure
@@ -898,29 +901,29 @@
to DUT from SHPE3 using traffic generator for one vlan.
Bring down the link between SHPE3 and traffic generator.
Measure the time taken to flush the DUT PBB-EVPN MAC table. The DUT
and MHPE2 are running SA mode.
Bring up the link which was made Down(the link between SHPE3 and
traffic generator).
- Measure time taken by the DUT to relearn these "X" MAC
+ Measure time taken by the DUT to relearn these X MAC
Measurement :
Measure the time taken to flush X remote MAC from PBB-EVPN MAC table
of the DUT. Measure the time taken to relearn these X MAC in DUT.
- The test is repeated for "N" times and the values are collected. The
- flush rate is calculated by averaging the values obtained by "N"
- samples. "N" is an arbitrary number to get a sufficient sample. The
+ The test is repeated for N times and the values are collected. The
+ flush rate is calculated by averaging the values obtained by N
+ samples. N is an arbitrary number to get a sufficient sample. The
time measured for each sample is denoted by T1,T2...Tn. The
measurement is carried out using external server which polls the DUT
using automated scripts.
Flush rate = (T1+T2+..Tn)/N
Relearning rate = (T1+T2+..Tn)/N
4.5. MAC Aging
@@ -945,26 +948,25 @@
timers for aging.
Measure the time taken to flush X MAC from DUT PBB-EVPN MAC table due
to aging.
The DUT and MHPE2 are running SA mode.
Measurement :
Measure the time taken to flush X MAC addresses due to aging. The
- test is repeated for "N" times and the values are collected. The
- aging is calculated averaging the values obtained by "N" samples.
- "N" is an arbitrary number to get a sufficient sample. The time
- measured for each sample is denoted by T1,T2...Tn. The measurement
- is carried out using external server which polls the DUT using
- automated scripts.
+ test is repeated for N times and the values are collected. The aging
+ is calculated averaging the values obtained by N samples. N is an
+ arbitrary number to get a sufficient sample. The time measured for
+ each sample is denoted by T1,T2...Tn. The measurement is carried out
+ using external server which polls the DUT using automated scripts.
Aging time for X MAC in sec = (T1+T2+..Tn)/N
4.6. Remote MAC Aging.
Objective:
Measure the remote MAC aging time.
Topology : Topology 1
@@ -983,26 +986,26 @@
timers for aging.
Measure the time taken to flush X MAC from DUT PBB-EVPN MAC table due
to aging.
The DUT and MHPE2 are running SA mode.
Measurement :
Measure the time taken to flush X remote MAC learned in DUT EVPN MAC
- table due to aging. The test is repeated for "N" times and the
- values are collected. The aging is calculated by averaging the
- values obtained by "N" samples. "N" is an arbitrary number to get a
- sufficient sample. The time measured for each sample is denoted by
- T1,T2...Tn. The measurement is carried out using external server
- which polls the DUT using automated scripts.
+ table due to aging. The test is repeated for N times and the values
+ are collected. The aging is calculated by averaging the values
+ obtained by N samples. N is an arbitrary number to get a sufficient
+ sample. The time measured for each sample is denoted by T1,T2...Tn.
+ The measurement is carried out using external server which polls the
+ DUT using automated scripts.
Aging time for X MAC in sec = (T1+T2+..Tn)/N
4.7. Local and Remote MAC Learning
Objective:
Measure the time taken to learn both local and remote MAC.
Topology : Topology 1
@@ -1020,23 +1023,23 @@
The source and destination addresses of flows must be complimentary
to have unicast flows.
Measure the time taken by the DUT to learn 2X in PBB-EVPN MAC table.
DUT and MHPE2 are running in SA mode.
Measurement :
Measure the time taken to learn 2X MAC addresses in DUT PBB-EVPN MAC
- table. The test is repeated for "N" times and the values are
+ table. The test is repeated for N times and the values are
collected. The MAC learning time is calculated by averaging the
- values obtained by "N" samples. "N" is an arbitrary number to get a
+ values obtained by N samples. N is an arbitrary number to get a
sufficient sample. The time measured for each sample is denoted by
T1,T2...Tn. The measurement is carried out using external server
which polls the DUT using automated scripts
MAC learning rate = (T1+T2+..Tn)/N
4.8. High Availability
Objective:
@@ -1060,46 +1063,45 @@
Ensure the DUT learn 2X MAC.
Then do a routing engine fail-over.
Measurement :
The expectation of the test is 0 traffic loss with no change in the
DF role. DUT should not withdraw any routes.But in cases where the
DUT is not property synchronized between master and standby, due to
that packet loss are observed. In that scenario the packet loss is
- measured. The test is repeated for "N" times and the values are
+ measured. The test is repeated for N times and the values are
collected. The packet loss is calculated by averaging the values
- obtained by "N" samples. "N" is an arbitrary number to get a
- sufficient sample. The time measured for each sample is denoted by
- T1,T2...Tn. The measurement is carried out using external server
- which polls the DUT using automated scripts to ensure the DUT learned
- 2X MAC. The packet drop is measured using traffic generator.
+ obtained by N samples. N is an arbitrary number to get a sufficient
+ sample. The time measured for each sample is denoted by T1,T2...Tn.
+ The measurement is carried out using external server which polls the
+ DUT using automated scripts to ensure the DUT learned 2X MAC. The
+ packet drop is measured using traffic generator.
Packet loss in sec with 2X MAC addresses = (T1+T2+..Tn)/N
4.9. Scale
Objective:
Measure the scale limit of DUT for PBB-EVPN.
Topology : Topology 1
Procedure:
Confirm the DUT is up and running with PBB-EVPN.
- The DUT,MHPE2 and SHPE3 are scaled to "N" PBB-EVI.
+ The DUT,MHPE2 and SHPE3 are scaled to N PBB-EVI.
- Ensure routes received from MHPE2 and SHPE3 for "N" PBB-EVI in the
- DUT.
+ Ensure routes received from MHPE2 and SHPE3 for N PBB-EVI in the DUT.
Then increment the scale of N by 5% of N till the limit is reached.
The limit is where the DUT cant learn any EVPN routes from its peers.
Measurement :
There should not be any loss of route types 2,3 and 4 in DUT. DUT
must relearn all type 2, 3 and 4 from remote routers. The DUT must
be subjected to various values of N to find the optimal scale limit.
@@ -1136,23 +1138,23 @@
Then clear the BGP neighbors in the DUT.
Once the BGP session is in established state in DUT.
Measure the time taken to learn 2X MAC address in DUT MAC table.
Measurement :
The DUT must learn 2X MAC addresses. Measure the time taken to learn
- 2X MAC in DUT. The test is repeated for "N" times and the values are
+ 2X MAC in DUT. The test is repeated for N times and the values are
collected. The convergence time is calculated by averaging the
- values obtained by "N" samples. "N" is an arbitrary number to get a
+ values obtained by N samples. N is an arbitrary number to get a
sufficient sample.The time measured for each sample is denoted by
T1,T2...Tn. The measurement is carried out using external server
which polls the DUT using automated scripts.
Time taken to learn 2X MAC in DUT = (T1+T2+..Tn)/N
4.11. Soak Test
Objective: