draft-ietf-bmwg-evpntest-02.txt   draft-ietf-bmwg-evpntest-03.txt 
Internet Engineering Task Force S. Jacob, Ed. Internet Engineering Task Force S. Jacob, Ed.
Internet-Draft K. Tiruveedhula Internet-Draft K. Tiruveedhula
Intended status: Standards Track Juniper Networks Intended status: Standards Track Juniper Networks
Expires: November 3, 2019 May 2, 2019 Expires: February 22, 2020 August 21, 2019
Benchmarking Methodology for EVPN and PBB-EVPN Benchmarking Methodology for EVPN and PBB-EVPN
draft-ietf-bmwg-evpntest-02 draft-ietf-bmwg-evpntest-03
Abstract Abstract
This document defines methodologies for benchmarking EVPN and PBB- This document defines methodologies for benchmarking EVPN and PBB-
EVPN performance. EVPN is defined in RFC 7432, and is being deployed EVPN performance. EVPN is defined in RFC 7432, and is being deployed
in Service Provider networks. Specifically this document defines the in Service Provider networks. Specifically this document defines the
methodologies for benchmarking EVPN/PBB-EVPN convergence, data plane methodologies for benchmarking EVPN/PBB-EVPN convergence, data plane
performance, and control plane performance. performance, and control plane performance.
Status of This Memo Status of This Memo
skipping to change at page 1, line 34 skipping to change at page 1, line 34
Internet-Drafts are working documents of the Internet Engineering Internet-Drafts are working documents of the Internet Engineering
Task Force (IETF). Note that other groups may also distribute Task Force (IETF). Note that other groups may also distribute
working documents as Internet-Drafts. The list of current Internet- working documents as Internet-Drafts. The list of current Internet-
Drafts is at https://datatracker.ietf.org/drafts/current/. Drafts is at https://datatracker.ietf.org/drafts/current/.
Internet-Drafts are draft documents valid for a maximum of six months Internet-Drafts are draft documents valid for a maximum of six months
and may be updated, replaced, or obsoleted by other documents at any and may be updated, replaced, or obsoleted by other documents at any
time. It is inappropriate to use Internet-Drafts as reference time. It is inappropriate to use Internet-Drafts as reference
material or to cite them other than as "work in progress." material or to cite them other than as "work in progress."
This Internet-Draft will expire on November 3, 2019. This Internet-Draft will expire on February 22, 2020.
Copyright Notice Copyright Notice
Copyright (c) 2019 IETF Trust and the persons identified as the Copyright (c) 2019 IETF Trust and the persons identified as the
document authors. All rights reserved. document authors. All rights reserved.
This document is subject to BCP 78 and the IETF Trust's Legal This document is subject to BCP 78 and the IETF Trust's Legal
Provisions Relating to IETF Documents Provisions Relating to IETF Documents
(https://trustee.ietf.org/license-info) in effect on the date of (https://trustee.ietf.org/license-info) in effect on the date of
publication of this document. Please review these documents publication of this document. Please review these documents
carefully, as they describe your rights and restrictions with respect carefully, as they describe your rights and restrictions with respect
to this document. Code Components extracted from this document must to this document. Code Components extracted from this document must
include Simplified BSD License text as described in Section 4.e of include Simplified BSD License text as described in Section 4.e of
the Trust Legal Provisions and are provided without warranty as the Trust Legal Provisions and are provided without warranty as
described in the Simplified BSD License. described in the Simplified BSD License.
Table of Contents Table of Contents
1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . 3 1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . 2
1.1. Requirements Language . . . . . . . . . . . . . . . . . . 3 1.1. Requirements Language . . . . . . . . . . . . . . . . . . 3
1.2. Terminologies . . . . . . . . . . . . . . . . . . . . . . 3 1.2. Terminologies . . . . . . . . . . . . . . . . . . . . . . 3
2. Test Topology . . . . . . . . . . . . . . . . . . . . . . . . 4 2. Test Topology . . . . . . . . . . . . . . . . . . . . . . . . 3
3. Test Cases . . . . . . . . . . . . . . . . . . . . . . . . . 7 3. Test Cases for EVPN Benchmarking . . . . . . . . . . . . . . 6
3.1. How long it takes to learn local mac address in EVPN . . 7 3.1. Local MAC Learning . . . . . . . . . . . . . . . . . . . 6
3.2. How long it takes to learn local mac address in PBB EVPN 8 3.2. Remote MAC Learning . . . . . . . . . . . . . . . . . . . 7
3.3. How long it takes to learn the remote macs . . . . . . . 8 3.3. MAC Flush due to local link failure and Relearning . . . 7
3.4. PBB-EVPN How long it takes to learn the mac from remote 3.4. MAC Flush due to remote link failure. . . . . . . . . . . 8
peer . . . . . . . . . . . . . . . . . . . . . . . . . . 9 3.5. MAC Aging . . . . . . . . . . . . . . . . . . . . . . . . 8
3.5. How long it takes to flush the local macs due to CE link 3.6. Remote Mac Aging . . . . . . . . . . . . . . . . . . . . 9
flap and measure the relearning rate of MACs . . . . . . 9 3.7. Local and Remote MAC Learning . . . . . . . . . . . . . . 9
3.6. PBB-EVPN how long it takes to flush the local macs and 3.8. High Availability. . . . . . . . . . . . . . . . . . . . 10
measure the relearning rate of macs during PE-CE link 3.9. ARP/ND Scale . . . . . . . . . . . . . . . . . . . . . . 11
flap . . . . . . . . . . . . . . . . . . . . . . . . . . 10 3.10. Scaling of Services . . . . . . . . . . . . . . . . . . . 11
3.7. How long it takes to flush the remote macs, due to remote 3.11. Scale Convergence . . . . . . . . . . . . . . . . . . . . 12
link failure. . . . . . . . . . . . . . . . . . . . . . . 11 3.12. SOAK Test. . . . . . . . . . . . . . . . . . . . . . . . 12
3.8. PBB-EVPN How long it takes to flush the remote macs due 4. Test Cases for PBB-EVPN Benchmarking . . . . . . . . . . . . 13
to remote link failure . . . . . . . . . . . . . . . . . 11 4.1. Local MAC Learning . . . . . . . . . . . . . . . . . . . 13
3.9. To measure the MAC aging time. . . . . . . . . . . . . . 12 4.2. Remote Mac Learning . . . . . . . . . . . . . . . . . . . 13
3.10. PBB-EVPN To measure the MAC aging time. . . . . . . . . . 12 4.3. MAC Flush due to link failure . . . . . . . . . . . . . . 14
3.11. How long it takes to age out the remote macs . . . . . . 13 4.4. MAC Flush due to remote Failure . . . . . . . . . . . . . 14
3.12. PBB-EVPN How long it takes to age out the remote macs. . 13 4.5. MAC aging . . . . . . . . . . . . . . . . . . . . . . . . 15
3.13. How long it takes to learn both local and remote macs. . 14 4.6. Remote MAC Aging. . . . . . . . . . . . . . . . . . . . . 16
3.14. PBB-EVPN How long it takes to learn both local and remote 4.7. Local and Remote MAC Learning . . . . . . . . . . . . . . 16
macs . . . . . . . . . . . . . . . . . . . . . . . . . . 14 4.8. High Availability . . . . . . . . . . . . . . . . . . . . 17
4. High Availability . . . . . . . . . . . . . . . . . . . . . . 15 4.9. Scale . . . . . . . . . . . . . . . . . . . . . . . . . . 17
4.1. To Record the whether there is traffic loss due to 4.10. Scale Convergence . . . . . . . . . . . . . . . . . . . . 18
routing engine failover for redundancy test. . . . . . . 15 4.11. Soak Test . . . . . . . . . . . . . . . . . . . . . . . . 18
4.2. PBB-EVPN To Record the whether there is traffic loss due 5. Acknowledgements . . . . . . . . . . . . . . . . . . . . . . 19
to routing engine failover for redundancy test . . . . . 16 6. IANA Considerations . . . . . . . . . . . . . . . . . . . . . 19
5. ARP/ND Scale . . . . . . . . . . . . . . . . . . . . . . . . 16 7. Security Considerations . . . . . . . . . . . . . . . . . . . 19
5.1. To find ARP/ND scale . . . . . . . . . . . . . . . . . . 16 8. References . . . . . . . . . . . . . . . . . . . . . . . . . 19
6. Scale . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17 8.1. Normative References . . . . . . . . . . . . . . . . . . 19
6.1. To Measure the scale limit of DUT with trigger (Scale 8.2. Informative References . . . . . . . . . . . . . . . . . 20
without traffic) . . . . . . . . . . . . . . . . . . . . 17 Appendix A. Appendix . . . . . . . . . . . . . . . . . . . . . . 20
6.2. PBB-EVPN To measure the scale limit with trigger. . . . . 17 Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . . 20
6.3. To measure the convergence time of DUT with scale and
traffic. . . . . . . . . . . . . . . . . . . . . . . . . 18
6.4. .PBB-EVPN To measure the convergence time of DUT with
scale and traffic. . . . . . . . . . . . . . . . . . . . 18
7. SOAK Test . . . . . . . . . . . . . . . . . . . . . . . . . . 19
7.1. To Measure the stability of the DUT with scale and
traffic. . . . . . . . . . . . . . . . . . . . . . . . . 19
7.2. PBB-EVPN to measure the stability of DUT with scale and
traffic. . . . . . . . . . . . . . . . . . . . . . . . . 20
8. Acknowledgements . . . . . . . . . . . . . . . . . . . . . . 20
9. IANA Considerations . . . . . . . . . . . . . . . . . . . . . 20
10. Security Considerations . . . . . . . . . . . . . . . . . . . 20
11. References . . . . . . . . . . . . . . . . . . . . . . . . . 20
11.1. Normative References . . . . . . . . . . . . . . . . . . 21
11.2. Informative References . . . . . . . . . . . . . . . . . 21
Appendix A. Appendix . . . . . . . . . . . . . . . . . . . . . . 21
Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . . 21
1. Introduction 1. Introduction
EVPN is defined in RFC 7432, and describes BGP MPLS- based Ethernet EVPN is defined in RFC 7432, and describes BGP MPLS- based Ethernet
VPNs (EVPN). PBB-EVPN is defined in RFC 7623, discusses how Ethernet VPNs (EVPN). PBB-EVPN is defined in RFC 7623, discusses how Ethernet
Provider backbone Bridging can be combined with EVPNs to provide a Provider backbone Bridging can be combined with EVPNs to provide a
new/combined solution. This draft defines methodologies that can be new/combined solution. This draft defines methodologies that can be
used to benchmark both RFC 7432 and RFC 7623 solutions. Further, used to benchmark both RFC 7432 and RFC 7623 solutions. Further,
this draft provides methodologies for benchmarking the performance of this draft provides methodologies for benchmarking the performance of
EVPN data and control planes, MAC learning, MAC flushing, MAC ageing, EVPN data and control planes, MAC learning, MAC flushing, MAC ageing,
skipping to change at page 4, line 20 skipping to change at page 4, line 5
DF Designated Forwarder. DF Designated Forwarder.
ESI Ethernet Segment Identifier. ESI Ethernet Segment Identifier.
2. Test Topology 2. Test Topology
EVPN/PBB-EVPN Services running on SHPE3, MHPE1 and MHPE2 in Single EVPN/PBB-EVPN Services running on SHPE3, MHPE1 and MHPE2 in Single
Active Mode: Active Mode:
Topology Diagram | [Traffic Generator ] Router Tester traffic sender/receiver of layer 2 traffic with multiple vlan.
| [Traffic Generator ] Router Tester traffic receiver for layer 2 traffic from CE
+----------+ +----------+
| | | |
| SHPE3 |
| SHPE3 | | SHPE3 |
| |
+----------+ +----------+
| |
|Core link |Core link
+----------+ +----------+
| | | |
| RR | | RR |
| | Route Reflector/Core router | | Route Reflector/Core router
+----------+-------------| +----------+-------------|
| | | |
| Core links | | Core links |
skipping to change at page 4, line 48 skipping to change at page 4, line 31
| | | MHPE2 | | | | MHPE2 |
| DUT | | | | DUT | | |
| MHPE1 | | | | MHPE1 | | |
+----------+ +-----------+ +----------+ +-----------+
| PE-CE link | | PE-CE link |
+----------+------------ +----------+------------
| | | |
| CE | | CE |
| layer2 | | layer2 |
|bridge | |bridge |
+----------+------------ [Traffic Generator](Router Tester sending layer 2 traffic with different VLAN ) +----------+------------ [Traffic Generator](Router Tester sender/reciever of layer 2 traffic with multiple vlan)
Topology 1 Topology 1
| [Traffic Generator ] Router Tester sending layer 2 traffic.
+----------+
| |
| SHPE3 |
| SHPE3 |
+----------+
|
|Core link
+----------+
| |
| RR |
| | Route Reflector/Core router
+----------+-------------|
| |
| Core links |
+----------+ +-----------+
| | | MHPE2 |
| DUT | | |
| MHPE1 | | |
+----------+ +-----------+
| PE-CE link |
+----------+------------
| |
| CE |
| layer2 |
|bridge |
+----------+------------ [Traffic Generator](Router Tester receiver for layer 2 traffic with different vlans.)
Topology 2 Test Setup
| [Traffic Generator ] Router Tester sending layer 2 bi directional traffic sender/receiver
+----------+
| |
| SHPE3 |
| SHPE3 |
+----------+
|
|Core link
+----------+
| |
| RR |
| | Route Reflector/Core router
+----------+-------------|
| |
| Core links |
+----------+ +-----------+
| | | MHPE2 |
| DUT | | |
| MHPE1 | | |
+----------+ +-----------+
| PE-CE link |
+----------+------------
| |
| CE |
| layer2 |
|bridge |
+----------+------------ [Traffic Generator](Router Tester sending bi directional layer 2 traffic with different VLAN sender/receiver)
Topology 3 Figure 1
Topology Diagram +-----------------+---------------------+---------------------+---------------------+----------------------+-----------------------+
| | | | | | |
| | | | | | |
| | | | | | |
| | | | | | |
| Mode | | | |Receiver | |
| | Test |Traffic Direction |Sender | | |
| | | | | | |
| | | | | | |
| | | | | | |
+----------------------------------------------------------------------------------------------------------------------------------+
| | | | | | |
| | | | | SHPE3 | |
|Single Active | Local Mac | |CE | |Layer 2 traffic |
| | Learning | Uni | | | |
| | | | | | multiple MAC |
| | | | | | |
+-----------------------------------------------------------------------------------------------------------------------------------+
| | | | | | |
|Single Active | Remote MAC | | | CE |Layer 2 traffic |
| | Learning | uni | SHPE3 | | |
| | | | | |multiple MAC |
| | | | | | ++
+----------------------------------------------------------------------------------------------------------------------------------+
| | | | | | |
|Single Active | Scale Convergence | Bi | | CE/SHPE3 | |
| | | | CE/SHPE3 | |Layer 2 traffic |
| | Local& Remote | | | |multiple mac& vlans |
| | Learning | | | | |
+-----------------+---------------------+---------------------+--------------------------------------------+-----------------------+
|
++
Figure 1 Table showing Traffic pattern for various test
There are five routers in the topology. SHPE3, RR/P, MHPE1 and MHPE2 Figure 2
emulating a service provider network. CE is a customer device
Test Setup Configurations:
There are five routers in the Test setup. SHPE3, RR/P, MHPE1 and
MHPE2 emulating a service provider network. CE is a customer device
connected to MHPE1 and MHPE2, it is configured with bridge domains in connected to MHPE1 and MHPE2, it is configured with bridge domains in
different vlans. The router tester is connected to CE and SHPE3.The multiple vlans. The router tester is connected to CE and SHPE3.The
MHPE1 acts DUT.The RT will act as sender and receiver.The measurement MHPE1 acts as DUT.The RT will be used as sender and receiver of
will be taken in DUT. traffic.The measurement will be taken in DUT.
All routers except CE is configured with OSPF/IS-IS,LDP,MPLS,BGP with All routers except CE is configured with OSPF/IS-IS,LDP,MPLS,BGP with
EVPN address family. EVPN address family.
All routers except CE must have IBGP configured with RR acting as All routers except CE must have IBGP configured with RR acting as
route reflector. route reflector.
MHPE1,MHPE2,SHPE3 must be configured with "N" EVPN/PBB-EVPN instances MHPE1,MHPE2,SHPE3 must be configured with "N" EVPN/PBB-EVPN instances
depends up on the cases. depends up on the cases.
MHPE1 and MHEPE2 must be configured with ESI per vlan or ESI on IFD. MHPE1 and MHEPE2 must be configured with ESI per vlan or ESI on IFD.
MHPE1 and MHEPE2 are running Single Active mode of EVPN. MHPE1 and MHEPE2 are running Single Active mode of EVPN.
CE is acting as bridge configured with vlans that is configured on CE is acting as bridge configured with vlans that is configured on
MHPE1,MHPE2,SHPE3. MHPE1,MHPE2,SHPE3.
Depends up on the test traffic will be flowing uni directional or bi Depends up on the test traffic will be flowing uni directional or bi
directional depends on the topology mentioned above. directional depends on the test performed.
The above configuration will serve as base configuration for all the
test cases.
3. Test Cases The above configuration will be serving as the base configuration for
all test cases.
The following tests are conducted to measure the time taken to learn 3. Test Cases for EVPN Benchmarking
the "X" number of MAC's locally in EVI . The data plane learning of
MAC will happen locally from connected interface. The control plane
learning of MAC is through BGP advertisements from the remote
PE(SHPE3). The control plane learning of "X" MAC. The data plane
MAC learning can be measured using the parameters defined in RFC 2889
section 5.8.
3.1. How long it takes to learn local mac address in EVPN 3.1. Local MAC Learning
Objective: Objective:
To Record the time taken to learn the MAC address locally in DUT. To Record the time taken to learn the MAC address locally in DUT.
Topology : Topology 1 Topology : Topology 1
Procedure: Procedure:
Send "X" unicast frames from CE to MHPE1(DUT) working in SA mode with The data plane MAC learning can be measured using the parameters
"X" different source and destination address from RT. The DUT must defined in RFC 2889 section 5.8. Send "X" unicast frames from CE to
learn these "X" macs in data plane. MHPE1(DUT) working in SA mode with "X" different source and
destination address from RT. The DUT must learn these "X" macs in
data plane.
Measurement : Measurement :
Measure the time taken to learn "X" MACs in DUT evpn mac table. The Measure the time taken to learn "X" MACs in DUT evpn mac table. The
data plane measurement is taken by considering DUT as black box the data plane measurement is taken by considering DUT as black box the
range of X MAC is known from RT and the same must be learned in DUT, range of X MAC is known from RT and the same must be learned in DUT,
the time taken to learn "X" macs is measured. the time taken to learn "X" macs is measured.
Repeat these test and plot the data. The test is repeated for "N" Repeat these test and plot the data. The test is repeated for "N"
times and the values are collected. The mac learning time is times and the values are collected. The mac learning time is
calculated by averaging the values obtained from "N" samples. calculated by averaging the values obtained from "N" samples.
Mac learning in sec = (T1+T2+..Tn/N) Mac learning in sec = (T1+T2+..Tn/N)
3.2. How long it takes to learn local mac address in PBB EVPN 3.2. Remote MAC Learning
Objective:
To Record the time taken to learn the MAC address locally.
Topology : Topology 1
Procedure:
Send "X" unicast frames from CE to MHPE1(DUT) working in SA mode with
"X" different source and destination address from RT. The DUT must
learn "X" macs in data plane.
Measurement :
Measure the time taken by the DUT to learn the "X" MACs in the data
plane. The data plane measurement is taken by considering DUT as
black box the range of "X" MAC is known from RT and the same must be
learned in DUT, the time taken to learn "X" MAC is measured. Repeat
these test and plot the data. The test is repeated for "N" times and
the values are collected. The mac learning time is calculated by
averaging the values obtained from "N" samples.
Mac learning in sec = (T1+T2+..Tn/N)
3.3. How long it takes to learn the remote macs
Objective: Objective:
To Record the time taken to learn the remote macs. To Record the time taken to learn the remote macs.
Topology : Topology 2 Topology : Topology 1
Procedure: Procedure:
Send X frames with X different SA and DA to SHPE3 from RT. SHPE3 Send X frames with X different SA and DA to SHPE3 from RT. SHPE3
will advertise these locally learned macs to MHPE1 and MHPE2 via will advertise these locally learned macs to MHPE1 and MHPE2 via
control plane.Measure the time taken to learn these X MACs from control plane.Measure the time taken to learn these X MACs from
remote peer in DUT EVPN MAC address table.The DUT and MHPE2 are remote peer in DUT EVPN MAC address table.The DUT and MHPE2 are
running SA mode. running SA mode.
Measurement : Measurement :
Measure the time taken by the DUT to learn the "X" MACs in the data Measure the time taken by the DUT to learn the "X" MACs in the data
plane.Repeat these test and plot the data.The test is repeated for plane.Repeat these test and plot the data.The test is repeated for
"N" times and the values are collected.The mac learning time is "N" times and the values are collected.The mac learning time is
calculated by averaging the values obtained from "N" samples. calculated by averaging the values obtained from "N" samples.
Mac learning in sec = (T1+T2+..Tn/N) Mac learning in sec = (T1+T2+..Tn/N)
3.4. PBB-EVPN How long it takes to learn the mac from remote peer 3.3. MAC Flush due to local link failure and Relearning
Objective:
To Record the time taken to learn the remote macs.
Topology : Topology 2
Procedure:
Send X frames with X different SA and DA to SHPE3 from RT.These macs
will be flooded to MHPE1 and MHPE2 by SHPE3.The DUT and MHPE2 are
running SA mode.
Measurement :
Measure the time taken to learn X mac address in DUT mac table.
Repeat these test and plot the data.The test is repeated for "N"
times and the values are collected.The mac learning time is
calculated by averaging the values obtained by "N" samples.
Mac learning in sec = (T1+T2+..Tn/N)
3.5. How long it takes to flush the local macs due to CE link flap and
measure the relearning rate of MACs
Objective: Objective:
To record the time taken to flush the mac learned locally and the To record the time taken to flush the mac learned locally and the
time taken to relearn the same amount of macs. time taken to relearn the same amount of macs.
Topology : Topology 1 Topology : Topology 1
Procedure: Procedure:
Send X frames with X different SA and DA to DUT from CE using traffic Send X frames with X different SA and DA to DUT from CE using traffic
generator. Wait till the MHPE1 learns all X MAC address. Then fail generator. Wait till the MHPE1 learns all X MAC address. Then fail
the MHPE1 CE link and measure the time taken to flush these X MACs the MHPE1 CE link and measure the time taken to flush these X MACs
from the EVPN MAC table. Bring up the link which was made Down(the from the EVPN MAC table. Bring up the link which was made Down(the
link between MHPE1 and CE).Measure time taken to relearn it. The DUT link between MHPE1 and CE).Measure time taken to relearn it. The DUT
and MHPE2 are running SA mode. and MHPE2 are running SA mode.
Measurement : Measurement :
skipping to change at page 10, line 21 skipping to change at page 8, line 15
and MHPE2 are running SA mode. and MHPE2 are running SA mode.
Measurement : Measurement :
Measure the time taken for flushing these X MAC address. Measure the Measure the time taken for flushing these X MAC address. Measure the
time taken to relearn the X MACs in DUT. Repeat these test and plot time taken to relearn the X MACs in DUT. Repeat these test and plot
the data. The test is repeated for "N" times and the values are the data. The test is repeated for "N" times and the values are
collected. The flush and the relearning time is calculated by collected. The flush and the relearning time is calculated by
averaging the values obtained by "N" samples. averaging the values obtained by "N" samples.
Flush time for X Macs in sec = (T1+T2+..Tn/N) Relearning time for X Flush time for X Macs in sec = (T1+T2+..Tn/N)
macs in sec = (T1+T2+..Tn/N)
3.6. PBB-EVPN how long it takes to flush the local macs and measure the Relearning time for X macs in sec = (T1+T2+..Tn/N)
relearning rate of macs during PE-CE link flap
3.4. MAC Flush due to remote link failure.
Objective: Objective:
To record the time taken to flush the mac learned locally and the To record the time taken to flush the remote mac learned in DUT
time taken to relearn the same amount of macs. during remote link failure.
Topology : Topology 1 Topology : Topology 1
Procedure: Procedure:
Send X frames with X different SA and DA to DUT from CE using traffic Send X frames with X different SA and DA to DUT from SHPE3 using
generator. Wait till the MHPE1 learn all X MAC address. Then fail traffic generator. Bring down the link between SHPE3 and traffic
the MHPE1 CE link and measure the time taken to flush these X MACs generator. Then measure the time taken to flush the DUT EVPN MAC
from the PBB-EVPN MAC table. Then bring up the link. Measure the table. The DUT and MHPE2 are running SA mode.
time taken to relearn X MACS. The DUT and MHPE2 are running SA mode.
Measurement : Measurement :
Measure the time taken for flushing these X MAC address. Measure the Measure the time taken to flush X remote MACs from EVPN MAC table of
time taken to relearn the X MACs in DUT. Repeat these test and plot DUT. Repeat these test and plot the data. The test is repeated for
the data. The test is repeated for "N" times and the values are "N" times and the values are collected. The flush rate is calculated
collected. The flush and the relearning time is calculated by
averaging the values obtained by "N" samples. averaging the values obtained by "N" samples.
Flush time for X Macs in sec = (T1+T2+..Tn/N) Relearning time for X Flush time for X Macs in sec = (T1+T2+..Tn/N)
macs in sec = (T1+T2+..Tn/N)
3.7. How long it takes to flush the remote macs, due to remote link 3.5. MAC Aging
failure.
Objective: Objective:
To record the time taken to flush the remote mac learned in DUT To measure the mac aging time.
during remote link failure.
Topology : Topology 2
Topology : Topology 1
Procedure: Procedure:
Send X frames with X different SA and DA to DUT from SHPE3 using Send X frames with X different SA and DA to DUT from CE using traffic
traffic generator. Bring down the link between SHPE3 and traffic generator. Wait till X MAC address are learned. Then stop the
generator. Then measure the time taken to flush the DUT EVPN MAC traffic. Record the time taken to flush X MACS from DUT EVPN MAC
table. The DUT and MHPE2 are running SA mode. table due to aging. The DUT and MHPE2 are running SA mode
Measurement : Measurement :
Measure the time taken to flush X remote MACs from EVPN MAC table of Measure the time taken to flush X MAC address due to aging. Repeat
DUT. Repeat these test and plot the data. The test is repeated for these test and plot the data. The test is repeated for "N" times and
"N" times and the values are collected. The flush rate is calculated the values are collected. The aging is calculated averaging the
averaging the values obtained by "N" samples. values obtained by "N" samples.
Flush time for X Macs in sec = (T1+T2+..Tn/N) Aging time for X Macs in sec = (T1+T2+..Tn/N)
3.8. PBB-EVPN How long it takes to flush the remote macs due to remote 3.6. Remote Mac Aging
link failure
Objective: Objective:
To record the time taken to flush the remote mac learned in DUT To measure the remote mac aging time.
during remote link failure.
Topology : Topology 2 Topology : Topology 1
Procedure: Procedure:
Send X frames with X different SA and DA to DUT from SHPE3 using Send X frames with X different SA and DA to DUT from SHPE3 using
traffic generator. Bring down the link between SHPE3 and traffic traffic generator. Stop the traffic at remote PE SHPE3.Due to MAC
generator. Then measure the time taken to flush the DUT PBB-EVPN MAC aging SHPE3 will withdraw its routes from DUT and MHPE2. Measure the
address table. The remote MACs will be learned by Data plane, but time taken to remove these MACs from DUT EVPN MAC table. DUT and
the B-MAC will be learned by control plane. The DUT and MHPE2 are MHPE2 are running in SA mode
running SA mode.
Measurement : Measurement :
Measure the time taken to flush X remote MACs from PBB-EVPN MAC table Measure the time taken to flush X remote MACs learned in DUT EVPN MAC
of DUT. Repeat these test and plot the data. The test is repeated table due to aging. Repeat these test and plot the data. The test
for "N" times and the values are collected. The flush rate is is repeated for "N" times and the values are collected. The aging is
calculated by averaging the values obtained by "N" samples. calculated by averaging the values obtained by "N" samples.
Flush time for X Macs in sec = (T1+T2+..Tn/N) Aging time for X Macs in sec = (T1+T2+..Tn/N)
3.9. To measure the MAC aging time. 3.7. Local and Remote MAC Learning
Objective: Objective:
To measure the mac aging time. To record the time taken to learn both local and remote macs.
Topology : Topology 1 Topology : Topology 1
Procedure: Procedure:
Send X frames with X different SA and DA to DUT from CE using traffic Send X frames with X different SA and DA to DUT from SHPE3 using
generator. Wait till X MAC address are learned. Then stop the traffic generator. Send X frames with different SA and DA from
traffic. Record the time taken to flush X MACS from DUT EVPN MAC traffic generator connected to CE. The SA and DA of flows must be
table due to aging. The DUT and MHPE2 are running SA mode complimentary to have unicast flows. Measure the time taken by the
DUT to learn 2X in EVPN MAC. DUT and MHPE2 are running in SA mode.
Measurement : Measurement :
Measure the time taken to flush X MAC address due to aging. Repeat Measure the time taken to learn 2X MAC address in DUT EVPN MAC table.
these test and plot the data. The test is repeated for "N" times and Repeat these test and plot the data. The test is repeated for "N"
the values are collected. The aging is calculated averaging the times and the values are collected. The mac learning time is
values obtained by "N" samples. calculated by averaging the values obtained by "N" samples.
Aging time for X Macs in sec = (T1+T2+..Tn/N) Time to learn 2X Macs in sec = (T1+T2+..Tn/N)
3.10. PBB-EVPN To measure the MAC aging time. 3.8. High Availability.
Objective: Objective:
To measure the mac aging time. To record traffic loss during routing engine fail over.
Topology : Topology 1 Topology : Topology 1
Procedure: Procedure:
Send X frames with X different SA and DA to DUT from CE using traffic Send X frames from CE to DUT from traffic generator withX different
generator. Wait till X MAC address are learned in DUT PBB- EVPN MAC SA and DA. Send X frames from traffic generator to SHPE3 with X
table. Then stop the traffic. Record the time taken to flush X MAC different SA and DA so that 2X MAC address will be learned in DUT.
entries due to aging. The DUT and MHPE2 running in SA mode There is a bi directional traffic flow with X pps in each direction.
Then do a routing engine fail-over.
Measurement : Measurement :
Measure the time taken to flush X MAC address due to aging. Repeat There should be 0 traffic loss which is the ideal case, No change in
these test and plot the data. The test is repeated for "N" times and the DF role. DUT should not withdraw any routes.Repeat the test "N"
the values are collected. The aging is calculated by averaging the times and plot the data.The packet loss is calculated by averaging
values obtained by "N" samples. the values obtained from "N" samples.
Aging time for X Macs in sec = (T1+T2+..Tn/N) Packet loss in sec = (T1+T2+..Tn/N)
3.11. How long it takes to age out the remote macs 3.9. ARP/ND Scale
These tests are conducted to Record the scaling parameter of ARP/ND
of the DUT.
Objective: Objective:
To measure the remote mac aging time. To Record the ARP/ND scale of the DUT.
Topology : Topology 2 Topology : Topology 1
Procedure: Procedure:
Send X frames with X different SA and DA to DUT from SHPE3 using Send X arp/icmpv6 request from RT to DUT with different sender ip/
traffic generator. Stop the traffic at remote PE SHPE3.Due to MAC ipv6 address to the same target gateway ip address. Measure whether
aging SHPE3 will withdraw its routes from DUT and MHPE2. Measure the X MAC+IPv4 address/MAC+IPv6 address of the hosts are learned in DUT.
time taken to remove these MACs from DUT EVPN MAC table. DUT and
MHPE2 are running in SA mode
Measurement : Measurement :
Measure the time taken to flush X remote MACs learned in DUT EVPN MAC The DUT must learn X MAC+IPV4/MAC+IPv6 and it must advertise the X
table due to aging. Repeat these test and plot the data. The test MAC+IPV4/MAC+IPV6 to the remote router.
is repeated for "N" times and the values are collected. The aging is
calculated by averaging the values obtained by "N" samples.
Aging time for X Macs in sec = (T1+T2+..Tn/N) 3.10. Scaling of Services
3.12. PBB-EVPN How long it takes to age out the remote macs. Objective:
To measure the scale limit of DUT for EVPN.This is to measure the
performance of DUT in scaling to "X" EVPN instances.
Topology : Topology 1
Procedure:
The DUT,MHPE2 and SHPE3 are scaled to "N" EVI.Clear BGP neighbors of
the DUT. Once adjacency is established in the DUT. Measure the
routes received from MHPE2 and SHPE3 for "N" EVI in the DUT.
Measurement :
There should not be any loss of route types 1,2,3 and 4 in DUT. DUT
must relearn all type 1,2,3 and 4 from remote routers. The DUT must
be subjected to various values of N to find the optimal scale limit
3.11. Scale Convergence
Objective: Objective:
To measure the remote mac aging time. To measure the convergence time of DUT when the DUT is scaled with
EVPN instance along with traffic.
Topology : Topology 1
Topology : Topology 2
Procedure: Procedure:
Send X frames with X different SA and DA to DUT from SHPE3 using Scale N EVIs in DUT,SHPE3 and MHPE2.Send F frames to DUT from CE
traffic generator. Stop the traffic at remote PE(SHPE3).Measure the using traffic generator with X different SA and DA for N EVI's. Send
time taken to remove these remote MACs from DUT PBB-EVPN MAC table. F frames from traffic generator to SHPE3 with X different SA and DA.
The DUT and MHPE2 are running in SA mode. There will be 2X number of MAC address will be learned in DUT EVPN
MAC table. There is a bi directional traffic flow with F pps in each
direction. Then clear the BGP neighbors in the DUT. Once the
adjacency is restored in DUT. Measure the time taken to learn 2X MAC
address in DUT MAC table.
Measurement : Measurement :
Measure the time taken to flush the X remote MACs from DUT PBB-EVPN The DUT must learn 2X MAC address. Measure the time taken to learn
MAC table due to aging Repeat these test and plot the data. The test 2X MAC in DUT. Repeat these test and plot the data.The test is
is repeated for "N" times and the values are collected. The aging is repeated for "N" times and the values are collected.The convergence
calculated by averaging the values obtained by "N" samples. time is calculated by averaging the values obtained by "N" samples.
Aging time for X Macs in sec = (T1+T2+..Tn/N) Convergence time in sec = (T1+T2+..Tn/N)
3.13. How long it takes to learn both local and remote macs. 3.12. SOAK Test.
Objective: Objective:
To record the time taken to learn both local and remote macs. This test is carried out to measure the stability of the DUT in a
scaled environment with traffic over a period of time "T'". In each
interval "t1" the DUT CPU usage, memory usage are measured. The DUT
is checked for any crashes during this time period.
Topology : Topology 3 Topology : Topology 1
Procedure: Procedure:
Send X frames with X different SA and DA to DUT from SHPE3 using Scale N EVI's in DUT,SHPE3 and MHPE2.Send F frames to DUT from CE
traffic generator. Send X frames with different SA and DA from using traffic generator with different X SA and DA for N EVI's. Send
traffic generator connected to CE. The SA and DA of flows must be F frames from traffic generator to SHPE3 with X different SA and DA.
complimentary to have unicast flows. Measure the time taken by the There will be 2X number of MAC address will be learned in DUT EVPN
DUT to learn 2X in EVPN MAC. DUT and MHPE2 are running in SA mode. MAC table. There is a bi directional traffic flow with F pps in each
direction. The DUT must run with traffic for 24 hours, every hour
check for memory leak, CPU usage and crash.
Measurement : Measurement :
Measure the time taken to learn 2X MAC address in DUT EVPN MAC table. Take the hourly reading of CPU, process memory. There should not be
Repeat these test and plot the data. The test is repeated for "N" any leak, crashes, CPU spikes.
times and the values are collected. The mac learning time is
calculated by averaging the values obtained by "N" samples.
Time to learn 2X Macs in sec = (T1+T2+..Tn/N) 4. Test Cases for PBB-EVPN Benchmarking
3.14. PBB-EVPN How long it takes to learn both local and remote macs 4.1. Local MAC Learning
Objective: Objective:
To record the time taken to learn both local and remote macs. To Record the time taken to learn the MAC address locally.
Topology : Topology 3 Topology : Topology 1
Procedure: Procedure:
Send X frames with X different SA and DA to DUT from SHPE3 using Send "X" unicast frames from CE to MHPE1(DUT) working in SA mode with
traffic generator. Send X frames with different SA and DA from "X" different source and destination address from RT. The DUT must
traffic generator connected to CE. The SA and DA of flows must be learn "X" macs in data plane.
complimentary to have unicast flows. Measure the time taken by the
DUT to learn 2X in MAC table. DUT and MHPE2 are running in SA mode.
Measurement : Measurement :
Measure the time taken to learn 2X MAC address table in DUT PBB-EVPN Measure the time taken by the DUT to learn the "X" MACs in the data
MAC table. Repeat these test and plot the data. The test is plane. The data plane measurement is taken by considering DUT as
repeated for "N" times and the values are collected. The mac black box the range of "X" MAC is known from RT and the same must be
learning time is calculated by averaging the values obtained by "N" learned in DUT, the time taken to learn "X" MAC is measured. Repeat
samples. these test and plot the data. The test is repeated for "N" times and
the values are collected. The mac learning time is calculated by
Time to learn 2X Macs in sec = (T1+T2+..Tn/N) averaging the values obtained from "N" samples.
4. High Availability Mac learning in sec = (T1+T2+..Tn/N)
4.1. To Record the whether there is traffic loss due to routing engine 4.2. Remote Mac Learning
failover for redundancy test.
Objective: Objective:
To record traffic loss during routing engine failover. To Record the time taken to learn the remote macs.
Topology : Topology 3 Topology : Topology 1
Procedure: Procedure:
Send X frames from CE to DUT from traffic generator withX different Send X frames with X different SA and DA to SHPE3 from RT.These macs
SA and DA. Send X frames from traffic generator to SHPE3 with X will be flooded to MHPE1 and MHPE2 by SHPE3.The DUT and MHPE2 are
different SA and DA so that 2X MAC address will be learned in DUT. running SA mode.
There is a bi directional traffic flow with X pps in each direction.
Then do a routing engine fail-over.
Measurement : Measurement :
There should be 0 traffic loss which is the ideal case, No change in Measure the time taken to learn X mac address in DUT mac table.
the DF role. DUT should not withdraw any routes.Repeat the test "N" Repeat these test and plot the data.The test is repeated for "N"
times and plot the data.The packet loss is calculated by averaging times and the values are collected.The mac learning time is
the values obtained from "N" samples. calculated by averaging the values obtained by "N" samples.
Packet loss in sec = (T1+T2+..Tn/N) Mac learning in sec = (T1+T2+..Tn/N)
4.2. PBB-EVPN To Record the whether there is traffic loss due to 4.3. MAC Flush due to link failure
routing engine failover for redundancy test
Objective: Objective:
To record traffic loss during routing engine failover. To record the time taken to flush the mac learned locally and the
time taken to relearn the same amount of macs.
Topology : Topology 3 Topology : Topology 1
Procedure: Procedure:
Send X frames to DUT with X different SA and DA from CE using the Send X frames with X different SA and DA to DUT from CE using traffic
traffic generator. Send X frames from traffic generator to SHPE3 generator. Wait till the MHPE1 learn all X MAC address. Then fail
with X different SA and DA so that 2X MAC address will be Learned in the MHPE1 CE link and measure the time taken to flush these X MACs
DUT. There is a bi directional traffic flow with X pps in each from the PBB-EVPN MAC table. Then bring up the link. Measure the
direction. Then do a routing engine fail-over. time taken to relearn X MACS. The DUT and MHPE2 are running SA mode.
Measurement : Measurement :
There should be 0 traffic loss which is the ideal case, No change in Measure the time taken for flushing these X MAC address. Measure the
the DF role. DUT should not withdraw any routes.Repeat the test "N" time taken to relearn the X MACs in DUT. Repeat these test and plot
times and plot the data.The packet loss is calculated by averaging the data. The test is repeated for "N" times and the values are
the values obtained from "N" samples. collected. The flush and the relearning time is calculated by
averaging the values obtained by "N" samples.
Packet loss in sec = (T1+T2+..Tn/N)
5. ARP/ND Scale Flush time for X Macs in sec = (T1+T2+..Tn/N)
These tests are conducted to Record the scaling parameter of ARP/ND Relearning time for X macs in sec = (T1+T2+..Tn/N)
of the DUT.
5.1. To find ARP/ND scale 4.4. MAC Flush due to remote Failure
Objective: Objective:
To Record the ARP/ND scale of the DUT. To record the time taken to flush the remote mac learned in DUT
during remote link failure.
Topology : Topology 1 Topology : Topology 1
Procedure: Procedure:
Send X arp/icmpv6 request from RT to DUT with different sender ip/ Send X frames with X different SA and DA to DUT from SHPE3 using
ipv6 address to the same target gateway ip address. Measure whether traffic generator. Bring down the link between SHPE3 and traffic
X MAC+IPv4 address/MAC+IPv6 address of the hosts are learned in DUT. generator. Then measure the time taken to flush the DUT PBB-EVPN MAC
address table. The remote MACs will be learned by Data plane, but
the B-MAC will be learned by control plane. The DUT and MHPE2 are
running SA mode.
Measurement : Measurement :
The DUT must learn X MAC+IPV4/MAC+IPv6 and it must advertise the X Measure the time taken to flush X remote MACs from PBB-EVPN MAC table
MAC+IPV4/MAC+IPV6 to the remote router. of DUT. Repeat these test and plot the data. The test is repeated
for "N" times and the values are collected. The flush rate is
6. Scale calculated by averaging the values obtained by "N" samples.
This is to measure the performance of DUT in scaling to "X" EVPN Flush time for X Macs in sec = (T1+T2+..Tn/N)
instances. The measured parameters are CPU usage, memory
leak,crashes.
6.1. To Measure the scale limit of DUT with trigger (Scale without 4.5. MAC aging
traffic)
Objective: Objective:
To measure the scale limit of DUT for EVPN. To measure the mac aging time.
Topology : Topology 3 Topology : Topology 1
Procedure: Procedure:
The DUT,MHPE2 and SHPE3 are scaled to "N" EVI.Clear BGP neighbors of Send X frames with X different SA and DA to DUT from CE using traffic
the DUT. Once adjacency is established in the DUT. Measure the generator. Wait till X MAC address are learned in DUT PBB- EVPN MAC
routes received from MHPE2 and SHPE3 for "N" EVI in the DUT. table. Then stop the traffic. Record the time taken to flush X MAC
entries due to aging. The DUT and MHPE2 running in SA mode
Measurement : Measurement :
There should not be any loss of route types 1,2,3 and 4 in DUT. DUT Measure the time taken to flush X MAC address due to aging. Repeat
must relearn all type 1,2,3 and 4 from remote routers. The DUT must these test and plot the data. The test is repeated for "N" times and
be subjected to various values of N to find the optimal scale limit the values are collected. The aging is calculated by averaging the
values obtained by "N" samples.
6.2. PBB-EVPN To measure the scale limit with trigger. Aging time for X Macs in sec = (T1+T2+..Tn/N)
4.6. Remote MAC Aging.
Objective: Objective:
To measure the scale limit of DUT for PBB-EVPN. To measure the remote mac aging time.
Topology : Topology 3 Topology : Topology 1
Procedure: Procedure:
The DUT,MHPE2 and SHPE3 are scaled to "N" PBB-EVPN instances. Clear Send X frames with X different SA and DA to DUT from SHPE3 using
BGP neighbors in the DUT Once adjacency is established in DUT, check traffic generator. Stop the traffic at remote PE(SHPE3).Measure the
routes received from SHPE3 and MHPE2. time taken to remove these remote MACs from DUT PBB-EVPN MAC table.
The DUT and MHPE2 are running in SA mode.
Measurement : Measurement :
There should not be any loss of route types 2,3 and 4 in DUT. The Measure the time taken to flush the X remote MACs from DUT PBB-EVPN
DUT must relearn all type 2,3 and 4 routes from remote routers. The MAC table due to aging Repeat these test and plot the data. The test
DUT must be subjected to various values of N to find the optimal is repeated for "N" times and the values are collected. The aging is
scale limit. calculated by averaging the values obtained by "N" samples.
6.3. To measure the convergence time of DUT with scale and traffic. Aging time for X Macs in sec = (T1+T2+..Tn/N)
4.7. Local and Remote MAC Learning
Objective: Objective:
To measure the convergence time of DUT when the DUT is scaled with To record the time taken to learn both local and remote macs.
EVPN instance along with traffic.
Topology : Topology 3 Topology : Topology 1
Procedure: Procedure:
Scale N EVIs in DUT,SHPE3 and MHPE2.Send F frames to DUT from CE Send X frames with X different SA and DA to DUT from SHPE3 using
using traffic generator with X different SA and DA for N EVI's. Send traffic generator. Send X frames with different SA and DA from
F frames from traffic generator to SHPE3 with X different SA and DA. traffic generator connected to CE. The SA and DA of flows must be
There will be 2X number of MAC address will be learned in DUT EVPN complimentary to have unicast flows. Measure the time taken by the
MAC table. There is a bi directional traffic flow with F pps in each DUT to learn 2X in MAC table. DUT and MHPE2 are running in SA mode.
direction. Then clear the BGP neighbors in the DUT. Once the
adjacency is restored in DUT. Measure the time taken to learn 2X MAC
address in DUT MAC table.
Measurement : Measurement :
The DUT must learn 2X MAC address. Measure the time taken to learn Measure the time taken to learn 2X MAC address table in DUT PBB-EVPN
2X MAC in DUT. Repeat these test and plot the data.The test is MAC table. Repeat these test and plot the data. The test is
repeated for "N" times and the values are collected.The convergence repeated for "N" times and the values are collected. The mac
time is calculated by averaging the values obtained by "N" samples. learning time is calculated by averaging the values obtained by "N"
samples.
Convergence time in sec = (T1+T2+..Tn/N) Time to learn 2X Macs in sec = (T1+T2+..Tn/N)
6.4. .PBB-EVPN To measure the convergence time of DUT with scale and 4.8. High Availability
traffic.
Objective: Objective:
To measure the convergence time of DUT when the DUT is scaled with To record traffic loss during routing engine failover.
PBB-EVPN instance along with traffic.
Topology : Topology 3 Topology : Topology 1
Procedure: Procedure:
Scale N PBB-EVI's in DUT,SHPE3 and MHPE2.Send F frames to DUT from CE Send X frames to DUT with X different SA and DA from CE using the
using traffic generator with X different SA and DA for N EVI's. Send traffic generator. Send X frames from traffic generator to SHPE3
F frames from traffic generator to SHPE3 with X different SA and DA. with X different SA and DA so that 2X MAC address will be Learned in
There will be 2X number of MAC address will be learned in DUT PBB- DUT. There is a bi directional traffic flow with X pps in each
EVPN MAC table. There is a bi directional traffic flow with F pps in direction. Then do a routing engine fail-over.
each direction. Then clear the BGP neighbors in the DUT. Once the
adjacency is restored in DUT. Measure the time taken to learn 2X MAC
address in DUT PBB-MAC table.
Measurement : Measurement :
The DUT must learn 2X MAC address. Measure the time taken to learn There should be 0 traffic loss which is the ideal case, No change in
2X MAC in DUT. Repeat these test and plot the data. The test is the DF role. DUT should not withdraw any routes.Repeat the test "N"
repeated for "N" times and the values are collected. The convergence times and plot the data.The packet loss is calculated by averaging
time is calculated by averaging the values obtained by "N" samples. the values obtained from "N" samples.
Convergence time in sec = (T1+T2+..Tn/N) Packet loss in sec = (T1+T2+..Tn/N)
7. SOAK Test 4.9. Scale
This is measuring the performance of DUT running with scaled Objective:
configuration with traffic over a peroid of time "T'". In each
interval "t1" the parameters measured are CPU usage, memory usage,
crashes.
7.1. To Measure the stability of the DUT with scale and traffic. To measure the scale limit of DUT for PBB-EVPN.
Topology : Topology 1
Procedure:
The DUT,MHPE2 and SHPE3 are scaled to "N" PBB-EVPN instances. Clear
BGP neighbors in the DUT Once adjacency is established in DUT, check
routes received from SHPE3 and MHPE2.
Measurement :
There should not be any loss of route types 2,3 and 4 in DUT. The
DUT must relearn all type 2,3 and 4 routes from remote routers. The
DUT must be subjected to various values of N to find the optimal
scale limit.
4.10. Scale Convergence
Objective: Objective:
To measure the stability of the DUT in a scaled environment with To measure the convergence time of DUT when the DUT is scaled with
traffic. EVPN instance along with traffic.
Topology : Topology 3 Topology : Topology 1
Procedure: Procedure:
Scale N EVI's in DUT,SHPE3 and MHPE2.Send F frames to DUT from CE Scale N PBB-EVIs in DUT,SHPE3 and MHPE2.Send F frames to DUT from CE
using traffic generator with different X SA and DA for N EVI's. Send using traffic generator with X different SA and DA for N PBB-EVI's.
F frames from traffic generator to SHPE3 with X different SA and DA. Send F frames from traffic generator to SHPE3 with X different SA and
There will be 2X number of MAC address will be learned in DUT EVPN DA. There will be 2X number of MAC address will be learned in DUT
MAC table. There is a bi directional traffic flow with F pps in each PBB-EVPN MAC table. There is a bi directional traffic flow with F
direction. The DUT must run with traffic for 24 hours, every hour pps in each direction. Then clear the BGP neighbors in the DUT.
check for memory leak, crash. Once the adjacency is restored in DUT. Measure the time taken to
learn 2X MAC address in DUT MAC table.
Measurement : Measurement :
Take the hourly reading of CPU, process memory. There should not be The DUT must learn 2X MAC address. Measure the time taken to learn
any leak, crashes, CPU spikes. 2X MAC in DUT. Repeat these test and plot the data.The test is
repeated for "N" times and the values are collected.The convergence
time is calculated by averaging the values obtained by "N" samples.
7.2. PBB-EVPN to measure the stability of DUT with scale and traffic. Convergence time in sec = (T1+T2+..Tn/N)
4.11. Soak Test
Objective: Objective:
To measure the stability of the DUT in a scaled environment with To measure the stability of the DUT in a scaled environment with
traffic. traffic.
Topology : Topology 3 Topology : Topology 1
Procedure: Procedure:
Scale N PBB-EVI's in DUT,SHPE3 and MHPE2.Send F frames to DUT from CE Scale N PBB-EVI's in DUT,SHPE3 and MHPE2.Send F frames to DUT from CE
using traffic generator with X different SA and DA for N EVI's. Send using traffic generator with X different SA and DA for N EVI's. Send
F frames from traffic generator to SHPE3 with X different SA and DA. F frames from traffic generator to SHPE3 with X different SA and DA.
There will be 2X number of MAC address will be learned in DUT PBB- There will be 2X number of MAC address will be learned in DUT PBB-
EVPN MAC table. There is a bi directional traffic flow with F pps in EVPN MAC table. There is a bi directional traffic flow with F pps in
Each direction. The DUT must run with traffic for 24 hours, every Each direction. The DUT must run with traffic for 24 hours, every
hour check the memory leak, crashes. hour check the memory leak, crashes.
Measurement : Measurement :
Take the hourly reading of CPU process, memory usages. There should Take the hourly reading of CPU process, memory usages. There should
not be any memory leak, crashes,CPU spikes. not be any memory leak, crashes,CPU spikes.
8. Acknowledgements 5. Acknowledgements
We would like to thank Fioccola Giuseppe of Telecom Italia reviewing We would like to thank Fioccola Giuseppe of Telecom Italia reviewing
our draft and commenting it. We would like to thank Sarah Banks for our draft and commenting it. We would like to thank Sarah Banks for
guiding and mentoring us. guiding and mentoring us.
9. IANA Considerations 6. IANA Considerations
This memo includes no request to IANA. This memo includes no request to IANA.
10. Security Considerations 7. Security Considerations
There is no additional consideration from RFC 6192. There is no additional consideration from RFC 6192.
11. References 8. References
11.1. Normative References
8.1. Normative References
[RFC2119] Bradner, S., "Key words for use in RFCs to Indicate [RFC2119] Bradner, S., "Key words for use in RFCs to Indicate
Requirement Levels", BCP 14, RFC 2119, Requirement Levels", BCP 14, RFC 2119,
DOI 10.17487/RFC2119, March 1997, DOI 10.17487/RFC2119, March 1997,
<https://www.rfc-editor.org/info/rfc2119>. <https://www.rfc-editor.org/info/rfc2119>.
[RFC2544] Bradner, S. and J. McQuaid, "Benchmarking Methodology for [RFC2544] Bradner, S. and J. McQuaid, "Benchmarking Methodology for
Network Interconnect Devices", RFC 2544, Network Interconnect Devices", RFC 2544,
DOI 10.17487/RFC2544, March 1999, DOI 10.17487/RFC2544, March 1999,
<https://www.rfc-editor.org/info/rfc2544>. <https://www.rfc-editor.org/info/rfc2544>.
[RFC2899] Ginoza, S., "Request for Comments Summary RFC Numbers [RFC2899] Ginoza, S., "Request for Comments Summary RFC Numbers
2800-2899", RFC 2899, DOI 10.17487/RFC2899, May 2001, 2800-2899", RFC 2899, DOI 10.17487/RFC2899, May 2001,
<https://www.rfc-editor.org/info/rfc2899>. <https://www.rfc-editor.org/info/rfc2899>.
11.2. Informative References 8.2. Informative References
[RFC7432] Sajassi, A., Ed., Aggarwal, R., Bitar, N., Isaac, A., [RFC7432] Sajassi, A., Ed., Aggarwal, R., Bitar, N., Isaac, A.,
Uttaro, J., Drake, J., and W. Henderickx, "BGP MPLS-Based Uttaro, J., Drake, J., and W. Henderickx, "BGP MPLS-Based
Ethernet VPN", RFC 7432, DOI 10.17487/RFC7432, February Ethernet VPN", RFC 7432, DOI 10.17487/RFC7432, February
2015, <https://www.rfc-editor.org/info/rfc7432>. 2015, <https://www.rfc-editor.org/info/rfc7432>.
[RFC7623] Sajassi, A., Ed., Salam, S., Bitar, N., Isaac, A., and W. [RFC7623] Sajassi, A., Ed., Salam, S., Bitar, N., Isaac, A., and W.
Henderickx, "Provider Backbone Bridging Combined with Henderickx, "Provider Backbone Bridging Combined with
Ethernet VPN (PBB-EVPN)", RFC 7623, DOI 10.17487/RFC7623, Ethernet VPN (PBB-EVPN)", RFC 7623, DOI 10.17487/RFC7623,
September 2015, <https://www.rfc-editor.org/info/rfc7623>. September 2015, <https://www.rfc-editor.org/info/rfc7623>.
 End of changes. 131 change blocks. 
440 lines changed or deleted 379 lines changed or added

This html diff was produced by rfcdiff 1.47. The latest version is available from http://tools.ietf.org/tools/rfcdiff/