draft-ietf-bmwg-evpntest-00.txt   draft-ietf-bmwg-evpntest-01.txt 
Internet Engineering Task Force S. Jacob, Ed. Internet Engineering Task Force S. Jacob, Ed.
Internet-Draft K. Tiruveedhula Internet-Draft K. Tiruveedhula
Intended status: Standards Track Juniper Networks Intended status: Standards Track Juniper Networks
Expires: March 16, 2019 September 12, 2018 Expires: May 30, 2019 November 26, 2018
Benchmarking Methodology for EVPN and PBB-EVPN Benchmarking Methodology for EVPN and PBB-EVPN
draft-ietf-bmwg-evpntest-00 draft-ietf-bmwg-evpntest-01
Abstract Abstract
This document defines methodologies for benchmarking EVPN and PBB- This document defines methodologies for benchmarking EVPN and PBB-
EVPN performance. EVPN is defined in RFC 7432, and is being deployed EVPN performance. EVPN is defined in RFC 7432, and is being deployed
in Service Provider networks. Specifically this document defines the in Service Provider networks. Specifically this document defines the
methodologies for benchmarking EVPN/PBB-EVPN convergence, data plane methodologies for benchmarking EVPN/PBB-EVPN convergence, data plane
performance, and control plane performance. performance, and control plane performance.
Status of This Memo Status of This Memo
skipping to change at page 1, line 34 skipping to change at page 1, line 34
Internet-Drafts are working documents of the Internet Engineering Internet-Drafts are working documents of the Internet Engineering
Task Force (IETF). Note that other groups may also distribute Task Force (IETF). Note that other groups may also distribute
working documents as Internet-Drafts. The list of current Internet- working documents as Internet-Drafts. The list of current Internet-
Drafts is at https://datatracker.ietf.org/drafts/current/. Drafts is at https://datatracker.ietf.org/drafts/current/.
Internet-Drafts are draft documents valid for a maximum of six months Internet-Drafts are draft documents valid for a maximum of six months
and may be updated, replaced, or obsoleted by other documents at any and may be updated, replaced, or obsoleted by other documents at any
time. It is inappropriate to use Internet-Drafts as reference time. It is inappropriate to use Internet-Drafts as reference
material or to cite them other than as "work in progress." material or to cite them other than as "work in progress."
This Internet-Draft will expire on March 16, 2019. This Internet-Draft will expire on May 30, 2019.
Copyright Notice Copyright Notice
Copyright (c) 2018 IETF Trust and the persons identified as the Copyright (c) 2018 IETF Trust and the persons identified as the
document authors. All rights reserved. document authors. All rights reserved.
This document is subject to BCP 78 and the IETF Trust's Legal This document is subject to BCP 78 and the IETF Trust's Legal
Provisions Relating to IETF Documents Provisions Relating to IETF Documents
(https://trustee.ietf.org/license-info) in effect on the date of (https://trustee.ietf.org/license-info) in effect on the date of
publication of this document. Please review these documents publication of this document. Please review these documents
skipping to change at page 2, line 11 skipping to change at page 2, line 11
include Simplified BSD License text as described in Section 4.e of include Simplified BSD License text as described in Section 4.e of
the Trust Legal Provisions and are provided without warranty as the Trust Legal Provisions and are provided without warranty as
described in the Simplified BSD License. described in the Simplified BSD License.
Table of Contents Table of Contents
1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . 3 1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . 3
1.1. Requirements Language . . . . . . . . . . . . . . . . . . 3 1.1. Requirements Language . . . . . . . . . . . . . . . . . . 3
1.2. Terminologies . . . . . . . . . . . . . . . . . . . . . . 3 1.2. Terminologies . . . . . . . . . . . . . . . . . . . . . . 3
2. Test Topology . . . . . . . . . . . . . . . . . . . . . . . . 4 2. Test Topology . . . . . . . . . . . . . . . . . . . . . . . . 4
3. Test Cases . . . . . . . . . . . . . . . . . . . . . . . . . 7 3. Test Cases . . . . . . . . . . . . . . . . . . . . . . . . . 8
3.1. How long it takes to learn local mac address in EVPN . . 7 3.1. How long it takes to learn local mac address in EVPN . . 8
3.2. How long it takes to learn local mac address in PBB EVPN 8 3.2. How long it takes to learn local mac address in PBB EVPN 9
3.3. How long it takes to learn the remote macs . . . . . . . 8 3.3. How long it takes to learn the remote macs . . . . . . . 9
3.4. PBB-EVPN How long it takes to learn the mac from remote 3.4. PBB-EVPN How long it takes to learn the mac from remote
peer . . . . . . . . . . . . . . . . . . . . . . . . . . 9 peer . . . . . . . . . . . . . . . . . . . . . . . . . . 10
3.5. How long it takes to flush the local macs due to CE link 3.5. How long it takes to flush the local macs due to CE link
flap and measure the relearning rate of MACs . . . . . . 9 flap and measure the relearning rate of MACs . . . . . . 11
3.6. PBB-EVPN how long it takes to flush the local macs and 3.6. PBB-EVPN how long it takes to flush the local macs and
measure the relearning rate of macs during PE-CE link measure the relearning rate of macs during PE-CE link
flap . . . . . . . . . . . . . . . . . . . . . . . . . . 10 flap . . . . . . . . . . . . . . . . . . . . . . . . . . 12
3.7. How long it takes to flush the remote macs, due to remote 3.7. How long it takes to flush the remote macs, due to remote
link failure. . . . . . . . . . . . . . . . . . . . . . . 11 link failure. . . . . . . . . . . . . . . . . . . . . . . 12
3.8. PBB-EVPN How long it takes to flush the remote macs due 3.8. PBB-EVPN How long it takes to flush the remote macs due
to remote link failure . . . . . . . . . . . . . . . . . 11 to remote link failure . . . . . . . . . . . . . . . . . 13
3.9. To measure the MAC aging time. . . . . . . . . . . . . . 12 3.9. To measure the MAC aging time. . . . . . . . . . . . . . 14
3.10. PBB-EVPN To measure the MAC aging time. . . . . . . . . . 12 3.10. PBB-EVPN To measure the MAC aging time. . . . . . . . . . 15
3.11. How long it takes to age out the remote macs . . . . . . 13 3.11. How long it takes to age out the remote macs . . . . . . 15
3.12. PBB-EVPN How long it takes to age out the remote macs. . 13 3.12. PBB-EVPN How long it takes to age out the remote macs. . 16
3.13. How long it takes to learn both local and remote macs. . 14 3.13. How long it takes to learn both local and remote macs. . 17
3.14. PBB-EVPN How long it takes to learn both local and remote 3.14. PBB-EVPN How long it takes to learn both local and remote
macs . . . . . . . . . . . . . . . . . . . . . . . . . . 14 macs . . . . . . . . . . . . . . . . . . . . . . . . . . 17
4. High Availability . . . . . . . . . . . . . . . . . . . . . . 15 4. High Availability . . . . . . . . . . . . . . . . . . . . . . 18
4.1. To Record the whether there is traffic loss due to 4.1. To Record the whether there is traffic loss due to
routing engine failover for redundancy test. . . . . . . 15 routing engine failover for redundancy test. . . . . . . 18
4.2. PBB-EVPN To Record the whether there is traffic loss due 4.2. PBB-EVPN To Record the whether there is traffic loss due
to routing engine failover for redundancy test . . . . . 16 to routing engine failover for redundancy test . . . . . 19
5. ARP/ND Scale . . . . . . . . . . . . . . . . . . . . . . . . 16 5. ARP/ND Scale And Prefix Scale . . . . . . . . . . . . . . . . 19
5.1. To find ARP/ND scale . . . . . . . . . . . . . . . . . . 16 5.1. To find ARP/ND scale . . . . . . . . . . . . . . . . . . 19
6. Scale . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17 5.2. To find the prefix( type 5 route) scale . . . . . . . . . 20
6. Scale . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
6.1. To Measure the scale limit of DUT with trigger (Scale 6.1. To Measure the scale limit of DUT with trigger (Scale
without traffic) . . . . . . . . . . . . . . . . . . . . 17 without traffic) . . . . . . . . . . . . . . . . . . . . 20
6.2. PBB-EVPN To measure the scale limit with trigger. . . . . 17 6.2. PBB-EVPN To measure the scale limit with trigger. . . . . 21
6.3. To measure the convergence time of DUT with scale and 6.3. To measure the convergence time of DUT with scale and
traffic. . . . . . . . . . . . . . . . . . . . . . . . . 18 traffic. . . . . . . . . . . . . . . . . . . . . . . . . 21
6.4. .PBB-EVPN To measure the convergence time of DUT with 6.4. .PBB-EVPN To measure the convergence time of DUT with
scale and traffic. . . . . . . . . . . . . . . . . . . . 18 scale and traffic. . . . . . . . . . . . . . . . . . . . 22
7. SOAK Test . . . . . . . . . . . . . . . . . . . . . . . . . . 19 7. SOAK Test . . . . . . . . . . . . . . . . . . . . . . . . . . 23
7.1. To Measure the stability of the DUT with scale and 7.1. To Measure the stability of the DUT with scale and
traffic. . . . . . . . . . . . . . . . . . . . . . . . . 19 traffic. . . . . . . . . . . . . . . . . . . . . . . . . 23
7.2. PBB-EVPN to measure the stability of DUT with scale and 7.2. PBB-EVPN to measure the stability of DUT with scale and
traffic. . . . . . . . . . . . . . . . . . . . . . . . . 20 traffic. . . . . . . . . . . . . . . . . . . . . . . . . 23
8. Acknowledgements . . . . . . . . . . . . . . . . . . . . . . 24
8. Acknowledgements . . . . . . . . . . . . . . . . . . . . . . 20 9. IANA Considerations . . . . . . . . . . . . . . . . . . . . . 24
9. IANA Considerations . . . . . . . . . . . . . . . . . . . . . 20 10. Security Considerations . . . . . . . . . . . . . . . . . . . 24
10. Security Considerations . . . . . . . . . . . . . . . . . . . 20 11. References . . . . . . . . . . . . . . . . . . . . . . . . . 24
11. References . . . . . . . . . . . . . . . . . . . . . . . . . 20 11.1. Normative References . . . . . . . . . . . . . . . . . . 24
11.1. Normative References . . . . . . . . . . . . . . . . . . 21 11.2. Informative References . . . . . . . . . . . . . . . . . 24
11.2. Informative References . . . . . . . . . . . . . . . . . 21 Appendix A. Appendix . . . . . . . . . . . . . . . . . . . . . . 25
Appendix A. Appendix . . . . . . . . . . . . . . . . . . . . . . 21 Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . . 25
Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . . 21
1. Introduction 1. Introduction
EVPN is defined in RFC 7432, and describes BGP MPLS- based Ethernet EVPN is defined in RFC 7432, and describes BGP MPLS- based Ethernet
VPNs (EVPN). PBB-EVPN is defined in RFC 7623, discusses how Ethernet VPNs (EVPN). PBB-EVPN is defined in RFC 7623, discusses how Ethernet
Provider backbone Bridging can be combined with EVPNs to provide a Provider backbone Bridging can be combined with EVPNs to provide a
new/combined solution. This draft defines methodologies that can be new/combined solution. This draft defines methodologies that can be
used to benchmark both RFC 7432 and RFC 7623 solutions. Further, used to benchmark both RFC 7432 and RFC 7623 solutions. Further,
this draft provides methodologies for benchmarking the performance of this draft provides methodologies for benchmarking the performance of
EVPN data and control planes, MAC learning, MAC flushing, MAC ageing, EVPN data and control planes, MAC learning, MAC flushing, MAC ageing,
skipping to change at page 6, line 34 skipping to change at page 6, line 34
| PE-CE link | | PE-CE link |
+----------+------------ +----------+------------
| | | |
| CE | | CE |
| layer2 | | layer2 |
|bridge | |bridge |
+----------+------------ [Traffic Generator](Router Tester sending bi directional layer 2 traffic with different VLAN sender/receiver) +----------+------------ [Traffic Generator](Router Tester sending bi directional layer 2 traffic with different VLAN sender/receiver)
Topology 3 Topology 3
Topology Diagram | Traffic generator ( no traffic)
+----------+
| |
| SHPE3 |
| SHPE3 |
+----------+
|
|Core link
+----------+
| |
| RR |
| | Route Reflector/Core router
+----------+-------------|
| |
| Core links |
+----------+ +-----------+
| | | MHPE2 |
| DUT | | |
| MHPE1 | | |
+----------+ +-----------+
| |
Traffic generator (no traffic)
Traffic generator sending prefixes to DUT
Figure 1 Topology 4
There are five routers in the topology. SHPE3, RR/P, MHPE1 and MHPE2 There are five routers in the topology. SHPE3, RR/P, MHPE1 and MHPE2
emulating a service provider network. CE is a customer device emulating a service provider network. CE is a customer device
connected to MHPE1 and MHPE2, it is configured with bridge domains in connected to MHPE1 and MHPE2, it is configured with bridge domains in
different vlans. The router tester is connected to CE and SHPE3.The different vlans. The router tester is connected to CE and SHPE3.The
MHPE1 acts DUT.The RT will act as sender and receiver.The measurement MHPE1 acts DUT.The RT will act as sender and receiver.The measurement
will be taken in DUT. will be taken in DUT.
All routers except CE is configured with OSPF/IS-IS,LDP,MPLS,BGP with All routers except CE is configured with OSPF/IS-IS,LDP,MPLS,BGP with
EVPN address family. EVPN address family.
skipping to change at page 7, line 46 skipping to change at page 8, line 38
Objective: Objective:
To Record the time taken to learn the MAC address locally in DUT. To Record the time taken to learn the MAC address locally in DUT.
Topology : Topology 1 Topology : Topology 1
Procedure: Procedure:
Send "X" unicast frames from CE to MHPE1(DUT) working in SA mode with Send "X" unicast frames from CE to MHPE1(DUT) working in SA mode with
"X" different source and destination address from RT. The DUT must "X" different source and destination address from RT. The DUT must
learn these "X" macs in data plane. learn these "X" macs in data plane. After measuring the time taken
to learn the macs, stop the traffic. Clear the mac table, then
increase the scale of "X" by 10%. repeat the above procedure. After
each iteration the scale must be increased by 10% till the limit of
the DUT is reached.
Measurement : Measurement :
Measure the time taken to learn "X" MACs in DUT evpn mac table. The Measure the time taken to learn "X" MACs in DUT evpn mac table. The
data plane measurement is taken by considering DUT as black box the data plane measurement is taken by considering DUT as black box the
range of X MAC is known from RT and the same must be learned in DUT, range of X MAC is known from RT and the same must be learned in DUT,
the time taken to learn "X" macs is measured. the time taken to learn "X" macs is measured. The same procedure
must be used for increased scale.
Repeat these test and plot the data. The test is repeated for "N" Repeat these test and plot the data. The test is repeated for "N"
times and the values are collected. The mac learning time is times and the values are collected. The mac learning time is
calculated by averaging the values obtained from "N" samples. calculated by averaging the values obtained from "N" samples.
Mac learning in sec = (T1+T2+..Tn/N) Mac learning rate in sec for "X" macs = (T1+T2+..Tn/N)
Mac learning rate in sec for "X+10%" macs = (T1+T2+..Tn/N)
3.2. How long it takes to learn local mac address in PBB EVPN 3.2. How long it takes to learn local mac address in PBB EVPN
Objective: Objective:
To Record the time taken to learn the MAC address locally. To Record the time taken to learn the MAC address locally.
Topology : Topology 1 Topology : Topology 1
Procedure: Procedure:
Send "X" unicast frames from CE to MHPE1(DUT) working in SA mode with Send "X" unicast frames from CE to MHPE1(DUT) working in SA mode with
"X" different source and destination address from RT. The DUT must "X" different source and destination address from RT. The DUT must
learn "X" macs in data plane. learn "X" macs in data plane.After measuring the time taken to learn
the macs,stop the traffic and then clear mac table. Then increase
the scale of "X" by 10%.repeat the above procedure. After each
iteration the scale must be increased by 10% till the limit of the
DUT is reached.
Measurement : Measurement :
Measure the time taken by the DUT to learn the "X" MACs in the data Measure the time taken by the DUT to learn the "X" MACs in the data
plane. The data plane measurement is taken by considering DUT as plane. The data plane measurement is taken by considering DUT as
black box the range of "X" MAC is known from RT and the same must be black box the range of "X" MAC is known from RT and the same must be
learned in DUT, the time taken to learn "X" MAC is measured. Repeat learned in DUT, the time taken to learn "X" MAC is measured. Repeat
these test and plot the data. The test is repeated for "N" times and these test and plot the data. The test is repeated for "N" times and
the values are collected. The mac learning time is calculated by the values are collected. The mac learning time is calculated by
averaging the values obtained from "N" samples. averaging the values obtained from "N" samples. The same process is
repeated for increased scale.
Mac learning in sec = (T1+T2+..Tn/N) Mac learning rate in for "X" mac's in sec = (T1+T2+..Tn/N)
Mac learning rate for "X+10%" in sec = (T1+T2+..Tn/N)
3.3. How long it takes to learn the remote macs 3.3. How long it takes to learn the remote macs
Objective: Objective:
To Record the time taken to learn the remote macs. To Record the time taken to learn the remote macs.
Topology : Topology 2 Topology : Topology 2
Procedure: Procedure:
Send X frames with X different SA and DA to SHPE3 from RT. SHPE3 Send X frames with X different SA and DA to SHPE3 from RT. SHPE3
will advertise these locally learned macs to MHPE1 and MHPE2 via will advertise these locally learned macs to MHPE1 and MHPE2 via
control plane.Measure the time taken to learn these X MACs from control plane.Measure the time taken to learn these X MACs from
remote peer in DUT EVPN MAC address table.The DUT and MHPE2 are remote peer in DUT EVPN MAC address table.The DUT and MHPE2 are
running SA mode. running SA mode. After measuring the time taken to learn the
macs.stop the traffic and then clear mac table.Then increase the
scale of "X" by 10%. repeat the above procedure. After each
iteration the scale must be increased by 10% till the limit of the
DUT is reached.
Measurement : Measurement :
Measure the time taken by the DUT to learn the "X" MACs in the data Measure the time taken by the DUT to learn the "X" MACs in the data
plane.Repeat these test and plot the data.The test is repeated for plane.Repeat these test and plot the data.The test is repeated for
"N" times and the values are collected.The mac learning time is "N" times and the values are collected.The mac learning time is
calculated by averaging the values obtained from "N" samples. calculated by averaging the values obtained from "N" samples.The same
process is repeated for increased scale.
Mac learning in sec = (T1+T2+..Tn/N) Mac learning rate for "X" remote macs in sec = (T1+T2+..Tn/N)
Mac learning rate for "X+10%" remote macs in sec = (T1+T2+..Tn/N)
3.4. PBB-EVPN How long it takes to learn the mac from remote peer 3.4. PBB-EVPN How long it takes to learn the mac from remote peer
Objective: Objective:
To Record the time taken to learn the remote macs. To Record the time taken to learn the remote macs.
Topology : Topology 2 Topology : Topology 2
Procedure: Procedure:
Send X frames with X different SA and DA to SHPE3 from RT.These macs Send X frames with X different SA and DA to SHPE3 from RT.These macs
will be flooded to MHPE1 and MHPE2 by SHPE3.The DUT and MHPE2 are will be flooded to MHPE1 and MHPE2 by SHPE3.The DUT and MHPE2 are
running SA mode. running SA mode.After measuring the time taken to learn the macs.
Stop the traffic and then clear mac table. Then increase the scale
of "X" by 10%.repeat the above procedure. After each iteration the
scale must be increased by 10% till the limit of the DUT is reached.
Measurement : Measurement :
Measure the time taken to learn X mac address in DUT mac table. Measure the time taken to learn X mac address in DUT mac table.
Repeat these test and plot the data.The test is repeated for "N" Repeat these test and plot the data.The test is repeated for "N"
times and the values are collected.The mac learning time is times and the values are collected.The mac learning time is
calculated by averaging the values obtained by "N" samples. calculated by averaging the values obtained by "N" samples. The same
process is repeated for increased scale.
Mac learning in sec = (T1+T2+..Tn/N) Mac learning rate for "X" remote macs in sec = (T1+T2+..Tn/N)
Mac learning rate for "X+10%" remote macs in sec = (T1+T2+..Tn/N)
3.5. How long it takes to flush the local macs due to CE link flap and 3.5. How long it takes to flush the local macs due to CE link flap and
measure the relearning rate of MACs measure the relearning rate of MACs
Objective: Objective:
To record the time taken to flush the mac learned locally and the To record the time taken to flush the mac learned locally and the
time taken to relearn the same amount of macs. time taken to relearn the same amount of macs.
Topology : Topology 1 Topology : Topology 1
skipping to change at page 10, line 4 skipping to change at page 11, line 24
3.5. How long it takes to flush the local macs due to CE link flap and 3.5. How long it takes to flush the local macs due to CE link flap and
measure the relearning rate of MACs measure the relearning rate of MACs
Objective: Objective:
To record the time taken to flush the mac learned locally and the To record the time taken to flush the mac learned locally and the
time taken to relearn the same amount of macs. time taken to relearn the same amount of macs.
Topology : Topology 1 Topology : Topology 1
Procedure: Procedure:
Send X frames with X different SA and DA to DUT from CE using traffic Send X frames with X different SA and DA to DUT from CE using traffic
generator. Wait till the MHPE1 learns all X MAC address. Then fail generator. Wait till the MHPE1 learns all X MAC address. Then fail
the MHPE1 CE link and measure the time taken to flush these X MACs the MHPE1 CE link and measure the time taken to flush these X MACs
from the EVPN MAC table. Bring up the link which was made Down(the from the EVPN MAC table. Bring up the link which was made Down(the
link between MHPE1 and CE).Measure time taken to relearn it. The DUT link between MHPE1 and CE).Measure time taken to relearn it. The DUT
and MHPE2 are running SA mode. and MHPE2 are running SA mode.After measuring the time taken to re
learn the macs.Stop the traffic and then clear mac table. Then
increase the scale of "X" by 10%.repeat the above procedure. After
each iteration the scale must be increased by 10% till the limit of
the DUT is reached.
Measurement : Measurement :
Measure the time taken for flushing these X MAC address. Measure the Measure the time taken for flushing these X MAC address. Measure the
time taken to relearn the X MACs in DUT. Repeat these test and plot time taken to relearn the X MACs in DUT. Repeat these test and plot
the data. The test is repeated for "N" times and the values are the data. The test is repeated for "N" times and the values are
collected. The flush and the relearning time is calculated by collected. The flush and the relearning time is calculated by
averaging the values obtained by "N" samples. averaging the values obtained by "N" samples. The same process is
repeated for increased scale.
Flush time for X Macs in sec = (T1+T2+..Tn/N) Relearning time for X Flush time for X Macs in sec = (T1+T2+..Tn/N)
macs in sec = (T1+T2+..Tn/N)
Relearning time for X macs in sec = (T1+T2+..Tn/N)
Flush time for X+10% Macs in sec = (T1+T2+..Tn/N)
Relearning time for X+10% macs in sec = (T1+T2+..Tn/N)
3.6. PBB-EVPN how long it takes to flush the local macs and measure the 3.6. PBB-EVPN how long it takes to flush the local macs and measure the
relearning rate of macs during PE-CE link flap relearning rate of macs during PE-CE link flap
Objective: Objective:
To record the time taken to flush the mac learned locally and the To record the time taken to flush the mac learned locally and the
time taken to relearn the same amount of macs. time taken to relearn the same amount of macs.
Topology : Topology 1 Topology : Topology 1
Procedure: Procedure:
Send X frames with X different SA and DA to DUT from CE using traffic Send X frames with X different SA and DA to DUT from CE using traffic
generator. Wait till the MHPE1 learn all X MAC address. Then fail generator. Wait till the MHPE1 learn all X MAC address. Then fail
the MHPE1 CE link and measure the time taken to flush these X MACs the MHPE1 CE link and measure the time taken to flush these X MACs
from the PBB-EVPN MAC table. Then bring up the link. Measure the from the PBB-EVPN MAC table. Then bring up the link. Measure the
time taken to relearn X MACS. The DUT and MHPE2 are running SA mode. time taken to relearn X MACS. The DUT and MHPE2 are running SA mode.
After measuring the time taken to re learn the macs.Stop the traffic
and then clear mac table.Then increase the scale of "X" by 10%.
repeat the above procedure. After each iteration the scale must be
increased by 10% till the limit of the DUT is reached.
Measurement : Measurement :
Measure the time taken for flushing these X MAC address. Measure the Measure the time taken for flushing these X MAC address. Measure the
time taken to relearn the X MACs in DUT. Repeat these test and plot time taken to relearn the X MACs in DUT. Repeat these test and plot
the data. The test is repeated for "N" times and the values are the data. The test is repeated for "N" times and the values are
collected. The flush and the relearning time is calculated by collected. The flush and the relearning time is calculated by
averaging the values obtained by "N" samples. averaging the values obtained by "N" samples.The same process is
repeated for increased scale.
Flush time for X Macs in sec = (T1+T2+..Tn/N) Relearning time for X Flush time for X Macs in sec = (T1+T2+..Tn/N)
macs in sec = (T1+T2+..Tn/N)
Relearning time for X macs in sec = (T1+T2+..Tn/N)
Flush time for X+10% Macs in sec = (T1+T2+..Tn/N)
Relearning time for X+10% macs in sec = (T1+T2+..Tn/N)
3.7. How long it takes to flush the remote macs, due to remote link 3.7. How long it takes to flush the remote macs, due to remote link
failure. failure.
Objective: Objective:
To record the time taken to flush the remote mac learned in DUT To record the time taken to flush the remote mac learned in DUT
during remote link failure. during remote link failure.
Topology : Topology 2 Topology : Topology 2
Procedure: Procedure:
Send X frames with X different SA and DA to DUT from SHPE3 using Send X frames with X different SA and DA to DUT from SHPE3 using
traffic generator. Bring down the link between SHPE3 and traffic traffic generator. Bring down the link between SHPE3 and traffic
generator. Then measure the time taken to flush the DUT EVPN MAC generator. Then measure the time taken to flush the DUT EVPN MAC
table. The DUT and MHPE2 are running SA mode. table. The DUT and MHPE2 are running SA mode.Stop the traffic and
then clear mac table.Then increase the scale of "X" by 10%. repeat
the above procedure.After each iteration the scale must be increased
by 10% till the limit of the DUT is reached.
Measurement : Measurement :
Measure the time taken to flush X remote MACs from EVPN MAC table of Measure the time taken to flush X remote MACs from EVPN MAC table of
DUT. Repeat these test and plot the data. The test is repeated for DUT. Repeat these test and plot the data. The test is repeated for
"N" times and the values are collected. The flush rate is calculated "N" times and the values are collected. The flush rate is calculated
averaging the values obtained by "N" samples. averaging the values obtained by "N" samples.The same process is
repeated for increased scale.
Flush time for X Macs in sec = (T1+T2+..Tn/N) Flush time for X Macs in sec = (T1+T2+..Tn/N)
Flush time for X+10% Macs in sec = (T1+T2+..Tn/N)
3.8. PBB-EVPN How long it takes to flush the remote macs due to remote 3.8. PBB-EVPN How long it takes to flush the remote macs due to remote
link failure link failure
Objective: Objective:
To record the time taken to flush the remote mac learned in DUT To record the time taken to flush the remote mac learned in DUT
during remote link failure. during remote link failure.
Topology : Topology 2 Topology : Topology 2
Procedure: Procedure:
Send X frames with X different SA and DA to DUT from SHPE3 using Send X frames with X different SA and DA to DUT from SHPE3 using
traffic generator. Bring down the link between SHPE3 and traffic traffic generator. Bring down the link between SHPE3 and traffic
generator. Then measure the time taken to flush the DUT PBB-EVPN MAC generator. Then measure the time taken to flush the DUT PBB-EVPN MAC
address table. The remote MACs will be learned by Data plane, but address table. The remote MACs will be learned by Data plane, but
the B-MAC will be learned by control plane. The DUT and MHPE2 are the B-MAC will be learned by control plane. The DUT and MHPE2 are
running SA mode. running SA mode.Stop the traffic and then clear mac table.Then
increase the scale of "X" by 10%.repeat the above procedure. After
each iteration the scale must be increased by 10% till the limit of
the DUT is reached.
Measurement : Measurement :
Measure the time taken to flush X remote MACs from PBB-EVPN MAC table Measure the time taken to flush X remote MACs from PBB-EVPN MAC table
of DUT. Repeat these test and plot the data. The test is repeated of DUT. Repeat these test and plot the data. The test is repeated
for "N" times and the values are collected. The flush rate is for "N" times and the values are collected. The flush rate is
calculated by averaging the values obtained by "N" samples. calculated by averaging the values obtained by "N" samples. The same
process is repeated for increased scale.
Flush time for X Macs in sec = (T1+T2+..Tn/N) Flush time for X Macs in sec = (T1+T2+..Tn/N)
Flush time for X+10% Macs in sec = (T1+T2+..Tn/N)
3.9. To measure the MAC aging time. 3.9. To measure the MAC aging time.
Objective: Objective:
To measure the mac aging time. To measure the mac aging time.
Topology : Topology 1 Topology : Topology 1
Procedure: Procedure:
Send X frames with X different SA and DA to DUT from CE using traffic Send X frames with X different SA and DA to DUT from CE using traffic
generator. Wait till X MAC address are learned. Then stop the generator. Wait till X MAC address are learned. Then stop the
traffic. Record the time taken to flush X MACS from DUT EVPN MAC traffic. Record the time taken to flush X MACS from DUT EVPN MAC
table due to aging. The DUT and MHPE2 are running SA mode table due to aging. The DUT and MHPE2 are running SA mode. Then
increase the scale of "X" by 10%.repeat the above procedure. After
each iteration the scale must be increased by 10% till the limit of
the DUT is reached.
Measurement : Measurement :
Measure the time taken to flush X MAC address due to aging. Repeat Measure the time taken to flush X MAC address due to aging. Repeat
these test and plot the data. The test is repeated for "N" times and these test and plot the data. The test is repeated for "N" times and
the values are collected. The aging is calculated averaging the the values are collected. The aging is calculated averaging the
values obtained by "N" samples. values obtained by "N" samples.The same process is repeated for
increased scale.
Aging time for X Macs in sec = (T1+T2+..Tn/N) Aging time for X Macs in sec = (T1+T2+..Tn/N)
Aging time for X+10% Macs in sec = (T1+T2+..Tn/N)
3.10. PBB-EVPN To measure the MAC aging time. 3.10. PBB-EVPN To measure the MAC aging time.
Objective: Objective:
To measure the mac aging time. To measure the mac aging time.
Topology : Topology 1 Topology : Topology 1
Procedure: Procedure:
Send X frames with X different SA and DA to DUT from CE using traffic Send X frames with X different SA and DA to DUT from CE using traffic
generator. Wait till X MAC address are learned in DUT PBB- EVPN MAC generator. Wait till X MAC address are learned in DUT PBB- EVPN MAC
table. Then stop the traffic. Record the time taken to flush X MAC table. Then stop the traffic. Record the time taken to flush X MAC
entries due to aging. The DUT and MHPE2 running in SA mode entries due to aging. The DUT and MHPE2 running in SA mode. Then
increase the scale of "X" by 10%.repeat the above procedure. After
each iteration the scale must be increased by 10% till the limit of
the DUT is reached.
Measurement : Measurement :
Measure the time taken to flush X MAC address due to aging. Repeat Measure the time taken to flush X MAC address due to aging. Repeat
these test and plot the data. The test is repeated for "N" times and these test and plot the data. The test is repeated for "N" times and
the values are collected. The aging is calculated by averaging the the values are collected. The aging is calculated by averaging the
values obtained by "N" samples. values obtained by "N" samples.The same process is repeated for
increased scale.
Aging time for X Macs in sec = (T1+T2+..Tn/N) Aging time for X Macs in sec = (T1+T2+..Tn/N)
Aging time for X+10% Macs in sec = (T1+T2+..Tn/N)
3.11. How long it takes to age out the remote macs 3.11. How long it takes to age out the remote macs
Objective: Objective:
To measure the remote mac aging time. To measure the remote mac aging time.
Topology : Topology 2 Topology : Topology 2
Procedure: Procedure:
Send X frames with X different SA and DA to DUT from SHPE3 using Send X frames with X different SA and DA to DUT from SHPE3 using
traffic generator. Stop the traffic at remote PE SHPE3.Due to MAC traffic generator. Stop the traffic at remote PE SHPE3.Due to MAC
aging SHPE3 will withdraw its routes from DUT and MHPE2. Measure the aging SHPE3 will withdraw its routes from DUT and MHPE2. Measure the
time taken to remove these MACs from DUT EVPN MAC table. DUT and time taken to remove these MACs from DUT EVPN MAC table. DUT and
MHPE2 are running in SA mode MHPE2 are running in SA mode.Then increase the scale of "X" by
10%.repeat the above procedure. After each iteration the scale must
be increased by 10% till the limit of the DUT is reached.
Measurement : Measurement :
Measure the time taken to flush X remote MACs learned in DUT EVPN MAC Measure the time taken to flush X remote MACs learned in DUT EVPN MAC
table due to aging. Repeat these test and plot the data. The test table due to aging. Repeat these test and plot the data. The test
is repeated for "N" times and the values are collected. The aging is is repeated for "N" times and the values are collected. The aging is
calculated by averaging the values obtained by "N" samples. calculated by averaging the values obtained by "N" samples. the same
process is repeated for increased scale.
Aging time for X Macs in sec = (T1+T2+..Tn/N) Aging time for X Macs in sec = (T1+T2+..Tn/N)
Aging time for X+10% Macs in sec = (T1+T2+..Tn/N)
3.12. PBB-EVPN How long it takes to age out the remote macs. 3.12. PBB-EVPN How long it takes to age out the remote macs.
Objective: Objective:
To measure the remote mac aging time. To measure the remote mac aging time.
Topology : Topology 2 Topology : Topology 2
Procedure: Procedure:
Send X frames with X different SA and DA to DUT from SHPE3 using Send X frames with X different SA and DA to DUT from SHPE3 using
traffic generator. Stop the traffic at remote PE(SHPE3).Measure the traffic generator. Stop the traffic at remote PE(SHPE3).Measure the
time taken to remove these remote MACs from DUT PBB-EVPN MAC table. time taken to remove these remote MACs from DUT PBB-EVPN MAC table.
The DUT and MHPE2 are running in SA mode. The DUT and MHPE2 are running in SA mode.Then increase the scale of
"X" by 10%.repeat the above procedure. After each iteration the
scale must be increased by 10% till the limit of the DUT is reached.
Measurement : Measurement :
Measure the time taken to flush the X remote MACs from DUT PBB-EVPN Measure the time taken to flush the X remote MACs from DUT PBB-EVPN
MAC table due to aging Repeat these test and plot the data. The test MAC table due to aging Repeat these test and plot the data. The test
is repeated for "N" times and the values are collected. The aging is is repeated for "N" times and the values are collected. The aging is
calculated by averaging the values obtained by "N" samples. calculated by averaging the values obtained by "N" samples. The same
process is repeated for increased scale.
Aging time for X Macs in sec = (T1+T2+..Tn/N) Aging time for X Macs in sec = (T1+T2+..Tn/N)
Aging time for X+10% Macs in sec = (T1+T2+..Tn/N)
3.13. How long it takes to learn both local and remote macs. 3.13. How long it takes to learn both local and remote macs.
Objective: Objective:
To record the time taken to learn both local and remote macs. To record the time taken to learn both local and remote macs.
Topology : Topology 3 Topology : Topology 3
Procedure: Procedure:
Send X frames with X different SA and DA to DUT from SHPE3 using Send X frames with X different SA and DA to DUT from SHPE3 using
traffic generator. Send X frames with different SA and DA from traffic generator. Send X frames with different SA and DA from
traffic generator connected to CE. The SA and DA of flows must be traffic generator connected to CE. The SA and DA of flows must be
complimentary to have unicast flows. Measure the time taken by the complimentary to have unicast flows. Measure the time taken by the
DUT to learn 2X in EVPN MAC. DUT and MHPE2 are running in SA mode. DUT to learn 2X in EVPN MAC. DUT and MHPE2 are running in SA mode.
Stop the traffic, clear the mac table.Then increase the scale of "X"
by 10%.repeat the above procedure. After each iteration the scale
must be increased by 10% till the limit of the DUT is reached.
Measurement : Measurement :
Measure the time taken to learn 2X MAC address in DUT EVPN MAC table. Measure the time taken to learn 2X MAC address in DUT EVPN MAC table.
Repeat these test and plot the data. The test is repeated for "N" Repeat these test and plot the data. The test is repeated for "N"
times and the values are collected. The mac learning time is times and the values are collected. The mac learning time is
calculated by averaging the values obtained by "N" samples. calculated by averaging the values obtained by "N" samples.The same
process is repeated for increased scale.
Time to learn 2X Macs in sec = (T1+T2+..Tn/N) Time to learn 2X Macs in sec = (T1+T2+..Tn/N)
Time to learn 2(X+10%) Macs in sec = (T1+T2+..Tn/N)
3.14. PBB-EVPN How long it takes to learn both local and remote macs 3.14. PBB-EVPN How long it takes to learn both local and remote macs
Objective: Objective:
To record the time taken to learn both local and remote macs. To record the time taken to learn both local and remote macs.
Topology : Topology 3 Topology : Topology 3
Procedure: Procedure:
Send X frames with X different SA and DA to DUT from SHPE3 using Send X frames with X different SA and DA to DUT from SHPE3 using
traffic generator. Send X frames with different SA and DA from traffic generator. Send X frames with different SA and DA from
traffic generator connected to CE. The SA and DA of flows must be traffic generator connected to CE. The SA and DA of flows must be
complimentary to have unicast flows. Measure the time taken by the complimentary to have unicast flows. Measure the time taken by the
DUT to learn 2X in MAC table. DUT and MHPE2 are running in SA mode. DUT to learn 2X in MAC table. DUT and MHPE2 are running in SA mode.
Stop the traffic, clear the mac table.Then increase the scale of "X"
by 10%.repeat the above procedure. After each iteration the scale
must be increased by 10% till the limit of the DUT is reached.
Measurement : Measurement :
Measure the time taken to learn 2X MAC address table in DUT PBB-EVPN Measure the time taken to learn 2X MAC address table in DUT PBB-EVPN
MAC table. Repeat these test and plot the data. The test is MAC table. Repeat these test and plot the data. The test is
repeated for "N" times and the values are collected. The mac repeated for "N" times and the values are collected. The mac
learning time is calculated by averaging the values obtained by "N" learning time is calculated by averaging the values obtained by "N"
samples. samples.The same process must be repeated for increased scale.
Time to learn 2X Macs in sec = (T1+T2+..Tn/N) Time to learn 2X Macs in sec = (T1+T2+..Tn/N)
Time to learn 2(X+10%) Macs in sec = (T1+T2+..Tn/N)
4. High Availability 4. High Availability
4.1. To Record the whether there is traffic loss due to routing engine 4.1. To Record the whether there is traffic loss due to routing engine
failover for redundancy test. failover for redundancy test.
Objective: Objective:
To record traffic loss during routing engine failover. To record traffic loss during routing engine failover.
Topology : Topology 3 Topology : Topology 3
skipping to change at page 16, line 33 skipping to change at page 19, line 31
Measurement : Measurement :
There should be 0 traffic loss which is the ideal case, No change in There should be 0 traffic loss which is the ideal case, No change in
the DF role. DUT should not withdraw any routes.Repeat the test "N" the DF role. DUT should not withdraw any routes.Repeat the test "N"
times and plot the data.The packet loss is calculated by averaging times and plot the data.The packet loss is calculated by averaging
the values obtained from "N" samples. the values obtained from "N" samples.
Packet loss in sec = (T1+T2+..Tn/N) Packet loss in sec = (T1+T2+..Tn/N)
5. ARP/ND Scale 5. ARP/ND Scale And Prefix Scale
These tests are conducted to Record the scaling parameter of ARP/ND These tests are conducted to Record the scaling parameter of ARP/ND
of the DUT. of the DUT.
5.1. To find ARP/ND scale 5.1. To find ARP/ND scale
Objective: Objective:
To Record the ARP/ND scale of the DUT. To Record the ARP/ND scale of the DUT.
Topology : Topology 1 Topology : Topology 1
Procedure: Procedure:
Send X arp/icmpv6 request from RT to DUT with different sender ip/ Send X arp/icmpv6 request from RT to DUT with different sender ip/
ipv6 address to the same target gateway ip address. Measure whether ipv6 address to the same target gateway ip address. Measure whether
X MAC+IPv4 address/MAC+IPv6 address of the hosts are learned in DUT. X MAC+IPv4 address/MAC+IPv6 address of the hosts are learned in DUT.
Increase the scale by 10 percent, then measure the DUT in order to
find the new scale is reached.continue till the limit of the DUT.
that is DUT is no longer learn the arp/ND generated by
the traffic generator.
Measurement : Measurement :
The DUT must learn X MAC+IPV4/MAC+IPv6 and it must advertise the X The DUT must learn the arp and ND and it must advertise mac+ip/
MAC+IPV4/MAC+IPV6 to the remote router. mac+ipv6 to the remote PE's. Scale value is calculated based on the
maximum number if mac+ip/mac+ipv6 is learned beyond this number DUT
cant learn. The test is repeated "N" times and the average value is
taken as the scale limit.
5.2. To find the prefix( type 5 route) scale
Objective:
To Record the Prefix scale limit of the DUT
Topology : Topology 4
Procedure:
Send X Prefix to the DUT. DUT must learn the X prefixes and
advertise as type 5 route to the remote router. Increase the scale
by 10 percent, then measure the DUT in order to find the new scale is
reached. continue till the limit of the DUT is reached, that is DUT
is no longer learn the prefixes which is generated by traffic
generator.
Measurement :
The test is carried to find out the prefix scale of the DUT. The
test is repeated "N" times. The final scale value will be the average of
"N" samples.
6. Scale 6. Scale
This is to measure the performance of DUT in scaling to "X" EVPN This is to measure the performance of DUT in scaling to "X" EVPN
instances. The measured parameters are CPU usage, memory instances. The measured parameters are CPU usage, memory
leak,crashes. leak,crashes.
6.1. To Measure the scale limit of DUT with trigger (Scale without 6.1. To Measure the scale limit of DUT with trigger (Scale without
traffic) traffic)
 End of changes. 66 change blocks. 
78 lines changed or deleted 225 lines changed or added

This html diff was produced by rfcdiff 1.47. The latest version is available from http://tools.ietf.org/tools/rfcdiff/