< draft-ietf-bmwg-evpntest-08.txt   draft-ietf-bmwg-evpntest-09.txt >
Internet Engineering Task Force S. Jacob, Ed. Internet Engineering Task Force S. Jacob, Ed.
Internet-Draft Independent Internet-Draft Independent
Intended status: Informational K. Tiruveedhula Intended status: Informational K. Tiruveedhula
Expires: November 30, 2021 Juniper Networks Expires: December 20, 2021 Juniper Networks
May 29, 2021 June 18, 2021
Benchmarking Methodology for EVPN and PBB-EVPN Benchmarking Methodology for EVPN and PBB-EVPN
draft-ietf-bmwg-evpntest-08 draft-ietf-bmwg-evpntest-09
Abstract Abstract
This document defines methodologies for benchmarking EVPN and PBB- This document defines methodologies for benchmarking EVPN and PBB-
EVPN performance. EVPN is defined in RFC 7432, and is being deployed EVPN performance. EVPN is defined in RFC 7432, and is being deployed
in Service Provider networks. Specifically, this document defines in Service Provider networks. Specifically, this document defines
the methodologies for benchmarking EVPN/PBB-EVPN convergence, data the methodologies for benchmarking EVPN/PBB-EVPN convergence, data
plane performance, and control plane performance. plane performance, and control plane performance.
Status of This Memo Status of This Memo
skipping to change at page 1, line 35 skipping to change at page 1, line 35
Internet-Drafts are working documents of the Internet Engineering Internet-Drafts are working documents of the Internet Engineering
Task Force (IETF). Note that other groups may also distribute Task Force (IETF). Note that other groups may also distribute
working documents as Internet-Drafts. The list of current Internet- working documents as Internet-Drafts. The list of current Internet-
Drafts is at https://datatracker.ietf.org/drafts/current/. Drafts is at https://datatracker.ietf.org/drafts/current/.
Internet-Drafts are draft documents valid for a maximum of six months Internet-Drafts are draft documents valid for a maximum of six months
and may be updated, replaced, or obsoleted by other documents at any and may be updated, replaced, or obsoleted by other documents at any
time. It is inappropriate to use Internet-Drafts as reference time. It is inappropriate to use Internet-Drafts as reference
material or to cite them other than as "work in progress." material or to cite them other than as "work in progress."
This Internet-Draft will expire on November 30, 2021. This Internet-Draft will expire on December 20, 2021.
Copyright Notice Copyright Notice
Copyright (c) 2021 IETF Trust and the persons identified as the Copyright (c) 2021 IETF Trust and the persons identified as the
document authors. All rights reserved. document authors. All rights reserved.
This document is subject to BCP 78 and the IETF Trust's Legal This document is subject to BCP 78 and the IETF Trust's Legal
Provisions Relating to IETF Documents Provisions Relating to IETF Documents
(https://trustee.ietf.org/license-info) in effect on the date of (https://trustee.ietf.org/license-info) in effect on the date of
publication of this document. Please review these documents publication of this document. Please review these documents
skipping to change at page 2, line 19 skipping to change at page 2, line 19
1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . 3 1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . 3
1.1. Requirements Language . . . . . . . . . . . . . . . . . . 3 1.1. Requirements Language . . . . . . . . . . . . . . . . . . 3
1.2. Terminologies . . . . . . . . . . . . . . . . . . . . . . 3 1.2. Terminologies . . . . . . . . . . . . . . . . . . . . . . 3
2. Test Topology . . . . . . . . . . . . . . . . . . . . . . . . 4 2. Test Topology . . . . . . . . . . . . . . . . . . . . . . . . 4
3. Test Cases for EVPN Benchmarking . . . . . . . . . . . . . . 7 3. Test Cases for EVPN Benchmarking . . . . . . . . . . . . . . 7
3.1. Data Plane MAC Learning . . . . . . . . . . . . . . . . . 7 3.1. Data Plane MAC Learning . . . . . . . . . . . . . . . . . 7
3.2. Control Plane MAC Learning . . . . . . . . . . . . . . . 8 3.2. Control Plane MAC Learning . . . . . . . . . . . . . . . 8
3.3. MAC Flush-Local Link Failure and Relearning . . . . . . . 9 3.3. MAC Flush-Local Link Failure and Relearning . . . . . . . 9
3.4. MAC Flush-Remote Link Failure and Relearning. . . . . . . 10 3.4. MAC Flush-Remote Link Failure and Relearning. . . . . . . 10
3.5. MAC Aging . . . . . . . . . . . . . . . . . . . . . . . . 11 3.5. MAC Aging . . . . . . . . . . . . . . . . . . . . . . . . 11
3.6. Remote MAC Aging . . . . . . . . . . . . . . . . . . . . 11 3.6. Remote MAC Aging . . . . . . . . . . . . . . . . . . . . 12
3.7. Control and Data plane MAC Learning . . . . . . . . . . . 12 3.7. Control and Data plane MAC Learning . . . . . . . . . . . 12
3.8. High Availability. . . . . . . . . . . . . . . . . . . . 13 3.8. High Availability. . . . . . . . . . . . . . . . . . . . 13
3.9. ARP/ND Scale . . . . . . . . . . . . . . . . . . . . . . 14 3.9. ARP/ND Scale . . . . . . . . . . . . . . . . . . . . . . 14
3.10. Scaling of Services . . . . . . . . . . . . . . . . . . . 15 3.10. Scaling of Services . . . . . . . . . . . . . . . . . . . 15
3.11. Scale Convergence . . . . . . . . . . . . . . . . . . . . 15 3.11. Scale Convergence . . . . . . . . . . . . . . . . . . . . 16
3.12. SOAK Test. . . . . . . . . . . . . . . . . . . . . . . . 16 3.12. SOAK Test. . . . . . . . . . . . . . . . . . . . . . . . 17
4. Test Cases for PBB-EVPN Benchmarking . . . . . . . . . . . . 17 4. Test Cases for PBB-EVPN Benchmarking . . . . . . . . . . . . 18
4.1. Data Plane Local MAC Learning . . . . . . . . . . . . . . 17 4.1. Data Plane Local MAC Learning . . . . . . . . . . . . . . 18
4.2. Data Plane Remote MAC Learning . . . . . . . . . . . . . 18 4.2. Data Plane Remote MAC Learning . . . . . . . . . . . . . 18
4.3. MAC Flush-Local Link Failure . . . . . . . . . . . . . . 19 4.3. MAC Flush-Local Link Failure . . . . . . . . . . . . . . 19
4.4. MAC Flush-Remote Link Failure . . . . . . . . . . . . . . 20 4.4. MAC Flush-Remote Link Failure . . . . . . . . . . . . . . 20
4.5. MAC Aging . . . . . . . . . . . . . . . . . . . . . . . . 21 4.5. MAC Aging . . . . . . . . . . . . . . . . . . . . . . . . 21
4.6. Remote MAC Aging. . . . . . . . . . . . . . . . . . . . . 21 4.6. Remote MAC Aging. . . . . . . . . . . . . . . . . . . . . 22
4.7. Local and Remote MAC Learning . . . . . . . . . . . . . . 22 4.7. Local and Remote MAC Learning . . . . . . . . . . . . . . 23
4.8. High Availability . . . . . . . . . . . . . . . . . . . . 23 4.8. High Availability . . . . . . . . . . . . . . . . . . . . 23
4.9. Scale . . . . . . . . . . . . . . . . . . . . . . . . . . 24 4.9. Scale . . . . . . . . . . . . . . . . . . . . . . . . . . 24
4.10. Scale Convergence . . . . . . . . . . . . . . . . . . . . 25 4.10. Scale Convergence . . . . . . . . . . . . . . . . . . . . 25
4.11. Soak Test . . . . . . . . . . . . . . . . . . . . . . . . 26 4.11. Soak Test . . . . . . . . . . . . . . . . . . . . . . . . 26
5. Acknowledgments . . . . . . . . . . . . . . . . . . . . . . . 27 5. Acknowledgments . . . . . . . . . . . . . . . . . . . . . . . 27
6. IANA Considerations . . . . . . . . . . . . . . . . . . . . . 27 6. IANA Considerations . . . . . . . . . . . . . . . . . . . . . 27
7. Security Considerations . . . . . . . . . . . . . . . . . . . 27 7. Security Considerations . . . . . . . . . . . . . . . . . . . 27
8. References . . . . . . . . . . . . . . . . . . . . . . . . . 27 8. References . . . . . . . . . . . . . . . . . . . . . . . . . 27
8.1. Normative References . . . . . . . . . . . . . . . . . . 27 8.1. Normative References . . . . . . . . . . . . . . . . . . 27
8.2. Informative References . . . . . . . . . . . . . . . . . 27 8.2. Informative References . . . . . . . . . . . . . . . . . 28
Appendix A. Appendix . . . . . . . . . . . . . . . . . . . . . . 28 Appendix A. Appendix . . . . . . . . . . . . . . . . . . . . . . 28
Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . . 28 Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . . 28
1. Introduction 1. Introduction
EVPN is defined in RFC 7432, and describes BGP MPLS based Ethernet EVPN is defined in RFC 7432, and describes BGP MPLS based Ethernet
VPNs (EVPN). PBB-EVPN is defined in RFC 7623, discusses how Ethernet VPNs (EVPN). PBB-EVPN is defined in RFC 7623, discusses how Ethernet
Provider backbone Bridging can be combined with EVPNs to provide a Provider backbone Bridging can be combined with EVPNs to provide a
new/combined solution. This draft defines methodologies that can be new/combined solution. This draft defines methodologies that can be
used to benchmark both RFC 7432 and RFC 7623 solutions. Further, used to benchmark both RFC 7432 and RFC 7623 solutions. Further,
skipping to change at page 7, line 20 skipping to change at page 7, line 20
functioning as multi homing PE working on Single Active EVPN mode. functioning as multi homing PE working on Single Active EVPN mode.
This router serves as the DUT and it is connected to CE. MHPE1 is This router serves as the DUT and it is connected to CE. MHPE1 is
acting as DUT for all the test cases. acting as DUT for all the test cases.
MHPE2 is configured with Interior Gateway protocols like OPSF or IS- MHPE2 is configured with Interior Gateway protocols like OPSF or IS-
IS for underlay, LDP for MPLS support,Interior Border Gateway with IS for underlay, LDP for MPLS support,Interior Border Gateway with
EVPN address family for overlay support. This router must be EVPN address family for overlay support. This router must be
configured with N EVPN/PBB-EVPN instances for testing. This router configured with N EVPN/PBB-EVPN instances for testing. This router
is configured with ESI per vlan or ESI per interface. It is is configured with ESI per vlan or ESI per interface. It is
functioning as multi homing PE working on Single Active EVPN mode. functioning as multi homing PE working on Single Active EVPN mode.
It is connected to CE. It is connected to CE. It acts as standby router during the tests.
CE is acting as bridge configured with multiple vlans. The same CE is acting as bridge configured with multiple vlans. The same
vlans are configured on MHPE1,MHPE2,SHPE3. traffic generator is vlans are configured on MHPE1,MHPE2,SHPE3. traffic generator is
connected to CE. the traffic generator acts as sender or receiver of connected to CE. the traffic generator acts as sender or receiver of
traffic. traffic.
Depending up on the test scenarios the traffic generators will be Depending up on the test scenarios the traffic generators will be
used to generate uni directional or bi directional flows. used to generate uni directional or bi directional flows.
The above configuration will be serving as the base configuration for The above configuration will be serving as the base configuration for
all test cases. all test cases.
The X is used as variable to denote scale factor of the testing The X below is used as variable to denote scale factor of the testing
parameters.It must be in the multiples of 100. parameters.It must be in the multiples of 100.
3. Test Cases for EVPN Benchmarking 3. Test Cases for EVPN Benchmarking
3.1. Data Plane MAC Learning 3.1. Data Plane MAC Learning
Objective: Objective:
Measure the time taken to learn the Data Plane MAC in DUT. Measure the time taken to learn the Data Plane MAC in DUT.
skipping to change at page 8, line 21 skipping to change at page 8, line 21
The DUT will learn these X MAC in data plane. The DUT will learn these X MAC in data plane.
Measurement : Measurement :
Measure the time taken to learn X MAC locally in DUT EVPN MAC table. Measure the time taken to learn X MAC locally in DUT EVPN MAC table.
The data plane measurement is taken by considering DUT as black box. The data plane measurement is taken by considering DUT as black box.
The range of MAC are known from traffic generator, the same must be The range of MAC are known from traffic generator, the same must be
learned in DUT, the time taken to learn X MAC is measured. The learned in DUT, the time taken to learn X MAC is measured. The
measurement is carried out using external server which polls the DUT measurement is carried out using external server which polls the DUT
using automated scripts. using automated scripts which measures the MAC counter value with
timestamp. Note at present there are no standrard models to measure
the counters.
The test is repeated for N times and the values are collected. The The test is repeated for N times and the values are collected. The
MAC learning rate is calculated by averaging the values obtained from MAC learning rate is calculated by averaging the values obtained from
N samples. N is an arbitrary number to get a sufficient sample. The N samples. N is an arbitrary number to get a sufficient sample. The
time measured for each sample is denoted by T1,T2...Tn. time measured for each sample is denoted by T1,T2...Tn.
MAC learning rate = (T1+T2+..Tn)/N MAC learning rate = (T1+T2+..Tn)/N
3.2. Control Plane MAC Learning 3.2. Control Plane MAC Learning
skipping to change at page 9, line 11 skipping to change at page 9, line 13
The DUT will learn these X MAC in control plane. The DUT will learn these X MAC in control plane.
Measurement : Measurement :
Measure the time taken by the DUT to learn the X MAC in the data Measure the time taken by the DUT to learn the X MAC in the data
plane. The test is repeated for N times and the values are plane. The test is repeated for N times and the values are
collected. The remote MAC learning rate is calculated by averaging collected. The remote MAC learning rate is calculated by averaging
the values obtained from N samples. N is an arbitrary number to get the values obtained from N samples. N is an arbitrary number to get
a sufficient sample. The time measured for each sample is denoted by a sufficient sample. The time measured for each sample is denoted by
T1,T2...Tn. The measurement is carried out using external server T1,T2...Tn. The measurement is carried out using external server
which polls the DUT using automated scripts. which polls the DUT using automated scripts which measures the MAC
counter value with timestamp. Note at present there are no standrard
models to measure the counters.
MAC learning rate = (T1+T2+..Tn)/N MAC learning rate = (T1+T2+..Tn)/N
3.3. MAC Flush-Local Link Failure and Relearning 3.3. MAC Flush-Local Link Failure and Relearning
Objective: Objective:
Measure the time taken to flush the Data Plane MAC and the time taken Measure the time taken to flush the Data Plane MAC and the time taken
to relearn the same amount of MAC. to relearn the same amount of MAC.
skipping to change at page 9, line 50 skipping to change at page 10, line 6
Measurement : Measurement :
Measure the time taken for flushing these X MAC addresses. Measure Measure the time taken for flushing these X MAC addresses. Measure
the time taken to relearn these X MAC in DUT. The test is repeated the time taken to relearn these X MAC in DUT. The test is repeated
for N times and the values are collected. The flush and the for N times and the values are collected. The flush and the
relearning time is calculated by averaging the values obtained by N relearning time is calculated by averaging the values obtained by N
samples. N is an arbitrary number to get a sufficient sample. The samples. N is an arbitrary number to get a sufficient sample. The
time measured for each sample is denoted by T1,T2...Tn. The time measured for each sample is denoted by T1,T2...Tn. The
measurement is carried out using external server which polls the DUT measurement is carried out using external server which polls the DUT
using automated scripts. using automated scripts which measures the MAC counter value with
timestamp.
Flush rate = (T1+T2+..Tn)/N Flush rate = (T1+T2+..Tn)/N
Relearning rate = (T1+T2+..Tn)/N Relearning rate = (T1+T2+..Tn)/N
3.4. MAC Flush-Remote Link Failure and Relearning. 3.4. MAC Flush-Remote Link Failure and Relearning.
Objective: Objective:
Measure the time taken to flush the Control plane MAC learned in DUT Measure the time taken to flush the Control plane MAC learned in DUT
skipping to change at page 10, line 46 skipping to change at page 11, line 4
plane. plane.
Measurement : Measurement :
Measure the time taken to flush X remote MAC from EVPN MAC table of Measure the time taken to flush X remote MAC from EVPN MAC table of
the DUT. Measure the time taken to relearn these X MAC in DUT. The the DUT. Measure the time taken to relearn these X MAC in DUT. The
test is repeated for N times and the values are collected. The flush test is repeated for N times and the values are collected. The flush
rate is calculated by averaging the values obtained by N samples. N rate is calculated by averaging the values obtained by N samples. N
is an arbitrary number to get a sufficient sample. The time measured is an arbitrary number to get a sufficient sample. The time measured
for each sample is denoted by T1,T2...Tn. The measurement is carried for each sample is denoted by T1,T2...Tn. The measurement is carried
out using external server which polls the DUT using automated out using external server which polls the DUT using automated scripts
scripts. which measures the MAC counter value with timestamp.
Flush rate = (T1+T2+..Tn)/N Flush rate = (T1+T2+..Tn)/N
Relearning rate = (T1+T2+..Tn)/N Relearning rate = (T1+T2+..Tn)/N
3.5. MAC Aging 3.5. MAC Aging
Objective: Objective:
To measure the MAC Aging time. To measure the MAC Aging time.
skipping to change at page 11, line 39 skipping to change at page 11, line 45
The DUT and MHPE2 are running SA mode. The DUT and MHPE2 are running SA mode.
Measurement : Measurement :
Measure the time taken to flush X MAC addresses due to aging. The Measure the time taken to flush X MAC addresses due to aging. The
test is repeated for N times and the values are collected. The aging test is repeated for N times and the values are collected. The aging
is calculated by averaging the values obtained by N samples. N is an is calculated by averaging the values obtained by N samples. N is an
arbitrary number to get a sufficient sample. The time measured for arbitrary number to get a sufficient sample. The time measured for
each sample is denoted by T1,T2...Tn. The measurement is carried out each sample is denoted by T1,T2...Tn. The measurement is carried out
using external server which polls the DUT using automated scripts. using external server which polls the DUT using automated scripts
which measures the MAC counter value with timestamp.
Aging time for X MAC in sec = (T1+T2+..Tn)/N Aging time for X MAC in sec = (T1+T2+..Tn)/N
3.6. Remote MAC Aging 3.6. Remote MAC Aging
Objective: Objective:
Measure the control plane learned MAC Aging time. Measure the control plane learned MAC Aging time.
Topology : Topology 1 Topology : Topology 1
skipping to change at page 12, line 30 skipping to change at page 12, line 40
The DUT and MHPE2 are running SA mode. The DUT and MHPE2 are running SA mode.
Measurement : Measurement :
Measure the time taken to flush X remote MAC learned in DUT EVPN MAC Measure the time taken to flush X remote MAC learned in DUT EVPN MAC
table due to aging. The test is repeated for N times and the values table due to aging. The test is repeated for N times and the values
are collected. The aging is calculated by averaging the values are collected. The aging is calculated by averaging the values
obtained by N samples. N is an arbitrary number to get a sufficient obtained by N samples. N is an arbitrary number to get a sufficient
sample. The time measured for each sample is denoted by T1,T2...Tn. sample. The time measured for each sample is denoted by T1,T2...Tn.
The measurement is carried out using external server which polls the The measurement is carried out using external server which polls the
DUT using automated scripts. DUT using automated scripts which measures the MAC counter value with
timestamp.
Aging time for X MAC in sec = (T1+T2+..Tn)/N Aging time for X MAC in sec = (T1+T2+..Tn)/N
3.7. Control and Data plane MAC Learning 3.7. Control and Data plane MAC Learning
Objective: Objective:
To record the time taken to learn both local and remote MAC. To record the time taken to learn both local and remote MAC.
Topology : Topology 1 Topology : Topology 1
skipping to change at page 13, line 20 skipping to change at page 13, line 29
DUT and MHPE2 are running in SA mode. DUT and MHPE2 are running in SA mode.
Measurement : Measurement :
Measure the time taken to learn 2X MAC addresses in DUT EVPN MAC Measure the time taken to learn 2X MAC addresses in DUT EVPN MAC
table. The test is repeated for N times and the values are table. The test is repeated for N times and the values are
collected. The MAC learning time is calculated by averaging the collected. The MAC learning time is calculated by averaging the
values obtained by N samples. N is an arbitrary number to get a values obtained by N samples. N is an arbitrary number to get a
sufficient sample. The time measured for each sample is denoted by sufficient sample. The time measured for each sample is denoted by
T1,T2...Tn. The measurement is carried out using external server T1,T2...Tn. The measurement is carried out using external server
which polls the DUT using automated scripts which polls the DUT using automated scripts which measures the MAC
counter value with timestamp.
MAC learning rate = (T1+T2+..Tn)/N MAC learning rate = (T1+T2+..Tn)/N
3.8. High Availability. 3.8. High Availability.
Objective: Objective:
Measure traffic loss during routing engine fail over. Measure traffic loss during routing engine fail over.
Topology : Topology 1 Topology : Topology 1
skipping to change at page 15, line 5 skipping to change at page 15, line 17
more type 2 MAC+ip/MAC+ipv6.The test must be separately conducted for more type 2 MAC+ip/MAC+ipv6.The test must be separately conducted for
arp and ND. arp and ND.
Measurement : Measurement :
Measure the scale limit of type 2 MAC+ip/MAC+ipv6 route which DUT can Measure the scale limit of type 2 MAC+ip/MAC+ipv6 route which DUT can
learn. The test is repeated for N times and the values are learn. The test is repeated for N times and the values are
collected. The scale limit is calculated by averaging the values collected. The scale limit is calculated by averaging the values
obtained by N samples for both MAC+ip and MAC+ipv6. N is an obtained by N samples for both MAC+ip and MAC+ipv6. N is an
arbitrary number to get a sufficient sample. The scale value arbitrary number to get a sufficient sample. The scale value
obtained by each sample be v1,v2..vn. The measurement is carried out obtained by each sample be v1,v2..vn for MAC+ipv4 and s1,s2..sn for
using external server which polls the DUT using automated scripts to MAC+ipv6. The measurement is carried out using external server which
find the scale limit of MAC+ipv4/MAC+ipv6. polls the DUT using automated scripts to find the scale limit of
MAC+ipv4/MAC+ipv6.
Scale limit for MAC+ip = (v1+v2+..vn)/N Scale limit for MAC+ip = (v1+v2+..vn)/N
Scale limit for MAC+ipv6 = (v1+v2+..vn)/N Scale limit for MAC+ipv6 = (s1+s2+..sn)/N
3.10. Scaling of Services 3.10. Scaling of Services
Objective: Objective:
Measure the scale of EVPN instances that a DUT can hold. Measure the scale of EVPN instances that a DUT can hold.
Topology : Topology 1 Topology : Topology 1
Procedure: Procedure:
skipping to change at page 16, line 35 skipping to change at page 16, line 48
Measure the time taken to learn 2X MAC address in DUT MAC table. Measure the time taken to learn 2X MAC address in DUT MAC table.
Measurement : Measurement :
The DUT must learn 2X MAC addresses. Measure the time taken to learn The DUT must learn 2X MAC addresses. Measure the time taken to learn
2X MAC in DUT. The test is repeated for N times and the values are 2X MAC in DUT. The test is repeated for N times and the values are
collected. The convergence time is calculated by averaging the collected. The convergence time is calculated by averaging the
values obtained by N samples. N is an arbitrary number to get a values obtained by N samples. N is an arbitrary number to get a
sufficient sample.The time measured for each sample is denoted by sufficient sample.The time measured for each sample is denoted by
T1,T2...Tn. The measurement is carried out using external server T1,T2...Tn. The measurement is carried out using external server
which polls the DUT using automated scripts. which polls the DUT using automated scripts which measures the MAC
counter value with timestamp.
Time taken to learn 2X MAC in DUT = (T1+T2+..Tn)/N Time taken to learn 2X MAC in DUT = (T1+T2+..Tn)/N
3.12. SOAK Test. 3.12. SOAK Test.
Objective: Objective:
This test is carried out to measure the stability of the DUT in a This test is carried out to measure the stability of the DUT in a
scaled environment with traffic over a period of time "T'". In each scaled environment with traffic over a period of time "T'". In each
interval "t1" the DUT CPU usage, memory usage are measured. The DUT interval "t1" the DUT CPU usage, memory usage are measured. The DUT
skipping to change at page 18, line 21 skipping to change at page 18, line 35
The DUT will learn these X MAC in data plane. The DUT will learn these X MAC in data plane.
Measurement : Measurement :
Measure the time taken to learn X MAC locally in DUT PBB-EVPN MAC Measure the time taken to learn X MAC locally in DUT PBB-EVPN MAC
table. The data plane measurement is taken by considering DUT as table. The data plane measurement is taken by considering DUT as
black box. The range of MAC are known from traffic generator, the black box. The range of MAC are known from traffic generator, the
same must be learned in DUT, the time taken to learn X MAC is same must be learned in DUT, the time taken to learn X MAC is
measured.The measurement is carried out using external server which measured.The measurement is carried out using external server which
polls the DUT using automated scripts. polls the DUT using automated scripts which measures the MAC counter
value with timestamp.
The test is repeated for N times and the values are collected. The The test is repeated for N times and the values are collected. The
MAC learning rate is calculated by averaging the values obtained from MAC learning rate is calculated by averaging the values obtained from
N samples. N is an arbitrary number to get a sufficient sample. The N samples. N is an arbitrary number to get a sufficient sample. The
time measured for each sample is denoted by T1,T2...Tn. time measured for each sample is denoted by T1,T2...Tn.
MAC learning rate = (T1+T2+..Tn)/N MAC learning rate = (T1+T2+..Tn)/N
4.2. Data Plane Remote MAC Learning 4.2. Data Plane Remote MAC Learning
skipping to change at page 18, line 37 skipping to change at page 19, line 4
MAC learning rate = (T1+T2+..Tn)/N MAC learning rate = (T1+T2+..Tn)/N
4.2. Data Plane Remote MAC Learning 4.2. Data Plane Remote MAC Learning
Objective: Objective:
To Record the time taken to learn the remote MAC. To Record the time taken to learn the remote MAC.
Topology : Topology 1 Topology : Topology 1
Procedure: Procedure:
Confirm the DUT is up and running with PBB-EVPN. Confirm the DUT is up and running with PBB-EVPN.
Traffic generator connected to SHPE3 must send frames with X Traffic generator connected to SHPE3 must send frames with X
different source and destination MAC address for one vlan, the same different source and destination MAC address for one vlan, the same
vlan must be present in all the devices except RR. vlan must be present in all the devices except RR.
Ensure the frames must be destined to one PBB-EVPN instance. Ensure the frames must be destined to one PBB-EVPN instance.
The DUT will learn these X MAC in data plane. The DUT will learn these X MAC in data plane.
Measurement : Measurement :
Measure the time taken by the DUT to learn the X MAC in the data Measure the time taken by the DUT to learn the X MAC in the data
plane. The test is repeated for N times and the values are plane. The test is repeated for N times and the values are
collected. The remote MAC learning rate is calculated by averaging collected. The remote MAC learning rate is calculated by averaging
the values obtained from N samples. N is an arbitrary number to get the values obtained from N samples. N is an arbitrary number to get
a sufficient sample. The time measured for each sample is denoted by a sufficient sample. The time measured for each sample is denoted by
T1,T2...Tn. The measurement is carried out using external server T1,T2...Tn. The measurement is carried out using external server
which polls the DUT using automated scripts. which polls the DUT using automated scripts which measures the MAC
counter value with timestamp.
MAC learning rate = (T1+T2+..Tn)/N MAC learning rate = (T1+T2+..Tn)/N
4.3. MAC Flush-Local Link Failure 4.3. MAC Flush-Local Link Failure
Objective: Objective:
Measure the time taken to flush the locally learned MAC and the time Measure the time taken to flush the locally learned MAC and the time
taken to relearn the same amount of MAC. taken to relearn the same amount of MAC.
skipping to change at page 19, line 50 skipping to change at page 20, line 19
Measurement : Measurement :
Measure the time taken for flushing these X MAC addresses. Measure Measure the time taken for flushing these X MAC addresses. Measure
the time taken to relearn these X MAC in DUT. The test is repeated the time taken to relearn these X MAC in DUT. The test is repeated
for N times and the values are collected. The flush and the for N times and the values are collected. The flush and the
relearning time is calculated by averaging the values obtained by N relearning time is calculated by averaging the values obtained by N
samples. N is an arbitrary number to get a sufficient sample. The samples. N is an arbitrary number to get a sufficient sample. The
time measured for each sample is denoted by T1,T2...Tn. The time measured for each sample is denoted by T1,T2...Tn. The
measurement is carried out using external server which polls the DUT measurement is carried out using external server which polls the DUT
using automated scripts. using automated scripts which measures the MAC counter value with
timestamp.
Flush rate = (T1+T2+..Tn)/N Flush rate = (T1+T2+..Tn)/N
Relearning rate = (T1+T2+..Tn)/N Relearning rate = (T1+T2+..Tn)/N
4.4. MAC Flush-Remote Link Failure 4.4. MAC Flush-Remote Link Failure
Objective: Objective:
Measure the time taken to flush the remote MAC learned in DUT due to Measure the time taken to flush the remote MAC learned in DUT due to
skipping to change at page 20, line 34 skipping to change at page 21, line 4
Bring down the link between SHPE3 and traffic generator. Bring down the link between SHPE3 and traffic generator.
Measure the time taken to flush the DUT PBB-EVPN MAC table. The DUT Measure the time taken to flush the DUT PBB-EVPN MAC table. The DUT
and MHPE2 are running SA mode. and MHPE2 are running SA mode.
Bring up the link which was made Down(the link between SHPE3 and Bring up the link which was made Down(the link between SHPE3 and
traffic generator). traffic generator).
Measure time taken by the DUT to relearn these X MAC Measure time taken by the DUT to relearn these X MAC
Measurement : Measurement :
Measure the time taken to flush X remote MAC from PBB-EVPN MAC table Measure the time taken to flush X remote MAC from PBB-EVPN MAC table
of the DUT. Measure the time taken to relearn these X MAC in DUT. of the DUT. Measure the time taken to relearn these X MAC in DUT.
The test is repeated for N times and the values are collected. The The test is repeated for N times and the values are collected. The
flush rate is calculated by averaging the values obtained by N flush rate is calculated by averaging the values obtained by N
samples. N is an arbitrary number to get a sufficient sample. The samples. N is an arbitrary number to get a sufficient sample. The
time measured for each sample is denoted by T1,T2...Tn. The time measured for each sample is denoted by T1,T2...Tn. The
measurement is carried out using external server which polls the DUT measurement is carried out using external server which polls the DUT
using automated scripts. using automated scripts which measures the MAC counter value with
timestamp.
Flush rate = (T1+T2+..Tn)/N Flush rate = (T1+T2+..Tn)/N
Relearning rate = (T1+T2+..Tn)/N Relearning rate = (T1+T2+..Tn)/N
4.5. MAC Aging 4.5. MAC Aging
Objective: Objective:
Measure the MAC Aging time. Measure the MAC Aging time.
skipping to change at page 21, line 39 skipping to change at page 22, line 7
The DUT and MHPE2 are running SA mode. The DUT and MHPE2 are running SA mode.
Measurement : Measurement :
Measure the time taken to flush X MAC addresses due to aging. The Measure the time taken to flush X MAC addresses due to aging. The
test is repeated for N times and the values are collected. The aging test is repeated for N times and the values are collected. The aging
is calculated averaging the values obtained by N samples. N is an is calculated averaging the values obtained by N samples. N is an
arbitrary number to get a sufficient sample. The time measured for arbitrary number to get a sufficient sample. The time measured for
each sample is denoted by T1,T2...Tn. The measurement is carried out each sample is denoted by T1,T2...Tn. The measurement is carried out
using external server which polls the DUT using automated scripts. using external server which polls the DUT using automated scripts
which measures the MAC counter value with timestamp.
Aging time for X MAC in sec = (T1+T2+..Tn)/N Aging time for X MAC in sec = (T1+T2+..Tn)/N
4.6. Remote MAC Aging. 4.6. Remote MAC Aging.
Objective: Objective:
Measure the remote MAC Aging time. Measure the remote MAC Aging time.
Topology : Topology 1 Topology : Topology 1
skipping to change at page 22, line 30 skipping to change at page 22, line 47
The DUT and MHPE2 are running SA mode. The DUT and MHPE2 are running SA mode.
Measurement : Measurement :
Measure the time taken to flush X remote MAC learned in DUT EVPN MAC Measure the time taken to flush X remote MAC learned in DUT EVPN MAC
table due to aging. The test is repeated for N times and the values table due to aging. The test is repeated for N times and the values
are collected. The aging is calculated by averaging the values are collected. The aging is calculated by averaging the values
obtained by N samples. N is an arbitrary number to get a sufficient obtained by N samples. N is an arbitrary number to get a sufficient
sample. The time measured for each sample is denoted by T1,T2...Tn. sample. The time measured for each sample is denoted by T1,T2...Tn.
The measurement is carried out using external server which polls the The measurement is carried out using external server which polls the
DUT using automated scripts. DUT using automated scripts which measures the MAC counter value with
timestamp.
Aging time for X MAC in sec = (T1+T2+..Tn)/N Aging time for X MAC in sec = (T1+T2+..Tn)/N
4.7. Local and Remote MAC Learning 4.7. Local and Remote MAC Learning
Objective: Objective:
Measure the time taken to learn both local and remote MAC. Measure the time taken to learn both local and remote MAC.
Topology : Topology 1 Topology : Topology 1
skipping to change at page 23, line 20 skipping to change at page 23, line 38
DUT and MHPE2 are running in SA mode. DUT and MHPE2 are running in SA mode.
Measurement : Measurement :
Measure the time taken to learn 2X MAC addresses in DUT PBB-EVPN MAC Measure the time taken to learn 2X MAC addresses in DUT PBB-EVPN MAC
table. The test is repeated for N times and the values are table. The test is repeated for N times and the values are
collected. The MAC learning time is calculated by averaging the collected. The MAC learning time is calculated by averaging the
values obtained by N samples. N is an arbitrary number to get a values obtained by N samples. N is an arbitrary number to get a
sufficient sample. The time measured for each sample is denoted by sufficient sample. The time measured for each sample is denoted by
T1,T2...Tn. The measurement is carried out using external server T1,T2...Tn. The measurement is carried out using external server
which polls the DUT using automated scripts which polls the DUT using automated scripts which measures the MAC
counter value with timestamp.
MAC learning rate = (T1+T2+..Tn)/N MAC learning rate = (T1+T2+..Tn)/N
4.8. High Availability 4.8. High Availability
Objective: Objective:
Measure traffic loss during routing engine failover. Measure traffic loss during routing engine failover.
Topology : Topology 1 Topology : Topology 1
skipping to change at page 25, line 45 skipping to change at page 26, line 11
Measure the time taken to learn 2X MAC address in DUT MAC table. Measure the time taken to learn 2X MAC address in DUT MAC table.
Measurement : Measurement :
The DUT must learn 2X MAC addresses. Measure the time taken to learn The DUT must learn 2X MAC addresses. Measure the time taken to learn
2X MAC in DUT. The test is repeated for N times and the values are 2X MAC in DUT. The test is repeated for N times and the values are
collected. The convergence time is calculated by averaging the collected. The convergence time is calculated by averaging the
values obtained by N samples. N is an arbitrary number to get a values obtained by N samples. N is an arbitrary number to get a
sufficient sample.The time measured for each sample is denoted by sufficient sample.The time measured for each sample is denoted by
T1,T2...Tn. The measurement is carried out using external server T1,T2...Tn. The measurement is carried out using external server
which polls the DUT using automated scripts. which polls the DUT using automated scripts which measures the MAC
counter value with timestamp.
Time taken to learn 2X MAC in DUT = (T1+T2+..Tn)/N Time taken to learn 2X MAC in DUT = (T1+T2+..Tn)/N
4.11. Soak Test 4.11. Soak Test
Objective: Objective:
To measure the stability of the DUT in a scaled environment with To measure the stability of the DUT in a scaled environment with
traffic. traffic.
 End of changes. 29 change blocks. 
37 lines changed or deleted 53 lines changed or added

This html diff was produced by rfcdiff 1.48. The latest version is available from http://tools.ietf.org/tools/rfcdiff/