idnits 2.17.1 draft-kishjac-bmwg-evpntest-07.txt: Checking boilerplate required by RFC 5378 and the IETF Trust (see https://trustee.ietf.org/license-info): ---------------------------------------------------------------------------- No issues found here. Checking nits according to https://www.ietf.org/id-info/1id-guidelines.txt: ---------------------------------------------------------------------------- == The page length should not exceed 58 lines per page, but there was 1 longer page, the longest (page 4) being 75 lines Checking nits according to https://www.ietf.org/id-info/checklist : ---------------------------------------------------------------------------- ** There are 2 instances of too long lines in the document, the longest one being 7 characters in excess of 72. ** There are 14 instances of lines with control characters in the document. Miscellaneous warnings: ---------------------------------------------------------------------------- == The copyright year in the IETF Trust and authors Copyright Line does not match the current year == Line 125 has weird spacing: '...in this docu...' == Line 368 has weird spacing: '.... There wont...' == Line 394 has weird spacing: '.... There wont...' == Line 411 has weird spacing: '...a while to le...' == Line 447 has weird spacing: '...SI must be c...' == (26 more instances...) == The document doesn't use any RFC 2119 keywords, yet seems to have RFC 2119 boilerplate text. -- Couldn't find a document date in the document -- date freshness check skipped. Checking references for intended status: Full Standard ---------------------------------------------------------------------------- (See RFCs 3967 and 4897 for information about using normative references to lower-maturity documents in RFCs) == Unused Reference: 'RFC2544' is defined on line 1021, but no explicit reference was found in the text == Unused Reference: 'RFC2889' is defined on line 1026, but no explicit reference was found in the text == Unused Reference: 'RFC7432' is defined on line 1031, but no explicit reference was found in the text == Unused Reference: 'RFC7623' is defined on line 1037, but no explicit reference was found in the text ** Downref: Normative reference to an Informational RFC: RFC 2544 ** Downref: Normative reference to an Informational RFC: RFC 2889 Summary: 4 errors (**), 0 flaws (~~), 13 warnings (==), 1 comment (--). Run idnits with the --verbose option for more detailed information about the items above. -------------------------------------------------------------------------------- 2 INTERNET-DRAFT Kishore Tiruveedhula 3 Intended Status:Standard Sudhin Jacob 4 Expires: October 1,2017 Juniper Networks 5 May 1,2017 7 Benchmarking Methodology for EVPN and PBB-EVPN 8 draft-kishjac-bmwg-evpntest-07 10 Abstract 12 This document defines the methodologies for benchmarking performance 13 of EVPN and PBB-EVPN.EVPN is defined in RFC 7432.It is being deployed 14 in provider network.This document provides the benchmarking 15 methodologies for EVPN/PBB-EVPN convergence,data plane,control plane 16 learning of mac. 18 Status of this Memo 20 This Internet-Draft is submitted in full conformance with the 21 provisions of BCP 78 and BCP 79. 23 Internet-Drafts are working documents of the Internet Engineering 24 Task Force (IETF). Note that other groups may also distribute 25 working documents as Internet-Drafts. The list of current Internet- 26 Drafts is at http://datatracker.ietf.org/drafts/current/. 28 Internet-Drafts are draft documents valid for a maximum of six months 29 and may be updated, replaced, or obsoleted by other documents at any 30 time. It is inappropriate to use Internet-Drafts as reference 31 material or to cite them other than as "work in progress." 33 This Internet-Draft will expire on October 1,2017. 35 Copyright and License Notice 37 Copyright (c) 2017 IETF Trust and the persons identified as the 38 document authors. All rights reserved. 40 This document is subject to BCP 78 and the IETF Trust's Legal 41 Provisions Relating to IETF Documents 42 (http://trustee.ietf.org/license-info) in effect on the date of 43 publication of this document. Please review these documents 44 carefully, as they describe your rights and restrictions with respect 45 to this document. Code Components extracted from this document must 46 include Simplified BSD License text as described in Section 4.e of 47 the Trust Legal Provisions and are provided without warranty as 48 described in the Simplified BSD License. 50 INTERNET DRAFT 52 Table of Contents 54 1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . 4 55 1.1 Terminology . . . . . . . . . . . . . . . . . . . . . . . . 4 56 2.Test Topology . . . . . . . . . . . . . . . . . . . . . . . . . 4 57 2.1 Terminologies . . . . . . . . . . . . . . . . . . . . . . . 5 58 3. Network . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 59 3.1 PBB-EVPN Network Setup . . . . . . . . . . . . . . . . . . 5 60 4. Test Procedure . . . . . . . . . . . . . . . . . . . . . . . . 6 61 5 Test Cases . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 62 5.1.1 To check the time taken to learn the mac address in 63 DUT . . . . . . . . . . . . . . . . . . . . . . . . . . 7 64 5.1.2. To check the time taken to learn X macs from remote 65 peer by DUT . . . . . . . . . . . . . . . . . . . . . 9 66 5.1.3. To check the time taken to flush the local entry due 67 to CE link failure . . . . . . . . . . . . . . . . . . 10 68 5.1.4. To check the time taken by DUT to flush X routes 69 learned from remote PE after R1 traffic generator 70 link failure . ........................................11 71 5.1.5. To measure the mac ageing time. . . . . . . . . . . . 12 72 5.1.6. To check the time taken by DUT to age X routes 73 learned from remote PE after stopping the traffic at 74 remote PE. ...........................................14 75 5.1.7. To check the time taken by DUT to learn X routes 76 from local and X from remote and measure the time 77 of flood from DUT .................................. . 15 78 5.1.8. To measure the time taken to elect a new DF by 79 adding a a MHPE. . . . . . . . . . . . . . . . . . . . 16 80 5.2 High Availability . . . . . . . . . . . . . . . . . . . 18 81 5.2.1 To check the whether there is traffic loss due to 82 routing engine failover for redundancy test. . . . . . 18 83 5.3 ARP/ND Scaling . . . . . . . . . . . . . . . . . . . . . . 19 84 5.4 Type 5 Route scaling . . . . . . . . . . . . . . . . . . . 20 85 6. Scale . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 86 6.1. To Scale the DUT to N EVI and clear bgp in DUT with out 87 traffic. . . . . . . . . . . . . . . . . . . . . . . . . . 20 88 6.2. To Scale the DUT to N EVI and clear bgp in DUT with 89 traffic.Measure the convergence time . . . . . . . . . . . 22 90 7. Soak Test . . . . . . . . . . . . . . . . . . . . . . . . . . 23 91 7.1. To Scale the DUT to N EVI in DUT with traffic and run 92 the set up for 24hrs . . . . . . . . . . . . . . . . . . . 23 93 8. Acknowledgements . . . . . . . . . . . . . . . . . . . . . . . 25 94 9. IANA Considerations . . . . . . . . . . . . . . . . . . . . . 25 95 10. Security Considerations . . . . . . . . . . . . . . . . . . . 25 97 INTERNET DRAFT 99 11 References . . . . . . . . . . . . . . . . . . . . . . . . . . 25 100 11.1 Normative References . . . . . . . . . . . . . . . . . . . 25 101 11.2 Informative References . . . . . . . . . . . . . . . . . . 25 102 Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . . . 26 104 INTERNET DRAFT 106 1 Introduction 108 EVPN which is defined in RFC7432 which describes procedures for 109 BGP MPLS-based Ethernet VPNs(EVPN).This document defines the 110 methodologies for benchmarking performance of EVPN.EVPN has been 111 implemented with many varying designs in order to achieve their 112 intended network functionality.The scope of this document is to 113 provide methodologies for benchmarking evpn data,control plane mac 114 learning,mac flush,mac ageing,convergence,high availability,scale. 115 The methodologies defined for evpn can be used for benchmarking the 116 performance of PBB-EVPN.PBB-EVPN is defined in RFC 7623.It is 117 being deployed in provider network.The difference between PBB-EVPN 118 and EVPN is the former learns the customer mac in data plane the 119 later learns in control plane. 121 1.1 Terminology 123 The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL 124 NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" 125 in this document are to be interpreted as described in RFC 2119 126 [RFC2119]. 128 2.Test Topology 130 Topology Diagram 132 Topology Diagram 134 | Traffic Generator layer 2 traffic send to each sub interface. 135 +----------+ 136 | | 137 | R1 | 138 | | 139 +----------+ 140 | 141 | 142 +----------+ 143 | | 144 | RR | 145 | | 146 +----------+-------------| 147 | | 148 | | 149 +----------+ +-----------+ 150 | | | MHPE2 | 151 | DUT | | | 152 | MHPE1 | | | 153 +----------+ +-----------+ 154 | | 155 +----------+------------ 156 | | 157 | CE | 158 | | 159 +----------+------------ Traffic Generator 160 Layer 2 traffic send to each sub interface 162 Topology Diagram 164 Figure 1 166 INTERNET DRAFT 168 2.1 Terminologies 170 MHPE Multi homed Provide Edge router. 172 RR Route Reflector 174 CE Customer Router/Devices 176 PE2 Provider Edge router 2 178 AA EVPN Terminologies AA All-Active 180 SA EVPN Terminologies SA Single-Active 182 RT Router Tester 184 3. Network 186 The network consists of 5 routers and 2 traffic generator 187 ports.DUT is acting as one of the MHPE to CE.The RR is acting as 188 route reflector and core router.R1 is a Single home router running 189 evpn. All four routers except CE are running mpls,bgp emulating a 190 provider scenario.CE is a dual home connected to DUT and MHPE2.The 191 testing will be done on DUT in order to bench mark the service. DUT 192 and the MHPE2 is running EVPN with SA/AA, CE will be configured 193 with layer 2 bridge.In AA EVPN there will be LAG running from CE to 194 both MHPE's.The DUT and other PE's will be running X EVI's (EVPN 195 instances) on X sub interfaces.The traffic generator will be 196 connected to R1 and the CE, which is capable of sending layer 2 197 frames.The traffic will be send either uni directional or bi 198 directional based on the benchmark parameters to be measured. 200 3.1 PBB-EVPN Network Setup 202 The network consists of 5 routers and 2 traffic generator 203 ports.DUT is acting as one of the MHPE to CE.The RR is acting as 204 route reflector and core router.R1 is a Single home router running 205 pbbevpn. All four routers except CE are running mpls,bgp emulating 206 a provider scenario.CE is a dual home connected to DUT and 207 MHPE2.DUT and MHPE2 is running PBB-EVPN with SA/AA with CE.CE will 208 be configured with layer 2 bridge.In AA PBB-EVPN there will be LAG 209 running from CE to both MHPE's.The DUT and other PE's will be 210 running X EVI's (PBB-EVPN instances) on X sub interfaces.The 211 traffic generator will be connected to R1 and the CE, which is 212 capable of sending layer 2 frames.The traffic will be send either 213 uni directional or bi directional based on the benchmark parameters 214 to be measured. 216 INTERNET DRAFT 218 4. Test Procedure 220 The test defined to bench mark the performance of EVPN mac learning 221 in control pland and data plane. Mac flush,High Availability, 222 convergence time in link failures,scale scenarios. 224 4.1 MAC Learning in Control plane and Data Plane 226 The MAC will be learned in data plane and control plane, test is to 227 measure the time taken to learn the "X" number of mac's in time "T" 228 sec. The data plane learning will from the locally connected 229 interface. The control plane learning is through BGP advertisements 230 from the remote PE. Let the local learning time be "T" and control 231 plane learning time be "T'". The data plane mac learning can be 232 measured using the parameters defined in RFC 2889 section 5.8. 234 4.2 MAC flush for locally learned and remote learned MAC 236 The time taken to flush the "X" locally learned mac, let it be "T1" 237 sec, once the traffic is stopped. The time taken to flush the remote 238 mac which is learned by control plane let it be "X" macs.The time 239 taken to flush the "X" remote macs, which is measured as "T2" sec. 241 4.3 High Availability 243 The traffic is flowing bi direction. The bgp is converged,consider 244 there are "X" numbers of macs learned locally and remotely. 245 Then traffic is flowing at "P" packets per sec. The traffic generator 246 is measuring the Tx and Rx packets, while the routing engine fail over there 247 should not any packet loss the router tester must show both "P" 248 packet per seconds. 250 4.4 Convergence Time 252 During any events like link failure, hard reset measure the time 253 taken to learn "X" mac's locally and remotely. 255 4.5 Scale 257 This is to measure the performance of DUT in scaling to "X" EVPN 258 instances. The measured parameters are CPU usage, memory 259 leak,crashes. 261 INTERNET DRAFT 263 4.6 SOAK 265 This test is used to measure the performance of DUT over a period of 266 time,with scaled configuration and traffic over a period of time 267 "T'". In each interval "t1" the parameters measured are CPU usage, 268 memory usage and crashes. 270 4.7 Measurement Statistics 272 The test is repeated for "N" times and the value is taken by 273 averaging the values. 275 5 Test Cases 277 The following tests are conducted to measure mac learning of local as 278 well as remote. 280 5.1.1 To check the time taken to learn the mac address in DUT 282 Objective: 284 To check the time taken to learn the mac address locally and time 285 taken to send the locally learned routes to peers. 287 a. Send X unicast frames from CE to MHPE1(DUT) working in SA 288 mode with different source and destination address, where DUT is 289 the DF so that it can forward the traffic.Measure the time 290 taken to learn these mac in forwarding table and in control plane. 291 The data plane learning is measured using RFC 2889 section 5.8. 292 Sending frames to the limit of bridge domain of particular EVI. 293 Measure the time taken to learn all X mac in data plane/hardware. 294 The Range of MAC is known from RT and this is verified in DUT. 296 b. Measure the time taken to send these X type 2 routes from 297 DUT to its peers. 299 Procedure: 301 Configure EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are 302 running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and 303 DUT.Once the bgp comes up check the DUT evpn table.For MH PE ESI must 305 INTERNET DRAFT 307 be configured per IFD/Interface.Using RT (traffic generator) to 308 send the traffic to the CE. The traffic is unidirectional.Since CE 309 is working in bridge mode,frames will be send to ingress sub 310 interface of DUT. 312 Measurement 314 The DUT mac table must learn the X macs in data plane in T time 315 frame.The DUT must send type 2 routes to remote router in T' time 316 frame.Repeat the test and plot the data.The data plane measurement 317 is taken by considering DUT as black box the range of X mac is 318 known from RT and the same is learned in DUT, the time to learn 319 that is measured. 321 PBB-EVPN To check the time taken to learn the mac address in DUT 323 Objective: 325 To check the time taken to learn the mac address locally. 327 a. Send X unicast frames from CE to MHPE1(DUT) working in SA 328 mode with different source and destination address, where DUT is 329 the DF so that it can forward the traffic. Measure the time 330 taken to learn these mac in forwarding table.The data plane 331 learning is measured using RFC 2889 section 5.8.Sending frames to 332 the limit of bridge domain of particular EVI.Measure the time 333 taken to learn all X mac in data plane/hardware.The Range of 334 MAC is known from RT and this is verified in DUT. 336 Procedure: 338 Configure PBB-EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are 339 running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and 340 DUT.Once the bgp comes up check the DUT evpn table.For MH PE ESI must 341 be configured per IFD/Interface.Using RT (traffic generator) to 342 send the traffic to the routers. 344 INTERNET DRAFT 346 Measurement 348 The DUT mac table must learn the X macs in data plane in T time 349 frame. Repeat the test and plot the data.The data plane measurement 350 is taken by considering DUT as black box the range of X mac is 351 known from RT and the same is learned in DUT, the time to learn 352 that is measured. 354 5.1.2. To check the time taken to learn X macs from remote peer by DUT 356 Objective: 358 Send X frames with different SA and DA to DUT from R1 using 359 traffic generator.Measure the time taken to learn these X 360 macs from remote peer and program the mac address table. 362 Procedure: 364 Configure EVPN EVI in R1,MHPE2,DUT. All 4 routers except CE are 365 running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and 366 DUT.Once the bgp comes up check the DUT evpn table. For MH PE ESI 367 must be configured per IFD/Interface.Using RT(traffic generator) 368 send the traffic to R1. The traffic is uni directional. There wont 369 be any traffic flow from CE to DUT during this test. 371 Measurement: 373 The DUT mac table must learn the X mac address in T time frame. 374 Repeat these test and plot the data. 376 PBB-EVPN To check the time taken to learn X mac's from remote peer 377 by DUT. 379 Objective: 381 Send X frames with different SA and DA to DUT from R1 using 382 traffic generator.Measure the time taken to learn these X macs from 383 remote peer and program the mac address table. 385 Procedure: 387 Configure PBB-EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are 388 running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and 390 INTERNET DRAFT 392 DUT.Once the bgp comes up check the DUT pbb-evpn table. For MHPE ESI 393 must be configured per IFD/Interface.Using RT(traffic generator) 394 send the traffic to R1. The traffic is uni directional. There wont 395 be any traffic flow from CE to DUT during this test. 397 Measurement: 399 The DUT mac table must learn the X mac address in T time frame. 400 Repeat these test and plot the data. 402 The following test cases are executed to measure the time taken to 403 flush the mac table in case of an event 405 5.1.3. To check the time taken to flush the local entry due to CE link 406 failure 408 Objective: 410 Send X frames with different SA and DA to DUT from CE using 411 traffic generator.Wait for a while to learn all X mac address. 412 Then fail the DUT CE link and measure the time taken to flush these 413 X macs from the mac table and from control plane. 415 Procedure: 417 Configure EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are 418 running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and DUT. 419 Once the bgp comes up check the DUT evpn table. For MH PE ESI must 420 be configured per IFD/Interface. Using RT(traffic generator) to send 421 the traffic to the routers.In this traffic will be only send from 422 CE. 424 Measurement: 426 Measure the time taken for flushing these X mac address.Repeat 427 the test and plot the data. 429 PBB-EVPN To check the time taken to flush the local entry due to CE 430 link failure 432 Objective: 434 Send X frames with different SA and DA to DUT from CE using 435 traffic generator.Wait for a while to learn all X mac address.Then 437 INTERNET DRAFT 439 fail the DUT CE link and measure the time taken to flush these X 440 macs from the mac table. 442 Procedure: 444 Configure PBB-EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are 445 running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and 446 DUT. Once the bgp comes up check the DUT pbb-evpn table. For MH PE 447 ESI must be configured per IFD/Interface. Using RT(traffic 448 generator) to send the traffic to the routers.In this traffic will 449 be only send from CE. 451 Measurement: 453 The DUT mac table must learn the X mac address and measure the 454 time taken for flushing these X mac address. 456 5.1.4. To check the time taken by DUT to flush X routes learned from 457 remote PE after R1 traffic generator link failure 459 Objective: 461 Send X frames with different SA and DA to DUT from R1 using 462 traffic generator.Bring down the link between R1 and traffic 463 generator.Then measure the time taken to flush the DUT mac address 464 table. 466 Procedure: 468 Configure EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are 469 running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and 470 DUT.Once the bgp comes up check the DUT evpn table.For MH PE ESI must 471 be configured per IFD/Interface. Using RT(traffic generator) to 472 send the traffic to the R1.There wont be any traffic flowing to CE 473 from RT. 475 Measurement: 477 Measure the time taken to flush X remote routes from mac table 478 of DUT.Repeat the test and plot the data. 480 INTERNET DRAFT 482 PBB-EVPN To check the time taken by DUT to flush X macs learned 483 from remote PE after R1 traffic generator link failure 485 Objective: 487 Send X frames with different SA and DA to DUT from R1 using 488 traffic generator.Bring down the link between R1 and traffic 489 generator.Then measure the time taken to flush the DUT mac address 490 table.The remote macs will be learned by Data plane,but the B-MAC 491 will be learned by control plane. 493 Procedure: 495 Configure PBB-EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are 496 running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and 497 DUT. Once the bgp comes up check the DUT pbb-evpn table.For MH PE 498 ESI must be configured per IFD/Interface. Using RT(traffic 499 generator) to send the traffic to the routers.In this traffic will 500 be only send from CE. 502 Measurement: 504 Measure the time taken to flush X remote macs from mac table of 505 DUT. 507 The following test cases are executed to measure the mac ageing in 508 locally learned and remote mac learned by control plane. 510 5.1.5. To measure the mac ageing time. 512 Objective: 514 Send X frames with different SA and DA to DUT from CE using 515 traffic generator.Wait to learn all X mac address.Then stop the 516 traffic.Wait to see how long it takes to flush these mac entries 517 due to ageing. 519 Procedure: 521 Configure EVPN EVI in R1,MHPE2,DUT. All 4 routers except CE are 523 INTERNET DRAFT 525 running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and 526 DUT.Once the bgp comes up check the DUT evpn table. For MH PE ESI 527 must be configured per IFD/Interface.Using RT(traffic generator) to 528 send the traffic to the routers.The traffic will be flowing from CE 529 to DUT.There wont be any traffic from R1. 531 Measurement: 533 Measure the time taken to flush X mac address due to ageing.Repeat 534 the test and plot the data. 536 PBB-EVPN To measure the mac ageing time. 538 Objective: 540 Send X frames with different SA and DA to DUT from CE using 541 traffic generator.Wait to learn all X mac address.Then stop the 542 traffic.Wait to see how long it takes to flush these mac entries 543 due to ageing. 545 Procedure: 547 Configure PBB-EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are 548 running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and 549 DUT.Once the bgp comes up check the DUT mac table. For MH PE ESI 550 must be configured per IFD/Interface. Using RT(traffic generator) to 551 send the traffic to the routers. 553 Measurement: 555 The DUT mac table must learn the X mac address, measure the time 556 taken for flushing these X mac address due to ageing. 558 INTERNET DRAFT 560 5.1.6. To check the time taken by DUT to age X routes learned from 561 remote PE after stopping the traffic at remote PE. 563 Objective: 565 Send X frames with different SA and DA to DUT from R1 using 566 traffic generator.After stopping the traffic at remote PE R1 567 traffic generator due to mac ageing it will withdraw its routes from 568 remote PE's.Measure the time taken to remove these macs from DUT 569 mac table. 571 Procedure: 573 Configure EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are 574 running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and 575 DUT.Once the bgp comes up check the DUT evpn table.For MH PE ESI must 576 be configured per IFD/Interface.Using RT(traffic generator) to send 577 the traffic to R1.There wont be any traffic from CE. 579 Measurement: 581 Measure the time taken to flush X remote macs from mac table of 582 DUT due to ageing.Repeat the test and plot the data. 584 PBB-EVPN To check the time taken by DUT to age X mac from remote 585 PE after stopping the traffic at remote PE. 587 Objective: 589 Send X frames with different SA and DA to DUT from R1 using 590 traffic generator.After stopping the traffic at remote PE(R1) traffic 591 generator.Measure the time taken to remove these macs from DUT mac 592 table. 594 Procedure: 596 Configure PBB-EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are 597 running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and 598 DUT.Once the bgp comes up check the DUT mac table.For MH PE ESI must 599 be configured per IFD/Interface.Using RT(traffic generator) to 600 send the traffic to the routers. 602 Measurement: 604 Measure the time taken to flush the remote macs from mac table of 605 DUT due to ageing. 607 INTERNET DRAFT 609 The following tests are executed to measure the convergence time in 610 case of an event or by lerning the mac without any external trigger. 612 5.1.7. To check the time taken by DUT to learn X routes from local and 613 X from remote and measure the time of flood from DUT. 615 Objective: 617 Send X frames with different SA and DA to DUT from R1 using 618 traffic generator.Send X frames with different SA and DA from 619 traffic generator connected to CE.The SA and DA of flows must be 620 complimentary to have unicast flows.Measure the time taken by the 621 DUT to learn 2X in mac table and in control plane.Measure the flood 622 time period of DUT. 624 Procedure: 626 Configure EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are 627 running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and 628 DUT.Once the bgp comes up check the DUT evpn table. For MH PE ESI 629 must be configured per IFD/Interface.Using RT(traffic generator) to 630 send the traffic to the routers.The traffic is bi directional. 632 Measurement: 634 Measure the time taken to learn 2X routes in control and mac 635 address table in DUT and measure the flood time of DUT.Repeat the 636 test and plot the data. 638 PBB-EVPN To check the time taken by DUT to learn X macs from 639 local and X from remote and measure the time of flood from 640 DUT. 642 Objective: 644 Send X frames with different SA and DA to DUT from R1 using 645 traffic generator. Send X frames with different SA and DA from 646 traffic generator connected to CE.The SA and DA of flows must be 647 complimentary to have unicast flows.Measure the time taken by the 648 DUT to learn 2X in mac table.Measure the flood time period of DUT. 650 INTERNET DRAFT 652 Procedure: 654 Configure PBB-EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are 655 running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and 656 DUT.Once the bgp comes up check the DUT evpn table.For MH PE ESI 657 must be configured per IFD/Interface.Using RT(traffic generator) to 658 send the traffic to the routers. 660 Measurement: 662 Measure the time taken to learn 2X mac address table in DUT. and 663 measure the flood time of DUT.Repeat the test and plot the data. 665 5.1.8. To measure the time taken to elect a new DF by adding a a MHPE. 667 Objective: 669 Send X frames from CE to DUT from traffic generator with 670 different SA and DA.Wait to learn all X mac address.Then add a new 671 router configured with evpn to the same ethernet segment.Configure 672 same ESI value which is configured in DUT and in MHPE1 on IFD.Then 673 the new DF election take place during that time there should not be 674 any loop and measure the time taken to come up the new DF.Measure 675 the time taken to elect the new DF. 677 Procedure: 679 Configure EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are 680 running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and 681 DUT.Once the bgp comes up check the DUT evpn table.For MHPE ESI 682 must be configured per IFD/Interface.Using RT(traffic generator) to 683 send the traffic to the routers. 685 Measurement: 687 Measure the time taken for new DF election in DUT and there should 689 INTERNET DRAFT 691 not be any loop or forwarding the BUM traffic back to the same 692 segment. 694 PBB-EVPN To measure the time taken to elect a new DF by adding a a 695 MHPE. 697 Objective: 699 Send X frames from CE to DUT from traffic generator with 700 different SA and DA.Wait to learn all X mac address.Then add a new 701 router to the same Ethernet segment by configuring the same ESI 702 value configured in DUT,MHPE2 in IFD.Then the new DF election take 703 place during that time there should not be any loop and measure the 704 time taken to come up the new DF.Measure the time taken to elect 705 the new DF. 707 Procedure: 709 Configure PBB-EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are 710 running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and 711 DUT.Once the bgp comes up check the DUT evpn table. For MH PE ESI 712 must be configured per IFD/Interface. Using RT(traffic generator) to 713 send the traffic to the routers. 715 Measurement: 717 Measure the time taken for new DF election in DUT and there should 718 not be any loop or forwarding the BUM traffic back to the same 719 segment. 721 INTERNET DRAFT 723 5.2 High Availability 725 These tests are conducted to check after an event there wont be 726 any change in functionality. 728 5.2.1 To check the whether there is traffic loss due to routing engine 729 failover for redundancy test. 731 Objective: 733 Send X frames from CE to DUT from traffic generator with 734 different SA and DA. Send X frames from traffic generator to R1 735 with different SA and DA so that 2X mac address will be learned in 736 DUT. There is a bi directional traffic flow with X pps in each 737 direction. Then do a routing engine failover. 739 Procedure: 741 Configure EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are 742 running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and 743 DUT.Once the bgp comes up check the DUT evpn table.For MH PE ESI must 744 be configured per IFD/Interface.Using RT(traffic generator) to send 745 the traffic to the routers. 747 Measurement: 749 There should be 0 traffic loss which is the ideal case,No 750 change in the DF role.No withdraw of any routes. 752 PBB-EVPN To check the whether there is traffic loss due to routing 753 engine failover for redundancy test. 755 Objective: 757 Send X frames from CE to DUT from traffic generator with 758 different SA and DA.Send X frames from traffic generator to R1 with 759 different SA and DA so that 2X mac address will be learned in DUT. 760 There is a bi directional traffic flow with X pps in each 761 direction.Then do a routing engine failover. 763 Procedure: 765 Configure PBB-EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are 767 INTERNET DRAFT 769 running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and 770 DUT.Once the bgp comes up check the DUT evpn table.For MH PE ESI must 771 be configured per IFD/Interface. Using RT(traffic generator) to 772 send the traffic to the routers. 774 Measurement: 776 There should be 0 packet loss loss which is a ideal case,No change 777 in the DF role. No withdraw of any routes. 779 5.3 ARP/ND Scaling 781 These tests are conducted to check the scaling parameter of arp/ND 782 of the DUT. 784 EVPN: To check the ARP/ND scale of the DUT when the gateway is 785 configured. 787 Objective: 789 Send X arp/icmpv6 request from RT to DUT,that with different 790 sender ip/ipv6 address to the same target gateway ip address. 792 Procedure: 794 Configure EPN EVI in R1,MHPE2,DUT.All 4 routers except CE are 795 running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and 796 DUT.Once the bgp comes up check the DUT evpn table.For MH PE ESI must 797 be configured per IFD/Interface.Using RT(traffic generator) to 798 send the arp request to the DUT which has gateway configured. 800 Measurement: 802 The DUT must learn X mac+ip/mac+ipv6 and it must advertise the X 803 mac+ip/mac+ipv6 to the remote router. 805 INTERNET DRAFT 807 5.4 Type 5 Route scaling 809 These tests are conducted to scale the type 5 route or the IP 810 prefixes in DUT. 812 EVPN: To check the scale of ip prefixes advertised by DUT to the peer 813 router. 815 Objective: 817 To check the scale of IP Prefixes advertised by the DUT to the peer 818 router. 820 Procedure: 822 Configure EPN EVI in R1,MHPE2,DUT.All 4 routers except CE are 823 running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and 824 DUT.Once the bgp comes up check the DUT evpn table.For MH PE ESI must 825 be configured per IFD/Interface.Configure the X IRB sub interface 826 in the DUT which is not extended to peer router. 828 Measurement: 830 The DUT must advertise X IP prefixes of the IRB to the peer 831 router. 833 6. Scale 834 6.1. To Scale the DUT to N EVI and clear bgp in DUT with out traffic. 836 Objective: 838 INTERNET DRAFT 840 The main purpose of the test the DUT performance to scale N EVI's. 841 Then clear bgp neighbor. There should not be any loss of routes or 842 any crashes. 844 Procedure: 846 Configure EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are 847 running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and 848 DUT.Once the bgp comes up check the DUT evpn table.For MHPE,DUT ESI 849 must be configured per IFD/Interface. Using RT(traffic generator) 850 to send the traffic to the routers. 852 Measurement 854 There should not be any loss of route types 1,2,3 and 4 in DUT. 856 PBB-EVPN To Scale the DUT to N PBB-EVPN instances and clear bgp in 857 DUT without traffic. 859 Objective: 861 The main purpose of the test the DUT performance to scale N PBB- 862 EVPN instances.Then clear bgp neighbor.There should not be any loss 863 of routes or any crashes. 865 Procedure: 867 Configure PBB-EVPN instances in R1,MHPE2,DUT.All 4 routers except 868 CE are running mpls,bgp,RR is acting as route reflector to R1,MHPE2 869 and DUT.Once the bgp comes up check the DUT evpn table.For MH PE 870 ESI must be configured per IFD/Interface.Using RT(traffic 871 generator) to send the traffic to the routers. 873 Measurement 875 There should not be any loss of route types 2,3 and 4 in DUT. 877 INTERNET DRAFT 879 6.2. To Scale the DUT to N EVI and clear bgp in DUT with 880 traffic.Measure the convergence time 882 Objective: 884 The main purpose of the test the DUT performance to scale N EVI's 885 with traffic. Then clear bgp neighbor.There should not be any loss 886 of routes or any crashes. Send F frames from CE to DUT from 887 traffic generator with different SA and DA for N EVI's. Send F 888 frames from traffic generator to R1 with different SA and DA for N 889 EVI's.so that 2F number of mac address will be learned in DUT. 890 There is a bi directional traffic flow with F pps in each 891 direction. Then clear the bgp nei in DUT after the bgp comes up and 892 started learning the routes, measure the time taken to learn all 893 2F mac routes. 895 Procedure: 897 Configure EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are 898 running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and 899 DUT.Once the bgp comes up check the DUT evpn table.For MH PE ESI must 900 be configured per IFD/Interface. Using RT(traffic generator) to 901 send the traffic to the routers. 903 Measurement: 905 The DUT must learn all 2F mac address.Measure the time taken to 906 learn 2F mac in DUT, measure the flood traffic time "t" of DUT 908 PBB-EVPN To Scale the DUT to "N" PBB-EVPN instances and clear bgp 909 in DUT with traffic.Measure the convergence time 911 Objective: 913 The main purpose of the test the DUT performance to scale N pbb- 914 evpn instances with traffic.Then clear bgp neighbor.There should 915 not be any loss of routes or any crashes.Send F frames from CE to 916 DUT from traffic generator with different SA and DA for N pbb-evpn 917 instances.Send F frames from traffic generator to R1 with different 918 SA and DA for N pbb-evpn instances.so that F mac address will be 919 learned in DUT.There is a bi directional traffic flow with F pps in 920 each direction.Then clear the bgp nei in DUT after the bgp comes up 921 and started learning the routes, measure the time taken to learn 922 all 2F macs in DUT. 924 INTERNET DRAFT 926 Procedure: 928 Configure PBB-EVPN instances in R1,MHPE2,DUT.All 4 routers except 929 CE are running mpls,bgp,RR is acting as route reflector to R1,MHPE2 930 and DUT.Once the bgp comes up check the DUT evpn table.For MH PE 931 ESI must be configured per IFD/Interface. Using RT(traffic 932 generator) to send the traffic to the routers. 934 Measurement: 936 The DUT must learn all 2F mac address.Measure the time taken 937 to learn 2F mac in DUT, measure the flood traffic time "t" of DUT 939 7. Soak Test 941 7.1. To Scale the DUT to N EVI in DUT with traffic and run the set up 942 for 24hrs 944 Objective: 946 The main purpose of the test the DUT performance to scale N EVI's 947 with traffic.There should not be any loss of routes or any crashes. 948 Send F frames from CE to DUT from traffic generator with different 949 SA and DA for N EVI's.Send F frames from traffic generator to R1 with 950 different SA and DA for N EVI's.so that 2F mac address will be 951 learned in DUT. There is a bi directional traffic flow with F 952 pps in each direction.Keep the setup up and running for 24 hrs, 953 take hourly CPU utilization,memory usage. 955 Procedure: 957 Configure EVPN EVI in R1,MHPE2,DUT.All 4 routers except CE are 958 running mpls,bgp,RR is acting as route reflector to R1,MHPE2 and 959 DUT.Once the bgp comes up check the DUT evpn table.For MH PE ESI must 960 be configured per IFD/Interface. Using RT(traffic generator) to 961 send the traffic to the routers. 963 Measurement: 965 Take the hourly reading of CPU,process memory.There should not be 966 any leak,crashes,CPU spikes. 968 INTERNET DRAFT 970 PBB-EVPN To Scale the DUT to N PBB-EVPN instances in DUT with 971 traffic and run the set up for 24hrs 973 Objective: 975 The main purpose of the test the DUT performance to scale N EVI's 976 with traffic.There should not be any 977 loss of routes or any crashes.Send F frames from CE to DUT from 978 traffic generator with different SA and DA for N EVI's.Send F 979 frames from traffic generator to R1 with different SA and DA for N 980 EVI's.so that 2F mac address will be learned in DUT. There is a bi 981 directional traffic flow with F pps in each direction.Keep the 982 setup up and running for 24 hrs,take hourly CPU utilization,memory 983 usage. 985 Procedure: 987 Configure PBB-EVPN instances in R1,MHPE2,DUT.All 4 routers except 988 CE are running mpls,bgp,RR is acting as route reflector to R1,MHPE2 989 and DUT.Once the bgp comes up check the DUT evpn table.For MH PE 990 ESI must be configured per IFD/Interface. Using RT(traffic 991 generator) to send the traffic to the routers. 993 Measurement: 995 Take the hourly reading of CPU,process memory.There should not be 996 any leak,crashes,CPU spikes. 998 INTERNET DRAFT 1000 8. Acknowledgements 1002 We would like to thank Fioccola Giuseppe of Telecom Italia 1003 reviewing our draft and commenting it. 1005 9. IANA Considerations 1007 This memo includes no request to IANA. 1009 10. Security Considerations 1011 There is no additional consideration from RFC 6192. 1012 11 References 1014 11.1 Normative References 1016 [RFC2119] Bradner, S., "Key words for use in RFCs to 1017 Indicate Requirement Levels", BCP 14, RFC 2119, 1018 DOI 10.17487/RFC2119, June 1997,. 1021 [RFC2544] Bradner, S. and J. McQuaid, "Benchmarking 1022 Methodology for Network Interconnect Devices", RFC 1023 2544,DOI 10.17487/RFC2544, June 1999,. 1026 [RFC2889] R.Mandeville and J. Perser "Benchmarking Methodology 1027 for LAN Switching Devices" 1029 11.2 Informative References 1031 [RFC7432] Sajassi, A., Ed., Aggarwal, R., Bitar, N., 1032 Isaac, A.,Uttaro, J., Drake, J., and W.Henderickx, 1033 "BGP MPLS-Based Ethernet VPN", 1034 RFC 7432, DOI 10.17487/RFC7432, February 1035 2015, . 1037 [RFC7623] Sajassi, A., Ed., Aggarwal, R., Bitar, N., 1038 Isaac, A.,J., Drake, J., and W. Henderickx, 1039 " Provider Backbone Bridging Combined with Ethernet 1040 VPN(PBB-EVPN)",RFC 7623,10.17487/RFC7623,September 2015 1041 . 1043 INTERNET DRAFT 1045 Authors' Addresses 1047 Appendix A. Appendix 1049 Authors' Addresses 1051 Sudhin Jacob (editor) 1052 Juniper Networks 1053 Bangalore 1054 India 1056 Phone: +91 8061212543 1057 Email: sjacob@juniper.net 1058 sudhinjacob@rediffmail.com 1060 Kishore Tiruveedhula 1061 Juniper Networks 1062 10 Technology Park Dr 1063 Westford, MA 01886 1064 USA 1066 Phone: +1 9785898861 1067 Email: kishoret@juniper.net