idnits 2.17.1 draft-dreibholz-mptcp-nornet-experience-05.txt: Checking boilerplate required by RFC 5378 and the IETF Trust (see https://trustee.ietf.org/license-info): ---------------------------------------------------------------------------- No issues found here. Checking nits according to https://www.ietf.org/id-info/1id-guidelines.txt: ---------------------------------------------------------------------------- No issues found here. Checking nits according to https://www.ietf.org/id-info/checklist : ---------------------------------------------------------------------------- No issues found here. Miscellaneous warnings: ---------------------------------------------------------------------------- == The copyright year in the IETF Trust and authors Copyright Line does not match the current year -- The document date (December 3, 2019) is 1605 days in the past. Is this intentional? Checking references for intended status: Informational ---------------------------------------------------------------------------- ** Obsolete normative reference: RFC 6824 (ref. '2') (Obsoleted by RFC 8684) Summary: 1 error (**), 0 flaws (~~), 1 warning (==), 1 comment (--). Run idnits with the --verbose option for more detailed information about the items above. -------------------------------------------------------------------------------- 2 Network Working Group T. Dreibholz 3 Internet-Draft SimulaMet 4 Intended status: Informational S. Ferlin 5 Expires: June 5, 2020 Simula Research Laboratory 6 O. Alay 7 A. Elmokashfi 8 I. Livadariu 9 SimulaMet 10 X. Zhou 11 Hainan University 12 December 3, 2019 14 MPTCP Experiences in the NorNet Testbed 15 draft-dreibholz-mptcp-nornet-experience-05 17 Abstract 19 This document collects some experiences of Multi-Path TCP (MPTCP) 20 evaluations in the NorNet testbed. 22 Status of This Memo 24 This Internet-Draft is submitted in full conformance with the 25 provisions of BCP 78 and BCP 79. 27 Internet-Drafts are working documents of the Internet Engineering 28 Task Force (IETF). Note that other groups may also distribute 29 working documents as Internet-Drafts. The list of current Internet- 30 Drafts is at https://datatracker.ietf.org/drafts/current/. 32 Internet-Drafts are draft documents valid for a maximum of six months 33 and may be updated, replaced, or obsoleted by other documents at any 34 time. It is inappropriate to use Internet-Drafts as reference 35 material or to cite them other than as "work in progress." 37 This Internet-Draft will expire on June 5, 2020. 39 Copyright Notice 41 Copyright (c) 2019 IETF Trust and the persons identified as the 42 document authors. All rights reserved. 44 This document is subject to BCP 78 and the IETF Trust's Legal 45 Provisions Relating to IETF Documents 46 (https://trustee.ietf.org/license-info) in effect on the date of 47 publication of this document. Please review these documents 48 carefully, as they describe your rights and restrictions with respect 49 to this document. Code Components extracted from this document must 50 include Simplified BSD License text as described in Section 4.e of 51 the Trust Legal Provisions and are provided without warranty as 52 described in the Simplified BSD License. 54 Table of Contents 56 1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . 2 57 1.1. Abbreviations . . . . . . . . . . . . . . . . . . . . . . 2 58 1.2. Multi-Path TCP . . . . . . . . . . . . . . . . . . . . . 2 59 1.3. Scope . . . . . . . . . . . . . . . . . . . . . . . . . . 2 60 2. Testbed Evaluation . . . . . . . . . . . . . . . . . . . . . 3 61 2.1. The NorNet Testbed . . . . . . . . . . . . . . . . . . . 3 62 2.2. Multi-Path TCP in NorNet . . . . . . . . . . . . . . . . 3 63 2.3. NetPerfMeter . . . . . . . . . . . . . . . . . . . . . . 3 64 3. Research Results and Work in Progress . . . . . . . . . . . . 4 65 4. Security Considerations . . . . . . . . . . . . . . . . . . . 5 66 5. IANA Considerations . . . . . . . . . . . . . . . . . . . . . 5 67 6. Acknowledgments . . . . . . . . . . . . . . . . . . . . . . . 5 68 7. References . . . . . . . . . . . . . . . . . . . . . . . . . 6 69 7.1. Normative References . . . . . . . . . . . . . . . . . . 6 70 7.2. Informative References . . . . . . . . . . . . . . . . . 6 71 Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . . 11 73 1. Introduction 75 1.1. Abbreviations 77 o TCP: Transmission Control Protocol 79 o MPTCP: Multi-Path TCP 81 1.2. Multi-Path TCP 83 The Multi-Path TCP (MPTCP) extension for the Transmission Control 84 Protocol (TCP) has been defined in [3], [4], [1], [2], [5]. There 85 are also detailed introductions provided for example by [8], [9] as 86 well as lots of further information material on [6]. MPTCP is 87 therefore not introduced in more detail here. 89 1.3. Scope 91 The scope of this document is to collect some experiences with the 92 usage of MPTCP in the NorNet testbed, a large-scale Internet testbed 93 for multi-homed systems. 95 2. Testbed Evaluation 97 2.1. The NorNet Testbed 99 The NorNet testbed (https://www.nntb.no) introduced in [11], [15], 100 [10] is a programmable testbed platform with focus on the evaluation 101 of multi-homed systems. It consists of programmable nodes that are 102 distributed all over Norway as well as further locations in other 103 countries. NotNet is built and operated by the Simula Research 104 Laboratory and financed by Forskningsraedet (the Research Council of 105 Norway) through their INFRASTRUKTUR program (project number 208798/ 106 F50). 108 NorNet has two main components: NorNet Core and NorNet Edge. NorNet 109 Core consists of currently 20 programmable sites 110 (https://www.nntb.no/pub/nornet-configuration/NorNetCore-Sites.html), 111 most of them multi-homed to several network providers. Details can 112 be found in [12], [14], [11] and [16]. NorNet Edge consists of 113 several hundreds of smaller nodes connected to all mobile broadband 114 providers in Norway (http://robustenett.no/map), details can be found 115 in [13]. Together, these two components offer a unique platform for 116 experimental networking research. NorNet is made available to the 117 international networking research community. 119 Further details on NorNet can be found on the NorNet website [17]. 121 2.2. Multi-Path TCP in NorNet 123 The NorNet nodes are Linux-based and therefore run the Linux MPTCP 124 implementation by Universite catholique de Louvain-la-Neuve (see 125 [18]). With support by all NorNet Core nodes (circa 100 nodes at 126 currently 20 sites) and most NorNet Edge nodes (several hundreds), 127 NorNet probably provides the world's largest MPTCP experimentation 128 platform. 130 2.3. NetPerfMeter 132 NetPerfMeter [19], [7] is a network performance meter for the UDP, 133 TCP, MPTCP, SCTP and DCCP transport protocols over IPv4 and IPv6. It 134 simultaneously transmits bidirectional flows to an endpoint and 135 measures the resulting flow bandwidths and QoS. The results are 136 written as vector and scalar files. NetPerfMeter is provided in 137 NorNet to allow for transport protocol comparisons and transport 138 protocol performance evaluations. 140 3. Research Results and Work in Progress 142 So far, work has been done on evaluating MPTCP in the real-world 143 Internet. The following list is a short overview of current 144 research: 146 o [20] examines the different properties of 3G paths (UMTS as well 147 as CDMA2000) in NorNet Edge. These results provide an overview of 148 the QoS characteristics that can be expected by multi-path 149 transport protocols (and particularly by MPTCP) on different 150 paths. 152 o [21] analyzes the impact of buffer bloat on MPTCP connections over 153 mobile broadband (2G, 3G) and WLAN paths. Furthermore, it 154 proposes and evaluates Multi-Path Transport Bufferbloat Mitigation 155 (MPT-BM), a bufferbloat mitigation algorithm to improve MPTCP 156 performance in buffer-bloated wireless networks. 158 o [22] examines the performance benefits of multi-path transport 159 with MPTCP under heterogeneous wireless networks. It furthermore 160 introduces and evaluates the Dynamic Relative Path Scoring 161 (DRePaS) algorithm that optimizes the path management in such 162 setups. 164 o [23] examines the performance benefits of the state-of-the-art 165 Linux MPTCP implementation in a large-scale NorNet setup, covering 166 sites in multiple countries on different continents. It 167 particularly also shortly introduces the NetPerfMeter measurement 168 tool that is used to perform the measurements, and particularly 169 its extension for MPTCP. 171 o [24] examines how the IPv4/IPv6 identity duality can be utilized 172 with MPTCP in order to improve performance even in case of only a 173 single ISP connection. 175 o [25] provides an introduction to the NetPerfMeter tool for MPTCP 176 experiments. 178 o [26] presents MPTCP's architecture and multi-path congestion 179 control algorithm concepts. Then, it examines three test 180 scenarios in the NorNet testbed, particularly highlighting the 181 performance difference between using uncoupled and coupled 182 congestion controls in multi-homed, real-world Internet setups. 184 o [27] introduces a scanning infrastructure to search for MPTCP- 185 capable hosts in the Internet. In a study, it used the top-1M 186 Alexa servers to test the platform and gain insight about server 187 support for MPTCP. 189 o [28] proposes a practical shared bottleneck detection (SBD) 190 algorithm for MPTCP, namely MPTCP-SBD. Through extensive 191 emulations, it is shown that MPTCP-SBD outperforms all currently 192 deployed MPTCP coupled congestion controls by accurately detecting 193 bottlenecks resulting in throughput gains in the absence of shared 194 bottlenecks, while remaining fair to TCP in shared bottlenecks 195 scenarios. 197 o [29] proposes a send-window BLocking ESTimation scheduler, BLEST, 198 which aims to minimise head-of-line-blocking in heterogeneous 199 networks. BLEST increases the potential for capacity aggregation 200 by reducing the number of spurious retransmissions. 202 o [30] examines path management strategies for MPTCP in real-world, 203 multi-homed Internet setups. Particular goal is to highlight the 204 performance impact of different path management and congestion 205 control settings in such realistic scenarios. 207 o [31] analyses the actual buffer size requirements for MPTCP in 208 heterogeneous, multi-homed Internet setups. Particular goal is to 209 provide some guidelines on buffer size requirements for achieving 210 a reasonable throughput, while on the other hand not wasting 211 resources. 213 o [32] examines the relationship of buffer size with throughput and 214 congestion control algorithms, based on the statistical predictive 215 modelling method. 217 o [33] examines the application of MPTCP for real-time video 218 streaming for future Mobile Edge Computing (MEC) scenarios. 220 4. Security Considerations 222 Security considerations on MPTCP are described in [3]. 224 5. IANA Considerations 226 This document has no actions for IANA. 228 6. Acknowledgments 230 The authors would like to thank Hakim Adhari, Fa Fu, Feng Zhou and 231 Kun Wang for discussions and support. 233 7. References 235 7.1. Normative References 237 [1] Raiciu, C., Handley, M., and D. Wischik, "Coupled 238 Congestion Control for Multipath Transport Protocols", 239 RFC 6356, DOI 10.17487/RFC6356, October 2011, 240 . 242 [2] Ford, A., Raiciu, C., Handley, M., and O. Bonaventure, 243 "TCP Extensions for Multipath Operation with Multiple 244 Addresses", RFC 6824, DOI 10.17487/RFC6824, January 2013, 245 . 247 7.2. Informative References 249 [3] Bagnulo, M., "Threat Analysis for TCP Extensions for 250 Multipath Operation with Multiple Addresses", RFC 6181, 251 DOI 10.17487/RFC6181, March 2011, 252 . 254 [4] Ford, A., Raiciu, C., Handley, M., Barre, S., and J. 255 Iyengar, "Architectural Guidelines for Multipath TCP 256 Development", RFC 6182, DOI 10.17487/RFC6182, March 2011, 257 . 259 [5] Scharf, M. and A. Ford, "Multipath TCP (MPTCP) Application 260 Interface Considerations", RFC 6897, DOI 10.17487/RFC6897, 261 March 2013, . 263 [6] Dreibholz, T., "Thomas Dreibholz's MPTCP Page", 264 Online: https://www.uni-due.de/~be0001/mptcp/, 2016, 265 . 267 [7] Dreibholz, T., "NetPerfMeter - A TCP/MPTCP/UDP/SCTP/DCCP 268 Network Performance Meter Tool", 269 Online: https://www.uni-due.de/~be0001/netperfmeter/, 270 2016, . 272 [8] Becke, M., "Revisiting the IETF Multipath Extensions on 273 Transport Layer", November 2014, 274 . 278 [9] Ruengeler, I., "SCTP - Evaluating, Improving and Extending 279 the Protocol for Broader Deployment", December 2009, 280 . 284 [10] Dreibholz, T., "The NorNet Testbed for Multi-Homed Systems 285 - Introduction and Status", Invited Talk at Princeton 286 University, Department of Computer Science, May 2014, 287 . 290 [11] Dreibholz, T., "NorNet at NICTA - An Introduction to the 291 NorNet Testbed", Invited Talk at National Information 292 Communications Technology Australia (NICTA), January 2016, 293 . 296 [12] Gran, E., Dreibholz, T., and A. Kvalbein, "NorNet Core - A 297 Multi-Homed Research Testbed", Computer Networks, Special 298 Issue on Future Internet Testbeds Volume 61, Pages 75-87, 299 ISSN 1389-1286, DOI 10.1016/j.bjp.2013.12.035, March 2014, 300 . 302 [13] Kvalbein, A., Baltrunas, D., Evensen, K., Xiang, J., 303 Elmokashfi, A., and S. Ferlin, "The NorNet Edge Platform 304 for Mobile Broadband Measurements", Computer Networks, 305 Special Issue on Future Internet Testbeds Volume 61, Pages 306 88-101, ISSN 1389-1286, DOI 10.1016/j.bjp.2013.12.036, 307 March 2014, 308 . 311 [14] Dreibholz, T. and E. Gran, "Design and Implementation of 312 the NorNet Core Research Testbed for Multi-Homed Systems", 313 Proceedings of the 3nd International Workshop on Protocols 314 and Applications with Multi-Homing Support (PAMS) Pages 315 1094-1100, ISBN 978-0-7695-4952-1, 316 DOI 10.1109/WAINA.2013.71, March 2013, 317 . 321 [15] Dreibholz, T., "Multi-Path Transport - From Simulations to 322 Real-World Internet Measurements", Keynote Talk at the 323 Universidad de Castilla-La Mancha, Instituto de 324 Investigacion Informatica de Albacete, February 2017, 325 . 328 [16] Dreibholz, T., "An Experiment Tutorial for the NorNet Core 329 Testbed at the the Universidad de Castilla-La Mancha", 330 Tutorial at the Universidad de Castilla-La Mancha, 331 Instituto de Investigacion Informatica de Albacete, 332 February 2017, . 335 [17] Dreibholz, T., "NorNet - A Real-World, Large-Scale Multi- 336 Homing Testbed", Online: https://www.nntb.no/, 2017, 337 . 339 [18] Paasch, C. and S. Barre, "Multipath TCP implementation in 340 the Linux kernel", Online: http://www.multipath-tcp.org, 341 2016, . 343 [19] Dreibholz, T., Becke, M., Adhari, H., and E. Rathgeb, 344 "Evaluation of A New Multipath Congestion Control Scheme 345 using the NetPerfMeter Tool-Chain", Proceedings of the 346 19th IEEE International Conference on Software, 347 Telecommunications and Computer Networks (SoftCOM) Pages 348 1-6, ISBN 978-953-290-027-9, September 2011, 349 . 352 [20] Ferlin, S., Dreibholz, T., Alay, Oe., and A. Kvalbein, 353 "Measuring the QoS Characteristics of Operational 3G 354 Mobile Broadband Networks", Proceedings of the 4th 355 International Workshop on Protocols and Applications with 356 Multi-Homing Support (PAMS) Pages 753-758, 357 ISBN 978-1-4799-2652-7, DOI 10.1109/WAINA.2014.123, May 358 2014, . 361 [21] Ferlin, S., Dreibholz, T., and Oe. Alay, "Tackling the 362 Challenge of Bufferbloat in Multi-Path Transport over 363 Heterogeneous Wireless Networks", Proceedings of the IEEE/ 364 ACM International Symposium on Quality of 365 Service (IWQoS) Pages 123-128, ISBN 978-1-4799-4852-9, 366 DOI 10.1109/IWQoS.2014.6914310, May 2014, 367 . 370 [22] Ferlin, S., Dreibholz, T., and Oe. Alay, "Multi-Path 371 Transport over Heterogeneous Wireless Networks: Does it 372 really pay off?", Proceedings of the IEEE Global 373 Communications Conference (GLOBECOM) Pages 5005-5011, 374 ISBN 978-1-4799-3512-3, December 2014, 375 . 378 [23] Dreibholz, T., Zhou, X., and F. Fa, "Multi-Path TCP in 379 Real-World Setups - An Evaluation in the NorNet Core 380 Testbed", 5th International Workshop on Protocols and 381 Applications with Multi-Homing Support (PAMS), March 2015, 382 . 385 [24] Livadariu, I., Ferlin, S., Alay, Oe., Dreibholz, T., 386 Dhamdhere, A., and A. Elmokashfi, "Leveraging the IPv4/ 387 IPv6 Identity Duality by using Multi-Path Transport", 388 Proceedings of the 18th IEEE Global Internet 389 Symposium (GI), April 2015, . 392 [25] Dreibholz, T., "NetPerfMeter: A Network Performance 393 Metering Tool", Multipath TCP Blog, September 2015, 394 . 397 [26] Fa, F., Zhou, X., Dreibholz, T., Wang, K., Zhou, F., and 398 Q. Gan, "Performance Comparison of Congestion Control 399 Strategies for Multi-Path TCP in the NorNet Testbed", 400 Proceedings of the 4th IEEE/CIC International Conference 401 on Communications in China (ICCC) Pages 607-612, 402 ISBN 978-1-5090-0243-6, November 2015, . 406 [27] Mehani, O., Holz, R., Ferlin, S., and R. Boreli, "An Early 407 Look at Multipath TCP Deployment in the Wild", Proceedings 408 of the 6th International Workshop on Hot Topics in Planet- 409 Scale Measurement ISBN 978-1-4503-3534-8, 410 DOI 10.1145/2798087.2798088, 2015, 411 . 414 [28] Ferlin, S., Alay, Oe., Hayes, D., Dreibholz, T., and M. 415 Welzl, "Revisiting Congestion Control for Multipath TCP 416 with Shared Bottleneck Detection", Proceedings of the 417 35th IEEE International Conference on Computer 418 Communications (INFOCOM), April 2016. 420 [29] Ferlin, S., Alay, Oe., Mehani, O., and R. Boreli, "BLEST: 421 Blocking Estimation-Based MPTCP Scheduler for 422 Heterogeneous Networks", Proceedings of the IFIP 423 Networking Conference Pages 431-439, 424 DOI 10.1109/IFIPNetworking.2016.7497206, May 2016, 425 . 428 [30] Wang, K., Dreibholz, T., Zhou, X., Fu, F., Tan, Y., Cheng, 429 X., and Q. Tan, "On the Path Management of Multi-Path TCP 430 in Internet Scenarios based on the NorNet Testbed", 431 Proceedings of the IEEE International Conference on 432 Advanced Information Networking and 433 Applications (AINA) ISBN 978-1-5090-6028-3, March 2017, 434 . 437 [31] Zhou, F., Dreibholz, T., Zhou, X., Fu, F., Tan, Y., and Q. 438 Gan, "The Performance Impact of Buffer Sizes for Multi- 439 Path TCP in Internet Setups", Proceedings of the IEEE 440 International Conference on Advanced Information 441 Networking and Applications (AINA) ISBN 978-1-5090-6028-3, 442 March 2017, . 445 [32] Tan, Q., Yang, X., Zhao, L., Zhou, X., and T. Dreibholz, 446 "A Statistic Procedure to Find Formulae for Buffer Size in 447 MPTCP", Proceedings of the 3rd IEEE Advanced Information 448 Technology, Electronic and Automation Control 449 Conference (IAEAC) Pages 900-907, ISBN 978-1-5386-4509-3, 450 October 2018, 451 . 453 [33] Luo, Y., Zhou, X., Dreibholz, T., and H. Kuang, "A Real- 454 Time Video Streaming System over IPv6+MPTCP Technology", 455 Proceedings of the 1st International Workshop on Recent 456 Advances for Multi-Clouds and Mobile Edge Computing (M2EC) 457 in conjunction with the 33rd International Conference on 458 Advanced Information Networking and Applications (AINA), 459 March 2019, . 462 Authors' Addresses 464 Thomas Dreibholz 465 Simula Metropolitan Centre for Digital Engineering 466 Pilestredet 52 467 0167 Oslo, Oslo 468 Norway 470 Phone: +47-6782-8200 471 Fax: +47-6782-8201 472 Email: dreibh@simula.no 473 URI: https://www.simula.no/people/dreibh 475 Simone Ferlin 476 Simula Research Laboratory, Networks Department 477 Martin Linges vei 17 478 1364 Fornebu, Akershus 479 Norway 481 Phone: +47-4072-0702 482 Fax: +47-4072-0702 483 Email: ferlin@simula.no 484 URI: https://www.simula.no/people/ferlin 486 Ozgu Alay 487 Simula Metropolitan Centre for Digital Engineering 488 Pilestredet 52 489 0167 Oslo, Oslo 490 Norway 492 Phone: +47-9848-5362 493 Fax: +47-9848-5362 494 Email: ozgu@simula.no 495 URI: https://www.simula.no/people/ozgu 497 Ahmed Elmokashfi 498 Simula Metropolitan Centre for Digital Engineering 499 Pilestredet 52 500 0167 Oslo, Oslo 501 Norway 503 Phone: +47-474-52-315 504 Fax: +47-6782-8201 505 Email: ahmed@simula.no 506 URI: https://www.simula.no/people/ahmed 507 Ioana Alexandrina Livadariu 508 Simula Metropolitan Centre for Digital Engineering 509 Pilestredet 52 510 0167 Oslo, Oslo 511 Norway 513 Phone: +47-453-98-686 514 Fax: +47-6782-8201 515 Email: ioana@simula.no 516 URI: https://www.simula.no/people/ioana 518 Xing Zhou 519 Hainan University, College of Information Science and Technology 520 Renmin Avenue 58 521 570228 Haikou, Hainan 522 China 524 Phone: +86-898-66279141 525 Email: zhouxing@hainu.edu.cn 526 URI: http://www.hainu.edu.cn/stm/xinxi/2011330/10409758.shtml