idnits 2.17.1 draft-dreibholz-mptcp-nornet-experience-04.txt: Checking boilerplate required by RFC 5378 and the IETF Trust (see https://trustee.ietf.org/license-info): ---------------------------------------------------------------------------- No issues found here. Checking nits according to https://www.ietf.org/id-info/1id-guidelines.txt: ---------------------------------------------------------------------------- No issues found here. Checking nits according to https://www.ietf.org/id-info/checklist : ---------------------------------------------------------------------------- No issues found here. Miscellaneous warnings: ---------------------------------------------------------------------------- == The copyright year in the IETF Trust and authors Copyright Line does not match the current year -- The document date (March 30, 2017) is 2577 days in the past. Is this intentional? Checking references for intended status: Informational ---------------------------------------------------------------------------- ** Obsolete normative reference: RFC 6824 (ref. '2') (Obsoleted by RFC 8684) Summary: 1 error (**), 0 flaws (~~), 1 warning (==), 1 comment (--). Run idnits with the --verbose option for more detailed information about the items above. -------------------------------------------------------------------------------- 2 Network Working Group T. Dreibholz, Ed. 3 Internet-Draft S. Ferlin 4 Intended status: Informational O. Alay 5 Expires: October 1, 2017 A. Elmokashfi 6 I. Livadariu 7 Simula Research Laboratory 8 X. Zhou 9 Hainan University 10 March 30, 2017 12 MPTCP Experiences in the NorNet Testbed 13 draft-dreibholz-mptcp-nornet-experience-04.txt 15 Abstract 17 This document collects some experiences of Multi-Path TCP (MPTCP) 18 evaluations in the NorNet testbed. 20 Status of This Memo 22 This Internet-Draft is submitted in full conformance with the 23 provisions of BCP 78 and BCP 79. 25 Internet-Drafts are working documents of the Internet Engineering 26 Task Force (IETF). Note that other groups may also distribute 27 working documents as Internet-Drafts. The list of current Internet- 28 Drafts is at http://datatracker.ietf.org/drafts/current/. 30 Internet-Drafts are draft documents valid for a maximum of six months 31 and may be updated, replaced, or obsoleted by other documents at any 32 time. It is inappropriate to use Internet-Drafts as reference 33 material or to cite them other than as "work in progress." 35 This Internet-Draft will expire on October 1, 2017. 37 Copyright Notice 39 Copyright (c) 2017 IETF Trust and the persons identified as the 40 document authors. All rights reserved. 42 This document is subject to BCP 78 and the IETF Trust's Legal 43 Provisions Relating to IETF Documents 44 (http://trustee.ietf.org/license-info) in effect on the date of 45 publication of this document. Please review these documents 46 carefully, as they describe your rights and restrictions with respect 47 to this document. Code Components extracted from this document must 48 include Simplified BSD License text as described in Section 4.e of 49 the Trust Legal Provisions and are provided without warranty as 50 described in the Simplified BSD License. 52 Table of Contents 54 1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . 2 55 1.1. Abbreviations . . . . . . . . . . . . . . . . . . . . . . 2 56 1.2. Multi-Path TCP . . . . . . . . . . . . . . . . . . . . . 2 57 1.3. Scope . . . . . . . . . . . . . . . . . . . . . . . . . . 2 58 2. Testbed Evaluation . . . . . . . . . . . . . . . . . . . . . 3 59 2.1. The NorNet Testbed . . . . . . . . . . . . . . . . . . . 3 60 2.2. Multi-Path TCP in NorNet . . . . . . . . . . . . . . . . 3 61 2.3. NetPerfMeter . . . . . . . . . . . . . . . . . . . . . . 3 62 3. Research Results and Work in Progress . . . . . . . . . . . . 4 63 4. Security Considerations . . . . . . . . . . . . . . . . . . . 5 64 5. IANA Considerations . . . . . . . . . . . . . . . . . . . . . 5 65 6. Acknowledgments . . . . . . . . . . . . . . . . . . . . . . . 5 66 7. References . . . . . . . . . . . . . . . . . . . . . . . . . 5 67 7.1. Normative References . . . . . . . . . . . . . . . . . . 5 68 7.2. Informative References . . . . . . . . . . . . . . . . . 6 69 Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . . 10 71 1. Introduction 73 1.1. Abbreviations 75 o TCP: Transmission Control Protocol 77 o MPTCP: Multi-Path TCP 79 1.2. Multi-Path TCP 81 The Multi-Path TCP (MPTCP) extension for the Transmission Control 82 Protocol (TCP) has been defined in [3], [4], [1], [2], [5]. There 83 are also detailed introductions provided for example by [8], [9] as 84 well as lots of further information material on [6]. MPTCP is 85 therefore not introduced in more detail here. 87 1.3. Scope 89 The scope of this document is to collect some experiences with the 90 usage of MPTCP in the NorNet testbed, a large-scale Internet testbed 91 for multi-homed systems. 93 2. Testbed Evaluation 95 2.1. The NorNet Testbed 97 The NorNet testbed (https://www.nntb.no) introduced in [11], [15], 98 [10] is a programmable testbed platform with focus on the evaluation 99 of multi-homed systems. It consists of programmable nodes that are 100 distributed all over Norway as well as further locations in other 101 countries. NotNet is built and operated by the Simula Research 102 Laboratory and financed by Forskningsraedet (the Research Council of 103 Norway) through their INFRASTRUKTUR program (project number 208798/ 104 F50). 106 NorNet has two main components: NorNet Core and NorNet Edge. NorNet 107 Core consists of currently 20 programmable sites 108 (https://www.nntb.no/pub/nornet-configuration/NorNetCore-Sites.html), 109 most of them multi-homed to several network providers. Details can 110 be found in [12], [14], [11] and [16]. NorNet Edge consists of 111 several hundreds of smaller nodes connected to all mobile broadband 112 providers in Norway (http://robustenett.no/map), details can be found 113 in [13]. Together, these two components offer a unique platform for 114 experimental networking research. NorNet is made available to the 115 international networking research community. 117 Further details on NorNet can be found on the NorNet website [17]. 119 2.2. Multi-Path TCP in NorNet 121 The NorNet nodes are Linux-based and therefore run the Linux MPTCP 122 implementation by Universite catholique de Louvain-la-Neuve (see 123 [18]). With support by all NorNet Core nodes (circa 100 nodes at 124 currently 20 sites) and most NorNet Edge nodes (several hundreds), 125 NorNet probably provides the world's largest MPTCP experimentation 126 platform. 128 2.3. NetPerfMeter 130 NetPerfMeter [19], [7] is a network performance meter for the UDP, 131 TCP, MPTCP, SCTP and DCCP transport protocols over IPv4 and IPv6. It 132 simultaneously transmits bidirectional flows to an endpoint and 133 measures the resulting flow bandwidths and QoS. The results are 134 written as vector and scalar files. NetPerfMeter is provided in 135 NorNet to allow for transport protocol comparisons and transport 136 protocol performance evaluations. 138 3. Research Results and Work in Progress 140 So far, work has been done on evaluating MPTCP in the real-world 141 Internet. The following list is a short overview of current 142 research: 144 o [20] examines the different properties of 3G paths (UMTS as well 145 as CDMA2000) in NorNet Edge. These results provide an overview of 146 the QoS characteristics that can be expected by multi-path 147 transport protocols (and particularly by MPTCP) on different 148 paths. 150 o [21] analyzes the impact of buffer bloat on MPTCP connections over 151 mobile broadband (2G, 3G) and WLAN paths. Furthermore, it 152 proposes and evaluates Multi-Path Transport Bufferbloat Mitigation 153 (MPT-BM), a bufferbloat mitigation algorithm to improve MPTCP 154 performance in buffer-bloated wireless networks. 156 o [22] examines the performance benefits of multi-path transport 157 with MPTCP under heterogeneous wireless networks. It furthermore 158 introduces and evaluates the Dynamic Relative Path Scoring 159 (DRePaS) algorithm that optimizes the path management in such 160 setups. 162 o [23] examines the performance benefits of the state-of-the-art 163 Linux MPTCP implementation in a large-scale NorNet setup, covering 164 sites in multiple countries on different continents. It 165 particularly also shortly introduces the NetPerfMeter measurement 166 tool that is used to perform the measurements, and particularly 167 its extension for MPTCP. 169 o [24] examines how the IPv4/IPv6 identity duality can be utilized 170 with MPTCP in order to improve performance even in case of only a 171 single ISP connection. 173 o [25] provides an introduction to the NetPerfMeter tool for MPTCP 174 experiments. 176 o [26] presents MPTCP's architecture and multi-path congestion 177 control algorithm concepts. Then, it examines three test 178 scenarios in the NorNet testbed, particularly highlighting the 179 performance difference between using uncoupled and coupled 180 congestion controls in multi-homed, real-world Internet setups. 182 o [27] introduces a scanning infrastructure to search for MPTCP- 183 capable hosts in the Internet. In a study, it used the top-1M 184 Alexa servers to test the platform and gain insight about server 185 support for MPTCP. 187 o [28] proposes a practical shared bottleneck detection (SBD) 188 algorithm for MPTCP, namely MPTCP-SBD. Through extensive 189 emulations, it is shown that MPTCP-SBD outperforms all currently 190 deployed MPTCP coupled congestion controls by accurately detecting 191 bottlenecks resulting in throughput gains in the absence of shared 192 bottlenecks, while remaining fair to TCP in shared bottlenecks 193 scenarios. 195 o [29] proposes a send-window BLocking ESTimation scheduler, BLEST, 196 which aims to minimise head-of-line-blocking in heterogeneous 197 networks. BLEST increases the potential for capacity aggregation 198 by reducing the number of spurious retransmissions. 200 o [30] examines path management strategies for MPTCP in real-world, 201 multi-homed Internet setups. Particular goal is to highlight the 202 performance impact of different path management and congestion 203 control settings in such realistic scenarios. 205 o [31] analyses the actual buffer size requirements for MPTCP in 206 heterogeneous, multi-homed Internet setups. Particular goal is to 207 provide some guidelines on buffer size requirements for achieving 208 a reasonable throughput, while on the other hand not wasting 209 resources. 211 4. Security Considerations 213 Security considerations on MPTCP are described in [3]. 215 5. IANA Considerations 217 This document has no actions for IANA. 219 6. Acknowledgments 221 The authors would like to thank Hakim Adhari, Fa Fu, Feng Zhou and 222 Kun Wang for discussions and support. 224 7. References 226 7.1. Normative References 228 [1] Raiciu, C., Handley, M., and D. Wischik, "Coupled 229 Congestion Control for Multipath Transport Protocols", 230 RFC 6356, DOI 10.17487/RFC6356, October 2011, 231 . 233 [2] Ford, A., Raiciu, C., Handley, M., and O. Bonaventure, 234 "TCP Extensions for Multipath Operation with Multiple 235 Addresses", RFC 6824, DOI 10.17487/RFC6824, January 2013, 236 . 238 7.2. Informative References 240 [3] Bagnulo, M., "Threat Analysis for TCP Extensions for 241 Multipath Operation with Multiple Addresses", RFC 6181, 242 DOI 10.17487/RFC6181, March 2011, 243 . 245 [4] Ford, A., Raiciu, C., Handley, M., Barre, S., and J. 246 Iyengar, "Architectural Guidelines for Multipath TCP 247 Development", RFC 6182, DOI 10.17487/RFC6182, March 2011, 248 . 250 [5] Scharf, M. and A. Ford, "Multipath TCP (MPTCP) Application 251 Interface Considerations", RFC 6897, DOI 10.17487/RFC6897, 252 March 2013, . 254 [6] Dreibholz, T., "Thomas Dreibholz's MPTCP Page", 255 Online: http://www.iem.uni-due.de/~dreibh/mptcp/, 2016, 256 . 258 [7] Dreibholz, T., "NetPerfMeter - A TCP/MPTCP/UDP/SCTP/DCCP 259 Network Performance Meter Tool", Online: https://www.uni- 260 due.de/~be0001/netperfmeter/, 2016, . 263 [8] Becke, M., "Revisiting the IETF Multipath Extensions on 264 Transport Layer", November 2014, 265 . 269 [9] Ruengeler, I., "SCTP - Evaluating, Improving and Extending 270 the Protocol for Broader Deployment", December 2009, 271 . 275 [10] Dreibholz, T., "The NorNet Testbed for Multi-Homed Systems 276 - Introduction and Status", Invited Talk at Princeton 277 University, Department of Computer Science, May 2014, 278 . 281 [11] Dreibholz, T., "NorNet at NICTA - An Introduction to the 282 NorNet Testbed", Invited Talk at National Information 283 Communications Technology Australia (NICTA), January 2016, 284 . 287 [12] Gran, E., Dreibholz, T., and A. Kvalbein, "NorNet Core - A 288 Multi-Homed Research Testbed", Computer Networks, Special 289 Issue on Future Internet Testbeds Volume 61, Pages 75-87, 290 ISSN 1389-1286, DOI 10.1016/j.bjp.2013.12.035, March 2014, 291 . 294 [13] Kvalbein, A., Baltrunas, D., Evensen, K., Xiang, J., 295 Elmokashfi, A., and S. Ferlin, "The NorNet Edge Platform 296 for Mobile Broadband Measurements", Computer Networks, 297 Special Issue on Future Internet Testbeds Volume 61, Pages 298 88-101, ISSN 1389-1286, DOI 10.1016/j.bjp.2013.12.036, 299 March 2014, 300 . 303 [14] Dreibholz, T. and E. Gran, "Design and Implementation of 304 the NorNet Core Research Testbed for Multi-Homed Systems", 305 Proceedings of the 3nd International Workshop on Protocols 306 and Applications with Multi-Homing Support (PAMS) Pages 307 1094-1100, ISBN 978-0-7695-4952-1, 308 DOI 10.1109/WAINA.2013.71, March 2013, 309 . 313 [15] Dreibholz, T., "Multi-Path Transport - From Simulations to 314 Real-World Internet Measurements", Keynote Talk at the 315 Universidad de Castilla-La Mancha, Instituto de 316 Investigacion Informatica de Albacete, February 2017, 317 . 320 [16] Dreibholz, T., "An Experiment Tutorial for the NorNet Core 321 Testbed at the the Universidad de Castilla-La Mancha", 322 Tutorial at the Universidad de Castilla-La Mancha, 323 Instituto de Investigacion Informatica de Albacete, 324 February 2017, . 327 [17] Dreibholz, T., "NorNet - A Real-World, Large-Scale Multi- 328 Homing Testbed", Online: https://www.nntb.no/, 2017, 329 . 331 [18] Paasch, C. and S. Barre, "Multipath TCP implementation in 332 the Linux kernel", Online: http://www.multipath-tcp.org, 333 2016, . 335 [19] Dreibholz, T., Becke, M., Adhari, H., and E. Rathgeb, 336 "Evaluation of A New Multipath Congestion Control Scheme 337 using the NetPerfMeter Tool-Chain", Proceedings of the 338 19th IEEE International Conference on Software, 339 Telecommunications and Computer Networks (SoftCOM) Pages 340 1-6, ISBN 978-953-290-027-9, September 2011, 341 . 344 [20] Ferlin, S., Dreibholz, T., Alay, Oe., and A. Kvalbein, 345 "Measuring the QoS Characteristics of Operational 3G 346 Mobile Broadband Networks", Proceedings of the 4th 347 International Workshop on Protocols and Applications with 348 Multi-Homing Support (PAMS) Pages 753-758, 349 ISBN 978-1-4799-2652-7, DOI 10.1109/WAINA.2014.123, May 350 2014, . 353 [21] Ferlin, S., Dreibholz, T., and Oe. Alay, "Tackling the 354 Challenge of Bufferbloat in Multi-Path Transport over 355 Heterogeneous Wireless Networks", Proceedings of the IEEE/ 356 ACM International Symposium on Quality of 357 Service (IWQoS) Pages 123-128, ISBN 978-1-4799-4852-9, 358 DOI 10.1109/IWQoS.2014.6914310, May 2014, 359 . 362 [22] Ferlin, S., Dreibholz, T., and Oe. Alay, "Multi-Path 363 Transport over Heterogeneous Wireless Networks: Does it 364 really pay off?", Proceedings of the IEEE Global 365 Communications Conference (GLOBECOM) Pages 5005-5011, 366 ISBN 978-1-4799-3512-3, December 2014, 367 . 370 [23] Dreibholz, T., Zhou, X., and F. Fa, "Multi-Path TCP in 371 Real-World Setups - An Evaluation in the NorNet Core 372 Testbed", 5th International Workshop on Protocols and 373 Applications with Multi-Homing Support (PAMS), March 2015, 374 . 377 [24] Livadariu, I., Ferlin, S., Alay, Oe., Dreibholz, T., 378 Dhamdhere, A., and A. Elmokashfi, "Leveraging the IPv4/ 379 IPv6 Identity Duality by using Multi-Path Transport", 380 Proceedings of the 18th IEEE Global Internet 381 Symposium (GI), April 2015, 382 . 385 [25] Dreibholz, T., "NetPerfMeter: A Network Performance 386 Metering Tool", Multipath TCP Blog, September 2015, 387 . 390 [26] Fa, F., Zhou, X., Dreibholz, T., Wang, K., Zhou, F., and 391 Q. Gan, "Performance Comparison of Congestion Control 392 Strategies for Multi-Path TCP in the NorNet Testbed", 393 Proceedings of the 4th IEEE/CIC International Conference 394 on Communications in China (ICCC) Pages 607-612, 395 ISBN 978-1-5090-0243-6, November 2015, 396 . 399 [27] Mehani, O., Holz, R., Ferlin, S., and R. Boreli, "An Early 400 Look at Multipath TCP Deployment in the Wild", Proceedings 401 of the 6th International Workshop on Hot Topics in Planet- 402 Scale Measurement ISBN 978-1-4503-3534-8, 403 DOI 10.1145/2798087.2798088, 2015, 404 . 407 [28] Ferlin, S., Alay, Oe., Hayes, D., Dreibholz, T., and M. 408 Welzl, "Revisiting Congestion Control for Multipath TCP 409 with Shared Bottleneck Detection", Proceedings of the 410 35th IEEE International Conference on Computer 411 Communications (INFOCOM), April 2016. 413 [29] Ferlin, S., Alay, Oe., Mehani, O., and R. Boreli, "BLEST: 414 Blocking Estimation-Based MPTCP Scheduler for 415 Heterogeneous Networks", Proceedings of the IFIP 416 Networking Conference Pages 431-439, 417 DOI 10.1109/IFIPNetworking.2016.7497206, May 2016, 418 . 421 [30] Wang, K., Dreibholz, T., Zhou, X., Fu, F., Tan, Y., Cheng, 422 X., and Q. Tan, "On the Path Management of Multi-Path TCP 423 in Internet Scenarios based on the NorNet Testbed", 424 Proceedings of the IEEE International Conference on 425 Advanced Information Networking and Applications (AINA), 426 March 2017, . 429 [31] Zhou, F., Dreibholz, T., Zhou, X., Fu, F., Tan, Y., and Q. 430 Gan, "The Performance Impact of Buffer Sizes for Multi- 431 Path TCP in Internet Setups", Proceedings of the IEEE 432 International Conference on Advanced Information 433 Networking and Applications (AINA), March 2017, 434 . 437 Authors' Addresses 439 Thomas Dreibholz (editor) 440 Simula Research Laboratory, Networks Department 441 Martin Linges vei 17 442 1364 Fornebu, Akershus 443 Norway 445 Phone: +47-6782-8200 446 Fax: +47-6782-8201 447 Email: dreibh@simula.no 448 URI: http://www.iem.uni-due.de/~dreibh/ 450 Simone Ferlin 451 Simula Research Laboratory, Networks Department 452 Martin Linges vei 17 453 1364 Fornebu, Akershus 454 Norway 456 Phone: +47-4072-0702 457 Fax: +47-4072-0702 458 Email: ferlin@simula.no 459 URI: https://www.simula.no/people/ferlin 460 Ozgu Alay 461 Simula Research Laboratory, Networks Department 462 Martin Linges vei 17 463 1364 Fornebu, Akershus 464 Norway 466 Phone: +47-9848-5362 467 Fax: +47-9848-5362 468 Email: ozgu@simula.no 469 URI: https://www.simula.no/people/ozgu 471 Ahmed Elmokashfi 472 Simula Research Laboratory, Networks Department 473 Martin Linges vei 17 474 1364 Fornebu, Akershus 475 Norway 477 Phone: +47-474-52-315 478 Fax: +47-6782-8201 479 Email: ahmed@simula.no 480 URI: https://www.simula.no/people/ahmed 482 Ioana Alexandrina Livadariu 483 Simula Research Laboratory, Networks Department 484 Martin Linges vei 17 485 1364 Fornebu, Akershus 486 Norway 488 Phone: +47-453-98-686 489 Fax: +47-6782-8201 490 Email: ioana@simula.no 491 URI: https://www.simula.no/people/ioana 493 Xing Zhou 494 Hainan University, College of Information Science and Technology 495 Renmin Avenue 58 496 570228 Haikou, Hainan 497 China 499 Phone: +86-898-66279141 500 Email: zhouxing@hainu.edu.cn 501 URI: http://www.hainu.edu.cn/stm/xinxi/2011330/10409758.shtml