idnits 2.17.1 draft-heist-tsvwg-sce-one-and-two-flow-tests-00.txt: Checking boilerplate required by RFC 5378 and the IETF Trust (see https://trustee.ietf.org/license-info): ---------------------------------------------------------------------------- No issues found here. Checking nits according to https://www.ietf.org/id-info/1id-guidelines.txt: ---------------------------------------------------------------------------- No issues found here. Checking nits according to https://www.ietf.org/id-info/checklist : ---------------------------------------------------------------------------- No issues found here. Miscellaneous warnings: ---------------------------------------------------------------------------- == The copyright year in the IETF Trust and authors Copyright Line does not match the current year -- The document date (3 July 2019) is 1758 days in the past. Is this intentional? Checking references for intended status: Informational ---------------------------------------------------------------------------- No issues found here. Summary: 0 errors (**), 0 flaws (~~), 1 warning (==), 1 comment (--). Run idnits with the --verbose option for more detailed information about the items above. -------------------------------------------------------------------------------- 2 Transport Working Group P. Heist 3 Internet-Draft R.W. Grimes 4 Intended status: Informational J. Morton 5 Expires: 4 January 2020 3 July 2019 7 Some Congestion Experienced One and Two-Flow Tests 8 draft-heist-tsvwg-sce-one-and-two-flow-tests-00 10 Abstract 12 This note presents one and two-flow test results for the SCE (Some 13 Congestion Experienced) reference implementation. These tests are 14 not intended to be a comprehensive real-world evaluation of SCE, but 15 an illustration of SCE's influence on basic TCP metrics in a 16 controlled environment. 18 Status of This Memo 20 This Internet-Draft is submitted in full conformance with the 21 provisions of BCP 78 and BCP 79. 23 Internet-Drafts are working documents of the Internet Engineering 24 Task Force (IETF). Note that other groups may also distribute 25 working documents as Internet-Drafts. The list of current Internet- 26 Drafts is at https://datatracker.ietf.org/drafts/current/. 28 Internet-Drafts are draft documents valid for a maximum of six months 29 and may be updated, replaced, or obsoleted by other documents at any 30 time. It is inappropriate to use Internet-Drafts as reference 31 material or to cite them other than as "work in progress." 33 This Internet-Draft will expire on 4 January 2020. 35 Copyright Notice 37 Copyright (c) 2019 IETF Trust and the persons identified as the 38 document authors. All rights reserved. 40 This document is subject to BCP 78 and the IETF Trust's Legal 41 Provisions Relating to IETF Documents (https://trustee.ietf.org/ 42 license-info) in effect on the date of publication of this document. 43 Please review these documents carefully, as they describe your rights 44 and restrictions with respect to this document. Code Components 45 extracted from this document must include Simplified BSD License text 46 as described in Section 4.e of the Trust Legal Provisions and are 47 provided without warranty as described in the Simplified BSD License. 49 Table of Contents 51 1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . 2 52 2. Terminology . . . . . . . . . . . . . . . . . . . . . . . . . 3 53 3. Test Tools and Environment . . . . . . . . . . . . . . . . . 3 54 4. Tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4 55 5. Results and Analysis . . . . . . . . . . . . . . . . . . . . 4 56 5.1. One-Flow Tests . . . . . . . . . . . . . . . . . . . . . 4 57 5.1.1. Reno-SCE TCP Throughput . . . . . . . . . . . . . . . 5 58 5.1.2. Reno-SCE TCP RTT . . . . . . . . . . . . . . . . . . 6 59 5.1.3. DCTCP-SCE TCP Throughput . . . . . . . . . . . . . . 7 60 5.1.4. DCTCP-SCE TCP RTT . . . . . . . . . . . . . . . . . . 8 61 5.2. Two-Flow Tests . . . . . . . . . . . . . . . . . . . . . 9 62 5.2.1. Single Queue (Cake "flowblind") . . . . . . . . . . . 9 63 5.2.2. Single Queue (Cake "sce-single") . . . . . . . . . . 11 64 5.2.3. Fair Queue (Cake "triple-isolate") . . . . . . . . . 13 65 6. Security Considerations . . . . . . . . . . . . . . . . . . . 15 66 7. IANA Considerations . . . . . . . . . . . . . . . . . . . . . 15 67 8. Acknowledgments . . . . . . . . . . . . . . . . . . . . . . . 15 68 9. Informative References . . . . . . . . . . . . . . . . . . . 15 69 Appendix A. Appendix (Raw Results Tables) . . . . . . . . . . . 15 70 A.1. One-Flow TCP Throughput . . . . . . . . . . . . . . . . . 16 71 A.2. One-Flow TCP RTT . . . . . . . . . . . . . . . . . . . . 18 72 A.3. Two-Flow TCP Throughput (Cake "flowblind") . . . . . . . 21 73 A.4. Two-Flow TCP Throughput (Cake "flowblind 74 sce-single") . . . . . . . . . . . . . . . . . . . . . . 28 75 A.5. Two-Flow TCP Throughput (Cake "triple-isolate") . . . . . 36 76 A.6. Two-Flow TCP RTT (Cake "flowblind") . . . . . . . . . . . 43 77 A.7. Two-Flow TCP RTT (Cake "flowblind sce-single") . . . . . 50 78 A.8. Two-Flow TCP RTT (Cake "triple-isolate") . . . . . . . . 58 79 Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . . 65 81 1. Introduction 83 SCE provides early and proportional feedback to the CC (congestion 84 control) algorithms for transport protocols, including but not 85 limited to TCP. The [sce-repo] is a Linux kernel modified to support 86 SCE, including: 88 * Enhancements to Linux's Cake (Common Applications Kept Enhanced) 89 AQM to support SCE signaling 91 * Modifications to the TCP receive path to reflect SCE signals back 92 to the sender 94 * The addition of three new TCP CC algorithms that modify the 95 originals to add SCE support: Reno-SCE, DCTCP-SCE and Cubic-SCE 96 (work in progress as of this writing) 98 In this note we run one and two-flow TCP tests across a range of 99 simulated path bandwidths and RTTs. One-flow tests measure SCE's 100 impact on TCP throughput and TCP RTT. Two-flow tests evaluate 101 fairness between and among several SCE and non-SCE TCP 102 implementations, while making several adjustments to Cake's SCE and 103 fair queueing parameters. 105 It is recognized that these tests do not simulate real-world 106 conditions, and will not be an indication of how SCE will perform in 107 all situations. However, they serve as fundamental tests for the SCE 108 reference implementation. Once the behavior in these tests is well 109 understood and theory and experiment are in agreement, additional 110 complexity can be added to the test procedures with the confidence 111 that the reference implementation's fundamentals are sound. 113 2. Terminology 115 The following terminology is used in this document: 117 * Path Bandwidth or Cake-limited Bandwidth: The available bandwidth 118 between the sender and receiver, as controlled by Cake on the 119 middlebox, and set by Cake's bandwidth parameter. 121 * Path RTT or just RTT (in context): The approximate minimum round- 122 trip time of packets that go from the sender to receiver and back 123 when the path is unloaded. 125 * Netem bi-directional delay: The total path RTT added by netem in 126 both directions. 128 * TCP throughput and TCP RTT: Well-known terms that apply 129 specifically to the flows under test. 131 3. Test Tools and Environment 133 The [Flent] tool is used for all tests. Flent uses netperf for its 134 TCP tests, and allows for test batches, plotting, the recording of 135 results and the collection of metadata in JSON format [RFC8259]. 136 Flent both captures the measured TCP throughput from netperf, and 137 simultaneously uses the [ss] tool in Linux to passively monitor TCP 138 RTT. 140 All tests are performed using a three node dumbbell topology: 142 +--------+ +-----------+ +----------+ 143 | Sender |--------------| Middlebox |--------------| Receiver | 144 +--------+ +-----------+ +----------+ 145 Figure 1: Test topology 147 * Sender: Runs Flent and sends data to the receiver 149 * Middlebox: 151 - Acts as a router between the sender and receiver 153 - Runs Cake on egress of both interfaces for queue management and 154 SCE signaling 156 - Runs netem on the ingress of both interfaces for delay 157 simulation, splitting the total delay in half for each 158 interface 160 * Receiver: Receives data from and reflects SCE signals back to the 161 sender via the ESCE (Echo Some Congestion Experienced) bit 163 All nodes run the SCE reference implementation kernel as of commit 164 56915a82 (2019-06-20), and are connected directly via Gigabit 165 Ethernet. 167 4. Tests 169 The tests are implemented with a Flent batch file to drive netperf 170 and re-configure Cake and netem on the middlebox with various 171 parameters. Scripts post-process the results and create csv and 172 markdown tables for external use, including by this document. 174 Unless otherwise mentioned, measurements are obtained from TCP flows 175 from start to finish, not at steady state. This allows for some 176 discussion of the differences in TCP CC algorithm behavior during 177 slow start and congestion avoidance. Typically, each test is run 178 long enough to obtain a reasonable approximation of steady state 179 throughput, but in a few high BDP cases slow start accounts for a 180 significant portion of the test length. When relevant to the 181 analysis of the results, this is stated in the text. 183 5. Results and Analysis 185 5.1. One-Flow Tests 187 The goal of the one-flow tests is to analyze the impact of SCE on the 188 TCP throughput and TCP RTT of single TCP flows across a range of 189 simulated path bandwidths and RTTs. What follows is an analysis of 190 the results. See Section a.1 and Section a.2 for the raw results for 191 TCP throughput and TCP RTT, respectively. 193 5.1.1. Reno-SCE TCP Throughput 195 The following table shows the difference in TCP throughput for Reno- 196 SCE vs Reno across the tested range of simulated path bandwidths and 197 RTTs: 199 +---+-----+------+------+-------+--------+--------+--------+--------+ 200 | | 0| 2| 5| 10| 20 | 40 | 80 | 160 | 201 +===+=====+======+======+=======+========+========+========+========+ 202 |0.5|0.000| 0.000| 0.000| 0.000| 0.000 | -0.100 | -0.180 | -0.160 | 203 +---+-----+------+------+-------+--------+--------+--------+--------+ 204 |1 |0.000| 0.000| 0.000| 0.000| -0.110 | -0.210 | -0.280 | -0.280 | 205 +---+-----+------+------+-------+--------+--------+--------+--------+ 206 |2 |0.000| 0.000|-0.010| -0.120| -0.210 | -0.375 | -0.370 | -0.405 | 207 +---+-----+------+------+-------+--------+--------+--------+--------+ 208 |5 |0.000|-0.052|-0.142| -0.228| -0.178 | -0.032 | -0.006 | 0.016 | 209 +---+-----+------+------+-------+--------+--------+--------+--------+ 210 |10 |0.000|-0.071|-0.139| -0.143| -0.046 | 0.062 | 0.116 | 0.168 | 211 +---+-----+------+------+-------+--------+--------+--------+--------+ 212 |25 |0.000|-0.003|-0.006| 0.010| 0.073 | 0.143 | 0.196 | 0.259 | 213 +---+-----+------+------+-------+--------+--------+--------+--------+ 214 |50 |0.000| 0.000| 0.001| 0.029| 0.102 | 0.169 | 0.235 | 0.272 | 215 +---+-----+------+------+-------+--------+--------+--------+--------+ 216 |100|0.000| 0.000| 0.004| 0.043| 0.103 | 0.215 | 0.238 | 0.289 | 217 +---+-----+------+------+-------+--------+--------+--------+--------+ 219 Table 1: Difference in TCP Throughput (reno-sce - reno), 220 normalized to Cake- limited Bandwidth; Columns: netem bi- 221 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 223 From the above TCP throughput differences we can observe: 225 1. Improved utilization for SCE at sufficiently high BDPs. This is 226 due to SCE's proportional congestion signals, which can 227 significantly reduce the classic Reno throughput sawtooth by 228 making drops or CE marks rare to non-existent. The utilization 229 improvement increases with BDP largely because the TCP window 230 recovery time after a drop or CE mark increases with BDP, 231 deepening the sawtooth. 233 2. Significant under-utilization at bandwidths <= 10Mbit, which 234 tends to worsen as path RTT increases. Investigation is underway 235 as to the source of this. These drops in utilization are however 236 also accompanied by drops in TCP RTT (see below). 238 5.1.2. Reno-SCE TCP RTT 240 The following table shows the difference in TCP RTT for Reno-SCE vs 241 Reno across the tested range of simulated path bandwidths and RTTs: 243 +---+------+------+------+------+--------+--------+--------+--------+ 244 | | 0| 2| 5| 10| 20 | 40 | 80 | 160 | 245 +===+======+======+======+======+========+========+========+========+ 246 |0.5|-88.41|-87.51|-88.43|-88.59| -62.37 | -52.56 | -42.23 | -31.93 | 247 +---+------+------+------+------+--------+--------+--------+--------+ 248 |1 |-42.30|-41.94|-42.65|-33.03| -32.92 | -27.92 | -19.13 | -13.20 | 249 +---+------+------+------+------+--------+--------+--------+--------+ 250 |2 |-29.09|-27.67|-22.19|-19.23| -14.54 | -10.12 | -3.66 | -1.50 | 251 +---+------+------+------+------+--------+--------+--------+--------+ 252 |5 | -9.18| -9.47| -7.51| -8.37| -5.63 | -3.49 | -1.69 | -1.24 | 253 +---+------+------+------+------+--------+--------+--------+--------+ 254 |10 | -2.46| -2.75| -2.95| -3.91| -2.44 | -1.42 | -0.54 | -0.41 | 255 +---+------+------+------+------+--------+--------+--------+--------+ 256 |25 | -1.87| -2.09| -2.53| -1.74| -0.42 | 0.01 | 0.19 | -0.01 | 257 +---+------+------+------+------+--------+--------+--------+--------+ 258 |50 | -2.00| -2.18| -1.48| -0.31| 0.59 | 0.98 | 0.86 | 0.57 | 259 +---+------+------+------+------+--------+--------+--------+--------+ 260 |100| -1.87| -1.67| -1.04| 0.06| 0.95 | 1.42 | 1.41 | 1.15 | 261 +---+------+------+------+------+--------+--------+--------+--------+ 263 Table 2: Difference in TCP RTT (reno-sce - reno); Columns: netem bi- 264 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 266 From the above TCP RTT differences we can observe: 268 1. Significant reductions in TCP RTT for Reno-SCE at most BDPs. 269 SCE's proportional congestion signals are aiding the sender in 270 managing queue lengths. 272 2. Greater reductions in TCP RTT at lower path bandwidths and RTTs. 273 This is because Reno-linear growth becomes relatively larger as 274 the path bandwidth decreases. This results in greater queue 275 growth in the interval before AQM activates, and a subsequently 276 longer drain time after congestion is signaled. 278 3. A slight increase in TCP RTT for SCE at high BDPs. This has been 279 observed to have a possible connection to the ESCE (Echo Some 280 Congestion Experienced) feedback strategy implemented in on the 281 TCP receive side. Research and optimization in this area is 282 ongoing. 284 5.1.3. DCTCP-SCE TCP Throughput 286 The following table shows the difference in TCP throughput for DCTCP- 287 SCE vs DCTCP across the tested range of simulated path bandwidths and 288 RTTs: 290 +---+------+------+------+------+--------+--------+--------+--------+ 291 | | 0| 2| 5| 10| 20 | 40 | 80 | 160 | 292 +===+======+======+======+======+========+========+========+========+ 293 |0.5| 0.000| 0.000| 0.000| 0.000| 0.000 | -0.120 | -0.220 | -0.400 | 294 +---+------+------+------+------+--------+--------+--------+--------+ 295 |1 | 0.000| 0.000| 0.000| 0.000| -0.120 | -0.260 | -0.420 | -0.570 | 296 +---+------+------+------+------+--------+--------+--------+--------+ 297 |2 | 0.000| 0.000|-0.015|-0.130| -0.285 | -0.505 | -0.565 | -0.705 | 298 +---+------+------+------+------+--------+--------+--------+--------+ 299 |5 | 0.000|-0.038|-0.150|-0.270| -0.374 | -0.588 | -0.652 | -0.620 | 300 +---+------+------+------+------+--------+--------+--------+--------+ 301 |10 | 0.000|-0.087|-0.197|-0.265| -0.266 | -0.257 | -0.271 | -0.134 | 302 +---+------+------+------+------+--------+--------+--------+--------+ 303 |25 |-0.006|-0.060|-0.131|-0.167| -0.154 | -0.133 | -0.067 | 0.110 | 304 +---+------+------+------+------+--------+--------+--------+--------+ 305 |50 | 0.000|-0.001|-0.006|-0.008| 0.005 | 0.012 | 0.143 | 0.180 | 306 +---+------+------+------+------+--------+--------+--------+--------+ 307 |100| 0.000| 0.007| 0.018| 0.031| 0.040 | 0.087 | 0.151 | 0.246 | 308 +---+------+------+------+------+--------+--------+--------+--------+ 310 Table 3: Difference in TCP Throughput (dctcp-sce - dctcp), 311 normalized to Cake- limited Bandwidth; Columns: netem bi- 312 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 314 From the above TCP throughput differences we can observe: 316 1. Improved utilization for SCE at higher BDPs. At first glance we 317 might assume that this is due to SCE's feedback signals improving 318 upon DCTCP's window recovery time, as with Reno, but another 319 significant part of this increase is due to DCTCP-SCE's steeper 320 ramp during slow start, and a test length that is short relative 321 to the time spent in slow start. The test is 300 seconds long, 322 and at a path bandwidth of 100Mbit and RTT of 160ms, DCTCP takes 323 a full 225 seconds to ramp up to the BDP, while DCTCP-SCE, with 324 its steeper ramp, takes only 80 seconds. That said, steady state 325 throughput at this BDP is around 87Mbit for DCTCP, and around 326 96Mbit for DCTCP-SCE, an increase of around 10%, so the 327 proportional congestion control signals also play a part in 328 increasing utilization. 330 2. Significant under-utilization at bandwidths <= 25Mbit, which 331 tends to worsen as path RTT increases. Investigation is underway 332 as to the source of this. These drops in utilization are however 333 also accompanied by drops in TCP RTT (see below). 335 5.1.4. DCTCP-SCE TCP RTT 337 The following table shows the difference in TCP RTT for DCTCP-SCE vs 338 DCTCP across the tested range of simulated path bandwidths and RTTs: 340 +---+------+------+------+------+--------+--------+--------+--------+ 341 | | 0| 2| 5| 10| 20 | 40 | 80 | 160 | 342 +===+======+======+======+======+========+========+========+========+ 343 |0.5|-82.57|-81.21|-81.37|-81.53| -60.53 | -70.29 | -74.76 | -54.33 | 344 +---+------+------+------+------+--------+--------+--------+--------+ 345 |1 |-41.78|-42.31|-40.43|-30.98| -35.26 | -39.27 | -29.95 | -15.62 | 346 +---+------+------+------+------+--------+--------+--------+--------+ 347 |2 |-21.94|-20.29|-20.86|-17.58| -19.93 | -12.70 | -7.37 | -3.97 | 348 +---+------+------+------+------+--------+--------+--------+--------+ 349 |5 | -6.65| -7.27| -7.08| -6.45| -5.57 | -3.59 | -2.19 | -1.31 | 350 +---+------+------+------+------+--------+--------+--------+--------+ 351 |10 | -1.85| -2.11| -2.85| -2.25| -2.16 | -1.51 | -1.28 | -1.12 | 352 +---+------+------+------+------+--------+--------+--------+--------+ 353 |25 | -2.47| -2.52| -2.94| -3.13| -2.93 | -1.63 | -0.98 | -0.78 | 354 +---+------+------+------+------+--------+--------+--------+--------+ 355 |50 | -2.63| -3.15| -2.99| -3.12| -3.37 | -3.57 | -0.81 | -0.63 | 356 +---+------+------+------+------+--------+--------+--------+--------+ 357 |100| -2.79| -2.81| -2.82| -3.01| -3.26 | -2.52 | -0.14 | 0.02 | 358 +---+------+------+------+------+--------+--------+--------+--------+ 360 Table 4: Difference in TCP RTT (dctcp-sce - dctcp); Columns: 361 netem bi- directional Delay (ms); Rows: Cake-limited Bandwidth 362 (Mbit) 364 From the above TCP RTT differences we can observe: 366 1. A nearly across the board reduction in TCP RTT for DCTCP-SCE. 367 SCE's proportional congestion signals are aiding the sender in 368 managing queue lengths. 370 2. Greater reductions in TCP RTT at lower bandwidths and path RTTs. 371 See Section 5.1.2 for an explanation of this. 373 3. A slight increase in TCP RTT for DCTCP-SCE at 100Mbit / 160ms. 374 See Section 5.1.2 for a likely explanation of this. 376 5.2. Two-Flow Tests 378 The goal of the two-flow tests is to measure fairness between and 379 among SCE and non-SCE TCP flows, through either a single queue or 380 with fair queueing. What follows is a partial analysis of the 381 results, and see Section a.3 through Section a.8 for the raw results 382 tables. 384 5.2.1. Single Queue (Cake "flowblind") 386 Cake's flowblind parameter disables fair queueing, so that Cake uses 387 only a single queue. This can be used to evaluate single-queue 388 throughput fairness between SCE and non-SCE flows. 390 5.2.1.1. Reno vs Reno 392 It might be useful to remind ourselves that competition between two 393 (or more) flows of the same TCP CC algorithm is usually designed to 394 yield a high degree of throughput fairness in a single queue. 395 Looking at Jain's fairness index [RFC5166] for two flows across a 396 range of simulated path bandwidths and RTTs shows this to be true for 397 two TCP Reno flows, for example: 399 +-----+-------+-------+-------+-------+ 400 | | 0 | 10 | 20 | 80 | 401 +=====+=======+=======+=======+=======+ 402 | 1 | 0.993 | 1.000 | 1.000 | 0.998 | 403 +-----+-------+-------+-------+-------+ 404 | 5 | 1.000 | 1.000 | 0.998 | 0.998 | 405 +-----+-------+-------+-------+-------+ 406 | 10 | 1.000 | 0.999 | 0.998 | 1.000 | 407 +-----+-------+-------+-------+-------+ 408 | 50 | 1.000 | 0.998 | 0.999 | 0.999 | 409 +-----+-------+-------+-------+-------+ 410 | 100 | 0.998 | 0.999 | 0.999 | 1.000 | 411 +-----+-------+-------+-------+-------+ 413 Table 5: reno vs reno Jain's 414 fairness index; Columns: netem bi- 415 dir Delay (ms); Rows: Cake 416 Bandwidth (Mbit) 418 5.2.1.2. Reno vs Reno-SCE 420 Now, we do a comparison of Reno vs Reno-SCE in a single queue, while 421 still using Cake's default SCE signaling ramp: 423 +-----+-------+-------+-------+-------+ 424 | | 0 | 10 | 20 | 80 | 425 +=====+=======+=======+=======+=======+ 426 | 1 | 0.969 | 0.969 | 0.915 | 0.821 | 427 +-----+-------+-------+-------+-------+ 428 | 5 | 0.958 | 0.824 | 0.714 | 0.632 | 429 +-----+-------+-------+-------+-------+ 430 | 10 | 0.959 | 0.719 | 0.669 | 0.698 | 431 +-----+-------+-------+-------+-------+ 432 | 50 | 0.608 | 0.621 | 0.673 | 0.907 | 433 +-----+-------+-------+-------+-------+ 434 | 100 | 0.560 | 0.627 | 0.668 | 0.782 | 435 +-----+-------+-------+-------+-------+ 437 Table 6: reno vs reno-sce Jain's 438 fairness index; Columns: netem bi- 439 dir Delay (ms); Rows: Cake 440 Bandwidth (Mbit) 442 From the above Jain's fairness index numbers we can observe that 443 while there can be reasonable fairness at very low BDPs, and while 444 there is no starvation, fairness degrades quickly at higher 445 throughputs and RTTs. This is due to the Cake's default SCE 446 signaling ramp being tuned to provide an early signal of congestion, 447 to avoid CE marks and packet drops. As a result, SCE enabled flows 448 back off in the face of competition, whereas non-SCE flows fill the 449 queue until a drop or CE mark occurs. 451 5.2.1.3. Cubic vs DCTCP-SCE 453 Of particular interest to the congestion control community is 454 competition between the commonly used TCP Cubic algorithm and DCTCP- 455 SCE. It is a well-established fact that classic DCTCP will typically 456 out-compete Cubic in a single queue. It would be valuable if there 457 were a way to improve that fairness with SCE. 459 When comparing Cubic vs DCTCP-SCE using Cake's default SCE signaling 460 ramp, we can see that while there is no starvation, fairness does 461 degrade fairly rapidly as BDP increases: 463 +-----+-------+-------+-------+-------+ 464 | | 0 | 10 | 20 | 80 | 465 +=====+=======+=======+=======+=======+ 466 | 1 | 0.979 | 0.976 | 0.922 | 0.821 | 467 +-----+-------+-------+-------+-------+ 468 | 5 | 0.977 | 0.797 | 0.708 | 0.604 | 469 +-----+-------+-------+-------+-------+ 470 | 10 | 0.979 | 0.693 | 0.645 | 0.627 | 471 +-----+-------+-------+-------+-------+ 472 | 50 | 0.599 | 0.570 | 0.586 | 0.607 | 473 +-----+-------+-------+-------+-------+ 474 | 100 | 0.547 | 0.552 | 0.563 | 0.599 | 475 +-----+-------+-------+-------+-------+ 477 Table 7: cubic vs dctcp-sce Jain's 478 fairness index; Columns: netem bi- 479 dir Delay (ms); Rows: Cake 480 Bandwidth (Mbit) 482 As of today, SCE by default does not lead to fairness at all BDPs 483 between SCE and non-SCE flows. However, efforts are ongoing to 484 improve this, and as we can see in Section 5.2.2, Cake's signaling 485 ramp can be tuned to improve this fairness. 487 5.2.2. Single Queue (Cake "sce-single") 489 As we saw in Section 5.2.1, there is room to improve SCE vs non-SCE 490 fairness in a single queue. One way to do this is to change the SCE 491 signaling ramp to reduce or delay SCE signals until closer to the 492 point where CE signals occur. This is the motivation behind the sce- 493 single and sce-thresh Cake parameters. 495 By default, Cake begins proportionally signaling SCE when a packet's 496 sojourn time in the queue is greater than half the CoDel target, and 497 reaches 100% SCE signaling when the sojourn time is greater than or 498 equal to the CoDel target. The sce-single parameter delays the start 499 of the ramp until the sojourn reaches the CoDel target itself, while 500 keeping the ramp slope the same. The sce-thresh parameter, while not 501 evaluated here, allows an intermediate ramp between the default and 502 sce-single, using values from 2-1024, with sce-thresh set to 8 503 yielding a ramp that's halfway in-between. 505 It is expected that the result of signaling SCE later is a subsequent 506 increase in TCP RTT, including for single flows. Thus, the 507 adjustment of the SCE signaling ramp is a tradeoff between the 508 increased utilization and reduced TCP RTT possible with SCE, and 509 fairness with non-SCE flows in a single queue. By using sce-single, 510 we can show the maximum fairness that can be achieved by tuning the 511 SCE signaling ramp in this way. 513 5.2.2.1. Reno vs Reno-SCE 515 Revisiting the Reno vs Reno-SCE comparison that we did in 516 Section 5.2.1.2, we now run the same test with Cake's sce-single 517 parameter set: 519 +-----+-------+-------+-------+-------+ 520 | | 0 | 10 | 20 | 80 | 521 +=====+=======+=======+=======+=======+ 522 | 1 | 1.000 | 0.998 | 1.000 | 0.987 | 523 +-----+-------+-------+-------+-------+ 524 | 5 | 0.997 | 0.952 | 0.785 | 0.819 | 525 +-----+-------+-------+-------+-------+ 526 | 10 | 0.997 | 0.950 | 0.790 | 0.994 | 527 +-----+-------+-------+-------+-------+ 528 | 50 | 1.000 | 0.986 | 0.980 | 0.977 | 529 +-----+-------+-------+-------+-------+ 530 | 100 | 0.988 | 0.901 | 0.932 | 0.987 | 531 +-----+-------+-------+-------+-------+ 533 Table 8: reno vs reno-sce Jain's 534 fairness index; Columns: netem bi- 535 dir Delay (ms); Rows: Cake 536 Bandwidth (Mbit) 538 We can see that single queue fairness has improved considerably. 539 While there are results at a few bandwidth-delay combinations that 540 are still under investigation, single queue fairness between Reno and 541 Reno-SCE has largely been achieved. 543 5.2.2.2. Cubic vs DCTCP-SCE 545 Revisiting the Cubic vs DCTCP-SCE comparison that we did in 546 Section 5.2.1.3, we now run the same test with Cake's sce-single 547 parameter set: 549 +-----+-------+-------+-------+-------+ 550 | | 0 | 10 | 20 | 80 | 551 +=====+=======+=======+=======+=======+ 552 | 1 | 0.993 | 0.999 | 0.995 | 0.963 | 553 +-----+-------+-------+-------+-------+ 554 | 5 | 1.000 | 0.898 | 0.765 | 0.741 | 555 +-----+-------+-------+-------+-------+ 556 | 10 | 0.975 | 0.893 | 0.733 | 0.885 | 557 +-----+-------+-------+-------+-------+ 558 | 50 | 0.999 | 0.752 | 0.799 | 0.923 | 559 +-----+-------+-------+-------+-------+ 560 | 100 | 0.944 | 0.714 | 0.661 | 0.650 | 561 +-----+-------+-------+-------+-------+ 563 Table 9: cubic vs dctcp-sce Jain's 564 fairness index; Columns: netem bi- 565 dir Delay (ms); Rows: Cake 566 Bandwidth (Mbit) 568 While it can be seen that there is an almost across the board 569 improvement vs Cake's default SCE ramp, there are still bandwidth- 570 delay combinations that do not yield a sufficient level of fairness 571 in a single queue. Work is ongoing to improve this. 573 5.2.3. Fair Queue (Cake "triple-isolate") 575 Cake's default triple-isolate fairness mode provides fairness among 576 flows and a combination of source and destination IP addresses. For 577 our purposes, this will effectively serve as fair queueing among 578 flows, as we are only using one IP on each of the source and 579 destination hosts. 581 With fair queueing, we expect to achieve a high level of throughput 582 fairness at most bandwidth-delay combinations. 584 5.2.3.1. Cubic vs DCTCP-SCE 586 Revisiting the Cubic vs DCTCP-SCE comparisons that we did in 587 Section 5.2.1.3 and Section 5.2.2.2, we now run the same test with 588 Cake's fair queueing enabled via triple-isolate: 590 +-----+-------+-------+-------+-------+ 591 | | 0 | 10 | 20 | 80 | 592 +=====+=======+=======+=======+=======+ 593 | 1 | 1.000 | 1.000 | 1.000 | 0.916 | 594 +-----+-------+-------+-------+-------+ 595 | 5 | 1.000 | 0.980 | 0.931 | 0.698 | 596 +-----+-------+-------+-------+-------+ 597 | 10 | 1.000 | 0.946 | 0.896 | 0.722 | 598 +-----+-------+-------+-------+-------+ 599 | 50 | 1.000 | 0.978 | 0.977 | 1.000 | 600 +-----+-------+-------+-------+-------+ 601 | 100 | 1.000 | 0.999 | 1.000 | 1.000 | 602 +-----+-------+-------+-------+-------+ 604 Table 10: cubic vs dctcp-sce Jain's 605 fairness index; Columns: netem bi- 606 dir Delay (ms); Rows: Cake 607 Bandwidth (Mbit) 609 With fair queueing, fairness is achieved for a broad range of 610 bandwidth-delay combinations. We do see a consistent and narrow 611 deviation at around 160ms between 5 and 10Mbit, which happens in 612 competition between SCE and non-SCE flows, regardless of the exact 613 algorithms in use. The cause of this will be investigated. 615 5.2.3.2. DCTCP vs DCTCP-SCE 617 As another example of SCE vs non-SCE competition with fair queueing 618 enabled, here we compare DCTCP vs DCTCP-SCE: 620 +-----+-------+-------+-------+-------+ 621 | | 0 | 10 | 20 | 80 | 622 +=====+=======+=======+=======+=======+ 623 | 1 | 1.000 | 1.000 | 1.000 | 0.900 | 624 +-----+-------+-------+-------+-------+ 625 | 5 | 1.000 | 0.973 | 0.925 | 0.661 | 626 +-----+-------+-------+-------+-------+ 627 | 10 | 1.000 | 0.950 | 0.901 | 0.739 | 628 +-----+-------+-------+-------+-------+ 629 | 50 | 1.000 | 0.976 | 0.978 | 1.000 | 630 +-----+-------+-------+-------+-------+ 631 | 100 | 1.000 | 0.999 | 0.999 | 0.999 | 632 +-----+-------+-------+-------+-------+ 634 Table 11: dctcp vs dctcp-sce Jain's 635 fairness index; Columns: netem bi- 636 dir Delay (ms); Rows: Cake 637 Bandwidth (Mbit) 639 As with Cubic vs DCTCP-SCE, a high degree of fairness is achieved for 640 most bandwidth-delay combinations, yet we do see the same small gap 641 in fairness at around 160ms between 5 and 10Mbit as we see with Cubic 642 vs DCTCP-SCE and other SCE vs non-SCE flow tests with fair queueing. 643 It is expected that further investigation into this will lead to a 644 solution. 646 6. Security Considerations 648 There are no known security considerations introduced by this note. 650 7. IANA Considerations 652 This document has no IANA actions. 654 8. Acknowledgments 656 Many thanks go out to Toke Hoiland-Jorgensen for making several key 657 changes to the Flent tool. 659 9. Informative References 661 [Flent] "The FLExible Network Tester Home Page", July 2019, 662 . 664 [RFC5166] Floyd, S., Ed., "Metrics for the Evaluation of Congestion 665 Control Mechanisms", RFC 5166, DOI 10.17487/RFC5166, March 666 2008, . 668 [RFC8259] Bray, T., Ed., "The JavaScript Object Notation (JSON) Data 669 Interchange Format", STD 90, RFC 8259, 670 DOI 10.17487/RFC8259, December 2017, 671 . 673 [sce-repo] "Some Congestion Experienced Reference Implementation 674 GitHub Repository", July 2019, 675 . 677 [ss] "ss man page", July 2019, 678 . 680 Appendix A. Appendix (Raw Results Tables) 681 A.1. One-Flow TCP Throughput 683 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 684 | | 0 | 2 | 5 | 10 | 20 | 40 | 80 | 160 | 685 +===+=======+=======+=======+=======+=======+=======+=======+=======+ 686 |0.5| 0.48 | 0.48 | 0.48 | 0.48 | 0.48 | 0.47 | 0.48 | 0.44 | 687 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 688 |1 | 0.96 | 0.96 | 0.96 | 0.96 | 0.95 | 0.94 | 0.87 | 0.82 | 689 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 690 |2 | 1.91 | 1.91 | 1.91 | 1.91 | 1.91 | 1.83 | 1.82 | 1.52 | 691 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 692 |5 | 4.78 | 4.78 | 4.78 | 4.78 | 4.76 | 4.57 | 4.32 | 3.28 | 693 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 694 |10 | 9.56 | 9.56 | 9.56 | 9.55 | 9.43 | 8.85 | 8.23 | 6.51 | 695 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 696 |25 | 23.91 | 23.91 | 23.89 | 23.82 | 23.17 | 22.13 | 20.83 | 16.07 | 697 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 698 |50 | 47.81 | 47.80 | 47.71 | 47.43 | 45.87 | 44.12 | 40.44 | 31.64 | 699 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 700 |100| 95.64 | 95.50 | 95.17 | 94.39 | 92.52 | 87.73 | 77.25 | 82.38 | 701 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 703 Table 12: cubic Mean TCP Throughput (Mbit); Columns: netem bi- 704 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 706 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 707 | | 0 | 2 | 5 | 10 | 20 | 40 | 80 | 160 | 708 +===+=======+=======+=======+=======+=======+=======+=======+=======+ 709 |0.5| 0.48 | 0.48 | 0.48 | 0.48 | 0.48 | 0.47 | 0.45 | 0.40 | 710 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 711 |1 | 0.96 | 0.96 | 0.96 | 0.96 | 0.95 | 0.94 | 0.89 | 0.82 | 712 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 713 |2 | 1.91 | 1.91 | 1.91 | 1.90 | 1.84 | 1.85 | 1.64 | 1.54 | 714 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 715 |5 | 4.78 | 4.78 | 4.78 | 4.78 | 4.64 | 3.91 | 3.88 | 3.29 | 716 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 717 |10 | 9.56 | 9.56 | 9.56 | 9.52 | 8.90 | 8.04 | 7.44 | 6.43 | 718 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 719 |25 | 23.91 | 23.91 | 23.89 | 23.38 | 21.65 | 19.51 | 17.63 | 14.50 | 720 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 721 |50 | 47.82 | 47.81 | 47.74 | 46.21 | 42.17 | 38.31 | 31.97 | 28.85 | 722 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 723 |100| 95.63 | 95.53 | 94.91 | 90.65 | 83.51 | 69.92 | 63.70 | 53.89 | 724 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 726 Table 13: reno Mean TCP Throughput (Mbit); Columns: netem bi- 727 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 729 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 730 | | 0 | 2 | 5 | 10 | 20 | 40 | 80 | 160 | 731 +===+=======+=======+=======+=======+=======+=======+=======+=======+ 732 |0.5| 0.48 | 0.48 | 0.48 | 0.48 | 0.48 | 0.42 | 0.36 | 0.32 | 733 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 734 |1 | 0.96 | 0.96 | 0.96 | 0.96 | 0.84 | 0.73 | 0.61 | 0.54 | 735 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 736 |2 | 1.91 | 1.91 | 1.89 | 1.66 | 1.42 | 1.10 | 0.90 | 0.73 | 737 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 738 |5 | 4.78 | 4.52 | 4.07 | 3.64 | 3.75 | 3.75 | 3.85 | 3.37 | 739 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 740 |10 | 9.56 | 8.85 | 8.17 | 8.09 | 8.44 | 8.66 | 8.60 | 8.11 | 741 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 742 |25 | 23.90 | 23.84 | 23.74 | 23.62 | 23.47 | 23.09 | 22.54 | 20.97 | 743 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 744 |50 | 47.81 | 47.81 | 47.78 | 47.66 | 47.25 | 46.74 | 43.70 | 42.44 | 745 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 746 |100| 95.64 | 95.58 | 95.30 | 94.98 | 93.82 | 91.37 | 87.46 | 82.83 | 747 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 749 Table 14: reno-sce Mean TCP Throughput (Mbit); Columns: netem bi- 750 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 752 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 753 | | 0 | 2 | 5 | 10 | 20 | 40 | 80 | 160 | 754 +===+=======+=======+=======+=======+=======+=======+=======+=======+ 755 |0.5| 0.48 | 0.48 | 0.48 | 0.48 | 0.48 | 0.48 | 0.47 | 0.47 | 756 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 757 |1 | 0.96 | 0.96 | 0.96 | 0.96 | 0.96 | 0.95 | 0.93 | 0.91 | 758 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 759 |2 | 1.91 | 1.91 | 1.91 | 1.91 | 1.91 | 1.88 | 1.78 | 1.78 | 760 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 761 |5 | 4.78 | 4.78 | 4.78 | 4.77 | 4.74 | 4.68 | 4.54 | 4.10 | 762 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 763 |10 | 9.56 | 9.56 | 9.55 | 9.52 | 9.41 | 9.23 | 8.86 | 7.23 | 764 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 765 |25 | 23.91 | 23.90 | 23.84 | 23.68 | 23.25 | 22.34 | 20.33 | 15.86 | 766 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 767 |50 | 47.82 | 47.75 | 47.55 | 46.96 | 45.33 | 43.93 | 34.63 | 31.54 | 768 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 769 |100| 95.62 | 94.89 | 93.59 | 91.78 | 90.26 | 81.84 | 70.42 | 57.89 | 770 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 772 Table 15: dctcp Mean TCP Throughput (Mbit); Columns: netem bi- 773 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 775 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 776 | | 0 | 2 | 5 | 10 | 20 | 40 | 80 | 160 | 777 +===+=======+=======+=======+=======+=======+=======+=======+=======+ 778 |0.5| 0.48 | 0.48 | 0.48 | 0.48 | 0.48 | 0.42 | 0.36 | 0.27 | 779 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 780 |1 | 0.96 | 0.96 | 0.96 | 0.96 | 0.84 | 0.69 | 0.51 | 0.34 | 781 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 782 |2 | 1.91 | 1.91 | 1.88 | 1.65 | 1.34 | 0.87 | 0.65 | 0.37 | 783 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 784 |5 | 4.78 | 4.59 | 4.03 | 3.42 | 2.87 | 1.74 | 1.28 | 1.00 | 785 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 786 |10 | 9.56 | 8.69 | 7.58 | 6.87 | 6.75 | 6.66 | 6.15 | 5.89 | 787 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 788 |25 | 23.75 | 22.39 | 20.56 | 19.51 | 19.39 | 19.02 | 18.66 | 18.62 | 789 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 790 |50 | 47.81 | 47.68 | 47.27 | 46.54 | 45.59 | 44.52 | 41.77 | 40.53 | 791 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 792 |100| 95.64 | 95.59 | 95.34 | 94.90 | 94.30 | 90.53 | 85.48 | 82.53 | 793 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 795 Table 16: dctcp-sce Mean TCP Throughput (Mbit); Columns: netem 796 bi-directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 798 A.2. One-Flow TCP RTT 800 +---+------+------+------+------+--------+--------+--------+--------+ 801 | |0 |2 |5 |10 | 20 | 40 | 80 | 160 | 802 +===+======+======+======+======+========+========+========+========+ 803 |0.5|121.38|120.07|119.91|121.37| 108.48 | 128.70 | 189.50 | 230.34 | 804 +---+------+------+------+------+--------+--------+--------+--------+ 805 |1 |68.40 |68.16 |68.10 |69.33 | 72.97 | 88.11 | 116.66 | 191.18 | 806 +---+------+------+------+------+--------+--------+--------+--------+ 807 |2 |34.80 |35.01 |40.33 |40.17 | 52.74 | 62.05 | 100.71 | 175.00 | 808 +---+------+------+------+------+--------+--------+--------+--------+ 809 |5 |13.79 |15.92 |18.43 |23.83 | 31.04 | 49.07 | 87.79 | 167.49 | 810 +---+------+------+------+------+--------+--------+--------+--------+ 811 |10 |7.08 |8.95 |12.58 |17.39 | 26.12 | 44.73 | 84.60 | 164.49 | 812 +---+------+------+------+------+--------+--------+--------+--------+ 813 |25 |6.36 |8.29 |11.31 |15.33 | 24.06 | 43.37 | 82.68 | 162.72 | 814 +---+------+------+------+------+--------+--------+--------+--------+ 815 |50 |5.88 |8.16 |10.70 |14.76 | 23.51 | 42.82 | 82.10 | 161.81 | 816 +---+------+------+------+------+--------+--------+--------+--------+ 817 |100|5.99 |8.08 |10.38 |14.42 | 23.69 | 42.90 | 82.16 | 162.01 | 818 +---+------+------+------+------+--------+--------+--------+--------+ 820 Table 17: cubic Mean TCP RTT (ms); Columns: netem bi-directional 821 Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 823 +---+------+------+------+------+--------+--------+--------+--------+ 824 | |0 |2 |5 |10 | 20 | 40 | 80 | 160 | 825 +===+======+======+======+======+========+========+========+========+ 826 |0.5|138.77|137.84|138.91|138.92| 132.94 | 140.51 | 170.48 | 235.32 | 827 +---+------+------+------+------+--------+--------+--------+--------+ 828 |1 |66.82 |66.68 |68.93 |69.02 | 77.11 | 91.69 | 123.15 | 196.59 | 829 +---+------+------+------+------+--------+--------+--------+--------+ 830 |2 |41.00 |41.25 |40.81 |42.24 | 47.24 | 65.51 | 99.34 | 176.74 | 831 +---+------+------+------+------+--------+--------+--------+--------+ 832 |5 |16.25 |18.37 |19.18 |25.13 | 32.06 | 49.61 | 87.61 | 167.39 | 833 +---+------+------+------+------+--------+--------+--------+--------+ 834 |10 |7.68 |9.86 |13.14 |18.75 | 26.74 | 45.54 | 84.50 | 164.45 | 835 +---+------+------+------+------+--------+--------+--------+--------+ 836 |25 |6.27 |8.26 |11.46 |15.22 | 23.65 | 42.84 | 82.59 | 162.69 | 837 +---+------+------+------+------+--------+--------+--------+--------+ 838 |50 |5.99 |8.08 |10.34 |14.11 | 22.86 | 42.22 | 81.97 | 162.08 | 839 +---+------+------+------+------+--------+--------+--------+--------+ 840 |100|5.87 |7.64 |9.85 |13.62 | 22.64 | 41.96 | 81.73 | 161.76 | 841 +---+------+------+------+------+--------+--------+--------+--------+ 843 Table 18: reno Mean TCP RTT (ms); Columns: netem bi-directional 844 Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 846 +---+-----+-------+-------+-------+-------+-------+--------+--------+ 847 | |0 | 2 | 5 | 10 | 20 | 40 | 80 | 160 | 848 +===+=====+=======+=======+=======+=======+=======+========+========+ 849 |0.5|50.36| 50.33 | 50.48 | 50.33 | 70.57 | 87.95 | 128.25 | 203.39 | 850 +---+-----+-------+-------+-------+-------+-------+--------+--------+ 851 |1 |24.52| 24.74 | 26.28 | 35.99 | 44.19 | 63.77 | 104.02 | 183.39 | 852 +---+-----+-------+-------+-------+-------+-------+--------+--------+ 853 |2 |11.91| 13.58 | 18.62 | 23.01 | 32.70 | 55.39 | 95.68 | 175.24 | 854 +---+-----+-------+-------+-------+-------+-------+--------+--------+ 855 |5 |7.07 | 8.90 | 11.67 | 16.76 | 26.43 | 46.12 | 85.92 | 166.15 | 856 +---+-----+-------+-------+-------+-------+-------+--------+--------+ 857 |10 |5.22 | 7.11 | 10.19 | 14.84 | 24.30 | 44.12 | 83.96 | 164.04 | 858 +---+-----+-------+-------+-------+-------+-------+--------+--------+ 859 |25 |4.40 | 6.17 | 8.93 | 13.48 | 23.23 | 42.85 | 82.78 | 162.68 | 860 +---+-----+-------+-------+-------+-------+-------+--------+--------+ 861 |50 |3.99 | 5.90 | 8.86 | 13.80 | 23.45 | 43.20 | 82.83 | 162.65 | 862 +---+-----+-------+-------+-------+-------+-------+--------+--------+ 863 |100|4.00 | 5.97 | 8.81 | 13.68 | 23.59 | 43.38 | 83.14 | 162.91 | 864 +---+-----+-------+-------+-------+-------+-------+--------+--------+ 866 Table 19: reno-sce Mean TCP RTT (ms); Columns: netem bi- 867 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 869 +---+------+------+------+------+--------+--------+--------+--------+ 870 | |0 |2 |5 |10 | 20 | 40 | 80 | 160 | 871 +===+======+======+======+======+========+========+========+========+ 872 |0.5|132.20|131.17|131.14|130.92| 130.17 | 157.56 | 199.65 | 260.24 | 873 +---+------+------+------+------+--------+--------+--------+--------+ 874 |1 |66.23 |66.69 |66.65 |66.60 | 79.38 | 103.86 | 135.31 | 203.32 | 875 +---+------+------+------+------+--------+--------+--------+--------+ 876 |2 |33.84 |34.07 |39.03 |40.24 | 52.76 | 69.25 | 104.09 | 183.85 | 877 +---+------+------+------+------+--------+--------+--------+--------+ 878 |5 |13.67 |15.87 |18.50 |23.05 | 32.73 | 53.12 | 89.63 | 168.33 | 879 +---+------+------+------+------+--------+--------+--------+--------+ 880 |10 |6.99 |9.06 |12.82 |17.26 | 26.75 | 45.79 | 85.43 | 165.10 | 881 +---+------+------+------+------+--------+--------+--------+--------+ 882 |25 |6.57 |8.26 |11.25 |16.07 | 25.65 | 44.11 | 83.45 | 163.30 | 883 +---+------+------+------+------+--------+--------+--------+--------+ 884 |50 |6.22 |8.39 |10.98 |15.83 | 25.65 | 45.56 | 82.73 | 162.51 | 885 +---+------+------+------+------+--------+--------+--------+--------+ 886 |100|6.31 |8.27 |11.16 |16.12 | 25.88 | 44.90 | 82.43 | 162.05 | 887 +---+------+------+------+------+--------+--------+--------+--------+ 889 Table 20: dctcp Mean TCP RTT (ms); Columns: netem bi-directional 890 Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 892 +---+-----+-------+-------+-------+-------+-------+--------+--------+ 893 | |0 | 2 | 5 | 10 | 20 | 40 | 80 | 160 | 894 +===+=====+=======+=======+=======+=======+=======+========+========+ 895 |0.5|49.63| 49.96 | 49.77 | 49.39 | 69.64 | 87.27 | 124.89 | 205.91 | 896 +---+-----+-------+-------+-------+-------+-------+--------+--------+ 897 |1 |24.45| 24.38 | 26.22 | 35.62 | 44.12 | 64.59 | 105.36 | 187.70 | 898 +---+-----+-------+-------+-------+-------+-------+--------+--------+ 899 |2 |11.90| 13.78 | 18.17 | 22.66 | 32.83 | 56.55 | 96.72 | 179.88 | 900 +---+-----+-------+-------+-------+-------+-------+--------+--------+ 901 |5 |7.02 | 8.60 | 11.42 | 16.60 | 27.16 | 49.53 | 90.11 | 170.64 | 902 +---+-----+-------+-------+-------+-------+-------+--------+--------+ 903 |10 |5.14 | 6.95 | 9.97 | 15.01 | 24.59 | 44.28 | 84.15 | 163.98 | 904 +---+-----+-------+-------+-------+-------+-------+--------+--------+ 905 |25 |4.10 | 5.74 | 8.31 | 12.94 | 22.72 | 42.48 | 82.47 | 162.52 | 906 +---+-----+-------+-------+-------+-------+-------+--------+--------+ 907 |50 |3.59 | 5.24 | 7.99 | 12.71 | 22.28 | 41.99 | 81.92 | 161.88 | 908 +---+-----+-------+-------+-------+-------+-------+--------+--------+ 909 |100|3.52 | 5.46 | 8.34 | 13.11 | 22.62 | 42.38 | 82.29 | 162.07 | 910 +---+-----+-------+-------+-------+-------+-------+--------+--------+ 912 Table 21: dctcp-sce Mean TCP RTT (ms); Columns: netem bi- 913 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 915 A.3. Two-Flow TCP Throughput (Cake "flowblind") 917 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 918 | | 0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 919 +===+=======+=======+=======+=======+=======+=======+=======+=======+ 920 | | cubic | | | | cubic | | | | 921 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 922 |1 | 0.48 | 0.48 | 0.48 | 0.46 | 0.48 | 0.48 | 0.47 | 0.46 | 923 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 924 |5 | 2.41 | 2.39 | 2.37 | 2.27 | 2.37 | 2.38 | 2.37 | 2.19 | 925 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 926 |10 | 4.82 | 4.57 | 4.70 | 3.83 | 4.74 | 4.93 | 4.77 | 4.83 | 927 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 928 |50 | 22.64 | 23.46 | 24.09 | 22.26 | 25.18 | 24.19 | 23.07 | 20.68 | 929 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 930 |100| 47.66 | 42.88 | 46.29 | 44.10 | 48.01 | 52.03 | 48.29 | 43.72 | 931 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 933 Table 22: cubic-cubic Mean TCP Throughput (Mbit); Columns: netem 934 bi-directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 936 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 937 | | 0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 938 +===+=======+=======+=======+=======+=======+=======+=======+=======+ 939 | | cubic | | | | reno | | | | 940 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 941 |1 | 0.43 | 0.46 | 0.45 | 0.41 | 0.53 | 0.50 | 0.51 | 0.51 | 942 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 943 |5 | 2.10 | 2.04 | 2.46 | 2.30 | 2.68 | 2.71 | 2.22 | 2.04 | 944 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 945 |10 | 4.23 | 4.61 | 4.50 | 4.16 | 5.34 | 4.81 | 4.83 | 4.17 | 946 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 947 |50 | 22.79 | 24.60 | 23.55 | 26.18 | 25.03 | 23.05 | 23.32 | 14.70 | 948 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 949 |100| 46.82 | 51.06 | 48.73 | 55.96 | 48.83 | 43.85 | 44.96 | 29.02 | 950 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 952 Table 23: cubic-reno Mean TCP Throughput (Mbit); Columns: netem 953 bi-directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 955 +---+-------+-------+-------+-------+----------+-----+------+-------+ 956 | | 0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 957 +===+=======+=======+=======+=======+==========+=====+======+=======+ 958 | | cubic | | | | reno-sce | | | | 959 +---+-------+-------+-------+-------+----------+-----+------+-------+ 960 |1 | 0.55 | 0.55 | 0.62 | 0.66 | 0.41 | 0.41| 0.34 | 0.24 | 961 +---+-------+-------+-------+-------+----------+-----+------+-------+ 962 |5 | 2.75 | 3.63 | 3.96 | 3.92 | 2.03 | 1.14| 0.80 | 0.46 | 963 +---+-------+-------+-------+-------+----------+-----+------+-------+ 964 |10 | 5.50 | 7.97 | 8.24 | 7.57 | 4.06 | 1.57| 1.26 | 1.37 | 965 +---+-------+-------+-------+-------+----------+-----+------+-------+ 966 |50 | 43.53 | 44.29 | 42.98 | 39.36 | 4.30 | 3.44| 4.25 | 4.89 | 967 +---+-------+-------+-------+-------+----------+-----+------+-------+ 968 |100| 91.16 | 89.89 | 88.69 | 76.76 | 4.46 | 5.28| 5.77 | 11.79 | 969 +---+-------+-------+-------+-------+----------+-----+------+-------+ 971 Table 24: cubic-reno-sce Mean TCP Throughput (Mbit); Columns: 972 netem bi- directional Delay (ms); Rows: Cake-limited Bandwidth 973 (Mbit) 975 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 976 | | 0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 977 +===+=======+=======+=======+=======+=======+=======+=======+=======+ 978 | | cubic | | | | dctcp | | | | 979 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 980 |1 | 0.48 | 0.47 | 0.40 | 0.33 | 0.48 | 0.48 | 0.56 | 0.60 | 981 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 982 |5 | 2.30 | 1.53 | 1.49 | 1.70 | 2.49 | 3.25 | 3.26 | 2.87 | 983 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 984 |10 | 3.69 | 2.77 | 2.81 | 2.99 | 5.88 | 6.77 | 6.68 | 5.96 | 985 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 986 |50 | 14.99 | 16.93 | 15.25 | 18.99 | 32.85 | 30.62 | 31.72 | 24.58 | 987 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 988 |100| 31.33 | 30.67 | 33.63 | 32.23 | 64.35 | 63.57 | 59.81 | 55.50 | 989 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 991 Table 25: cubic-dctcp Mean TCP Throughput (Mbit); Columns: netem 992 bi-directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 994 +---+-------+-------+-------+-------+-----------+-----+------+------+ 995 | | 0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 996 +===+=======+=======+=======+=======+===========+=====+======+======+ 997 | | cubic | | | | dctcp-sce | | | | 998 +---+-------+-------+-------+-------+-----------+-----+------+------+ 999 |1 | 0.55 | 0.55 | 0.62 | 0.66 | 0.41 | 0.40| 0.34 | 0.24 | 1000 +---+-------+-------+-------+-------+-----------+-----+------+------+ 1001 |5 | 2.76 | 3.59 | 3.91 | 4.01 | 2.02 | 1.18| 0.85 | 0.42 | 1002 +---+-------+-------+-------+-------+-----------+-----+------+------+ 1003 |10 | 5.48 | 7.95 | 8.24 | 7.81 | 4.08 | 1.60| 1.22 | 1.01 | 1004 +---+-------+-------+-------+-------+-----------+-----+------+------+ 1005 |50 | 43.46 | 44.60 | 43.46 | 39.78 | 4.36 | 3.12| 3.75 | 4.29 | 1006 +---+-------+-------+-------+-------+-----------+-----+------+------+ 1007 |100| 91.37 | 90.47 | 88.47 | 77.27 | 4.28 | 4.69| 5.59 | 7.74 | 1008 +---+-------+-------+-------+-------+-----------+-----+------+------+ 1010 Table 26: cubic-dctcp-sce Mean TCP Throughput (Mbit); Columns: 1011 netem bi- directional Delay (ms); Rows: Cake-limited Bandwidth 1012 (Mbit) 1014 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1015 | | 0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 1016 +===+=======+=======+=======+=======+=======+=======+=======+=======+ 1017 | | reno | | | | reno | | | | 1018 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1019 |1 | 0.52 | 0.48 | 0.47 | 0.44 | 0.44 | 0.48 | 0.48 | 0.48 | 1020 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1021 |5 | 2.39 | 2.36 | 2.23 | 1.98 | 2.39 | 2.37 | 2.41 | 2.15 | 1022 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1023 |10 | 4.74 | 4.86 | 4.79 | 3.92 | 4.82 | 4.51 | 4.40 | 3.93 | 1024 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1025 |50 | 23.88 | 22.77 | 22.88 | 18.78 | 23.95 | 24.90 | 24.03 | 17.50 | 1026 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1027 |100| 49.89 | 45.68 | 48.07 | 36.99 | 45.76 | 49.17 | 44.65 | 37.37 | 1028 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1030 Table 27: reno-reno Mean TCP Throughput (Mbit); Columns: netem 1031 bi-directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 1033 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1034 | |0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 1035 +===+=====+======+=======+=======+==========+=======+=======+=======+ 1036 | |reno | | | | reno-sce | | | | 1037 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1038 |1 |0.56 | 0.56 | 0.62 | 0.66 | 0.39 | 0.39 | 0.33 | 0.24 | 1039 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1040 |5 |2.89 | 3.43 | 3.82 | 3.64 | 1.89 | 1.26 | 0.86 | 0.49 | 1041 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1042 |10 |5.77 | 7.71 | 7.91 | 6.96 | 3.80 | 1.78 | 1.38 | 1.44 | 1043 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1044 |50 |43.10| 42.13| 39.08 | 28.40 | 4.72 | 5.18 | 6.99 | 14.62 | 1045 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1046 |100|90.26| 83.33| 78.25 | 62.70 | 5.40 | 10.72 | 13.52 | 19.41 | 1047 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1049 Table 28: reno-reno-sce Mean TCP Throughput (Mbit); Columns: 1050 netem bi- directional Delay (ms); Rows: Cake-limited Bandwidth 1051 (Mbit) 1053 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1054 | | 0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 1055 +===+=======+=======+=======+=======+=======+=======+=======+=======+ 1056 | | reno | | | | dctcp | | | | 1057 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1058 |1 | 0.55 | 0.54 | 0.42 | 0.37 | 0.41 | 0.42 | 0.53 | 0.57 | 1059 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1060 |5 | 2.60 | 1.65 | 1.58 | 1.44 | 2.18 | 3.12 | 3.15 | 3.09 | 1061 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1062 |10 | 4.12 | 3.28 | 2.98 | 2.80 | 5.44 | 6.24 | 6.46 | 5.99 | 1063 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1064 |50 | 17.17 | 17.86 | 16.27 | 11.57 | 30.66 | 29.71 | 30.63 | 28.80 | 1065 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1066 |100| 36.09 | 33.70 | 28.55 | 18.60 | 59.58 | 60.61 | 64.04 | 59.50 | 1067 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1069 Table 29: reno-dctcp Mean TCP Throughput (Mbit); Columns: netem 1070 bi-directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 1072 +---+------+-------+-------+-------+-----------+----+-------+-------+ 1073 | | 0 | 10 | 20 | 80 | 0 |10 | 20 | 80 | 1074 +===+======+=======+=======+=======+===========+====+=======+=======+ 1075 | | reno | | | | dctcp-sce | | | | 1076 +---+------+-------+-------+-------+-----------+----+-------+-------+ 1077 |1 | 0.57 | 0.56 | 0.63 | 0.66 | 0.39 |0.39| 0.33 | 0.24 | 1078 +---+------+-------+-------+-------+-----------+----+-------+-------+ 1079 |5 | 2.89 | 3.74 | 3.88 | 3.68 | 1.89 |1.03| 0.83 | 0.47 | 1080 +---+------+-------+-------+-------+-----------+----+-------+-------+ 1081 |10 | 5.70 | 7.72 | 7.94 | 7.03 | 3.86 |1.77| 1.32 | 1.18 | 1082 +---+------+-------+-------+-------+-----------+----+-------+-------+ 1083 |50 | 43.12| 42.73 | 39.77 | 31.55 | 4.70 |4.57| 6.11 | 9.93 | 1084 +---+------+-------+-------+-------+-----------+----+-------+-------+ 1085 |100| 90.46| 84.75 | 79.64 | 63.20 | 5.18 |9.21| 11.03 | 11.65 | 1086 +---+------+-------+-------+-------+-----------+----+-------+-------+ 1088 Table 30: reno-dctcp-sce Mean TCP Throughput (Mbit); Columns: 1089 netem bi- directional Delay (ms); Rows: Cake-limited Bandwidth 1090 (Mbit) 1092 +---+----------+-----+-----+-----+----------+-------+-------+-------+ 1093 | | 0 |10 |20 |80 | 0 | 10 | 20 | 80 | 1094 +===+==========+=====+=====+=====+==========+=======+=======+=======+ 1095 | | reno-sce | | | | reno-sce | | | | 1096 +---+----------+-----+-----+-----+----------+-------+-------+-------+ 1097 |1 | 0.48 |0.48 |0.48 |0.32 | 0.48 | 0.48 | 0.48 | 0.34 | 1098 +---+----------+-----+-----+-----+----------+-------+-------+-------+ 1099 |5 | 2.39 |1.99 |1.75 |1.77 | 2.39 | 2.04 | 1.75 | 1.52 | 1100 +---+----------+-----+-----+-----+----------+-------+-------+-------+ 1101 |10 | 4.78 |3.80 |3.82 |4.23 | 4.78 | 4.00 | 3.79 | 4.06 | 1102 +---+----------+-----+-----+-----+----------+-------+-------+-------+ 1103 |50 | 24.24 |21.17|24.08|24.69| 23.60 | 26.11 | 22.91 | 20.34 | 1104 +---+----------+-----+-----+-----+----------+-------+-------+-------+ 1105 |100| 42.25 |47.10|37.69|44.31| 53.39 | 48.22 | 57.14 | 40.92 | 1106 +---+----------+-----+-----+-----+----------+-------+-------+-------+ 1108 Table 31: reno-sce-reno-sce Mean TCP Throughput (Mbit); Columns: 1109 netem bi- directional Delay (ms); Rows: Cake-limited Bandwidth 1110 (Mbit) 1112 +---+----------+-----+------+-------+-------+-------+-------+-------+ 1113 | | 0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 1114 +===+==========+=====+======+=======+=======+=======+=======+=======+ 1115 | | reno-sce | | | | dctcp | | | | 1116 +---+----------+-----+------+-------+-------+-------+-------+-------+ 1117 |1 | 0.46 | 0.46| 0.31 | 0.19 | 0.50 | 0.50 | 0.65 | 0.75 | 1118 +---+----------+-----+------+-------+-------+-------+-------+-------+ 1119 |5 | 2.16 | 1.12| 0.78 | 0.38 | 2.63 | 3.66 | 4.00 | 4.20 | 1120 +---+----------+-----+------+-------+-------+-------+-------+-------+ 1121 |10 | 3.62 | 1.57| 1.15 | 0.90 | 5.94 | 7.98 | 8.35 | 8.33 | 1122 +---+----------+-----+------+-------+-------+-------+-------+-------+ 1123 |50 | 4.03 | 2.33| 2.98 | 10.00 | 43.81 | 45.32 | 44.04 | 32.95 | 1124 +---+----------+-----+------+-------+-------+-------+-------+-------+ 1125 |100| 4.38 | 4.10| 3.77 | 15.34 | 91.30 | 89.54 | 88.99 | 67.81 | 1126 +---+----------+-----+------+-------+-------+-------+-------+-------+ 1128 Table 32: reno-sce-dctcp Mean TCP Throughput (Mbit); Columns: 1129 netem bi- directional Delay (ms); Rows: Cake-limited Bandwidth 1130 (Mbit) 1132 +---+----------+------+-------+-------+-----------+-------+----+----+ 1133 | | 0 | 10 | 20 | 80 | 0 | 10 |20 |80 | 1134 +===+==========+======+=======+=======+===========+=======+====+====+ 1135 | | reno-sce | | | | dctcp-sce | | | | 1136 +---+----------+------+-------+-------+-----------+-------+----+----+ 1137 |1 | 0.48 | 0.48 | 0.48 | 0.34 | 0.48 | 0.48 |0.48|0.33| 1138 +---+----------+------+-------+-------+-----------+-------+----+----+ 1139 |5 | 2.39 | 1.97 | 1.65 | 1.78 | 2.39 | 2.05 |1.73|0.96| 1140 +---+----------+------+-------+-------+-----------+-------+----+----+ 1141 |10 | 4.78 | 3.97 | 3.93 | 5.01 | 4.78 | 3.73 |3.29|2.60| 1142 +---+----------+------+-------+-------+-----------+-------+----+----+ 1143 |50 | 31.92 | 39.92| 40.62 | 39.76 | 15.90 | 7.24 |5.80|4.70| 1144 +---+----------+------+-------+-------+-----------+-------+----+----+ 1145 |100| 62.33 | 82.41| 85.50 | 82.05 | 33.30 | 12.61 |9.49|6.82| 1146 +---+----------+------+-------+-------+-----------+-------+----+----+ 1148 Table 33: reno-sce-dctcp-sce Mean TCP Throughput (Mbit); Columns: 1149 netem bi- directional Delay (ms); Rows: Cake-limited Bandwidth 1150 (Mbit) 1152 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1153 | | 0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 1154 +===+=======+=======+=======+=======+=======+=======+=======+=======+ 1155 | | dctcp | | | | dctcp | | | | 1156 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1157 |1 | 0.48 | 0.48 | 0.50 | 0.47 | 0.48 | 0.48 | 0.45 | 0.47 | 1158 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1159 |5 | 2.41 | 2.40 | 2.39 | 2.32 | 2.37 | 2.38 | 2.37 | 2.27 | 1160 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1161 |10 | 4.89 | 4.88 | 4.77 | 4.66 | 4.68 | 4.66 | 4.70 | 4.38 | 1162 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1163 |50 | 23.87 | 23.68 | 25.27 | 19.63 | 23.95 | 23.72 | 21.30 | 21.54 | 1164 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1165 |100| 49.20 | 45.78 | 47.85 | 41.79 | 46.43 | 47.44 | 45.23 | 39.41 | 1166 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1168 Table 34: dctcp-dctcp Mean TCP Throughput (Mbit); Columns: netem 1169 bi-directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 1171 +---+-------+-------+-------+-------+-----------+-----+------+------+ 1172 | | 0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 1173 +===+=======+=======+=======+=======+===========+=====+======+======+ 1174 | | dctcp | | | | dctcp-sce | | | | 1175 +---+-------+-------+-------+-------+-----------+-----+------+------+ 1176 |1 | 0.50 | 0.50 | 0.63 | 0.75 | 0.45 | 0.46| 0.33 | 0.19 | 1177 +---+-------+-------+-------+-------+-----------+-----+------+------+ 1178 |5 | 2.62 | 3.67 | 4.00 | 4.26 | 2.16 | 1.12| 0.76 | 0.34 | 1179 +---+-------+-------+-------+-------+-----------+-----+------+------+ 1180 |10 | 5.98 | 7.98 | 8.38 | 8.47 | 3.59 | 1.56| 1.12 | 0.69 | 1181 +---+-------+-------+-------+-------+-----------+-----+------+------+ 1182 |50 | 43.80 | 45.41 | 44.22 | 34.01 | 4.02 | 2.21| 2.72 | 9.50 | 1183 +---+-------+-------+-------+-------+-----------+-----+------+------+ 1184 |100| 91.58 | 89.85 | 89.10 | 69.89 | 4.07 | 3.82| 3.61 | 8.74 | 1185 +---+-------+-------+-------+-------+-----------+-----+------+------+ 1187 Table 35: dctcp-dctcp-sce Mean TCP Throughput (Mbit); Columns: 1188 netem bi- directional Delay (ms); Rows: Cake-limited Bandwidth 1189 (Mbit) 1191 +---+-----------+-----+-----+-----+-----------+-----+-------+-------+ 1192 | | 0 |10 |20 |80 | 0 |10 | 20 | 80 | 1193 +===+===========+=====+=====+=====+===========+=====+=======+=======+ 1194 | | dctcp-sce | | | | dctcp-sce | | | | 1195 +---+-----------+-----+-----+-----+-----------+-----+-------+-------+ 1196 |1 | 0.48 |0.48 |0.48 |0.34 | 0.48 |0.48 | 0.48 | 0.33 | 1197 +---+-----------+-----+-----+-----+-----------+-----+-------+-------+ 1198 |5 | 2.39 |1.99 |1.70 |1.02 | 2.39 |2.04 | 1.66 | 1.01 | 1199 +---+-----------+-----+-----+-----+-----------+-----+-------+-------+ 1200 |10 | 4.78 |3.78 |3.58 |3.04 | 4.78 |3.71 | 3.23 | 3.33 | 1201 +---+-----------+-----+-----+-----+-----------+-----+-------+-------+ 1202 |50 | 24.16 |19.48|19.33|18.15| 23.61 |21.42| 19.76 | 20.18 | 1203 +---+-----------+-----+-----+-----+-----------+-----+-------+-------+ 1204 |100| 48.08 |43.17|54.14|19.58| 47.56 |49.83| 36.85 | 19.25 | 1205 +---+-----------+-----+-----+-----+-----------+-----+-------+-------+ 1207 Table 36: dctcp-sce-dctcp-sce Mean TCP Throughput (Mbit); 1208 Columns: netem bi- directional Delay (ms); Rows: Cake-limited 1209 Bandwidth (Mbit) 1211 A.4. Two-Flow TCP Throughput (Cake "flowblind sce-single") 1213 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1214 | | 0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 1215 +===+=======+=======+=======+=======+=======+=======+=======+=======+ 1216 | | cubic | | | | cubic | | | | 1217 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1218 |1 | 0.48 | 0.48 | 0.48 | 0.42 | 0.48 | 0.48 | 0.48 | 0.51 | 1219 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1220 |5 | 2.42 | 2.31 | 2.44 | 2.21 | 2.36 | 2.46 | 2.29 | 2.30 | 1221 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1222 |10 | 4.83 | 4.95 | 4.62 | 4.15 | 4.74 | 4.59 | 4.88 | 4.63 | 1223 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1224 |50 | 23.88 | 23.31 | 24.19 | 23.67 | 23.95 | 24.34 | 22.99 | 19.38 | 1225 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1226 |100| 50.40 | 47.62 | 48.40 | 38.13 | 45.25 | 47.30 | 46.14 | 48.92 | 1227 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1229 Table 37: cubic-cubic Mean TCP Throughput (Mbit); Columns: netem 1230 bi-directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 1232 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1233 | | 0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 1234 +===+=======+=======+=======+=======+=======+=======+=======+=======+ 1235 | | cubic | | | | reno | | | | 1236 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1237 |1 | 0.55 | 0.46 | 0.44 | 0.40 | 0.41 | 0.50 | 0.51 | 0.52 | 1238 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1239 |5 | 2.14 | 2.06 | 2.23 | 2.08 | 2.64 | 2.68 | 2.46 | 2.18 | 1240 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1241 |10 | 4.39 | 4.63 | 4.92 | 4.28 | 5.18 | 4.78 | 4.44 | 4.06 | 1242 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1243 |50 | 22.61 | 24.49 | 25.41 | 29.22 | 25.22 | 23.18 | 21.59 | 12.14 | 1244 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1245 |100| 46.37 | 48.43 | 44.51 | 52.13 | 49.30 | 46.45 | 48.88 | 31.90 | 1246 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1248 Table 38: cubic-reno Mean TCP Throughput (Mbit); Columns: netem 1249 bi-directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 1251 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1252 | |0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 1253 +===+=====+======+=======+=======+==========+=======+=======+=======+ 1254 | |cubic| | | | reno-sce | | | | 1255 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1256 |1 |0.45 | 0.46 | 0.51 | 0.48 | 0.50 | 0.50 | 0.44 | 0.42 | 1257 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1258 |5 |2.24 | 3.07 | 3.78 | 3.24 | 2.54 | 1.68 | 0.97 | 1.13 | 1259 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1260 |10 |4.16 | 5.59 | 7.04 | 4.21 | 5.40 | 3.78 | 2.36 | 4.18 | 1261 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1262 |50 |23.95| 24.71| 25.16 | 17.98 | 23.87 | 22.53 | 21.18 | 20.74 | 1263 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1264 |100|50.40| 66.75| 65.82 | 64.67 | 45.26 | 28.41 | 28.70 | 22.52 | 1265 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1267 Table 39: cubic-reno-sce Mean TCP Throughput (Mbit); Columns: 1268 netem bi- directional Delay (ms); Rows: Cake-limited Bandwidth 1269 (Mbit) 1271 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1272 | | 0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 1273 +===+=======+=======+=======+=======+=======+=======+=======+=======+ 1274 | | cubic | | | | dctcp | | | | 1275 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1276 |1 | 0.40 | 0.39 | 0.37 | 0.30 | 0.56 | 0.57 | 0.59 | 0.65 | 1277 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1278 |5 | 1.87 | 1.38 | 1.25 | 1.57 | 2.91 | 3.40 | 3.50 | 3.03 | 1279 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1280 |10 | 3.37 | 1.88 | 1.56 | 2.00 | 6.20 | 7.66 | 7.89 | 7.04 | 1281 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1282 |50 | 6.74 | 5.79 | 6.91 | 11.76 | 41.11 | 39.67 | 37.24 | 30.38 | 1283 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1284 |100| 11.73 | 12.49 | 11.51 | 22.96 | 83.95 | 71.89 | 69.95 | 60.58 | 1285 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1287 Table 40: cubic-dctcp Mean TCP Throughput (Mbit); Columns: netem 1288 bi-directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 1290 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1291 | |0 |10 | 20 | 80 | 0 | 10 | 20 | 80 | 1292 +===+=====+=====+=======+=======+===========+=======+=======+=======+ 1293 | |cubic| | | | dctcp-sce | | | | 1294 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1295 |1 |0.44 |0.46 | 0.51 | 0.55 | 0.52 | 0.49 | 0.44 | 0.37 | 1296 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1297 |5 |2.40 |3.18 | 3.69 | 3.46 | 2.39 | 1.58 | 1.06 | 0.89 | 1298 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1299 |10 |4.02 |6.35 | 7.58 | 5.48 | 5.54 | 3.09 | 1.87 | 2.58 | 1300 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1301 |50 |24.54|37.56| 35.51 | 27.95 | 23.29 | 10.16 | 11.77 | 15.42 | 1302 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1303 |100|59.52|77.63| 80.96 | 75.79 | 36.12 | 17.42 | 13.35 | 11.62 | 1304 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1306 Table 41: cubic-dctcp-sce Mean TCP Throughput (Mbit); Columns: 1307 netem bi- directional Delay (ms); Rows: Cake-limited Bandwidth 1308 (Mbit) 1310 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1311 | | 0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 1312 +===+=======+=======+=======+=======+=======+=======+=======+=======+ 1313 | | reno | | | | reno | | | | 1314 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1315 |1 | 0.49 | 0.47 | 0.49 | 0.46 | 0.47 | 0.48 | 0.47 | 0.45 | 1316 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1317 |5 | 2.38 | 2.39 | 2.33 | 1.96 | 2.40 | 2.35 | 2.33 | 2.16 | 1318 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1319 |10 | 4.78 | 4.58 | 4.63 | 3.79 | 4.79 | 4.84 | 4.61 | 4.23 | 1320 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1321 |50 | 24.05 | 23.35 | 24.20 | 19.51 | 23.78 | 24.33 | 22.69 | 16.79 | 1322 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1323 |100| 46.69 | 50.26 | 46.11 | 35.97 | 48.97 | 44.58 | 46.86 | 38.56 | 1324 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1326 Table 42: reno-reno Mean TCP Throughput (Mbit); Columns: netem 1327 bi-directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 1329 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1330 | |0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 1331 +===+=====+======+=======+=======+==========+=======+=======+=======+ 1332 | |reno | | | | reno-sce | | | | 1333 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1334 |1 |0.47 | 0.50 | 0.49 | 0.49 | 0.49 | 0.46 | 0.47 | 0.39 | 1335 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1336 |5 |2.51 | 2.89 | 3.58 | 3.08 | 2.27 | 1.83 | 1.12 | 1.11 | 1337 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1338 |10 |4.51 | 5.67 | 6.96 | 4.39 | 5.06 | 3.55 | 2.22 | 3.74 | 1339 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1340 |50 |23.88| 26.49| 26.33 | 15.66 | 23.94 | 20.93 | 19.68 | 21.41 | 1341 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1342 |100|53.06| 62.99| 58.85 | 48.15 | 42.59 | 31.69 | 33.83 | 38.41 | 1343 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1345 Table 43: reno-reno-sce Mean TCP Throughput (Mbit); Columns: 1346 netem bi- directional Delay (ms); Rows: Cake-limited Bandwidth 1347 (Mbit) 1349 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1350 | | 0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 1351 +===+=======+=======+=======+=======+=======+=======+=======+=======+ 1352 | | reno | | | | dctcp | | | | 1353 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1354 |1 | 0.42 | 0.42 | 0.38 | 0.33 | 0.54 | 0.53 | 0.58 | 0.62 | 1355 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1356 |5 | 2.00 | 1.50 | 1.47 | 1.49 | 2.79 | 3.28 | 3.28 | 3.06 | 1357 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1358 |10 | 3.62 | 2.19 | 1.92 | 2.07 | 5.95 | 7.35 | 7.53 | 6.87 | 1359 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1360 |50 | 7.80 | 6.96 | 6.91 | 8.15 | 40.04 | 38.98 | 37.41 | 31.25 | 1361 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1362 |100| 13.40 | 13.20 | 10.37 | 16.04 | 82.28 | 72.23 | 70.72 | 61.88 | 1363 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1365 Table 44: reno-dctcp Mean TCP Throughput (Mbit); Columns: netem 1366 bi-directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 1368 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1369 | |0 |10 | 20 | 80 | 0 | 10 | 20 | 80 | 1370 +===+=====+=====+=======+=======+===========+=======+=======+=======+ 1371 | |reno | | | | dctcp-sce | | | | 1372 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1373 |1 |0.47 |0.48 | 0.48 | 0.24 | 0.49 | 0.47 | 0.47 | 0.66 | 1374 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1375 |5 |2.50 |3.15 | 3.64 | 2.92 | 2.28 | 1.59 | 1.07 | 1.10 | 1376 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1377 |10 |4.53 |6.77 | 7.30 | 5.18 | 5.04 | 2.65 | 1.91 | 2.55 | 1378 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1379 |50 |26.20|35.85| 34.81 | 22.99 | 21.62 | 11.46 | 11.45 | 19.58 | 1380 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1381 |100|64.59|71.71| 71.03 | 59.15 | 31.06 | 22.61 | 20.74 | 17.50 | 1382 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1384 Table 45: reno-dctcp-sce Mean TCP Throughput (Mbit); Columns: 1385 netem bi- directional Delay (ms); Rows: Cake-limited Bandwidth 1386 (Mbit) 1388 +---+----------+-----+-----+-----+----------+-------+-------+-------+ 1389 | | 0 |10 |20 |80 | 0 | 10 | 20 | 80 | 1390 +===+==========+=====+=====+=====+==========+=======+=======+=======+ 1391 | | reno-sce | | | | reno-sce | | | | 1392 +---+----------+-----+-----+-----+----------+-------+-------+-------+ 1393 |1 | 0.47 |0.48 |0.50 |0.41 | 0.49 | 0.48 | 0.45 | 0.41 | 1394 +---+----------+-----+-----+-----+----------+-------+-------+-------+ 1395 |5 | 2.39 |2.19 |2.04 |1.81 | 2.39 | 2.15 | 1.85 | 1.97 | 1396 +---+----------+-----+-----+-----+----------+-------+-------+-------+ 1397 |10 | 4.77 |4.13 |3.90 |3.65 | 4.79 | 4.21 | 4.05 | 4.16 | 1398 +---+----------+-----+-----+-----+----------+-------+-------+-------+ 1399 |50 | 23.90 |23.79|21.48|17.40| 23.92 | 23.94 | 25.97 | 21.52 | 1400 +---+----------+-----+-----+-----+----------+-------+-------+-------+ 1401 |100| 48.57 |54.33|48.58|47.14| 47.10 | 40.97 | 46.49 | 41.08 | 1402 +---+----------+-----+-----+-----+----------+-------+-------+-------+ 1404 Table 46: reno-sce-reno-sce Mean TCP Throughput (Mbit); Columns: 1405 netem bi- directional Delay (ms); Rows: Cake-limited Bandwidth 1406 (Mbit) 1408 +---+----------+-----+------+-------+-------+-------+-------+-------+ 1409 | | 0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 1410 +===+==========+=====+======+=======+=======+=======+=======+=======+ 1411 | | reno-sce | | | | dctcp | | | | 1412 +---+----------+-----+------+-------+-------+-------+-------+-------+ 1413 |1 | 0.41 | 0.41| 0.38 | 0.28 | 0.55 | 0.55 | 0.58 | 0.66 | 1414 +---+----------+-----+------+-------+-------+-------+-------+-------+ 1415 |5 | 1.87 | 1.39| 1.06 | 0.67 | 2.91 | 3.38 | 3.69 | 3.96 | 1416 +---+----------+-----+------+-------+-------+-------+-------+-------+ 1417 |10 | 3.69 | 2.43| 2.03 | 1.17 | 5.88 | 7.08 | 7.37 | 7.96 | 1418 +---+----------+-----+------+-------+-------+-------+-------+-------+ 1419 |50 | 6.49 | 3.69| 3.98 | 9.37 | 41.35 | 41.62 | 39.72 | 30.90 | 1420 +---+----------+-----+------+-------+-------+-------+-------+-------+ 1421 |100| 7.56 | 6.25| 6.13 | 16.00 | 88.12 | 76.49 | 72.46 | 62.73 | 1422 +---+----------+-----+------+-------+-------+-------+-------+-------+ 1424 Table 47: reno-sce-dctcp Mean TCP Throughput (Mbit); Columns: 1425 netem bi- directional Delay (ms); Rows: Cake-limited Bandwidth 1426 (Mbit) 1428 +---+----------+-----+-----+-----+-----------+------+-------+-------+ 1429 | | 0 |10 |20 |80 | 0 | 10 | 20 | 80 | 1430 +===+==========+=====+=====+=====+===========+======+=======+=======+ 1431 | | reno-sce | | | | dctcp-sce | | | | 1432 +---+----------+-----+-----+-----+-----------+------+-------+-------+ 1433 |1 | 0.47 |0.47 |0.49 |0.42 | 0.48 | 0.48 | 0.46 | 0.40 | 1434 +---+----------+-----+-----+-----+-----------+------+-------+-------+ 1435 |5 | 2.35 |2.10 |1.91 |2.27 | 2.43 | 2.20 | 1.94 | 1.38 | 1436 +---+----------+-----+-----+-----+-----------+------+-------+-------+ 1437 |10 | 4.78 |4.37 |4.89 |4.74 | 4.78 | 3.78 | 2.97 | 2.62 | 1438 +---+----------+-----+-----+-----+-----------+------+-------+-------+ 1439 |50 | 27.23 |39.56|40.95|25.72| 20.59 | 8.16 | 6.56 | 13.56 | 1440 +---+----------+-----+-----+-----+-----------+------+-------+-------+ 1441 |100| 74.00 |82.84|79.48|67.86| 21.65 | 12.49| 15.53 | 11.94 | 1442 +---+----------+-----+-----+-----+-----------+------+-------+-------+ 1444 Table 48: reno-sce-dctcp-sce Mean TCP Throughput (Mbit); Columns: 1445 netem bi- directional Delay (ms); Rows: Cake-limited Bandwidth 1446 (Mbit) 1448 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1449 | | 0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 1450 +===+=======+=======+=======+=======+=======+=======+=======+=======+ 1451 | | dctcp | | | | dctcp | | | | 1452 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1453 |1 | 0.48 | 0.48 | 0.48 | 0.47 | 0.48 | 0.48 | 0.47 | 0.47 | 1454 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1455 |5 | 2.38 | 2.35 | 2.35 | 2.30 | 2.40 | 2.43 | 2.42 | 2.32 | 1456 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1457 |10 | 4.74 | 4.76 | 4.73 | 4.33 | 4.82 | 4.79 | 4.72 | 4.63 | 1458 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1459 |50 | 24.18 | 22.36 | 22.40 | 13.88 | 23.63 | 24.65 | 23.05 | 26.04 | 1460 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1461 |100| 42.61 | 32.42 | 25.55 | 43.30 | 53.04 | 56.18 | 59.67 | 35.60 | 1462 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1464 Table 49: dctcp-dctcp Mean TCP Throughput (Mbit); Columns: netem 1465 bi-directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 1467 +---+-------+-------+-------+-------+-----------+-----+------+------+ 1468 | | 0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 1469 +===+=======+=======+=======+=======+===========+=====+======+======+ 1470 | | dctcp | | | | dctcp-sce | | | | 1471 +---+-------+-------+-------+-------+-----------+-----+------+------+ 1472 |1 | 0.56 | 0.56 | 0.58 | 0.68 | 0.40 | 0.41| 0.37 | 0.27 | 1473 +---+-------+-------+-------+-------+-----------+-----+------+------+ 1474 |5 | 2.89 | 2.38 | 3.66 | 3.91 | 1.90 | 2.54| 1.09 | 0.67 | 1475 +---+-------+-------+-------+-------+-----------+-----+------+------+ 1476 |10 | 5.97 | 5.93 | 7.55 | 8.00 | 3.60 | 3.58| 1.85 | 1.05 | 1477 +---+-------+-------+-------+-------+-----------+-----+------+------+ 1478 |50 | 41.35 | 41.32 | 39.50 | 31.56 | 6.47 | 3.79| 3.92 | 9.96 | 1479 +---+-------+-------+-------+-------+-----------+-----+------+------+ 1480 |100| 89.09 | 76.31 | 73.53 | 63.92 | 6.60 | 6.36| 4.97 | 9.40 | 1481 +---+-------+-------+-------+-------+-----------+-----+------+------+ 1483 Table 50: dctcp-dctcp-sce Mean TCP Throughput (Mbit); Columns: 1484 netem bi- directional Delay (ms); Rows: Cake-limited Bandwidth 1485 (Mbit) 1487 +---+-----------+-----+-----+-----+-----------+-----+-------+-------+ 1488 | | 0 |10 |20 |80 | 0 |10 | 20 | 80 | 1489 +===+===========+=====+=====+=====+===========+=====+=======+=======+ 1490 | | dctcp-sce | | | | dctcp-sce | | | | 1491 +---+-----------+-----+-----+-----+-----------+-----+-------+-------+ 1492 |1 | 0.50 |0.48 |0.49 |0.40 | 0.46 |0.48 | 0.47 | 0.41 | 1493 +---+-----------+-----+-----+-----+-----------+-----+-------+-------+ 1494 |5 | 2.40 |2.12 |1.90 |1.65 | 2.39 |2.14 | 1.92 | 1.58 | 1495 +---+-----------+-----+-----+-----+-----------+-----+-------+-------+ 1496 |10 | 4.78 |3.91 |3.45 |3.71 | 4.79 |3.92 | 3.59 | 3.33 | 1497 +---+-----------+-----+-----+-----+-----------+-----+-------+-------+ 1498 |50 | 23.65 |24.33|22.34|21.85| 24.19 |23.17| 24.15 | 21.08 | 1499 +---+-----------+-----+-----+-----+-----------+-----+-------+-------+ 1500 |100| 53.54 |59.02|54.68|46.28| 42.10 |36.29| 40.24 | 43.95 | 1501 +---+-----------+-----+-----+-----+-----------+-----+-------+-------+ 1503 Table 51: dctcp-sce-dctcp-sce Mean TCP Throughput (Mbit); 1504 Columns: netem bi- directional Delay (ms); Rows: Cake-limited 1505 Bandwidth (Mbit) 1507 A.5. Two-Flow TCP Throughput (Cake "triple-isolate") 1509 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1510 | | 0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 1511 +===+=======+=======+=======+=======+=======+=======+=======+=======+ 1512 | | cubic | | | | cubic | | | | 1513 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1514 |1 | 0.48 | 0.48 | 0.48 | 0.46 | 0.48 | 0.48 | 0.48 | 0.46 | 1515 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1516 |5 | 2.39 | 2.39 | 2.39 | 2.20 | 2.39 | 2.39 | 2.36 | 2.21 | 1517 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1518 |10 | 4.78 | 4.74 | 4.80 | 4.42 | 4.78 | 4.79 | 4.70 | 4.19 | 1519 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1520 |50 | 23.91 | 23.82 | 23.59 | 20.89 | 23.91 | 23.83 | 23.56 | 22.55 | 1521 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1522 |100| 47.83 | 47.40 | 46.89 | 43.30 | 47.82 | 47.40 | 47.48 | 43.60 | 1523 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1525 Table 52: cubic-cubic Mean TCP Throughput (Mbit); Columns: netem 1526 bi-directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 1528 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1529 | | 0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 1530 +===+=======+=======+=======+=======+=======+=======+=======+=======+ 1531 | | cubic | | | | reno | | | | 1532 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1533 |1 | 0.48 | 0.48 | 0.48 | 0.46 | 0.48 | 0.48 | 0.48 | 0.45 | 1534 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1535 |5 | 2.39 | 2.39 | 2.48 | 2.11 | 2.39 | 2.39 | 2.18 | 2.16 | 1536 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1537 |10 | 4.78 | 4.71 | 4.81 | 4.43 | 4.78 | 4.80 | 4.60 | 4.20 | 1538 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1539 |50 | 23.91 | 24.24 | 24.11 | 23.11 | 23.91 | 23.42 | 22.23 | 17.99 | 1540 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1541 |100| 47.83 | 48.65 | 48.14 | 48.87 | 47.83 | 46.14 | 43.84 | 35.92 | 1542 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1544 Table 53: cubic-reno Mean TCP Throughput (Mbit); Columns: netem 1545 bi-directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 1547 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1548 | |0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 1549 +===+=====+======+=======+=======+==========+=======+=======+=======+ 1550 | |cubic| | | | reno-sce | | | | 1551 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1552 |1 |0.48 | 0.48 | 0.48 | 0.57 | 0.48 | 0.48 | 0.48 | 0.32 | 1553 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1554 |5 |2.39 | 2.70 | 2.87 | 3.40 | 2.39 | 2.00 | 1.75 | 1.00 | 1555 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1556 |10 |4.78 | 5.60 | 5.38 | 4.56 | 4.78 | 3.75 | 3.79 | 4.09 | 1557 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1558 |50 |23.92| 24.11| 23.51 | 20.30 | 23.90 | 23.56 | 23.72 | 24.27 | 1559 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1560 |100|47.83| 47.45| 46.41 | 42.39 | 47.81 | 47.71 | 48.22 | 48.49 | 1561 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1563 Table 54: cubic-reno-sce Mean TCP Throughput (Mbit); Columns: 1564 netem bi- directional Delay (ms); Rows: Cake-limited Bandwidth 1565 (Mbit) 1567 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1568 | | 0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 1569 +===+=======+=======+=======+=======+=======+=======+=======+=======+ 1570 | | cubic | | | | dctcp | | | | 1571 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1572 |1 | 0.48 | 0.48 | 0.48 | 0.44 | 0.48 | 0.48 | 0.48 | 0.50 | 1573 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1574 |5 | 2.39 | 2.38 | 2.34 | 2.16 | 2.39 | 2.40 | 2.41 | 2.35 | 1575 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1576 |10 | 4.78 | 4.68 | 4.77 | 4.38 | 4.78 | 4.85 | 4.71 | 4.44 | 1577 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1578 |50 | 23.91 | 23.86 | 23.36 | 21.81 | 23.91 | 23.68 | 23.58 | 21.10 | 1579 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1580 |100| 47.84 | 47.77 | 46.77 | 47.27 | 47.82 | 46.94 | 47.30 | 40.48 | 1581 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1583 Table 55: cubic-dctcp Mean TCP Throughput (Mbit); Columns: netem 1584 bi-directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 1586 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1587 | |0 |10 | 20 | 80 | 0 | 10 | 20 | 80 | 1588 +===+=====+=====+=======+=======+===========+=======+=======+=======+ 1589 | |cubic| | | | dctcp-sce | | | | 1590 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1591 |1 |0.48 |0.48 | 0.48 | 0.58 | 0.48 | 0.48 | 0.48 | 0.31 | 1592 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1593 |5 |2.39 |2.69 | 2.94 | 3.58 | 2.39 | 2.02 | 1.68 | 0.74 | 1594 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1595 |10 |4.78 |5.81 | 6.15 | 6.93 | 4.78 | 3.57 | 3.03 | 1.62 | 1596 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1597 |50 |24.02|27.16| 26.07 | 20.95 | 23.80 | 20.14 | 19.16 | 21.20 | 1598 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1599 |100|47.85|49.02| 47.67 | 42.50 | 47.80 | 46.02 | 45.94 | 42.97 | 1600 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1602 Table 56: cubic-dctcp-sce Mean TCP Throughput (Mbit); Columns: 1603 netem bi- directional Delay (ms); Rows: Cake-limited Bandwidth 1604 (Mbit) 1606 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1607 | | 0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 1608 +===+=======+=======+=======+=======+=======+=======+=======+=======+ 1609 | | reno | | | | reno | | | | 1610 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1611 |1 | 0.48 | 0.48 | 0.48 | 0.46 | 0.48 | 0.48 | 0.48 | 0.46 | 1612 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1613 |5 | 2.39 | 2.37 | 2.31 | 2.04 | 2.39 | 2.35 | 2.33 | 2.01 | 1614 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1615 |10 | 4.78 | 4.81 | 4.60 | 4.25 | 4.78 | 4.74 | 4.60 | 4.33 | 1616 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1617 |50 | 23.91 | 23.77 | 23.07 | 17.70 | 23.91 | 23.77 | 22.92 | 17.72 | 1618 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1619 |100| 47.83 | 47.39 | 45.06 | 37.23 | 47.83 | 47.54 | 44.58 | 35.40 | 1620 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1622 Table 57: reno-reno Mean TCP Throughput (Mbit); Columns: netem 1623 bi-directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 1625 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1626 | |0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 1627 +===+=====+======+=======+=======+==========+=======+=======+=======+ 1628 | |reno | | | | reno-sce | | | | 1629 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1630 |1 |0.48 | 0.48 | 0.48 | 0.55 | 0.48 | 0.48 | 0.48 | 0.32 | 1631 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1632 |5 |2.39 | 2.61 | 2.76 | 2.91 | 2.39 | 2.01 | 1.76 | 1.16 | 1633 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1634 |10 |4.78 | 5.39 | 5.44 | 4.34 | 4.78 | 3.84 | 3.76 | 4.24 | 1635 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1636 |50 |23.93| 23.81| 22.02 | 17.75 | 23.90 | 23.72 | 24.79 | 25.80 | 1637 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1638 |100|47.83| 46.09| 42.73 | 35.26 | 47.82 | 49.03 | 50.97 | 50.07 | 1639 +---+-----+------+-------+-------+----------+-------+-------+-------+ 1641 Table 58: reno-reno-sce Mean TCP Throughput (Mbit); Columns: 1642 netem bi- directional Delay (ms); Rows: Cake-limited Bandwidth 1643 (Mbit) 1645 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1646 | | 0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 1647 +===+=======+=======+=======+=======+=======+=======+=======+=======+ 1648 | | reno | | | | dctcp | | | | 1649 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1650 |1 | 0.48 | 0.48 | 0.48 | 0.43 | 0.48 | 0.48 | 0.48 | 0.50 | 1651 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1652 |5 | 2.39 | 2.30 | 2.27 | 1.88 | 2.39 | 2.47 | 2.47 | 2.44 | 1653 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1654 |10 | 4.78 | 4.73 | 4.66 | 4.19 | 4.78 | 4.79 | 4.78 | 4.30 | 1655 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1656 |50 | 23.91 | 23.45 | 21.71 | 17.98 | 23.91 | 24.13 | 24.75 | 21.47 | 1657 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1658 |100| 47.82 | 46.42 | 43.70 | 35.62 | 47.81 | 48.18 | 49.48 | 42.19 | 1659 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1661 Table 59: reno-dctcp Mean TCP Throughput (Mbit); Columns: netem 1662 bi-directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 1664 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1665 | |0 |10 | 20 | 80 | 0 | 10 | 20 | 80 | 1666 +===+=====+=====+=======+=======+===========+=======+=======+=======+ 1667 | |reno | | | | dctcp-sce | | | | 1668 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1669 |1 |0.48 |0.48 | 0.48 | 0.54 | 0.48 | 0.48 | 0.48 | 0.33 | 1670 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1671 |5 |2.39 |2.60 | 2.81 | 3.25 | 2.39 | 2.02 | 1.69 | 0.75 | 1672 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1673 |10 |4.78 |5.65 | 6.18 | 6.09 | 4.78 | 3.60 | 2.97 | 1.90 | 1674 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1675 |50 |24.05|27.29| 24.37 | 18.32 | 23.77 | 19.78 | 19.76 | 22.57 | 1676 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1677 |100|47.87|47.75| 44.23 | 35.55 | 47.79 | 46.27 | 47.20 | 42.70 | 1678 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1680 Table 60: reno-dctcp-sce Mean TCP Throughput (Mbit); Columns: 1681 netem bi- directional Delay (ms); Rows: Cake-limited Bandwidth 1682 (Mbit) 1684 +---+----------+-----+-----+-----+----------+-------+-------+-------+ 1685 | | 0 |10 |20 |80 | 0 | 10 | 20 | 80 | 1686 +===+==========+=====+=====+=====+==========+=======+=======+=======+ 1687 | | reno-sce | | | | reno-sce | | | | 1688 +---+----------+-----+-----+-----+----------+-------+-------+-------+ 1689 |1 | 0.48 |0.48 |0.48 |0.34 | 0.48 | 0.48 | 0.48 | 0.33 | 1690 +---+----------+-----+-----+-----+----------+-------+-------+-------+ 1691 |5 | 2.39 |2.05 |1.80 |1.75 | 2.39 | 2.03 | 1.89 | 1.62 | 1692 +---+----------+-----+-----+-----+----------+-------+-------+-------+ 1693 |10 | 4.78 |4.15 |4.14 |4.22 | 4.78 | 4.15 | 4.12 | 4.31 | 1694 +---+----------+-----+-----+-----+----------+-------+-------+-------+ 1695 |50 | 23.91 |23.66|23.54|22.01| 23.90 | 23.69 | 23.24 | 22.75 | 1696 +---+----------+-----+-----+-----+----------+-------+-------+-------+ 1697 |100| 47.82 |47.66|47.52|45.05| 47.82 | 47.66 | 47.54 | 44.97 | 1698 +---+----------+-----+-----+-----+----------+-------+-------+-------+ 1700 Table 61: reno-sce-reno-sce Mean TCP Throughput (Mbit); Columns: 1701 netem bi- directional Delay (ms); Rows: Cake-limited Bandwidth 1702 (Mbit) 1704 +---+----------+-----+------+-------+-------+-------+-------+-------+ 1705 | | 0 |10 | 20 | 80 | 0 | 10 | 20 | 80 | 1706 +===+==========+=====+======+=======+=======+=======+=======+=======+ 1707 | | reno-sce | | | | dctcp | | | | 1708 +---+----------+-----+------+-------+-------+-------+-------+-------+ 1709 |1 | 0.48 |0.48 | 0.48 | 0.32 | 0.48 | 0.48 | 0.48 | 0.61 | 1710 +---+----------+-----+------+-------+-------+-------+-------+-------+ 1711 |5 | 2.39 |1.98 | 1.71 | 0.91 | 2.39 | 2.78 | 2.95 | 3.60 | 1712 +---+----------+-----+------+-------+-------+-------+-------+-------+ 1713 |10 | 4.78 |3.75 | 3.85 | 3.99 | 4.78 | 5.64 | 5.41 | 4.90 | 1714 +---+----------+-----+------+-------+-------+-------+-------+-------+ 1715 |50 | 23.91 |23.71| 23.51| 22.56 | 23.91 | 23.99 | 23.57 | 20.79 | 1716 +---+----------+-----+------+-------+-------+-------+-------+-------+ 1717 |100| 47.83 |48.07| 47.63| 46.93 | 47.83 | 47.03 | 46.40 | 39.48 | 1718 +---+----------+-----+------+-------+-------+-------+-------+-------+ 1720 Table 62: reno-sce-dctcp Mean TCP Throughput (Mbit); Columns: 1721 netem bi- directional Delay (ms); Rows: Cake-limited Bandwidth 1722 (Mbit) 1724 +---+----------+-----+-----+-----+-----------+------+-------+-------+ 1725 | | 0 |10 |20 |80 | 0 | 10 | 20 | 80 | 1726 +===+==========+=====+=====+=====+===========+======+=======+=======+ 1727 | | reno-sce | | | | dctcp-sce | | | | 1728 +---+----------+-----+-----+-----+-----------+------+-------+-------+ 1729 |1 | 0.48 |0.48 |0.48 |0.33 | 0.48 | 0.48 | 0.48 | 0.34 | 1730 +---+----------+-----+-----+-----+-----------+------+-------+-------+ 1731 |5 | 2.39 |2.01 |1.86 |1.82 | 2.39 | 2.05 | 1.73 | 1.03 | 1732 +---+----------+-----+-----+-----+-----------+------+-------+-------+ 1733 |10 | 4.78 |4.24 |4.60 |6.33 | 4.78 | 3.95 | 3.36 | 1.97 | 1734 +---+----------+-----+-----+-----+-----------+------+-------+-------+ 1735 |50 | 24.01 |26.91|27.21|23.75| 23.81 | 18.74| 16.94 | 18.75 | 1736 +---+----------+-----+-----+-----+-----------+------+-------+-------+ 1737 |100| 47.85 |49.17|49.32|46.19| 47.81 | 45.83| 44.78 | 40.59 | 1738 +---+----------+-----+-----+-----+-----------+------+-------+-------+ 1740 Table 63: reno-sce-dctcp-sce Mean TCP Throughput (Mbit); Columns: 1741 netem bi- directional Delay (ms); Rows: Cake-limited Bandwidth 1742 (Mbit) 1744 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1745 | | 0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 1746 +===+=======+=======+=======+=======+=======+=======+=======+=======+ 1747 | | dctcp | | | | dctcp | | | | 1748 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1749 |1 | 0.48 | 0.48 | 0.48 | 0.47 | 0.48 | 0.48 | 0.48 | 0.47 | 1750 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1751 |5 | 2.39 | 2.39 | 2.38 | 2.24 | 2.39 | 2.39 | 2.38 | 2.24 | 1752 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1753 |10 | 4.78 | 4.76 | 4.73 | 4.45 | 4.78 | 4.77 | 4.71 | 4.47 | 1754 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1755 |50 | 23.91 | 23.70 | 23.29 | 20.37 | 23.91 | 23.70 | 23.30 | 20.80 | 1756 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1757 |100| 47.73 | 47.13 | 46.71 | 39.67 | 47.73 | 47.17 | 46.73 | 41.12 | 1758 +---+-------+-------+-------+-------+-------+-------+-------+-------+ 1760 Table 64: dctcp-dctcp Mean TCP Throughput (Mbit); Columns: netem 1761 bi-directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 1763 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1764 | |0 |10 | 20 | 80 | 0 | 10 | 20 | 80 | 1765 +===+=====+=====+=======+=======+===========+=======+=======+=======+ 1766 | |dctcp| | | | dctcp-sce | | | | 1767 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1768 |1 |0.48 |0.48 | 0.48 | 0.62 | 0.48 | 0.48 | 0.48 | 0.31 | 1769 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1770 |5 |2.39 |2.77 | 3.00 | 3.86 | 2.39 | 1.98 | 1.67 | 0.64 | 1771 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1772 |10 |4.78 |5.76 | 6.17 | 6.85 | 4.78 | 3.61 | 3.10 | 1.74 | 1773 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1774 |50 |24.01|27.30| 26.52 | 20.66 | 23.81 | 19.96 | 19.56 | 19.92 | 1775 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1776 |100|47.85|48.63| 48.11 | 40.69 | 47.77 | 46.10 | 45.60 | 38.33 | 1777 +---+-----+-----+-------+-------+-----------+-------+-------+-------+ 1779 Table 65: dctcp-dctcp-sce Mean TCP Throughput (Mbit); Columns: 1780 netem bi- directional Delay (ms); Rows: Cake-limited Bandwidth 1781 (Mbit) 1783 +---+-----------+-----+-----+-----+-----------+-----+-------+-------+ 1784 | | 0 |10 |20 |80 | 0 |10 | 20 | 80 | 1785 +===+===========+=====+=====+=====+===========+=====+=======+=======+ 1786 | | dctcp-sce | | | | dctcp-sce | | | | 1787 +---+-----------+-----+-----+-----+-----------+-----+-------+-------+ 1788 |1 | 0.48 |0.48 |0.48 |0.34 | 0.48 |0.48 | 0.48 | 0.34 | 1789 +---+-----------+-----+-----+-----+-----------+-----+-------+-------+ 1790 |5 | 2.39 |2.04 |1.71 |1.09 | 2.39 |2.03 | 1.76 | 1.06 | 1791 +---+-----------+-----+-----+-----+-----------+-----+-------+-------+ 1792 |10 | 4.78 |3.91 |3.55 |2.97 | 4.78 |4.01 | 3.59 | 2.84 | 1793 +---+-----------+-----+-----+-----+-----------+-----+-------+-------+ 1794 |50 | 23.88 |21.37|20.20|19.68| 23.91 |21.09| 20.51 | 20.44 | 1795 +---+-----------+-----+-----+-----+-----------+-----+-------+-------+ 1796 |100| 47.82 |45.19|43.83|36.16| 47.82 |46.37| 44.59 | 37.07 | 1797 +---+-----------+-----+-----+-----+-----------+-----+-------+-------+ 1799 Table 66: dctcp-sce-dctcp-sce Mean TCP Throughput (Mbit); 1800 Columns: netem bi- directional Delay (ms); Rows: Cake-limited 1801 Bandwidth (Mbit) 1803 A.6. Two-Flow TCP RTT (Cake "flowblind") 1805 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 1806 | |0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 1807 +===+=====+=======+=======+========+=======+=======+=======+========+ 1808 | |cubic| | | | cubic | | | | 1809 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 1810 |1 |70.73| 69.97 | 83.70 | 139.06 | 69.07 | 70.38 | 86.15 | 140.64 | 1811 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 1812 |5 |14.09| 25.54 | 35.72 | 91.62 | 14.26 | 25.99 | 35.59 | 91.28 | 1813 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 1814 |10 |7.88 | 18.69 | 28.67 | 86.54 | 7.79 | 18.46 | 28.60 | 85.74 | 1815 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 1816 |50 |6.53 | 16.30 | 25.55 | 82.98 | 6.47 | 16.37 | 25.66 | 83.06 | 1817 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 1818 |100|6.35 | 16.40 | 25.49 | 83.27 | 6.43 | 16.29 | 25.57 | 83.36 | 1819 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 1821 Table 67: cubic-cubic Mean TCP RTT (ms); Columns: netem bi- 1822 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 1824 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 1825 | |0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 1826 +===+=====+=======+=======+========+=======+=======+=======+========+ 1827 | |cubic| | | | reno | | | | 1828 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 1829 |1 |65.97| 71.14 | 83.63 | 139.14 | 66.25 | 72.11 | 87.70 | 140.12 | 1830 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 1831 |5 |14.00| 25.94 | 35.16 | 91.73 | 14.87 | 25.03 | 35.98 | 92.22 | 1832 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 1833 |10 |7.60 | 18.82 | 28.77 | 86.37 | 7.99 | 19.39 | 29.11 | 86.39 | 1834 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 1835 |50 |6.43 | 16.26 | 25.45 | 82.72 | 6.41 | 16.38 | 25.46 | 83.06 | 1836 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 1837 |100|6.31 | 16.20 | 25.09 | 83.07 | 6.47 | 16.09 | 25.11 | 83.19 | 1838 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 1840 Table 68: cubic-reno Mean TCP RTT (ms); Columns: netem bi- 1841 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 1843 +---+-----+-----+------+--------+----------+-------+-------+--------+ 1844 | |0 |10 | 20 | 80 | 0 | 10 | 20 | 80 | 1845 +===+=====+=====+======+========+==========+=======+=======+========+ 1846 | |cubic| | | | reno-sce | | | | 1847 +---+-----+-----+------+--------+----------+-------+-------+--------+ 1848 |1 |71.98|73.29| 93.38| 127.68 | 61.37 | 61.69 | 71.07 | 121.98 | 1849 +---+-----+-----+------+--------+----------+-------+-------+--------+ 1850 |5 |14.58|25.06| 33.50| 88.85 | 11.80 | 21.16 | 32.19 | 94.96 | 1851 +---+-----+-----+------+--------+----------+-------+-------+--------+ 1852 |10 |7.70 |17.86| 27.34| 85.73 | 6.98 | 18.59 | 30.43 | 90.51 | 1853 +---+-----+-----+------+--------+----------+-------+-------+--------+ 1854 |50 |5.95 |15.00| 24.47| 83.61 | 6.01 | 16.71 | 26.93 | 86.54 | 1855 +---+-----+-----+------+--------+----------+-------+-------+--------+ 1856 |100|6.01 |14.78| 24.44| 83.56 | 6.06 | 15.99 | 26.21 | 85.14 | 1857 +---+-----+-----+------+--------+----------+-------+-------+--------+ 1859 Table 69: cubic-reno-sce Mean TCP RTT (ms); Columns: netem bi- 1860 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 1862 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 1863 | |0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 1864 +===+=====+=======+=======+========+=======+=======+=======+========+ 1865 | |cubic| | | | dctcp | | | | 1866 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 1867 |1 |61.63| 62.74 | 79.63 | 144.41 | 81.28 | 81.99 | 88.30 | 142.69 | 1868 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 1869 |5 |12.75| 27.02 | 38.94 | 94.68 | 18.98 | 24.23 | 33.58 | 92.59 | 1870 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 1871 |10 |7.19 | 20.98 | 30.61 | 87.70 | 8.12 | 17.94 | 27.88 | 86.25 | 1872 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 1873 |50 |6.84 | 16.43 | 26.24 | 83.90 | 6.38 | 16.05 | 26.01 | 84.39 | 1874 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 1875 |100|6.49 | 16.34 | 26.42 | 85.08 | 6.46 | 16.42 | 26.19 | 84.83 | 1876 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 1878 Table 70: cubic-dctcp Mean TCP RTT (ms); Columns: netem bi- 1879 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 1881 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 1882 | |0 |10 |20 | 80 | 0 | 10 | 20 | 80 | 1883 +===+=====+=====+=====+========+===========+=======+=======+========+ 1884 | |cubic| | | | dctcp-sce | | | | 1885 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 1886 |1 |73.64|72.10|92.35| 127.57 | 60.95 | 63.18 | 73.14 | 117.81 | 1887 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 1888 |5 |14.10|23.88|32.68| 89.27 | 11.73 | 21.25 | 32.24 | 95.10 | 1889 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 1890 |10 |7.99 |17.94|27.11| 85.58 | 6.94 | 18.23 | 30.11 | 91.01 | 1891 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 1892 |50 |5.91 |14.97|24.16| 83.11 | 5.97 | 16.67 | 26.92 | 86.08 | 1893 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 1894 |100|6.13 |14.98|24.27| 82.93 | 6.08 | 16.17 | 26.17 | 84.85 | 1895 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 1897 Table 71: cubic-dctcp-sce Mean TCP RTT (ms); Columns: netem bi- 1898 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 1900 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 1901 | |0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 1902 +===+=====+=======+=======+========+=======+=======+=======+========+ 1903 | |reno | | | | reno | | | | 1904 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 1905 |1 |64.31| 68.79 | 84.19 | 141.79 | 66.79 | 71.57 | 83.55 | 140.03 | 1906 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 1907 |5 |14.46| 25.39 | 35.62 | 92.66 | 14.61 | 25.49 | 35.57 | 92.29 | 1908 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 1909 |10 |8.15 | 18.91 | 29.00 | 86.57 | 8.08 | 18.83 | 29.11 | 86.26 | 1910 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 1911 |50 |6.49 | 16.43 | 24.97 | 82.44 | 6.44 | 16.23 | 25.06 | 82.48 | 1912 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 1913 |100|6.43 | 16.20 | 24.68 | 82.39 | 6.50 | 16.18 | 24.91 | 82.39 | 1914 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 1916 Table 72: reno-reno Mean TCP RTT (ms); Columns: netem bi- 1917 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 1919 +---+-----+-----+------+--------+----------+-------+-------+--------+ 1920 | |0 |10 | 20 | 80 | 0 | 10 | 20 | 80 | 1921 +===+=====+=====+======+========+==========+=======+=======+========+ 1922 | |reno | | | | reno-sce | | | | 1923 +---+-----+-----+------+--------+----------+-------+-------+--------+ 1924 |1 |68.15|70.79| 91.27| 130.38 | 62.79 | 62.52 | 75.28 | 122.99 | 1925 +---+-----+-----+------+--------+----------+-------+-------+--------+ 1926 |5 |14.95|23.90| 34.12| 89.47 | 12.89 | 21.95 | 33.51 | 95.43 | 1927 +---+-----+-----+------+--------+----------+-------+-------+--------+ 1928 |10 |8.05 |18.27| 28.12| 85.51 | 7.22 | 18.71 | 29.40 | 90.04 | 1929 +---+-----+-----+------+--------+----------+-------+-------+--------+ 1930 |50 |5.99 |14.84| 24.17| 83.36 | 6.09 | 16.08 | 25.91 | 84.37 | 1931 +---+-----+-----+------+--------+----------+-------+-------+--------+ 1932 |100|6.19 |14.61| 24.02| 83.03 | 6.05 | 15.50 | 25.06 | 83.81 | 1933 +---+-----+-----+------+--------+----------+-------+-------+--------+ 1935 Table 73: reno-reno-sce Mean TCP RTT (ms); Columns: netem bi- 1936 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 1938 +---+-----+-----+-------+--------+--------+--------+-------+--------+ 1939 | |0 |10 | 20 | 80 | 0 | 10 | 20 | 80 | 1940 +===+=====+=====+=======+========+========+========+=======+========+ 1941 | |reno | | | | dctcp | | | | 1942 +---+-----+-----+-------+--------+--------+--------+-------+--------+ 1943 |1 |59.96|62.40| 83.02 | 144.86 | 114.59 | 108.05 | 87.97 | 143.70 | 1944 +---+-----+-----+-------+--------+--------+--------+-------+--------+ 1945 |5 |12.78|27.64| 38.54 | 95.38 | 22.21 | 24.00 | 33.12 | 92.06 | 1946 +---+-----+-----+-------+--------+--------+--------+-------+--------+ 1947 |10 |8.10 |20.18| 30.66 | 88.42 | 8.31 | 18.10 | 27.56 | 86.64 | 1948 +---+-----+-----+-------+--------+--------+--------+-------+--------+ 1949 |50 |6.87 |16.58| 26.04 | 83.56 | 6.48 | 16.36 | 25.81 | 83.38 | 1950 +---+-----+-----+-------+--------+--------+--------+-------+--------+ 1951 |100|6.38 |16.54| 26.00 | 84.56 | 6.48 | 16.43 | 25.93 | 83.75 | 1952 +---+-----+-----+-------+--------+--------+--------+-------+--------+ 1954 Table 74: reno-dctcp Mean TCP RTT (ms); Columns: netem bi- 1955 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 1957 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 1958 | |0 |10 |20 | 80 | 0 | 10 | 20 | 80 | 1959 +===+=====+=====+=====+========+===========+=======+=======+========+ 1960 | |reno | | | | dctcp-sce | | | | 1961 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 1962 |1 |67.25|70.19|93.80| 131.16 | 63.59 | 63.29 | 75.04 | 120.28 | 1963 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 1964 |5 |15.01|26.28|34.17| 89.37 | 12.68 | 23.72 | 33.43 | 94.57 | 1965 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 1966 |10 |7.89 |18.30|27.91| 85.30 | 7.11 | 18.84 | 29.84 | 90.39 | 1967 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 1968 |50 |6.09 |14.74|23.74| 82.58 | 6.07 | 16.17 | 25.95 | 84.17 | 1969 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 1970 |100|5.78 |14.32|23.62| 82.36 | 5.95 | 15.20 | 24.81 | 83.98 | 1971 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 1973 Table 75: reno-dctcp-sce Mean TCP RTT (ms); Columns: netem bi- 1974 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 1976 +---+----------+-----+-----+--------+----------+-----+-----+--------+ 1977 | | 0 |10 |20 | 80 | 0 |10 |20 | 80 | 1978 +===+==========+=====+=====+========+==========+=====+=====+========+ 1979 | | reno-sce | | | | reno-sce | | | | 1980 +---+----------+-----+-----+--------+----------+-----+-----+--------+ 1981 |1 | 49.45 |50.66|50.71| 114.04 | 50.74 |50.87|50.54| 113.68 | 1982 +---+----------+-----+-----+--------+----------+-----+-----+--------+ 1983 |5 | 9.58 |19.47|30.20| 88.97 | 9.66 |19.40|30.39| 89.81 | 1984 +---+----------+-----+-----+--------+----------+-----+-----+--------+ 1985 |10 | 6.55 |16.99|27.00| 85.35 | 6.55 |16.61|26.91| 85.29 | 1986 +---+----------+-----+-----+--------+----------+-----+-----+--------+ 1987 |50 | 4.46 |13.52|23.27| 82.93 | 4.54 |13.35|23.26| 83.11 | 1988 +---+----------+-----+-----+--------+----------+-----+-----+--------+ 1989 |100| 4.40 |14.06|23.83| 82.74 | 4.21 |14.07|23.74| 82.71 | 1990 +---+----------+-----+-----+--------+----------+-----+-----+--------+ 1992 Table 76: reno-sce-reno-sce Mean TCP RTT (ms); Columns: netem bi- 1993 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 1995 +---+----------+-----+-----+--------+------+-------+-------+--------+ 1996 | | 0 |10 |20 | 80 | 0 | 10 | 20 | 80 | 1997 +===+==========+=====+=====+========+======+=======+=======+========+ 1998 | | reno-sce | | | | dctcp| | | | 1999 +---+----------+-----+-----+--------+------+-------+-------+--------+ 2000 |1 | 53.35 |54.29|82.98| 132.00 | 93.33| 94.62 | 84.60 | 141.33 | 2001 +---+----------+-----+-----+--------+------+-------+-------+--------+ 2002 |5 | 11.15 |21.45|31.72| 93.81 | 18.29| 23.96 | 33.21 | 90.14 | 2003 +---+----------+-----+-----+--------+------+-------+-------+--------+ 2004 |10 | 7.04 |18.09|30.04| 92.23 | 8.00 | 17.48 | 27.41 | 86.25 | 2005 +---+----------+-----+-----+--------+------+-------+-------+--------+ 2006 |50 | 6.15 |16.43|27.42| 85.57 | 6.32 | 15.91 | 25.72 | 83.84 | 2007 +---+----------+-----+-----+--------+------+-------+-------+--------+ 2008 |100| 6.29 |16.54|26.52| 85.06 | 6.41 | 16.26 | 26.07 | 83.57 | 2009 +---+----------+-----+-----+--------+------+-------+-------+--------+ 2011 Table 77: reno-sce-dctcp Mean TCP RTT (ms); Columns: netem bi- 2012 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2014 +---+----------+-----+-----+-------+-----------+-----+-----+--------+ 2015 | | 0 |10 |20 | 80 | 0 |10 |20 | 80 | 2016 +===+==========+=====+=====+=======+===========+=====+=====+========+ 2017 | | reno-sce | | | | dctcp-sce | | | | 2018 +---+----------+-----+-----+-------+-----------+-----+-----+--------+ 2019 |1 | 49.87 |51.12|50.45| 113.39| 50.23 |50.54|50.13| 112.50 | 2020 +---+----------+-----+-----+-------+-----------+-----+-----+--------+ 2021 |5 | 9.57 |19.48|30.47| 88.94 | 9.64 |19.11|29.76| 91.18 | 2022 +---+----------+-----+-----+-------+-----------+-----+-----+--------+ 2023 |10 | 6.58 |16.86|27.26| 84.81 | 6.63 |16.66|27.39| 85.95 | 2024 +---+----------+-----+-----+-------+-----------+-----+-----+--------+ 2025 |50 | 4.20 |12.98|22.81| 82.45 | 4.59 |14.89|24.87| 84.83 | 2026 +---+----------+-----+-----+-------+-----------+-----+-----+--------+ 2027 |100| 4.15 |13.47|23.29| 82.64 | 4.11 |14.16|24.11| 83.93 | 2028 +---+----------+-----+-----+-------+-----------+-----+-----+--------+ 2030 Table 78: reno-sce-dctcp-sce Mean TCP RTT (ms); Columns: netem 2031 bi-directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2033 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2034 | |0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 2035 +===+=====+=======+=======+========+=======+=======+=======+========+ 2036 | |dctcp| | | | dctcp | | | | 2037 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2038 |1 |94.39| 94.71 | 87.26 | 145.73 | 95.80 | 95.81 | 92.26 | 144.97 | 2039 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2040 |5 |18.87| 25.91 | 35.08 | 93.41 | 19.48 | 26.10 | 34.76 | 93.83 | 2041 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2042 |10 |9.29 | 18.56 | 27.94 | 87.31 | 9.40 | 18.65 | 28.15 | 87.12 | 2043 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2044 |50 |6.78 | 16.54 | 26.18 | 84.83 | 6.74 | 16.48 | 26.21 | 84.80 | 2045 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2046 |100|6.69 | 16.43 | 25.89 | 85.15 | 6.75 | 16.30 | 25.94 | 85.35 | 2047 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2049 Table 79: dctcp-dctcp Mean TCP RTT (ms); Columns: netem bi- 2050 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2052 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2053 | |0 |10 |20 | 80 | 0 | 10 | 20 | 80 | 2054 +===+=====+=====+=====+========+===========+=======+=======+========+ 2055 | |dctcp| | | | dctcp-sce | | | | 2056 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2057 |1 |91.81|93.17|83.18| 141.45 | 53.62 | 53.10 | 76.65 | 133.28 | 2058 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2059 |5 |18.22|23.79|33.56| 91.14 | 11.04 | 21.38 | 31.87 | 93.16 | 2060 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2061 |10 |8.06 |17.46|27.21| 86.24 | 7.25 | 18.04 | 29.56 | 92.76 | 2062 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2063 |50 |6.14 |15.92|25.60| 83.50 | 6.17 | 16.47 | 27.02 | 86.00 | 2064 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2065 |100|6.35 |16.04|25.95| 83.06 | 6.43 | 16.35 | 26.71 | 85.56 | 2066 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2068 Table 80: dctcp-dctcp-sce Mean TCP RTT (ms); Columns: netem bi- 2069 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2071 +---+-----------+-----+-----+------+-----------+-----+-----+--------+ 2072 | | 0 |10 |20 |80 | 0 |10 |20 | 80 | 2073 +===+===========+=====+=====+======+===========+=====+=====+========+ 2074 | | dctcp-sce | | | | dctcp-sce | | | | 2075 +---+-----------+-----+-----+------+-----------+-----+-----+--------+ 2076 |1 | 48.67 |49.51|50.22|115.03| 49.42 |49.95|49.96| 113.68 | 2077 +---+-----------+-----+-----+------+-----------+-----+-----+--------+ 2078 |5 | 9.56 |19.62|29.79|91.63 | 9.63 |19.19|30.02| 91.44 | 2079 +---+-----------+-----+-----+------+-----------+-----+-----+--------+ 2080 |10 | 6.52 |16.78|27.09|85.64 | 6.61 |16.65|27.42| 85.73 | 2081 +---+-----------+-----+-----+------+-----------+-----+-----+--------+ 2082 |50 | 4.16 |13.13|22.39|82.21 | 4.18 |12.96|22.47| 82.09 | 2083 +---+-----------+-----+-----+------+-----------+-----+-----+--------+ 2084 |100| 3.90 |13.02|22.61|82.16 | 3.97 |12.94|22.72| 82.04 | 2085 +---+-----------+-----+-----+------+-----------+-----+-----+--------+ 2087 Table 81: dctcp-sce-dctcp-sce Mean TCP RTT (ms); Columns: netem 2088 bi-directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2090 A.7. Two-Flow TCP RTT (Cake "flowblind sce-single") 2092 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2093 | |0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 2094 +===+=====+=======+=======+========+=======+=======+=======+========+ 2095 | |cubic| | | | cubic | | | | 2096 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2097 |1 |68.26| 69.38 | 83.80 | 142.98 | 69.18 | 68.64 | 83.08 | 142.21 | 2098 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2099 |5 |13.86| 25.36 | 35.54 | 92.39 | 13.92 | 24.90 | 36.61 | 92.30 | 2100 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2101 |10 |8.39 | 18.95 | 28.76 | 86.67 | 8.19 | 19.22 | 28.77 | 86.23 | 2102 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2103 |50 |6.52 | 16.30 | 25.85 | 83.11 | 6.59 | 16.26 | 25.84 | 83.18 | 2104 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2105 |100|6.42 | 16.49 | 25.57 | 83.19 | 6.40 | 16.38 | 25.65 | 83.22 | 2106 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2108 Table 82: cubic-cubic Mean TCP RTT (ms); Columns: netem bi- 2109 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2111 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2112 | |0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 2113 +===+=====+=======+=======+========+=======+=======+=======+========+ 2114 | |cubic| | | | reno | | | | 2115 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2116 |1 |65.10| 69.82 | 83.36 | 144.19 | 64.96 | 69.20 | 85.01 | 144.48 | 2117 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2118 |5 |13.62| 25.89 | 35.86 | 92.45 | 14.26 | 25.25 | 36.40 | 93.45 | 2119 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2120 |10 |7.82 | 18.99 | 28.74 | 86.24 | 8.23 | 19.64 | 29.36 | 86.42 | 2121 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2122 |50 |6.57 | 16.15 | 25.30 | 82.60 | 6.53 | 16.17 | 25.47 | 83.21 | 2123 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2124 |100|6.46 | 16.14 | 24.89 | 83.04 | 6.54 | 16.23 | 24.88 | 83.28 | 2125 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2127 Table 83: cubic-reno Mean TCP RTT (ms); Columns: netem bi- 2128 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2130 +---+-----+-----+------+--------+----------+-------+-------+--------+ 2131 | |0 |10 | 20 | 80 | 0 | 10 | 20 | 80 | 2132 +===+=====+=====+======+========+==========+=======+=======+========+ 2133 | |cubic| | | | reno-sce | | | | 2134 +---+-----+-----+------+--------+----------+-------+-------+--------+ 2135 |1 |67.62|68.51| 83.34| 138.15 | 68.37 | 69.98 | 84.17 | 139.38 | 2136 +---+-----+-----+------+--------+----------+-------+-------+--------+ 2137 |5 |13.56|24.05| 34.64| 91.07 | 13.81 | 24.46 | 37.77 | 96.38 | 2138 +---+-----+-----+------+--------+----------+-------+-------+--------+ 2139 |10 |8.16 |18.42| 28.22| 86.47 | 8.07 | 19.70 | 31.56 | 86.75 | 2140 +---+-----+-----+------+--------+----------+-------+-------+--------+ 2141 |50 |6.44 |15.91| 25.22| 82.90 | 6.81 | 16.17 | 25.55 | 82.74 | 2142 +---+-----+-----+------+--------+----------+-------+-------+--------+ 2143 |100|6.47 |16.73| 26.43| 84.25 | 6.62 | 16.63 | 26.62 | 84.78 | 2144 +---+-----+-----+------+--------+----------+-------+-------+--------+ 2146 Table 84: cubic-reno-sce Mean TCP RTT (ms); Columns: netem bi- 2147 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2149 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2150 | |0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 2151 +===+=====+=======+=======+========+=======+=======+=======+========+ 2152 | |cubic| | | | dctcp | | | | 2153 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2154 |1 |64.14| 64.56 | 77.80 | 145.02 | 65.75 | 64.93 | 80.94 | 142.91 | 2155 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2156 |5 |13.23| 25.90 | 38.90 | 96.18 | 13.84 | 23.58 | 33.08 | 93.08 | 2157 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2158 |10 |7.73 | 21.30 | 34.10 | 90.52 | 7.86 | 18.08 | 27.45 | 87.45 | 2159 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2160 |50 |7.93 | 18.01 | 28.17 | 86.63 | 7.02 | 16.02 | 26.69 | 85.82 | 2161 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2162 |100|7.66 | 17.36 | 27.50 | 86.24 | 6.87 | 16.47 | 26.59 | 85.79 | 2163 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2165 Table 85: cubic-dctcp Mean TCP RTT (ms); Columns: netem bi- 2166 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2168 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2169 | |0 |10 |20 | 80 | 0 | 10 | 20 | 80 | 2170 +===+=====+=====+=====+========+===========+=======+=======+========+ 2171 | |cubic| | | | dctcp-sce | | | | 2172 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2173 |1 |67.09|68.20|83.79| 137.00 | 66.85 | 68.78 | 84.89 | 142.55 | 2174 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2175 |5 |14.22|24.20|34.59| 90.97 | 13.60 | 24.91 | 36.51 | 96.69 | 2176 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2177 |10 |8.16 |18.76|28.16| 86.07 | 8.16 | 20.29 | 31.97 | 88.89 | 2178 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2179 |50 |6.42 |16.27|25.71| 83.55 | 6.69 | 17.27 | 26.47 | 84.08 | 2180 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2181 |100|6.54 |16.35|25.54| 83.88 | 6.79 | 16.65 | 26.21 | 84.75 | 2182 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2184 Table 86: cubic-dctcp-sce Mean TCP RTT (ms); Columns: netem bi- 2185 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2187 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2188 | |0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 2189 +===+=====+=======+=======+========+=======+=======+=======+========+ 2190 | |reno | | | | reno | | | | 2191 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2192 |1 |67.27| 69.27 | 83.70 | 145.08 | 67.81 | 68.53 | 84.48 | 145.65 | 2193 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2194 |5 |14.07| 26.21 | 36.48 | 93.63 | 14.28 | 26.00 | 36.21 | 93.05 | 2195 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2196 |10 |8.21 | 19.06 | 29.68 | 86.73 | 8.20 | 18.96 | 29.25 | 86.39 | 2197 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2198 |50 |6.62 | 16.41 | 24.97 | 82.36 | 6.68 | 16.32 | 25.01 | 82.48 | 2199 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2200 |100|6.57 | 15.91 | 24.64 | 82.45 | 6.45 | 15.90 | 24.65 | 82.56 | 2201 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2203 Table 87: reno-reno Mean TCP RTT (ms); Columns: netem bi- 2204 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2206 +---+-----+-----+------+--------+----------+-------+-------+--------+ 2207 | |0 |10 | 20 | 80 | 0 | 10 | 20 | 80 | 2208 +===+=====+=====+======+========+==========+=======+=======+========+ 2209 | |reno | | | | reno-sce | | | | 2210 +---+-----+-----+------+--------+----------+-------+-------+--------+ 2211 |1 |67.65|68.24| 83.30| 139.85 | 68.25 | 70.37 | 79.56 | 142.52 | 2212 +---+-----+-----+------+--------+----------+-------+-------+--------+ 2213 |5 |14.09|24.97| 35.97| 91.33 | 14.55 | 24.35 | 37.58 | 96.81 | 2214 +---+-----+-----+------+--------+----------+-------+-------+--------+ 2215 |10 |8.54 |19.17| 28.84| 86.91 | 8.21 | 19.96 | 32.27 | 87.41 | 2216 +---+-----+-----+------+--------+----------+-------+-------+--------+ 2217 |50 |6.44 |15.55| 24.88| 82.79 | 6.56 | 16.08 | 25.22 | 82.59 | 2218 +---+-----+-----+------+--------+----------+-------+-------+--------+ 2219 |100|6.40 |16.27| 25.71| 85.25 | 6.74 | 16.42 | 25.90 | 85.13 | 2220 +---+-----+-----+------+--------+----------+-------+-------+--------+ 2222 Table 88: reno-reno-sce Mean TCP RTT (ms); Columns: netem bi- 2223 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2225 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2226 | |0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 2227 +===+=====+=======+=======+========+=======+=======+=======+========+ 2228 | |reno | | | | dctcp | | | | 2229 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2230 |1 |62.85| 65.76 | 79.20 | 146.75 | 65.00 | 66.92 | 78.64 | 140.83 | 2231 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2232 |5 |13.65| 26.18 | 38.66 | 97.29 | 14.02 | 23.92 | 33.54 | 93.24 | 2233 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2234 |10 |8.12 | 21.46 | 32.84 | 91.43 | 7.89 | 17.89 | 27.67 | 87.40 | 2235 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2236 |50 |7.90 | 18.20 | 28.50 | 85.93 | 6.86 | 16.53 | 26.78 | 84.89 | 2237 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2238 |100|7.58 | 17.41 | 27.77 | 85.89 | 7.06 | 16.76 | 27.43 | 85.22 | 2239 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2241 Table 89: reno-dctcp Mean TCP RTT (ms); Columns: netem bi- 2242 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2244 +---+-----+-----+-----+--------+-----------+------+-------+---------+ 2245 | |0 |10 |20 | 80 | 0 | 10 | 20 | 80 | 2246 +===+=====+=====+=====+========+===========+======+=======+=========+ 2247 | |reno | | | | dctcp-sce | | | | 2248 +---+-----+-----+-----+--------+-----------+------+-------+---------+ 2249 |1 |66.94|68.38|84.13| 443.94 | 68.15 | 70.50| 80.58 | 1036.03 | 2250 +---+-----+-----+-----+--------+-----------+------+-------+---------+ 2251 |5 |14.59|25.96|35.41| 91.34 | 14.17 | 25.50| 36.79 | 96.14 | 2252 +---+-----+-----+-----+--------+-----------+------+-------+---------+ 2253 |10 |8.76 |19.46|28.55| 86.17 | 8.35 | 21.14| 31.51 | 88.70 | 2254 +---+-----+-----+-----+--------+-----------+------+-------+---------+ 2255 |50 |6.32 |15.99|25.40| 83.48 | 6.63 | 17.15| 26.42 | 83.55 | 2256 +---+-----+-----+-----+--------+-----------+------+-------+---------+ 2257 |100|6.33 |15.98|25.24| 83.42 | 6.67 | 16.22| 25.74 | 84.21 | 2258 +---+-----+-----+-----+--------+-----------+------+-------+---------+ 2260 Table 90: reno-dctcp-sce Mean TCP RTT (ms); Columns: netem bi- 2261 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2263 +---+----------+-----+-----+--------+----------+-----+-----+--------+ 2264 | | 0 |10 |20 | 80 | 0 |10 |20 | 80 | 2265 +===+==========+=====+=====+========+==========+=====+=====+========+ 2266 | | reno-sce | | | | reno-sce | | | | 2267 +---+----------+-----+-----+--------+----------+-----+-----+--------+ 2268 |1 | 71.92 |72.60|85.12| 140.88 | 71.48 |71.82|82.18| 138.74 | 2269 +---+----------+-----+-----+--------+----------+-----+-----+--------+ 2270 |5 | 14.11 |24.23|34.56| 92.98 | 14.22 |24.21|35.30| 92.20 | 2271 +---+----------+-----+-----+--------+----------+-----+-----+--------+ 2272 |10 | 9.86 |19.83|29.38| 86.98 | 9.89 |19.80|29.32| 86.79 | 2273 +---+----------+-----+-----+--------+----------+-----+-----+--------+ 2274 |50 | 6.63 |17.01|26.57| 82.78 | 6.69 |16.95|26.48| 82.69 | 2275 +---+----------+-----+-----+--------+----------+-----+-----+--------+ 2276 |100| 6.49 |16.69|26.68| 85.00 | 6.53 |16.93|26.69| 85.15 | 2277 +---+----------+-----+-----+--------+----------+-----+-----+--------+ 2279 Table 91: reno-sce-reno-sce Mean TCP RTT (ms); Columns: netem bi- 2280 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2282 +---+----------+-----+-----+--------+------+-------+-------+--------+ 2283 | | 0 |10 |20 | 80 | 0 | 10 | 20 | 80 | 2284 +===+==========+=====+=====+========+======+=======+=======+========+ 2285 | | reno-sce | | | | dctcp| | | | 2286 +---+----------+-----+-----+--------+------+-------+-------+--------+ 2287 |1 | 69.23 |66.60|78.75| 146.62 | 67.72| 67.64 | 79.32 | 139.43 | 2288 +---+----------+-----+-----+--------+------+-------+-------+--------+ 2289 |5 | 13.35 |24.63|36.42| 98.92 | 13.90| 23.35 | 32.95 | 92.69 | 2290 +---+----------+-----+-----+--------+------+-------+-------+--------+ 2291 |10 | 8.00 |19.99|30.77| 94.50 | 7.85 | 18.12 | 27.44 | 87.54 | 2292 +---+----------+-----+-----+--------+------+-------+-------+--------+ 2293 |50 | 8.06 |19.71|31.42| 88.87 | 7.06 | 16.79 | 26.70 | 85.95 | 2294 +---+----------+-----+-----+--------+------+-------+-------+--------+ 2295 |100| 8.34 |19.77|32.99| 91.65 | 7.55 | 16.70 | 27.21 | 87.35 | 2296 +---+----------+-----+-----+--------+------+-------+-------+--------+ 2298 Table 92: reno-sce-dctcp Mean TCP RTT (ms); Columns: netem bi- 2299 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2301 +---+----------+-----+-----+-------+-----------+-----+-----+--------+ 2302 | | 0 |10 |20 | 80 | 0 |10 |20 | 80 | 2303 +===+==========+=====+=====+=======+===========+=====+=====+========+ 2304 | | reno-sce | | | | dctcp-sce | | | | 2305 +---+----------+-----+-----+-------+-----------+-----+-----+--------+ 2306 |1 | 71.87 |72.66|83.24| 139.33| 72.10 |73.13|86.11| 136.98 | 2307 +---+----------+-----+-----+-------+-----------+-----+-----+--------+ 2308 |5 | 15.51 |24.77|34.98| 91.65 | 15.39 |23.89|34.00| 93.84 | 2309 +---+----------+-----+-----+-------+-----------+-----+-----+--------+ 2310 |10 | 9.89 |19.46|28.37| 87.12 | 9.73 |19.48|30.06| 89.37 | 2311 +---+----------+-----+-----+-------+-----------+-----+-----+--------+ 2312 |50 | 6.53 |16.33|25.97| 82.70 | 6.66 |17.52|27.41| 83.22 | 2313 +---+----------+-----+-----+-------+-----------+-----+-----+--------+ 2314 |100| 6.81 |16.30|26.07| 83.48 | 6.96 |16.88|26.35| 84.50 | 2315 +---+----------+-----+-----+-------+-----------+-----+-----+--------+ 2317 Table 93: reno-sce-dctcp-sce Mean TCP RTT (ms); Columns: netem 2318 bi-directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2320 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2321 | |0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 2322 +===+=====+=======+=======+========+=======+=======+=======+========+ 2323 | |dctcp| | | | dctcp | | | | 2324 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2325 |1 |68.18| 68.95 | 80.54 | 143.93 | 69.62 | 69.18 | 80.52 | 141.76 | 2326 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2327 |5 |15.31| 24.50 | 34.27 | 94.45 | 15.27 | 24.16 | 33.93 | 95.11 | 2328 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2329 |10 |8.30 | 18.85 | 28.20 | 87.75 | 8.44 | 18.78 | 28.46 | 87.50 | 2330 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2331 |50 |7.47 | 16.58 | 26.42 | 85.35 | 7.49 | 16.75 | 26.67 | 85.34 | 2332 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2333 |100|7.64 | 16.55 | 26.77 | 86.26 | 7.52 | 17.00 | 26.75 | 86.42 | 2334 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2336 Table 94: dctcp-dctcp Mean TCP RTT (ms); Columns: netem bi- 2337 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2339 +---+-----+------+-----+--------+-----------+--------+-----+--------+ 2340 | |0 |10 |20 | 80 | 0 | 10 |20 | 80 | 2341 +===+=====+======+=====+========+===========+========+=====+========+ 2342 | |dctcp| | | | dctcp-sce | | | | 2343 +---+-----+------+-----+--------+-----------+--------+-----+--------+ 2344 |1 |66.02|66.25 |78.29| 139.85 | 67.98 | 65.82 |77.89| 145.81 | 2345 +---+-----+------+-----+--------+-----------+--------+-----+--------+ 2346 |5 |13.88|207.36|32.89| 92.04 | 13.55 | 380.51 |35.59| 98.73 | 2347 +---+-----+------+-----+--------+-----------+--------+-----+--------+ 2348 |10 |7.81 |80.88 |27.60| 87.58 | 7.95 | 154.57 |30.74| 93.93 | 2349 +---+-----+------+-----+--------+-----------+--------+-----+--------+ 2350 |50 |6.98 |16.12 |26.46| 85.87 | 8.00 | 19.22 |32.18| 88.74 | 2351 +---+-----+------+-----+--------+-----------+--------+-----+--------+ 2352 |100|7.72 |16.92 |27.67| 86.88 | 8.67 | 19.60 |32.95| 91.79 | 2353 +---+-----+------+-----+--------+-----------+--------+-----+--------+ 2355 Table 95: dctcp-dctcp-sce Mean TCP RTT (ms); Columns: netem bi- 2356 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2358 +---+-----------+-----+-----+------+-----------+-----+-----+--------+ 2359 | | 0 |10 |20 |80 | 0 |10 |20 | 80 | 2360 +===+===========+=====+=====+======+===========+=====+=====+========+ 2361 | | dctcp-sce | | | | dctcp-sce | | | | 2362 +---+-----------+-----+-----+------+-----------+-----+-----+--------+ 2363 |1 | 69.76 |71.34|84.74|139.62| 72.85 |71.92|86.45| 137.08 | 2364 +---+-----------+-----+-----+------+-----------+-----+-----+--------+ 2365 |5 | 15.58 |23.92|33.94|92.72 | 15.65 |23.80|33.77| 93.02 | 2366 +---+-----------+-----+-----+------+-----------+-----+-----+--------+ 2367 |10 | 9.78 |19.14|29.55|90.22 | 9.73 |19.36|29.58| 89.44 | 2368 +---+-----------+-----+-----+------+-----------+-----+-----+--------+ 2369 |50 | 6.75 |15.21|24.86|82.92 | 6.80 |15.27|24.83| 83.08 | 2370 +---+-----------+-----+-----+------+-----------+-----+-----+--------+ 2371 |100| 6.41 |15.71|25.16|83.67 | 6.59 |15.95|25.31| 83.71 | 2372 +---+-----------+-----+-----+------+-----------+-----+-----+--------+ 2374 Table 96: dctcp-sce-dctcp-sce Mean TCP RTT (ms); Columns: netem 2375 bi-directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2377 A.8. Two-Flow TCP RTT (Cake "triple-isolate") 2379 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2380 | |0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 2381 +===+=====+=======+=======+========+=======+=======+=======+========+ 2382 | |cubic| | | | cubic | | | | 2383 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2384 |1 |92.48| 88.69 | 88.22 | 131.91 | 92.05 | 90.01 | 87.87 | 131.57 | 2385 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2386 |5 |18.67| 28.80 | 36.43 | 90.88 | 18.74 | 28.85 | 36.72 | 90.74 | 2387 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2388 |10 |8.48 | 18.56 | 28.64 | 86.24 | 8.53 | 18.63 | 28.72 | 86.10 | 2389 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2390 |50 |6.51 | 15.85 | 24.13 | 82.81 | 6.60 | 15.85 | 24.00 | 82.69 | 2391 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2392 |100|6.04 | 15.21 | 23.73 | 82.62 | 5.92 | 15.29 | 23.71 | 82.59 | 2393 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2395 Table 97: cubic-cubic Mean TCP RTT (ms); Columns: netem bi- 2396 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2398 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2399 | |0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 2400 +===+=====+=======+=======+========+=======+=======+=======+========+ 2401 | |cubic| | | | reno | | | | 2402 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2403 |1 |90.34| 89.98 | 87.87 | 133.32 | 68.49 | 66.53 | 73.84 | 138.30 | 2404 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2405 |5 |17.62| 29.12 | 36.16 | 90.80 | 14.13 | 30.47 | 37.59 | 92.04 | 2406 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2407 |10 |8.49 | 18.41 | 28.65 | 86.04 | 8.90 | 20.00 | 30.17 | 86.63 | 2408 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2409 |50 |6.48 | 15.92 | 23.71 | 82.53 | 6.56 | 15.44 | 23.98 | 82.33 | 2410 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2411 |100|6.15 | 15.14 | 23.53 | 82.86 | 6.22 | 14.57 | 23.50 | 82.20 | 2412 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2414 Table 98: cubic-reno Mean TCP RTT (ms); Columns: netem bi- 2415 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2417 +---+-----+-----+------+--------+----------+-------+-------+--------+ 2418 | |0 |10 | 20 | 80 | 0 | 10 | 20 | 80 | 2419 +===+=====+=====+======+========+==========+=======+=======+========+ 2420 | |cubic| | | | reno-sce | | | | 2421 +---+-----+-----+------+--------+----------+-------+-------+--------+ 2422 |1 |92.71|90.37| 87.84| 129.22 | 50.64 | 50.51 | 50.24 | 117.80 | 2423 +---+-----+-----+------+--------+----------+-------+-------+--------+ 2424 |5 |16.87|24.55| 35.20| 90.00 | 9.62 | 19.86 | 30.07 | 92.04 | 2425 +---+-----+-----+------+--------+----------+-------+-------+--------+ 2426 |10 |8.53 |18.97| 29.09| 86.20 | 6.59 | 16.56 | 26.35 | 85.23 | 2427 +---+-----+-----+------+--------+----------+-------+-------+--------+ 2428 |50 |6.55 |15.97| 24.28| 82.65 | 4.41 | 13.89 | 23.32 | 82.85 | 2429 +---+-----+-----+------+--------+----------+-------+-------+--------+ 2430 |100|6.03 |15.27| 23.98| 82.61 | 3.93 | 13.85 | 23.58 | 82.96 | 2431 +---+-----+-----+------+--------+----------+-------+-------+--------+ 2433 Table 99: cubic-reno-sce Mean TCP RTT (ms); Columns: netem bi- 2434 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2436 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2437 | |0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 2438 +===+=====+=======+=======+========+=======+=======+=======+========+ 2439 | |cubic| | | | dctcp | | | | 2440 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2441 |1 |92.60| 89.79 | 87.75 | 135.20 | 97.84 | 96.66 | 96.75 | 149.61 | 2442 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2443 |5 |14.45| 28.19 | 37.86 | 91.20 | 19.07 | 25.58 | 35.17 | 94.03 | 2444 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2445 |10 |8.63 | 18.12 | 28.34 | 86.15 | 8.16 | 17.58 | 27.57 | 87.68 | 2446 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2447 |50 |6.57 | 15.82 | 24.40 | 82.81 | 6.80 | 16.42 | 25.94 | 84.05 | 2448 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2449 |100|6.24 | 15.32 | 23.81 | 82.84 | 6.52 | 16.12 | 25.83 | 82.92 | 2450 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2452 Table 100: cubic-dctcp Mean TCP RTT (ms); Columns: netem bi- 2453 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2455 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2456 | |0 |10 |20 | 80 | 0 | 10 | 20 | 80 | 2457 +===+=====+=====+=====+========+===========+=======+=======+========+ 2458 | |cubic| | | | dctcp-sce | | | | 2459 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2460 |1 |92.73|87.54|87.60| 126.28 | 50.28 | 49.77 | 49.69 | 115.82 | 2461 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2462 |5 |14.77|24.31|34.63| 89.26 | 9.54 | 20.04 | 29.91 | 93.48 | 2463 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2464 |10 |8.46 |18.88|28.82| 85.49 | 6.87 | 16.46 | 26.73 | 88.22 | 2465 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2466 |50 |6.61 |17.05|24.37| 82.43 | 4.19 | 13.11 | 22.72 | 82.28 | 2467 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2468 |100|6.41 |15.44|23.87| 82.35 | 3.66 | 12.84 | 22.70 | 82.27 | 2469 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2471 Table 101: cubic-dctcp-sce Mean TCP RTT (ms); Columns: netem bi- 2472 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2474 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2475 | |0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 2476 +===+=====+=======+=======+========+=======+=======+=======+========+ 2477 | |reno | | | | reno | | | | 2478 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2479 |1 |68.39| 66.58 | 73.72 | 142.08 | 68.61 | 66.66 | 73.74 | 142.94 | 2480 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2481 |5 |15.73| 25.66 | 38.41 | 92.20 | 14.62 | 25.71 | 37.82 | 92.07 | 2482 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2483 |10 |8.48 | 20.48 | 29.68 | 86.62 | 8.86 | 20.37 | 29.82 | 86.93 | 2484 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2485 |50 |6.58 | 15.60 | 23.71 | 82.41 | 6.54 | 15.64 | 23.77 | 82.36 | 2486 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2487 |100|6.32 | 14.10 | 23.44 | 82.17 | 6.36 | 14.13 | 23.13 | 81.99 | 2488 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2490 Table 102: reno-reno Mean TCP RTT (ms); Columns: netem bi- 2491 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2493 +---+-----+-----+------+--------+----------+-------+-------+--------+ 2494 | |0 |10 | 20 | 80 | 0 | 10 | 20 | 80 | 2495 +===+=====+=====+======+========+==========+=======+=======+========+ 2496 | |reno | | | | reno-sce | | | | 2497 +---+-----+-----+------+--------+----------+-------+-------+--------+ 2498 |1 |68.77|66.59| 73.78| 137.04 | 50.65 | 50.32 | 50.23 | 116.09 | 2499 +---+-----+-----+------+--------+----------+-------+-------+--------+ 2500 |5 |16.12|24.59| 37.04| 90.48 | 9.41 | 19.69 | 30.14 | 91.04 | 2501 +---+-----+-----+------+--------+----------+-------+-------+--------+ 2502 |10 |8.46 |19.67| 31.33| 86.72 | 6.76 | 16.53 | 26.33 | 85.41 | 2503 +---+-----+-----+------+--------+----------+-------+-------+--------+ 2504 |50 |6.59 |15.65| 23.98| 82.46 | 4.43 | 13.54 | 23.21 | 82.73 | 2505 +---+-----+-----+------+--------+----------+-------+-------+--------+ 2506 |100|6.35 |14.57| 23.37| 82.16 | 4.11 | 13.62 | 23.45 | 82.85 | 2507 +---+-----+-----+------+--------+----------+-------+-------+--------+ 2509 Table 103: reno-reno-sce Mean TCP RTT (ms); Columns: netem bi- 2510 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2512 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2513 | |0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 2514 +===+=====+=======+=======+========+=======+=======+=======+========+ 2515 | |reno | | | | dctcp | | | | 2516 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2517 |1 |68.04| 66.19 | 73.70 | 140.21 | 96.81 | 96.80 | 96.58 | 143.33 | 2518 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2519 |5 |16.18| 26.99 | 38.88 | 92.89 | 18.99 | 24.82 | 35.27 | 93.97 | 2520 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2521 |10 |8.59 | 19.99 | 30.15 | 86.79 | 8.27 | 17.92 | 27.99 | 88.08 | 2522 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2523 |50 |6.38 | 15.57 | 23.94 | 82.44 | 6.78 | 16.46 | 25.77 | 83.82 | 2524 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2525 |100|6.24 | 14.72 | 23.45 | 82.17 | 6.30 | 16.11 | 24.98 | 82.96 | 2526 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2528 Table 104: reno-dctcp Mean TCP RTT (ms); Columns: netem bi- 2529 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2531 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2532 | |0 |10 |20 | 80 | 0 | 10 | 20 | 80 | 2533 +===+=====+=====+=====+========+===========+=======+=======+========+ 2534 | |reno | | | | dctcp-sce | | | | 2535 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2536 |1 |69.06|67.33|65.57| 133.89 | 50.17 | 49.67 | 49.59 | 115.33 | 2537 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2538 |5 |16.04|24.23|36.62| 89.94 | 9.57 | 19.90 | 30.12 | 93.42 | 2539 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2540 |10 |8.51 |19.93|29.67| 85.60 | 6.65 | 16.53 | 26.99 | 87.11 | 2541 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2542 |50 |6.47 |16.89|24.02| 82.35 | 4.19 | 13.04 | 22.72 | 82.35 | 2543 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2544 |100|6.35 |14.57|23.39| 81.90 | 3.74 | 12.59 | 22.53 | 82.02 | 2545 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2547 Table 105: reno-dctcp-sce Mean TCP RTT (ms); Columns: netem bi- 2548 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2550 +---+----------+-----+-----+--------+----------+-----+-----+--------+ 2551 | | 0 |10 |20 | 80 | 0 |10 |20 | 80 | 2552 +===+==========+=====+=====+========+==========+=====+=====+========+ 2553 | | reno-sce | | | | reno-sce | | | | 2554 +---+----------+-----+-----+--------+----------+-----+-----+--------+ 2555 |1 | 50.10 |50.27|50.22| 117.12 | 50.62 |50.44|50.23| 116.67 | 2556 +---+----------+-----+-----+--------+----------+-----+-----+--------+ 2557 |5 | 9.54 |19.29|29.77| 88.86 | 9.63 |19.25|29.76| 89.43 | 2558 +---+----------+-----+-----+--------+----------+-----+-----+--------+ 2559 |10 | 6.89 |16.55|26.16| 85.44 | 6.62 |16.47|26.14| 85.52 | 2560 +---+----------+-----+-----+--------+----------+-----+-----+--------+ 2561 |50 | 4.50 |13.31|22.99| 82.65 | 4.47 |13.28|22.93| 82.60 | 2562 +---+----------+-----+-----+--------+----------+-----+-----+--------+ 2563 |100| 4.25 |13.89|23.70| 83.01 | 4.14 |13.74|23.59| 82.88 | 2564 +---+----------+-----+-----+--------+----------+-----+-----+--------+ 2566 Table 106: reno-sce-reno-sce Mean TCP RTT (ms); Columns: netem 2567 bi-directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2569 +---+----------+-----+-----+--------+------+-------+-------+--------+ 2570 | | 0 |10 |20 | 80 | 0 | 10 | 20 | 80 | 2571 +===+==========+=====+=====+========+======+=======+=======+========+ 2572 | | reno-sce | | | | dctcp| | | | 2573 +---+----------+-----+-----+--------+------+-------+-------+--------+ 2574 |1 | 49.93 |50.27|50.22| 119.15 | 97.30| 97.00 | 96.39 | 135.73 | 2575 +---+----------+-----+-----+--------+------+-------+-------+--------+ 2576 |5 | 9.45 |19.45|30.20| 92.32 | 19.13| 23.40 | 33.39 | 91.37 | 2577 +---+----------+-----+-----+--------+------+-------+-------+--------+ 2578 |10 | 6.71 |16.62|26.26| 85.57 | 8.16 | 18.21 | 28.41 | 87.40 | 2579 +---+----------+-----+-----+--------+------+-------+-------+--------+ 2580 |50 | 4.42 |13.69|23.24| 82.83 | 6.75 | 16.30 | 26.05 | 84.00 | 2581 +---+----------+-----+-----+--------+------+-------+-------+--------+ 2582 |100| 4.07 |13.79|23.61| 82.79 | 6.36 | 16.43 | 26.21 | 83.42 | 2583 +---+----------+-----+-----+--------+------+-------+-------+--------+ 2585 Table 107: reno-sce-dctcp Mean TCP RTT (ms); Columns: netem bi- 2586 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2588 +---+----------+-----+-----+-------+-----------+-----+-----+--------+ 2589 | | 0 |10 |20 | 80 | 0 |10 |20 | 80 | 2590 +===+==========+=====+=====+=======+===========+=====+=====+========+ 2591 | | reno-sce | | | | dctcp-sce | | | | 2592 +---+----------+-----+-----+-------+-----------+-----+-----+--------+ 2593 |1 | 50.11 |50.26|50.22| 115.48| 50.26 |49.68|49.61| 114.34 | 2594 +---+----------+-----+-----+-------+-----------+-----+-----+--------+ 2595 |5 | 9.52 |19.16|29.74| 88.60 | 9.61 |19.32|29.60| 91.03 | 2596 +---+----------+-----+-----+-------+-----------+-----+-----+--------+ 2597 |10 | 6.49 |16.48|25.83| 84.54 | 6.77 |16.38|26.33| 87.03 | 2598 +---+----------+-----+-----+-------+-----------+-----+-----+--------+ 2599 |50 | 4.41 |13.17|22.98| 82.60 | 4.12 |13.08|22.99| 82.38 | 2600 +---+----------+-----+-----+-------+-----------+-----+-----+--------+ 2601 |100| 4.16 |13.48|23.17| 82.59 | 3.78 |12.83|22.57| 82.04 | 2602 +---+----------+-----+-----+-------+-----------+-----+-----+--------+ 2604 Table 108: reno-sce-dctcp-sce Mean TCP RTT (ms); Columns: netem 2605 bi-directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2607 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2608 | |0 | 10 | 20 | 80 | 0 | 10 | 20 | 80 | 2609 +===+=====+=======+=======+========+=======+=======+=======+========+ 2610 | |dctcp| | | | dctcp | | | | 2611 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2612 |1 |97.66| 96.66 | 96.60 | 151.58 | 97.03 | 96.71 | 96.65 | 150.04 | 2613 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2614 |5 |18.76| 25.73 | 35.30 | 93.14 | 19.22 | 25.75 | 35.17 | 93.24 | 2615 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2616 |10 |8.15 | 18.04 | 27.99 | 87.51 | 8.36 | 17.57 | 27.57 | 87.54 | 2617 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2618 |50 |6.62 | 16.44 | 25.70 | 83.54 | 6.56 | 16.35 | 25.91 | 84.12 | 2619 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2620 |100|6.46 | 16.25 | 26.01 | 82.89 | 6.56 | 16.07 | 25.86 | 82.93 | 2621 +---+-----+-------+-------+--------+-------+-------+-------+--------+ 2623 Table 109: dctcp-dctcp Mean TCP RTT (ms); Columns: netem bi- 2624 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2626 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2627 | |0 |10 |20 | 80 | 0 | 10 | 20 | 80 | 2628 +===+=====+=====+=====+========+===========+=======+=======+========+ 2629 | |dctcp| | | | dctcp-sce | | | | 2630 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2631 |1 |97.80|96.84|96.75| 137.02 | 50.27 | 49.76 | 49.67 | 114.01 | 2632 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2633 |5 |18.89|23.68|33.54| 91.13 | 9.53 | 19.80 | 29.74 | 93.86 | 2634 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2635 |10 |8.09 |17.86|28.37| 85.94 | 6.63 | 16.42 | 26.54 | 87.48 | 2636 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2637 |50 |6.74 |16.51|25.50| 83.04 | 4.06 | 13.08 | 22.68 | 82.42 | 2638 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2639 |100|6.44 |16.27|26.02| 83.05 | 3.74 | 12.88 | 22.68 | 82.08 | 2640 +---+-----+-----+-----+--------+-----------+-------+-------+--------+ 2642 Table 110: dctcp-dctcp-sce Mean TCP RTT (ms); Columns: netem bi- 2643 directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2645 +---+-----------+-----+-----+------+-----------+-----+-----+--------+ 2646 | | 0 |10 |20 |80 | 0 |10 |20 | 80 | 2647 +===+===========+=====+=====+======+===========+=====+=====+========+ 2648 | | dctcp-sce | | | | dctcp-sce | | | | 2649 +---+-----------+-----+-----+------+-----------+-----+-----+--------+ 2650 |1 | 50.89 |49.74|49.64|116.00| 50.28 |49.72|49.68| 113.76 | 2651 +---+-----------+-----+-----+------+-----------+-----+-----+--------+ 2652 |5 | 9.44 |19.41|30.11|90.46 | 9.53 |19.19|29.78| 91.12 | 2653 +---+-----------+-----+-----+------+-----------+-----+-----+--------+ 2654 |10 | 6.66 |16.46|26.39|86.01 | 6.77 |16.44|26.44| 86.28 | 2655 +---+-----------+-----+-----+------+-----------+-----+-----+--------+ 2656 |50 | 4.14 |12.85|22.68|82.30 | 4.19 |13.06|22.55| 82.25 | 2657 +---+-----------+-----+-----+------+-----------+-----+-----+--------+ 2658 |100| 3.78 |12.57|22.34|81.86 | 3.80 |12.56|22.26| 81.96 | 2659 +---+-----------+-----+-----+------+-----------+-----+-----+--------+ 2661 Table 111: dctcp-sce-dctcp-sce Mean TCP RTT (ms); Columns: netem 2662 bi-directional Delay (ms); Rows: Cake-limited Bandwidth (Mbit) 2664 Authors' Addresses 2666 Peter G. Heist 2667 Redacted 2668 463 11 Liberec 30 2669 Czech Republic 2671 Email: pete@heistp.net 2672 Rodney W. Grimes 2673 Redacted 2674 Portland, OR 97217 2675 United States 2677 Email: rgrimes@freebsd.org 2679 Jonathan Morton 2680 Kokkonranta 21 2681 FI-31520 Pitkajarvi 2682 Finland 2684 Phone: +358 44 927 2377 2685 Email: chromatix99@gmail.com