Wednesday, August 23, 2017

Paper 3: Re-architecting datacenter networks and stacks for low latency and high performance

Paper 3: "Re-architecting datacenter networks and stacks for low latency and high performance" - authors are Mark Handley (University College London), Costin Raiciu, Alexandru Agache, and Andrei Voinescu (University Politehnica of Bucharest), and Andrew Moore, Gianni Antichi, and Marcin Wójcik (University of Cambridge)


The paper is presented by Prof. Mark Handley (University College London). This paper has received a SIGCOMM 2017 Best Paper Award.

The talk starts by describing three goals in DC networks:
  1. low latency between hosts
  2. receiver prioritisation
  3. predictable high throughput
Although, achieving these simultaneously is challenging. The authors present NDP, a DC protocol architecture that simultaneously achieves low latency and high throughput.

One of the key ideas in this paper is the use of packet trimming when a switch queue fills up. This idea proposed as Cut Payload (CP) in this paper (worth checking out):
P. Cheng, F. Ren, R. Shu, and C. Lin. Catch the whole lot in an action: Rapid precise packet loss noti cation in data centers. In Proc. Usenix NSDI, 2014.

In NDP, the authors addressed the shortcomings of CP  with the following changes:

  1. An NDP switch maintains separate queues for data packets and higher priority trimmed header packets. This provides low latency similar to lossless Ethernet, without the collateral damage caused by pausing.
  2. An NDP switch performs weighted round robin between the high and low priority queues. This can eliminate congestion collapse.
  3. An NDP switch decides wether to trim a newly arrived packet or the data data packet at the end of the low priority queue. This breaks up phase effects.


On top of presenting a switch queuing algorithm, NDP proposes a per-packet multipath forwarding and a novel transport protocol.

Implementation: the authors presented NDP in Linux hosts with DPDK, in a software switch, in a NetFPGA-based hardware switch, and in P4.

Results:

  • NDP provides very low flow completion time.
  • NDP provides much better isolation between different workloads than mechanisms such as DCQCN (that rely on lossless Ethernet for low delay).
  • Incast: While other solutions have also tackled this problem well (see figure below), the important part is that NDP solves the incast problem using only 8 packet buffers.


You can check out the great animations that were presented during the talk here.


The talk was followed by a lively Q&A, with questions on fairness (NDP ensures fairness), network topology (NDP requires a Clos topology) and failure awareness (NDP handles link failures by maintaining scores for links).




11 comments:

  1. s followed by a lively Q&A, with questions on fairness (NDP ensures fairn#LawofAttraction

    ReplyDelete
  2. Exit the Gungeon is a dungeon climber with a bullet in the immediate aftermath of the adventures of the inappropriate "Gungeoneers" and his personal graduation trip to Enter the Gungeon. Gungeon has turned into a paradox and is collapsing! paintstorm studio Free Download and dll suite Free Download and bulk image downloader activation key with synthesia keygen with an ever-changing weapon, an insatiable need to steal, and a dependable dodge role, each of our heroes must scale and escape through their own unique path of increasingly dangerous elevators. Fight the last and bitterest in Gundead at a frantic pace, slowing down enough to chat with some familiar faces ... and some new ones. Locker rooms, enemies, bosses, strange weapons, and items are combined to ensure there are no two attempts to get out of the dungeon.

    ReplyDelete
  3. This comment has been removed by the author.

    ReplyDelete
  4. meshcam pro crack Free downloadMeshCAM Crack provides you with intuitive operation and simple controls to select required geometry and tolerance parameters. Thanks to the available interface, it allows people to configure their CAD files for processing in a few simple steps. Although it only contains pictures of its different partsfairy tail game Download

    ReplyDelete
  5. his one is enough to teach and encourage you to get quality through the exams fast. It is a very angry innovation. For testing music compositionLinkhis one is enough to teach and encourage you to get quality through the exams fast. Check this My Listhis one is enough to teach and encourage you to get quality through the exams fast.
    My link his one is enough to teach and encourage you to get quality through the exams fast. This Link

    ReplyDelete
  6. Karma Activation Key Downloadprovides you with intuitive operation and ProxyCap Free Downloadsimple controls to select required geometry and tolerance FL Studio Downloadparameters. Thanks to the available interface, it allows people to configure their CAD jitbit Macro Recorder Free Downloadfiles for processing in a few simple steps.

    ReplyDelete
  7. Wow great blog article. Really thank you! Awesome. best stacked dies near me

    ReplyDelete
  8. You always post a very well-written blog. rock chip repair

    ReplyDelete
  9. สล็อต pg เว็บ ตรง แตก หนัก 2023 โอกาสที่คุณจะได้ยินถึงโลกน่าตื่นเต้นของเกมสล็อตออนไลน์ก็สูงมาก ในหมวดของผู้ให้บริการเกมสล็อตที่ได้รับความนิยมมากมาย สล็อต PG กล่าวได้เลย

    ReplyDelete
  10. Many players in Assassins Creed Revelations Download praised the continuation and conclusion of the story arcs of Ezio Auditore and Altaïr Ibn-La'Ahad. The intertwining narratives were seen as compelling and well-executed.

    ReplyDelete