Wednesday, August 23, 2017

Session 5 Paper 2: Neural Adaptive Video Streaming with Pensieve

Presented by: Hongzi Mao

Authors: Hongzi Mao, Ravi Netravali, and Mohammad Alizadeh (MIT Computer Science and Artificial Intelligence Laboratory)

Today’s video streaming relies on adaptive bitrate (ABR), e.g. 240P or 1080P, which is selected based on the network condition. The quality of a video is lower with low ABR but an ABR that is too high for the network condition to support would result in video pause. The authors proposed Pensieve, which adjusts ABR based on reinforcement learning on the network conditions and the resulted video quality under the selected ABR.

In this reinforcement learning problem, the action space is the ABR selections, e.g. 240P or 1080P. The reward function considers bitrate, rebuffering, and smoothness. For the state space, many features are considered, including chunk throughput, chunk download time, next chunk size, current buffer size, and past chunk bitrate, etc. These diverse features in the state space would be more helpful than mere throughput prediction and/or buffer occupancy in prior works.

They trained and tested over real network traces and find Pensieve would deliver 12-25% better QoE,  and 10 - 30% less rebuffering than previous ABR algorithms.
Q: How do you explain and understand where the benefits of your reinforcement learning algorithm come from?
A: Explaining the neural network remains a hard problem. We find Pensieve benefits from better control on rebuffering.

Q: What is the cost of computation?  
A: Storage cost is small. Training requires expensive computation but not much computation is needed for ABR selection based on the trained model.

Q: Do you compare with past works on model based congestion control?
A: It is hard to model the network and therefore we propose data driven congestion control.

Q: Did you try user satisfaction for the reward function?
A: No, because it is harder and slower to quantify user satisfaction than our simulation strategy, but it would be trivial to replace the function.

Q: How does it scale to many clients?  
A: We can learn for different clients and maybe coordinate the ABR for multiple clients.


  1. Scientific demonstrating is an OLAP device that is an estimation motor for determining proportions, changes and so on., including estimations and numerical information crosswise over numerous measurements.
    data science course in pune

  2. I was blown out after viewing the article which you have shared over here. So I just wanted to express my opinion on Data Analytics, as this is best trending medium to promote or to circulate the updates, happenings, knowledge sharing.. Aspirants & professionals are keeping a close eye on Data analytics course in Mumbai to equip it as their primary skill.

  3. Such a very useful article. I have learn some new information.thanks for sharing.
    data scientist course in mumbai

  4. Cool stuff you have and you keep overhaul every one of us
    Data Analytics Course in Mumbai

  5. Such a very useful article. Very interesting to read this article. I have learn some new information.thanks for sharing. ExcelR

  6. Very nice blog here and thanks for post it.. Keep blogging...
    ExcelR data science training

  7. Attend The PMP Certification From ExcelR. Practical PMP Certification Sessions With Assured Placement Support From Experienced Faculty. ExcelR Offers The PMP Certification.
    ExcelR PMP Certification

  8. Excellent Blog! I would like to thank for the efforts you have made in writing this post. I am hoping the same best work from you in the future as well. I wanted to thank you for this websites! Thanks for sharing. Great websites!
    data science course in mumbai

  9. Really nice and interesting post. I was looking for this kind of information and enjoyed reading this one. Keep posting. Thanks for sharing.
    data analytics course mumbai

  10. This is a wonderful article, Given so much info in it, These type of articles keeps the users interest in the website, and keep on sharing more ... good luck... data science course