Academia.eduAcademia.edu

Outline

Title
Abstract
Background
Delivery Methods
Conclusion
References
All Topics
Computer Science
Distributed Systems

Understanding Timelines Within MPEG Standards

Profile image of Fernando BoronatFernando Boronat

2016, IEEE Communications Surveys & Tutorials

https://doi.org/10.1109/COMST.2015.2488483
visibility

…

description

33 pages

link

1 file

Abstract

Nowadays, media content can be delivered via diverse broadband and broadcast technologies. Although these different technologies have somehow become rivals, their coordinated usage and convergence, by leveraging of their strengths and complementary characteristics, can bring many benefits to both operators and customers. For example, broadcast TV content can be augmented by on-demand broadband media content to provide enriched and personalized services, such as multi-view TV, audio language selection and inclusion of real-time web feeds. A piece of evidence is the recent Hybrid Broadcast Broadband TV (HbbTV) standard, which aims at harmonizing the delivery and consumption of (hybrid) broadcast and broadband TV content. A key challenge in these emerging scenarios is the synchronization between the involved media streams, which can be originated by the same or different sources, and delivered via the same or different technologies. To enable synchronized (hybrid) media delivery services, some mechanisms providing timelines at the source side are necessary to accurately time align the involved media streams at the receiver-side. This paper provides a comprehensive review of how clock references (timing) and timestamps (time) are conveyed and interpreted when using the most widespread delivery technologies, such as DVB, RTP/RTCP and MPEG standards (e.g., MPEG-2, MPEG-4, MPEG-DASH and MMT). It is particularly focused on the format, resolution, frequency and the position within the bitstream of the fields conveying timing information, as well as on the involved components and packetization aspects. Finally, it provides a survey of proofs of concepts making use of these synchronization related mechanisms. This complete and thorough source of information can be very useful for scholars and practitioners interested in media services with synchronization demands.

Related papers

Systematic Review of Multiple Contents Synchronization in Interactive Television Scenario
Celso Alberto Saibel Santos

ISRN Communications and Networking, 2014

Context. Interactive TV has not reached yet its full potential. How to make the use of interactivity in television content viable and attractive is something in evolution that can be seen with the popularization of new approaches as the use of second screen as interactive platform. Objective. This study aims at surveying existing research on Multiple Contents TV Synchronization in order to synthesize their results, classify works with common points, and identify needs for future research. Method. This paper reports the results of a systematic literature review and mapping study on TV Multiple Contents Synchronization published until middle 2013. As result, a set of 68 papers was generated and analyzed considering general information such as sources and time of publication; covered research topics; and synchronization aspects such as methods, channels, and precision. Results. Based on the obtained data, the paper provides a high level overview of the analyzed works; a detailed exploration of each used and proposed technique and its applications; and a discussion and proposal of a scenario overview and classification scheme based on the extracted data.

View PDFchevron_right
Self-Organized Inter-Destination Multimedia Synchronization For Adaptive Media Streaming
Benjamin Rainer

Proceedings of the ACM International Conference on Multimedia - MM '14, 2014

As social networks have become more pervasive, they have changed how we interact socially. The traditional TV experience has drifted from an event at a fixed location with family or friends to a location-independent and distributed social experience. In addition, more and more Video On-Demand services have adopted pull-based streaming. In order to provide a synchronized and immersive distributed TV experience we introduce self-organized Inter-Destination Multimedia Synchronization (IDMS) for adaptive media streaming. In particular, we adapt the principles of IDMS to MPEG-DASH to synchronize multimedia playback among geographically distributed peers. We introduce session management to MPEG-DASH and propose a Distributed Control Scheme (DCS) to negotiate a reference playback timestamp among the peers participating in an IDMS session. We evaluate our DCS with respect to scalability and the time required to negotiate the reference playback timestamp. Furthermore, we investigate how to compensate for asynchronism using Adaptive Media Playout (AMP) and define a temporal distortion metric for audio and video which allows the impact of playback rate variations to be modeled with respect to QoE. This metric is evaluated based on a subjective quality assessment using crowdsourcing.

View PDFchevron_right
Temporal Models for Multimedia Synchronization 1
MJ Pérez-Luque

1994

Multimedia synchronization has been studied by many researchers. Many approaches have been developed, some exist as proposals, others as established implementations. This fact, instead of being an advantage, is causing a great deal of confusion amongst researchers in communications, authoring, and user interface development. There is a lack of unified vision of the whole issue and it is difficult to evaluate and compare existing systems. In order to address this problem, we have developed a Temporal Reference Framework which unifies existing theories. It gives the necessary definitions for referencing and evaluating individual systems and enables the comparison of different synchronization schemes. In this paper, we focus on the foundation of our Temporal Reference Framework: models of time. We do this by first presenting a detailed survey of what time is and how it can be modeled. We describe models of time following a consistent terminology. We then introduce our framework. Finall...

View PDFchevron_right
To be included in the Proceedings of the IEEE ICMCS’99 Conference. On Satisfying Timing and Resource Constraints in Distributed Multimedia Systems
Costas Mourlas

2008

In this paper 1, we present a new synchronization strategy for multimedia applications executed in a distributed environment. This strategy makes the timing properties of the system and the quality of the media presentations predictable since one is able to determine analytically whether the timing requirements of each multimediaapplicationwillbe met, and if not, which timing requirements willfail. The proposed synchronization protocol provides deterministic guarantees and service reliability that can’t be compromised by resource contention. Thus, the application can maintain the initial quality of service (QoS) level without encountering unpredictable delays and blocking due to synchronization. 1.

View PDFchevron_right
TV anytime as an application scenario for MPEG-7
Silvia Pfeiffer

Proceedings of the 2000 ACM workshops on Multimedia - MULTIMEDIA '00, 2000

Phone: +61 2 9325 3144, Fax: +61 2 9325 3200 {SiMa.Pfeiffer I Uma.Srinivasan } @ cmis.csiro.au

View PDFchevron_right
An intermedia synchronisation mechanism for multimedia distributed systems
Saul E. Pomares Hernandez

International Journal of Internet Protocol Technology, 2009

Emerging distributed multimedia systems such as Telemedicine, Tele-Conference and IPTV, deal with simultaneous geographically distributed sources by transmitting heterogeneous data, such as text, images, graphics, video and audio. The preservation of temporal relations that consider different data types and simultaneous distributed sources is an open research area. Although several works try to specify and execute at runtime distributed temporal multimedia scenarios, they are far from resolving the problem. This paper proposes a synchronization mechanism to be used at runtime in distributed multimedia systems. One original aspect of the present work is that we avoid the use of a common reference by executing all possible multimedia temporal relations according to their causal dependencies. We emulate the mechanism considering a wide area network environment and using MPEG-4 encoders. The emulation results show that our mechanism is effective in reducing the intermedia synchronization error that can exist. The present work does not require previous knowledge of when, nor for how long, the media involved of a temporal scenario is executed.

View PDFchevron_right
Issues in data embedding and synchronization for digital television
Jose Brunheroto

2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532), 2000

As digital television matures, applications which utilize data embedded in the broadcast television signal are likely to be an important feature of the new medium. This paper explores some of the issues involved in the implementation of systems for the utilization of data which accompanies digital television's video and audio content. Chief among these issues are those which pertain to:

View PDFchevron_right
A Temporal Reference Framework for Multimedia Synchronization 1
MJ Pérez-Luque

2005

The synchronization problem for audio/visual reproduction has consumed engineers since the advent of recorded audio and images and the first multimedia productions. As computers have evolved to support programmed reproduction of multimedia information, the complexity but not the character or interest have changed. In the digital domain, synchronization problems exist due to data distribution and communications, random events caused by human-computer interaction, and general computer and communications performance limitations. This rich research domain has led to numerous approaches to the modeling and execution of multimedia synchronization scenarios. Unfortunately, these approaches are difficult to compare and evaluate due to their varied theoretical bases and modeling techniques. In this paper we develop a uniform, theoretical foundation for discussing multimedia synchronization and temporal specification. We propose a temporal reference framework and use it to compare existing te...

View PDFchevron_right
Adaptation and Synchronization in Bandwidth-Constrained Internet Video and Audio
Fabio Kon

Systems for the real-time transmission of video and audio on low-bandwidth lines must account for the limited bandwidth available, the bandwidth variance, packet loss rates, as well as CPU load. Vosaic, short for Video Mosaic, integrates real-time continuous media within standard Web pages, and handles the issues of transmitting continuous media with the Video Datagram Protocol (VDP). VDP dynamically adapts the media stream to the available network and CPU bandwidth, thus improving video performance. Built as an object-oriented framework, Vosaic permits the easy addition and customization of the basic VDP protocol for di erent media types. This family of protocols currently support two di erent standard video formats, as well as four audio formats.

View PDFchevron_right
Timing Challenges for Media Production and Transport over the Wide Area Network
Bengt Olsson

BEITC Proceedings - NAB, 2018

The transition from synchronous transport methods to IP for production quality video and audio services implies a deterioration of the timing quality of the signals, since IP is a completely asynchronous transport format. IEEE 1588 (PTP) has been introduced to convey precise timing over an IP network. In the Studio LAN, reaching the required quality level of timing transport with PTP is manageable, but doing it in the WAN is very challenging. In practice the only wide area solution today is to use GPS controlled Grand Master (GM) clocks at each remote location to provide synchronization with sufficient quality. This scheme has some disadvantages in that it depends on that a GPS signal is always available, which may not be the case, for several reasons. The industry also needs solutions for PTP transport over the terrestrial WANs. We will describe the challenges with PTP over the WAN, but also show how a synchronous overlay on top of the IP network can provide sufficient PTP quality over the WAN for professional Audio and Video services without resorting to GPS controlled GMs at each end point. Real operational cases using this functionality will be described.

View PDFchevron_right

References (103)

  1. References to implementations (or proof-of-concepts)
  2. J. Maisonneuve, M. Deschanel, J. Heiles, L. Wei , H. Lu, R. Sharpe and W. Yiyan "An Overview of IPTV Standards Development". Broadcasting, IEEE Transactions on, vol. 55, n. 2, pp. 315-328. June 2009.
  3. B. Li, Z. Wang, J. Liu and W, Zhu. "Two Decades of Internet Video Streaming: A Retrospective View". ACM Transactions on Multimedia Computing, Communications and Applications, vol. 9, n. 33, pp. 1-20. October 2013.
  4. H. Schulzrinne, S. Casner, R. Frederick and V. Jacobson. RFC 3550, RTP: A Transport Protocol for Real-time Applications. Internet Engineering Task Force, Standards Track. July 2003.
  5. ISO/IEC 23009-1: 2012. Information Technology. Dynamic Adaptive Streaming over HTTP (DASH). Part 1: Media Presentation Description and Segment Formats. April 2012.
  6. L. Beloqui Yuste and H. Melvin. "Enhanced IPTV Services through Time Synchronisation". 2010 IEEE 14 th International Symposium on Consumer Electronics (ISCE). vol., n., pp. 1-6. Braunschweig. June 2010.
  7. S. Aoki, K. Otsuki and H. Hamada. "Effective Usage of MMT in Broadcasting Systems". Broadband Multimedia Systems and Broadcast- ing (BMSB), 2013 IEEE International Symposium on, vol., n., pp. 1-6. June 2013.
  8. L. Beloqui Yuste and H. Melvin. "Inter-media Synchronization for IPTV: A Case Study for VLC". Digital Technologies, Žilina, Slovakia. November 2009.
  9. ETSI TS 102 796 V1.2.1 (2012-11) Hybrid Broadcast Broadband TV. 2012.
  10. ISO/IEC 23008-1: 2014. Information Technology. High Efficiency Coding and Media Delivery in Heterogeneous Environments. Part 1: MPEG Media Transport (MMT). June 2014.
  11. F. Boronat, R. Mekuria, M. Montagud and P. Cesar. "Distributed Media Synchronization for Shared Video Watching: Issues, Challenges, and Examples". Social Media Retrieval, Springer Computer Communications and Networks Series, pp. 393-431. 2013.
  12. W. J. Kooij, H. Stokking, R. van Brandenburg and P-T. de Boer. "Playout Delay of TV Signals: Measurement System Design, Validation and Results". Proceedings of the 2014 ACM International Conference on Interactive Experiences for TV and Online Video. TVX'14, pp. 23-30. Newcastle (UK). June 2014.
  13. D. Mills, J. Martin, J. Burbank and W. Kasch. RFC 5905, Network Time Protocol Version 4: Protocol and Algorithms Specification. Internet Engineering Task Force, Standards Track. June 2010.
  14. F. Boronat, J. Lloret, M. Garcia. "Multimedia Group and Inter-stream Synchronization Techniques: A Comparative Study". Elsevier, Informa- tion Systems 34 (2009), vol. 34, n. 1, pp. 108-131. March 2009.
  15. J. Ridoux and D. Veitch. "Principles of Robust Timing over the Internet". Queue -Emulators, vol. 8, n. 4, pp. 30-43. April 2010.
  16. C. Demichelis and P. Chimero. RFC 3393, IP Packet Delay Variation Metric for IP Performance Metrics (IPPM). Internet Engineering Task Force, Standards Track. November 2002.
  17. V. Paxson, G. Almes, J. Mahdavi and M. Mathis. RFC 2330, Framework for IP Performance Metrics. Internet Task Force, Standards Track. May 1998.
  18. "Timers, Timer Resolution and Development of Efficient Code". Date of access: 12 th August 2015. http://download.microsoft.com/download/ 3/0/2/3027D574-C433-412A-A8B6-5E0A75D5B237/Timer-Resolution. docx. June 2010.
  19. A. S. Tanenbaum and A. Woodhull. "The Minix book. Operating Systems. Design and Implementation". 3 rd Edition. Pearson Prentice Hall. 2006.
  20. D. Tsafrir, Y. Etsion, D. G. Feitelson and S. Kirkpatrick. "System Noise, OS Clock Ticks, and Fine-grained Parallel Applications". In Proceedings of the 19 th Annual International Conference on Supercomputing (ICS '05). ACM, New York, NY, USA, pp. 303-312. 2005.
  21. H. Melvin and L. Murphy. "An Integrated NTP/RTCP Skew Detection Method and Compensation for VoIP Applications". Multimedia and Expo, 2003. ICME'03. 2003 IEEE International Conference on, vol. 2, n., pp. 537-540. July 2003.
  22. ISO/IEC 13818-1. Information Technology. Generic Coding of Mov- ing Pictures and Associated Audio: Systems Recommendation H.222 (2000E). International Standards Organization (ISO/IEC). December 2010.
  23. M. Montagud, F. Boronat, H. Stokking and R. Van Brandemburg. "Inter- destination Multimedia Synchronization: Schemes Use Cases and Stan- dardization". Multimedia Systems, vol. 18, n. 6, pp. 459-482. November 2012.
  24. A. J. Mason and R. A. Salmon. "Factors Affecting Perception of Audio- Video Synchronization in Television". British Broadcasting Corporation. BBC R&D Publications. White Paper WHP176. January 2009.
  25. ITU-R BT.1359. International Telecommunication Union/ITU Radio Communication Sector Relative Timing of Sound and Vision for Broad- casting.
  26. R. Steinmetz. "Human Perception of Jitter and Media Synchronization". Selected Areas in Communications, IEEE Journal on, vol. 14, n. 1, pp. 61-72. January 1996.
  27. ATSC Implementation Subcommittee Finding. Doc. IS-191. "Relative Timing of Sound and Vision for Broadcast Operations". June 2003.
  28. ETSI TR 103 010 v1.1.1 (2007-03). Speech Processing, Transmission and Quality Aspects (STQ); Synchronization in IP Networks-Methods and User Perception.
  29. Y. Bang, J. Han, K. Lee, J. Yoon, J. Joung, S. Yang and J. Rhee. "Wireless Network Synchronization for Multichannel Multimedia Ser- vices". Advanced Communication Technology, 2009. ICAT 2009. 11 th International Conference on, vol. 2, n., pp. 1073-1077. February 2009.
  30. A. C. Begen, T. Akgul and M. Baugher. "Watching Video over the Web: Part 1: Streaming Protocols", IEEE Internet Computing, vol. 15, n. 2, pp. 54-63. March-April 2011.
  31. A. C. Begen, T. Akgul and M. Baugher. "Watching Video over the Web: Part 2: Applications, Standardization, and Open Issues", IEEE Internet Computing, vol. 15, n. 3, pp. 59-63. May-June 2011.
  32. R. Pantos. Internet Engineering Task Force. Internet-draft. HTTP Live Streaming. Draft-pantos-http-live-streaming-16. April 2015.
  33. HTTP Dynamic Streaming. Date of access: 12 August 2015. http://www. adobe.com/ie/products/hds-dynamic-streaming.html
  34. MS-SSTR. Smooth Streaming Protocol v20150630. June 2015.
  35. HbbTV Specification Version 2.0. HbbTV Association. 1 st August 2015.
  36. ETSI TS 102 823 v1.1.1 (2005-11). Technical Specification: Digital Video Broadcasting (DVB); Specification for the Carriage of Synchro- nized Auxiliary Data in DVB Transport Streams. November 2005.
  37. C. Köhnen, C. Köbel and N. Hellhund. "A DVB/IP Streaming Test- bed for Hybrid Digital Media Content Synchronization". Consumer Electronics -Berlin (ICCE-Berlin), 2012 IEEE International Conference on, vol., n., pp. 136-140. September 2012.
  38. J. Whitaker. "DTV Handbook". 3 rd edition. McGraw-Hill, New York. 2001.
  39. ISO/IEC 11172-1. Information Technology. Generic Coding of Moving Pictures and Associated Audio for Digital Storage Media at up to about 1.5Mbits/s. International Standards Organization (ISO/IEC). 1993.
  40. ISO/IEC 13818-2. Information Technology. Generic Coding of Moving Pictures and Associated Audio information: Video (1995E). International Standards Organization (ISO/IEC). International Standards Organization (ISO/IEC). 1995.
  41. O. Avaro, A. Eleftheriadis, C. Herpel, G. Rajan and L. Ward. "MPEG-4 Systems: Overview". Signal Processing: Image Communication, vol. 15, n. 14-15, pp. 281-298. January 2000.
  42. G. Franceschini. "The Delivery Layer in MPEG-4". Signal Processing: Image Communication, vol. 15, n. 4-5, pp. 347-363. January 2000.
  43. C. Herpel and A. Elefthriadis. "MPEG-4 Systems: Elementary Stream Management". Signal Processing: Image Communication, vol. 15, n. 4-5, pp. 299-320. January 2000.
  44. C. Herpel. "Elementary Stream Management in MPEG-4". IEEE Trans- actions on Circuits and Systems for Video Technology, vol. 9, n. 2, pp. 315-324. March 1999.
  45. ISO/IEC 14496-1. Information Technology. Generic Coding of Audio- Visual Objects. Part 1: Systems (2010E). International Standards Organi- zation (ISO/IEC). June 2010.
  46. ISO/IEC 14496-12. Information Technology. Generic Coding of Audio- Visual Objects. Part 12: ISO Base Media File Format. International Standards Organization (ISO/IEC). October 2008.
  47. ISO/IEC 14772-1. Information Technology.Computer graphics and im- age processing. The Virtual Reality Modelling Language. Part 1: Func- tional Specification and UTF-8 Encoding. International Standards Orga- nization (ISO/IEC). December 1997.
  48. A. Zambelli. IIS Smooth Streaming Technical Overview. Technical Report. Microsoft Corporation, March 2009.
  49. R. Fielding, J. Gettys, J. Mogul, H. Frystyk, L. Masinter, P. Leach and T. Berners-Lee. RFC 2616, Hypertext Transfer Protocol -HTTP/1.1. Internet Engineering Task Force, Standards Track. June 1999.
  50. Multimedia Group of Telecom ParisTech. GPAC Group. Date of access: 12 August 2015. http://download.tsi.telecom-paristech.fr/gpac/ DASH CONFORMANCE/TelecomParisTech/
  51. XML Schema Part 2: Datatypes Second Edition. Date of access: 12 August 2015. http://www.w3.org/TR/xmlschema-2/#rf-defn
  52. J. Le Feuvre, J-M. Thiesse, M. Parmentier, M. Raulet, and C. Daguet. 2014. "Ultra High Definition HEVC DASH Data Set". In Proceedings of the 5 th ACM Multimedia Systems Conference (MMSys '14), pp. 7-12. ACM, New York, NY, USA. 2014.
  53. A. Seema, L. Schwoebel, T. Shah, J. Morgan, M. Reisslein. "WVSNP- DASH: Name-Based Segmented Video Streaming". Broadcasting, IEEE Transactions on , vol., n. 99, pp.1. February 2015.
  54. S. Aoki, K. Otsuki and H. Hamada. "Effective Usage of MMT in Broadcasting Systems". Broadband Multimedia Systems and Broadcast- ing (BMSB), 2013 IEEE International Symposium on, vol., n., pp. 1-6. June 2013.
  55. L. Youngkwon, P. Kyungmo, L. Jin Young, S. Aoki and G. Fernando. "MMT: An Emerging MPEG Standard for Multimedia Delivery over the Internet". Multimedia, IEEE, vol. 20, n. 1, pp. 80-85. Jan-March 2013.
  56. Y. Lim. "MMT, New Alternative to MPEG-2 TS and RTP". 2013 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), vol., n., pp. 1-5. June 2013.
  57. S. Kwang-deok, J. Tae-jun, Y. Jeonglu, K. Chang Ki and H. Jinwoo. "A New Timing Model Design for MPEG Media Transport (MMT)".
  58. Broadband Multimedia Systems and Broadcasting (BMSB), 2012 IEEE International Symposium on, vol., n., pp. 1-5. June 2012.
  59. G. Fernando. "MMT: The Next-Generation Media Transport Standard". ZTE Communications. Vol. 10 n. 2, pp. 45-48. June 2012.
  60. U.H. Reimers. "DVB. The Family of International Standards for Digital Video Broadcasting". Proceedings of the IEEE, vol. 94, n. 1, pp. 173-182. January 2006.
  61. A. J. Stienstra. "Technologies for DVB Services on the Internet". Proceedings of the IEEE. vol. 94 n. 1, pp. 228-236. January 2006.
  62. ETSI TS 101 154 v1.11.1 (2012-11). Digital Video Broadcasting (DVB);
  63. Specification for the use of Video and Audio Coding in Broadcasting Applications based on the MPEG-2 Transport Stream. November 2012.
  64. ETSI EN 300 468 v1.14.1 (2014-01). Digital Video Broadcasting (DVB); Specification for Service Information (SI) in DVB systems. January 2014.
  65. ETSI TR 101 211 v1.11.2 (2012-05). Digital Video Broadcasting (DVB); Guidelines on Implementation and Usage of Service Information (SI). May 2012.
  66. W. Fischer. "Digital Video and Audio Broadcasting Technology. A Practical Engineering Guide". Signals and Communication Technology. A practical Engineering Guide, 2 nd edition Berlin: Springer. 2008.
  67. C. Concolato, S. Thomas, R. Bouqueau and J. Le Feuvre. "Synchro- nized Delivery of Multimedia Content over Uncoordinated Broadcast Broadband Networks". In Proceedings of the 3 rd Multimedia Systems Conference (MMSys '12). ACM, New York, NY, USA, 227-232. 2012.
  68. C. Howson, E. Gautier, P. Gilberton, A. Laurent and Y. Legallais. "Second Screen TV Synchronization". IEEE International Conference on Consumer Electronics, vol., n., pp. 361-365. Berlin. September 2011
  69. J. Le Feuvre and C. Concolato. "Hybrid Broadcast Services Using MPEG DASH". Proceedings of the Media Synchronization Workshop 2013. Nantes (France). October 2013.
  70. R. Brandenburg and A. Veenhuizen. "Immersive Second-screen Experi- ences Using Hybrid Media Synchronization". Proceedings of the Media Synchronization Workshop 2013. Nantes (France). October 2013.
  71. A. Veenhuizen and R. van Brandenburg. "Frame Accurate Media Synchronization of Heterogeneous Media Sources in an HBB Context". Proceedings of the Media Synchronization Workshop 2012. Berlin (Ger- many). October 2012.
  72. C. Köhnen, N. Hellhund, J. Renz and J. Müller. "Inter-Device and Inter-Media Synchronization in HBB-NEXT". Proceedings of the Media Synchronization Workshop 2013. Nantes (France). October 2013.
  73. HBB-Next, Deliverable D.4.3.1, Evaluation: Intermediate Middleware Software Components for Content Synchronization. May 2013. www. hbb-next.ue/documents/HBB-NEXT D4.3.1.pdf
  74. Information Technology Generic Coding of Moving Pictures and Associated Audio Information. Amendment 1: Delivery of timeline for external data. Recommendation ITU-T H.222.0 (2014) Amendment 1. April 2015.
  75. G. Goldberg. "IPTV-ID-0087. RTP/UDP/MPEG-2 TS as a means of transmission for IPTV Streams". International Telecommunication Union (ITU). Telecommunication Standardization Sector, Study Period 2005- 2008. Source: Cisco System Inc. USA.
  76. A. MacAulay, B. Felts, Y. Fisher. IP Streaming of MPEG-4: Native RTP vs MPEG-2 Transport Stream. White paper. Envivio. October 2005.
  77. F. Boronat, J.C.G. Guerri Cebollada and J. L. Mauri. "An RTP/RTCP Based Approach for Multimedia Group and Inter-stream Synchroniza- tion". Multimedia Tools and Applications. vol. 40, n. 2, pp. 285-319. November 2008.
  78. Y. Kikuchi, T. Nomura, S. Fukunaga, Y. Matsui and H. Kimata. RFC 3016, RTP Payload Format for MPEG-4 Audio/Visual Streams. Internet Engineering Task Force, Standards Track. November 2000.
  79. D. Hoffman, G. Fernando, V. Goyal and M. Civanlar. RFC 2250, RTP Payload Format for MPEG-1/MPEG-2 Video. Internet Engineering Task Force, Standards Track. January 1998.
  80. J. van der Meer, D. Mackie, V. Swaminathan, D. Singer and P. Gentric. RFC3640, RTP Payload for Transport of MPEG-4 Elementary Streams. Internet Engineering Task Force, Standards Track. November 2003.
  81. C. Zhu. RFC 2190, RTP Payload Format for H.263 Video Streams. Internet Engineering Task Force, Standards Track. September 1997.
  82. Y. -K. Wang, R. Even, T. Kristensen and R. Jesup. RFC 6184, RTP Payload Format for H.264 Video. Internet Engineering Task Force, Standards Track. May 2011.
  83. S. Wenger, Y. -K. Wang, T. Schierl and A. Eleftheriadis. RFC 6190, RTP Payload for Scalable Video Coding. Internet Engineering Task Force, Standards Track. May 2011.
  84. A. Basso, G. L. Cash, M. R. Civanlar. "Real-Time MPEG-2 Delivery Based on RTP: Implementation issues". Signal Processing: Image Com- munication, vol. 15, n. 1-2, pp. 165-178. September 1999.
  85. A. Basso, S. Varakliotis. "Transport of MPEG-4 over IP/RTP". Transac- tions on Emerging Telecommunications Technologies, vol. 12, n. 3, pp. 247-255. June 2001.
  86. R. van Brandenburg, H. Stokking, O. van Deventer, F. Boronat, M. Mon- tagud and K. Gross. RFC7272, Inter-destination Media Synchronization (IDMS) using the RTP Control Protocol (RTCP). Internet Engineering Task Force, Standards Track. June 2014.
  87. M. Montagud and F. Boronat. "RTP/RTCP and Media Sync: A Review and Discussion of Future Work". Proceedings of the Media Synchroniza- tion Workshop 2013. Nantes (France). October 2013.
  88. M. Montagud, F. Boronat, H. Stokking and P. Cesar. "Design, Develop- ment and Assessment of Control Schemes for IDMS in a Standardized RTCP-based Solution", vol. 70, n., pp. 240-259. September 2014.
  89. L. Beloqui Yuste and H. Melvin. "Enhanced IPTV Services through Time Synchronization". The 14 th IEEE International Symposium on Consumer Electronics (ISCE) Braunschweig. June 2010.
  90. L. Beloqui Yuste and H. Melvin. "Interactive Multi-source Media Synchronisation for HbbTV. Proceedings of the Media Synchronization Workshop. Berlin (Germany). October 2012.
  91. M. de Castro, D. Carrero, L. Puente and B. Ruiz. "Real-Time Subtitles Synchronization in Live Television Programs". Broadband Multimedia Systems and Broadcasting (BMSB), 2011, IEEE 6 th International Sym- posium on. vol., n., pp. 1-6. June 2011.
  92. P. Neumann, J. Qi and V. Reimers. "Seamless Delivery Network Switch- ing in Dynamic Broadcast Terminal Aspects". 2011 IEEE International Symposium on Broadcast Multimedia Systems and Broadcasting. June 2011.
  93. P. Neumann and U. Reimers. "Live and Time-shifted Content Delivery for Dynamic Broadcast: Terminal Aspects". Consumer Electronics, IEEE Transactions on, vol. 58, n. 1, pp. 53-59. February 2012.
  94. C. Concolato, J. Le Feuvre and R. Bouqueau. "Usages of DASH for Rich Media Services". In Proceedings of the 2 nd Annual ACM Conference on Multimedia Systems (MMSys '11). vol., n., pp. 265-270. New York, USA. 2011.
  95. K. Matsumura, M. J. Evans, Y. Shishikui and A. McParland. "Person- alization of Broadcast Programs using Synchronized Internet Content". Consumer Electronics (ICCE), 2010 Digest of Technical Papers Interna- tional Conference on, pp. 145-146. January 2010.
  96. M. Armstrong, J. Barret and M. Evans. "Enabling and Enriching Broadcast Services by Combining IP and Broadcast Delivery". British Broadcasting Corporation. BBC R&D Publications. White Paper WHP 185, September 2010.
  97. U. Rauschenbach, W. Putz. P. Wolf and R. Mies and G. Stoll. "A Scalable Interactive TV Service Supporting Synchronised Delivery over Broadcast and Broadband Networks". International Broadcasting Convention, IBC Conference. September 2004.
  98. S. Aoki, K. Aoki, H. Hamada and Y. Kanatsugu. "A New Transport Scheme for Hybrid Delivery of Content over Broadcast and Broadband". 2011 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), pp. 1-6. June 2011.
  99. A. Lykourgiotis, K. Birkos, T. Dagiuklas, E. Ekmekcioglu, S. Dogan, Y. Yildiz, I. Politis, G. O. Tanik, B. Demirtas, A. M. Kondoz and S. Kotsopoulos. "Hybrid Broadcast and Broadband Networks Convergence for Immersive TV Applications". Wireless Communications, IEEE, vol. 21, n. 3, pp. 62-69. June 2014.
  100. J. Le Feuvre and C. Concolato. "Hybrid Broadcast Services Using MPEG DASH". Proceedings of the Media Synchronization Workshop 2013. Nantes (France). October 2013.
  101. S. H. Kim, C. Lee, S. Kang, K. Seo and T. Jung. "Timing Control for Synchronizing Multimedia Streaming over Heterogeneous Networks". Advanced Communication Technology (ICACT), 2013 15 th International Conference on, vol., n., pp. 260-263. January 2013.
  102. J. Le Feuvre, V. NGuyen, W. Hammidouche, P. Marchal and P. Dupain. "A Test Bed for Hybrid Broadcast Broadband Services". Proceedings of the Media Synchronization Workshop 2015 with ACM TVX 2015. Brussels (Belgium). June 2015.
  103. Lourdes Beloqui Yuste Lourdes Beloqui Yuste is currently an Engineer at Ericsson, Ireland. Received her PhD in Information Technology for NUI Galway, Ireland, in September 2015. She received a Master in Software Design and Development in NUI Galway, Ireland, in 2009. She graduated from 'Universitat Rovira i Virgili', Tarragona (Spain). Fernando Boronat Fernando Boronat (M93, SM11), received the M.E. and Ph.D. degrees in telecommunication engineering from the Universitat Politècnica de València (UPV), València, Spain, in 1994 and 2014, respec- tively. After working for several Spanish Telecommunication Companies, he moved back to the UPV in 1996. He is an Assistant Professor in the Communications Department at the Gandia Campus where he is the head of the Immersive Interactive Media R&D group. His main topics of interest are Communication Networks, Multimedia Systems, Multimedia Protocols and Synchronization. He is involved in several IPCs of national and international journals and conferences. Webpage: http://personales.upv.es/fboronat/Research/index investig en.html Mario Montagud Mario Montagud (M09) was born in Montitxelvo (Spain). He studied Telecommunications Engineering at UPV (Polytechnic University of València), in Spain, and obtained the PhD degree from the same university in March 2015. Since then, he is a 1-year ERCIM postdoc fellow at CWI (The National Research Institute for Mathematics and Computer Science in the Netherlands). His topics of interest include Computer Networks, Interactive and Immersive Media, Synchronization and QoE (Quality of Experience). Mario is (co-) author of over 30 scientific and teaching publications, and has contributed to standardization within the IETF (Internet Engineering Task Force). He is member of the Technical Committee of several international conferences, co-organizer of the international MediaSync Workshop series, and member of the Editorial Board of international journals. Webpage: https: //sites.google.com/site/mamontor/ Hugh Melvin Dr. Hugh Melvin is based at the Discipline of Information Technology, NUI, Galway. His research scope extends to Internet Multimedia QoS & QoE, Timing Systems, Wireless Technologies, Cybersecurity for Critical Infrastructure, and Energy & Environmental Informatics. Prior to NUI, Galway, he worked for 9 years in Power Engineering. He serves as CoChair on the US NIST Cyber Physical Systems Academic Timing group www.cpspwg.org and is a member of the steering group for the Time Awareness in Applications, Computers, and Communication Systems interest group www.taaccs.org, and the Industry-based Timing conference International Telecommunications Synchronisation Forum. Graduated with a B.E from UCD in 1988, an MBA from University of Limerick in 1997, a Research M.Sc from NUI Galway in 2000, and a PhD from University College Dublin in 2004.

Related papers

Inter-destination multimedia synchronization: schemes, use cases and standardization
H. Stokking

Multimedia Systems, 2012

Traditionally, the media consumption model has been a passive and isolated activity. However, the advent of media streaming technologies, interactive social applications, and synchronous communications, as well as the convergence between these three developments, point to an evolution towards dynamic shared media experiences. In this new model, geographically distributed groups of consumers, independently of their location and the nature of their end-devices, can be immersed in a common virtual networked environment in which they can share multimedia services, interact and collaborate in real-time within the context of simultaneous media content consumption. In most of these multimedia services and applications, apart from the well-known intra and inter-stream synchronization techniques that are important inside the consumers' playout devices, also the synchronization of the playout processes between several distributed receivers, known as multipoint, group or Inter-destination multimedia synchronization (IDMS), becomes essential. Due to the increasing popularity of social networking, this type of multimedia synchronization has gained in popularity in recent years. Although Social TV is perhaps the most prominent use case in which IDMS is useful, in this paper we present up to 19 use cases for IDMS, each one having its own synchronization requirements. Different approaches used in the (recent) past by researchers to achieve IDMS are described and compared. As further proof of the significance of IDMS nowadays, relevant organizations' (such as ETSI TISPAN and IETF AVTCORE Group) efforts on IDMS standardization (in which authors have been and are participating actively), defining architectures and protocols, are summarized.

View PDFchevron_right
Multimedia and Multi-Stream Synchronization
Fuhua Lin

Techniques and Applications, 2003

View PDFchevron_right
From IPTV to synchronous shared experiences challenges in design: Distributed media synchronization
David Geerts

Signal Processing: …, 2011

View PDFchevron_right
A Reliable Scheme for Synchronizing Multimedia Data Streams under Multicasting Environment
jawad shafi

Applied Sciences, 2018

An emerging requirement in multimedia applications over the Internet is the provisioning of synchronized play out of multimedia streams on all the ultimate receivers. Most multimedia applications use real-time transport protocol/real-time control protocol (RTP/RTCP) to transport multimedia data over the internet. Internet Protocol (IP) network incurs a loss and/or delay of media packets resulting in distortions at receivers that can be perceived by the user. These distortions need to be removed before data is presented to the end user. To handle such issues inter-stream and intra-stream synchronization algorithms were developed by the researcher using RTP/RTCP protocols. These schemes could not work under multicasting environment properly. In this paper, we have presented an algorithm based on RTP/RTCP protocol that achieved synchronized playout of multimedia data under multicasting environment. The proposed scheme offers a modification in RTCP and usage of the Network Time Protocol (NTP) as a source of the common clock to achieve synchronized playout of multimedia data on multiple devices at the same time. We have implemented and tested our algorithm in Ericson Research Corporate Unit, Lulea, Sweden. Implementation results show that the proposed algorithm delivered accurately synchronized playout of multimedia data under all the possible scenarios defined in the experimental setup.

View PDFchevron_right
Intrastream synchronization for continuous media streams: a survey of playout schedulers
Nikolaos Laoutaris

IEEE Network, 2002

The transmission of real-time streams over best-effort networks has been an interesting research area for over a decade. An important objective of the research community has been to devise methods that cope with the variations of the network delay-also called delay jitter-that are an inherent characteristic of best-effort networks. Jitter destroys the temporal relationships between periodically transmitted media units (MUs) that constitute a real-time media stream, thus hindering the comprehension of the stream. Playout adaptation algorithms undertake the labor of the temporal reconstruction of the stream, which is sometimes referred to as the restoration of its intrastream synchronization quality. This paper surveys the work in the area of playout adaptation, aiming to concisely organize ideas that have been presented in isolation and identify the main points of differentiation amongst different schemes. The survey discusses issues related to the timing information, the handling of late media units, the quality evaluation metrics, and the adaptation to changing delay conditions.

View PDFchevron_right

Related topics

  • Management
  • Computer Science
  • Distributed Computing
  • Electrical and Electronic Engine...
  • MPEG-DASH
    • 580 California St., Suite 400
    San Francisco, CA, 94104
    © 2025 Academia. All rights reserved