Academia.eduAcademia.edu

Figure 3 – uploaded by Rodrigo Laiola Guimaraes

See full PDFdownloadDownload figure
Figure 3. Alignment scenarios when playing audiovisual content together with subtitle documents downloaded from the Internet.

Figure 3 Alignment scenarios when playing audiovisual content together with subtitle documents downloaded from the Internet.

Related Figures (8)

Figure 1. Playback of audiovisual content together with subtitle documents using a local media player: a) subtitle entries with perfect timing and b) shifted dt seconds. Screenshots extracted from “Ridley Scott + IBM Watson: A Conversation”. Available at https://youtu.be/KDtxQRH8al4. Take Figure 1 as an example. Here, we illustrate the playback of 2 subtitle documents with the corresponding audiovisual content (track in light blue with dot pattern). Figure 1.a represents the ideal scenario where subtitle entries (in yellow with line pattern) are perfectly synchronized with the base content. On the other hand, in Figure 1.b the timing of all subtitle entries (in orange with line pattern) are shifted Ot seconds. Note that this latter
Figure 1. Playback of audiovisual content together with subtitle documents using a local media player: a) subtitle entries with perfect timing and b) shifted dt seconds. Screenshots extracted from “Ridley Scott + IBM Watson: A Conversation”. Available at https://youtu.be/KDtxQRH8al4. Take Figure 1 as an example. Here, we illustrate the playback of 2 subtitle documents with the corresponding audiovisual content (track in light blue with dot pattern). Figure 1.a represents the ideal scenario where subtitle entries (in yellow with line pattern) are perfectly synchronized with the base content. On the other hand, in Figure 1.b the timing of all subtitle entries (in orange with line pattern) are shifted Ot seconds. Note that this latter
Figure 2. Typical SRT document shared online. Each subtitle entry includes a sequence number (in black), the time the text should appear and disappear (in red, left and right side of the ‘-->’ token, respectively), and the textual content (in blue). WebVIT® (Web Video Text Tracks Format) is a technology introduced in HTMLS that can be used to display timed text tracks with the HTMLS5 <track> element alongside <video> elements. The file is text-based and contains essentially (i) a header, (ii) a sequence of subtitle entries, and (iii) empty lines. Subtitle entries have a numerical identification, starting and ending times, and a textual payload. This format also admits text-formatting settings such as text direction (e.g., left to right or the other way round), rendering position, text size and alignment, and bold/italic/underlined tags, to name a few. WebVTT also supports comments by starting a line with the string “NOTE”. Said lines are not rendered on the screen.
Figure 2. Typical SRT document shared online. Each subtitle entry includes a sequence number (in black), the time the text should appear and disappear (in red, left and right side of the ‘-->’ token, respectively), and the textual content (in blue). WebVIT® (Web Video Text Tracks Format) is a technology introduced in HTMLS that can be used to display timed text tracks with the HTMLS5 <track> element alongside <video> elements. The file is text-based and contains essentially (i) a header, (ii) a sequence of subtitle entries, and (iii) empty lines. Subtitle entries have a numerical identification, starting and ending times, and a textual payload. This format also admits text-formatting settings such as text direction (e.g., left to right or the other way round), rendering position, text size and alignment, and bold/italic/underlined tags, to name a few. WebVTT also supports comments by starting a line with the string “NOTE”. Said lines are not rendered on the screen.
Algorithm 2 Subtitle adjustment algorithm
Algorithm 2 Subtitle adjustment algorithm
Figure 4. General framework in two steps: (a) enrichment of subtitle document with representative audio fingerprint annotations and (b) dynamic adjustment of subtitle entries based on fingerprints comparison.
Figure 4. General framework in two steps: (a) enrichment of subtitle document with representative audio fingerprint annotations and (b) dynamic adjustment of subtitle entries based on fingerprints comparison.
Note: the symbol ‘-’ applies either when a synchronization anchor is not found or when there is no need to use it. Table 1. Adjustment actions in different scenarios.
Note: the symbol ‘-’ applies either when a synchronization anchor is not found or when there is no need to use it. Table 1. Adjustment actions in different scenarios.
Figure 6. Processing power demands to process audio fingerprints and to decode video and audio streams.
Figure 6. Processing power demands to process audio fingerprints and to decode video and audio streams.
Related topics:
Audiovisual Translation (subtitling)Multimedia Synchronization
580 California St., Suite 400
San Francisco, CA, 94104
© 2025 Academia. All rights reserved