Academia.eduAcademia.edu

Figure 4 – uploaded by faustin uwizeyimana

See full PDFdownloadDownload figure
Fig. 4. Scenario of frame-skipping control. to prevent buffer overflow, is its major drawback. Note that since our rate control is a GOP basis, the insertion of I-frame can be viewed as the resume of another GOP round, thus our rate control still applicable. linear regression technique, the two model parameters .¥; and X» can be obtained as Step 2—Calculation of the Model Parameters X, and Xo: Based on these two values, the theoretical target bit rate can be calculated for each data point within the sliding window ob- tained in step 1. For those selected data points, the encoder col- lects quantization levels and actual bit-rate statistics. Using a

Figure 4 Scenario of frame-skipping control. to prevent buffer overflow, is its major drawback. Note that since our rate control is a GOP basis, the insertion of I-frame can be viewed as the resume of another GOP round, thus our rate control still applicable. linear regression technique, the two model parameters .¥; and X» can be obtained as Step 2—Calculation of the Model Parameters X, and Xo: Based on these two values, the theoretical target bit rate can be calculated for each data point within the sliding window ob- tained in step 1. For those selected data points, the encoder col- lects quantization levels and actual bit-rate statistics. Using a

Related Figures (12)

Fig. 1. Layer structure of a network-based multimedia system.
Fig. 1. Layer structure of a network-based multimedia system.
Fig. 2. Block diagram of the proposed SRC. A. Scalable Quadratic Rate Distortion Model
Fig. 2. Block diagram of the proposed SRC. A. Scalable Quadratic Rate Distortion Model
Fig. 3. Distribution of the bit-count difference.
Fig. 3. Distribution of the bit-count difference.
‘ig. 6. Block diagram of the proposed MB-level rate control. count difference is depicted in Fig. 3, where the X-axis denotes the bit-count difference of a coded P frame from the average coding bit count in a sequence or GOP, while the Y-axis denotes the number of P frames. In this example, the average bit count for a P-frame is calculated as (24 kbits «10 sec —1 kbit)/100 frames = 2.39 kbits, given 1 kbit is used for coding the first frame. If the target buffer level is in the middle level (i.e., 2 kbits), then the encoder has a upper or lower half of 6/2.39 frames for buffering any sudden bit count increasing, or de- creasing, respectively. Considering the buffer-overflow case, if a threshold value is properly set, then there is only a slight chance of overflowing the buffer. In this case, if the threshold is set as 80% of the buffer size (i.e., 4.8 kbits), the consecutive frame skipping occurs very rarely from the statstical viewpoint. This empirical assumption by setting a proper threshold demon- strates although our predictive frame-skipping scheme cannot guarantee no consecutive frame skipping occurring; however, there exist fairly high confidence that consecutive frame skip- ping rarely occurs. then the target bit rate is recalculated based on the new mode parameters. By applying this statistical technique, more repre sentative data are selected, and the final model parameters cai be derived based on new data. Note that, to avoid the remova of all data points, the latest data point is always selected in th data set. Ideally, if the input bit rate to the bufferis equal to the channel output rate, then the buffer fullness will keep its middle level, which is the target buffer level. Otherwise, it changes its full- ness upwards or downwards which may potentially cause buffer overflow or underflow, respectively. To effectively prevent the buffer overflow without losing overall video quality d ue to con- tinuous frame skipping, we proposed a predictive frame-skip- ping control. By setting asafety threshold, if an encoder predicts to have a potential buffer overflow, then it skips next frame (ob- ject) and subtracts the buffer fullness from the channel output rate. The safety threshold is selected based on the distribution of bit-count difference of a predicted frame (object from the average bit count of coded frame (object) in a video sequence or GOP. For example, a containership video sequence with 300 qcif frames is coded as the first I-frame and subsequent P-frame coding pattern at 10 fps and 24 kbits/s. Its distribution of the bit-
‘ig. 6. Block diagram of the proposed MB-level rate control. count difference is depicted in Fig. 3, where the X-axis denotes the bit-count difference of a coded P frame from the average coding bit count in a sequence or GOP, while the Y-axis denotes the number of P frames. In this example, the average bit count for a P-frame is calculated as (24 kbits «10 sec —1 kbit)/100 frames = 2.39 kbits, given 1 kbit is used for coding the first frame. If the target buffer level is in the middle level (i.e., 2 kbits), then the encoder has a upper or lower half of 6/2.39 frames for buffering any sudden bit count increasing, or de- creasing, respectively. Considering the buffer-overflow case, if a threshold value is properly set, then there is only a slight chance of overflowing the buffer. In this case, if the threshold is set as 80% of the buffer size (i.e., 4.8 kbits), the consecutive frame skipping occurs very rarely from the statstical viewpoint. This empirical assumption by setting a proper threshold demon- strates although our predictive frame-skipping scheme cannot guarantee no consecutive frame skipping occurring; however, there exist fairly high confidence that consecutive frame skip- ping rarely occurs. then the target bit rate is recalculated based on the new mode parameters. By applying this statistical technique, more repre sentative data are selected, and the final model parameters cai be derived based on new data. Note that, to avoid the remova of all data points, the latest data point is always selected in th data set. Ideally, if the input bit rate to the bufferis equal to the channel output rate, then the buffer fullness will keep its middle level, which is the target buffer level. Otherwise, it changes its full- ness upwards or downwards which may potentially cause buffer overflow or underflow, respectively. To effectively prevent the buffer overflow without losing overall video quality d ue to con- tinuous frame skipping, we proposed a predictive frame-skip- ping control. By setting asafety threshold, if an encoder predicts to have a potential buffer overflow, then it skips next frame (ob- ject) and subtracts the buffer fullness from the channel output rate. The safety threshold is selected based on the distribution of bit-count difference of a predicted frame (object from the average bit count of coded frame (object) in a video sequence or GOP. For example, a containership video sequence with 300 qcif frames is coded as the first I-frame and subsequent P-frame coding pattern at 10 fps and 24 kbits/s. Its distribution of the bit-
Fig. 7. Frame-level rate control: the buffer occupancy for various test conditions. SVORC: (a) silent_qcei f at 10 fps and 24 khits/s; (b) hall_qei f at 7.5 fps and 10 kbits/s; (c) mad _gqei f at 10 fps and 24 kbits/s; (d) madl_qcei f at 7.5 fps and 10 kbits/s; (e) news _cif at 15 fps and 112 kbits/s. (f) news_cif at 7.5 fps and 48 kbits/s.
Fig. 7. Frame-level rate control: the buffer occupancy for various test conditions. SVORC: (a) silent_qcei f at 10 fps and 24 khits/s; (b) hall_qei f at 7.5 fps and 10 kbits/s; (c) mad _gqei f at 10 fps and 24 kbits/s; (d) madl_qcei f at 7.5 fps and 10 kbits/s; (e) news _cif at 15 fps and 112 kbits/s. (f) news_cif at 7.5 fps and 48 kbits/s.
Ae Ae >BR EXPERIMENTAL RESULTS OF THE FRAME-LEVEL RATE CONTROL termined threshold, called the safety margin, for instance 80% of the buffer size, the next frame will be skipped. Note that the safety margin is used to reduce continuous frame skipping and can be adaptively changed based on the content, or a pre-deter- mined constant for simplicity. An example, as shown in Fig. 4, demonstrates our frame-skipping control. Before encoding the frame i + 2, the encoder uses the actual bit count used for the frame i + 1 to predict the next frame i + 2. Then the buffer occupancy will exceed 80% of the buffer size, resulting in skip- ping the frame i + 2 and decreasing the buffer occupancy by the channel output rate. The frame-skipping condition can be for- mulated as follows. However, this simple scheme suffers several serious problems. For example, the background VO may have bits left unused, while the foreground VO requires more. Therefore, we propose a new bit-allocation method to adaptively adjust the bit budget for each VO. Based on the coding complexity and perceptual importance, the distribution of the bit budget is proportional to the square of MAD of aVO, which is obtained empirically [27]. As long as the target bit rate is known at the frame level, say R,, the target bit rate for VO ¢ at time ¢, V;, is
Ae Ae >BR EXPERIMENTAL RESULTS OF THE FRAME-LEVEL RATE CONTROL termined threshold, called the safety margin, for instance 80% of the buffer size, the next frame will be skipped. Note that the safety margin is used to reduce continuous frame skipping and can be adaptively changed based on the content, or a pre-deter- mined constant for simplicity. An example, as shown in Fig. 4, demonstrates our frame-skipping control. Before encoding the frame i + 2, the encoder uses the actual bit count used for the frame i + 1 to predict the next frame i + 2. Then the buffer occupancy will exceed 80% of the buffer size, resulting in skip- ping the frame i + 2 and decreasing the buffer occupancy by the channel output rate. The frame-skipping condition can be for- mulated as follows. However, this simple scheme suffers several serious problems. For example, the background VO may have bits left unused, while the foreground VO requires more. Therefore, we propose a new bit-allocation method to adaptively adjust the bit budget for each VO. Based on the coding complexity and perceptual importance, the distribution of the bit budget is proportional to the square of MAD of aVO, which is obtained empirically [27]. As long as the target bit rate is known at the frame level, say R,, the target bit rate for VO ¢ at time ¢, V;, is
VBR EXPERIMENTAL RESULTS OF THE FRAME- LEVEL RATE CONTROL
VBR EXPERIMENTAL RESULTS OF THE FRAME- LEVEL RATE CONTROL
EXPERIMENTAL RESULTS OF MULTIPLE VO’S RATE CONTROL
EXPERIMENTAL RESULTS OF MULTIPLE VO’S RATE CONTROL
Fig. 8. Object-level rate control: the buffer occupancy for various test conditions. MVORC: (a) akiyo,ci f at 10 fps and 24 kbits/s; (b) akiyo_qcei f at 15 fps anc 64 kbits/s; (c) coastguard, ci f at 10 fps and 48 kbits/s; (d) news _ci f at 15 fps and 192 khits/s. (e) container, ci f at 10 fps and 24 kbits/s. (f) container _qci f at 15 fps and 64 kbits/s.
Fig. 8. Object-level rate control: the buffer occupancy for various test conditions. MVORC: (a) akiyo,ci f at 10 fps and 24 kbits/s; (b) akiyo_qcei f at 15 fps anc 64 kbits/s; (c) coastguard, ci f at 10 fps and 48 kbits/s; (d) news _ci f at 15 fps and 192 khits/s. (e) container, ci f at 10 fps and 24 kbits/s. (f) container _qci f at 15 fps and 64 kbits/s.
Fig. 9. MB-level rate control: the buffer occupancy for various test conditions under the maximum accumulated delays are 500 ms (left column) and 250 ms (right column). (a), (b): MBRC coastguard _qci f at 10 fps and 24 kbits/s. (c), (d): MBRC container_qcei f at 10 fps and 24 kbits/s. (e), (f): mad_gqei f at 10 fps and 24 kbits/s.
Fig. 9. MB-level rate control: the buffer occupancy for various test conditions under the maximum accumulated delays are 500 ms (left column) and 250 ms (right column). (a), (b): MBRC coastguard _qci f at 10 fps and 24 kbits/s. (c), (d): MBRC container_qcei f at 10 fps and 24 kbits/s. (e), (f): mad_gqei f at 10 fps and 24 kbits/s.
EXPERIMENTAL RESULTS OF MB-LAYER RATE CONTROL GIVEN THE MAXIMUM ACCUMULATED DELAYS ARE 500 AND 125 MS TABLE IV
EXPERIMENTAL RESULTS OF MB-LAYER RATE CONTROL GIVEN THE MAXIMUM ACCUMULATED DELAYS ARE 500 AND 125 MS TABLE IV
Fig. 9. (Continued). MB-level rate control: the buffer occupancy for various test conditions under the maximum accumulated delays are 500 ms (left column) and 250 ms (right column). (g), (h): news _ci f at 7.5 fps and 192 kbits/s. (i), (j): silent_qei f at 10 fps and 24 kbits/s. (i), (j): silent_qcei f at 10 fps and 24 kbits/s.
Fig. 9. (Continued). MB-level rate control: the buffer occupancy for various test conditions under the maximum accumulated delays are 500 ms (left column) and 250 ms (right column). (g), (h): news _ci f at 7.5 fps and 192 kbits/s. (i), (j): silent_qei f at 10 fps and 24 kbits/s. (i), (j): silent_qcei f at 10 fps and 24 kbits/s.
Related topics:
Image ProcessingVideo CompressionAdaptive Signal ProcessingVideo ObjectSliding mode controlLow LatencyMultimedia ApplicationElectrical and Electronic EngineeringAdaptive Thresholding
580 California St., Suite 400
San Francisco, CA, 94104
© 2025 Academia. All rights reserved