path: root/audio
diff options
authorwm4 <wm4@nowhere>2017-12-30 13:14:15 +0100
committerKevin Mitchell <>2018-01-01 23:17:56 -0800
commit33e5755c230c009119ac22282b74ac33451df2a9 (patch)
treecd3267c56aabfa453f6b3134c4b6c434a13bb13e /audio
parent2dd020efc297454fb50ddef0eb56db17e33530a0 (diff)
video, audio: always read all frames before getting next packet
The old code tried to make sure at all times to try to read a new packet. Only once that was read, it tried to retrieve new video or audio frames the decoder might already have decoded. Change this to strictly read frames from the decoder until it signals that it wants a new packet, and only then read and feed a new packet. This is in theory nicer, follows the libavcodec recommended data flow, and and reduces the minimum latency by 1 frame. This merely requires switching the order in which those calls are done. Normally, the decoder will return only 1 frame until a new packet is required. If we would just feed it 1 packet, return DATA_AGAIN, and wait until the next frame is decoded, we would run the playloop 1 time too often for no reason (which is fine but might have some overhead). To avoid this, try to read a frame again after possibly feeding a packet. For this reason, move the feed/read code to its own functions each, instead of merely moving the code. The audio and video code for this particular thing is basically duplicated. The idea is to unify them one day, so make the change to both. (Doing this for video is the real motivation for this change, see below.) The video code change is slightly more complicated, because we have to care about the framedrop counting (which is just a heuristic, but for now considered better than nothing, and possibly considered required to warn the user of framedrops happening - maybe). Apparently this change helps with stalling streams on Android with the mediacodec wrapper and mpeg2 decoder implementations which deinterlace on decoding (and return 2 frames per packet). Based on an idea and observations by tmm1.
Diffstat (limited to 'audio')
1 files changed, 18 insertions, 1 deletions
diff --git a/audio/decode/dec_audio.c b/audio/decode/dec_audio.c
index 5eca89b1e2..cd83cfd55e 100644
--- a/audio/decode/dec_audio.c
+++ b/audio/decode/dec_audio.c
@@ -202,7 +202,7 @@ static bool is_new_segment(struct dec_audio *da, struct demux_packet *p)
(p->start != da->start || p->end != da->end || p->codec != da->codec);
-void audio_work(struct dec_audio *da)
+static void feed_packet(struct dec_audio *da)
if (da->current_frame || !da->ad_driver)
@@ -228,6 +228,14 @@ void audio_work(struct dec_audio *da)
da->packet = NULL;
+ da->current_state = DATA_AGAIN;
+static void read_frame(struct dec_audio *da)
+ if (da->current_frame || !da->ad_driver)
+ return;
bool progress = da->ad_driver->receive_frame(da, &da->current_frame);
da->current_state = da->current_frame ? DATA_OK : DATA_AGAIN;
@@ -271,6 +279,15 @@ void audio_work(struct dec_audio *da)
+void audio_work(struct dec_audio *da)
+ read_frame(da);
+ if (!da->current_frame) {
+ feed_packet(da);
+ read_frame(da); // retry, to avoid redundant iterations
+ }
// Fetch an audio frame decoded with audio_work(). Returns one of:
// DATA_OK: *out_frame is set to a new image
// DATA_WAIT: waiting for demuxer; will receive a wakeup signal