[LG 2019/2020] Freezing SSAI live stream

[mkochman]

Hi 👋
so far it is noticed only for LG from 2019/2020, SSAI live stream during playing, directly before the dynamic ad break starts freezes, RX is trying to start next part of the stream but it gets stuck in buffering, video screen blinks black screen, then goes back to frozen last stream frame, it does that multiple times, then after about 2min(more and less) ad break starts, then it works smooth untill next ad break start.
It is reproducible on RX 4.3.0, 4.4.0, 4.4.1, I've also tried different RX configs like lowLatencyMode, enableFastSwitching, setting buffer values without success. Also, I've tried forcing a single quality setting during playback.

Part of debug logs

console.ts:40 SI: current video inventory timeline:
6417843.96|A|6417848.44 ~ 6417848.44|B|6417871.48
[A] P: 1671377 || R: 5(2960000)
[B] P: yo-1.0.1 || R: 5(2960000)
console.ts:40 ABR: new bandwidth estimate bitrate=2960000 representation="5"
console.ts:40 Stream: new video bitrate estimate received from ABR bitrate=11280142.36169056
console.ts:40 media: Current media element state tick. evt="timeupdate" position=6417846.844 seeking=1 internalSeek=true rebuffering=true freezing=false ended=false paused=true playbackRate=0 readyState=1 pendingPosition=null
console.ts:40 media: current playback timeline:
6417843.96|==27.52==|6417871.48
                ^6417846.844 
timeupdate
console.ts:40 SI: synchronizing video buffered ranges: 6417843.96-6417871.48
console.ts:40 SI: current video inventory timeline:
6417843.96|A|6417848.44 ~ 6417848.44|B|6417871.48
[A] P: 1671377 || R: 5(2960000)
[B] P: yo-1.0.1 || R: 5(2960000)
console.ts:40 SI: synchronizing audio buffered ranges: 6417843.954667-6417875.362666
console.ts:40 SI: current audio inventory timeline:
6417843.95|A|6417848.43 ~ 6417848.43|B|6417875.36
[A] P: 1671377 || R: 4(129327)
[B] P: yo-1.0.1 || R: 4(128000)
console.ts:40 Stream: full "empty" AdaptationStream bufferType="text" periodEnd=6417848.44 position=6417846.844 wantedBufferAhead=30
console.ts:40 ABR: new bandwidth estimate bitrate=2960000 representation="5"
console.ts:40 Stream: new video bitrate estimate received from ABR bitrate=11280142.36169056
console.ts:40 ABR: new bandwidth estimate bitrate=2960000 representation="5"
console.ts:40 Stream: queuing push order t="v" p="yo-1.0.1" a="1485523442" r="5" ss=6417871.48 se=6417875.32
console.ts:40 Stream: now pushing t="v" p="yo-1.0.1" a="1485523442" r="5" ss=6417871.48 se=6417875.32
console.ts:40 mse: receiving order to push data to the SourceBuffer type="video"
console.ts:40 mse: updating codec prevCodec="video/mp4;codecs=\"avc1.4D401E\"" newCodec="video/mp4;codecs=\"avc1.64001f\""
console.ts:40 mse: could not update codec prevCodec="video/mp4;codecs=\"avc1.4D401E\"" newCodec="video/mp4;codecs=\"avc1.64001f\""
console.ts:40 mse: pushing segment type="video"
console.ts:40 SF: Segment request ended with success t="v" p="yo-1.0.1" a="1485523442" r="5" ss=6417871.48 se=6417875.32
console.ts:40 SF: Beginning request t="a" p="yo-1.0.1" a="2083690061" r="4" ss=6417875.32 se=6417878.42
console.ts:40 utils: XHR GET https://tv2play-live-ls02-yos.akamaized.net/yos/4/5/8/9/9/4/3/0/0/08001/u-6…dntl~hmac=3f6d63b006f82826defa15ab0d3192e6cac4fc3df302670bb55eacf9546c70df type=arraybuffer to=30 cto=15
console.ts:40 SF: Beginning request t="v" p="yo-1.0.1" a="1485523442" r="5" ss=6417875.32 se=6417878.42
console.ts:40 utils: XHR GET https://tv2play-live-ls02-yos.akamaized.net/yos/4/5/8/9/9/4/3/0/0/08001/u-6…dntl~hmac=3f6d63b006f82826defa15ab0d3192e6cac4fc3df302670bb55eacf9546c70df type=arraybuffer to=30 cto=15
console.ts:40 Stream: queuing push order t="a" p="yo-1.0.1" a="2083690061" r="4" ss=6417875.32 se=6417878.42
console.ts:40 Stream: now pushing t="a" p="yo-1.0.1" a="2083690061" r="4" ss=6417875.32 se=6417878.42
console.ts:40 mse: receiving order to push data to the SourceBuffer type="audio"
console.ts:40 mse: pushing segment type="audio"
console.ts:40 SF: Segment request ended with success t="a" p="yo-1.0.1" a="2083690061" r="4" ss=6417875.32 se=6417878.42
console.ts:40 SI: Pushing segment strictly after previous one. t="audio" pse=6417875.362666 ss=6417875.3626666665
console.ts:40 SI: synchronizing audio buffered ranges: 6417843.954667-6417878.482666
console.ts:40 SI: found true buffered end t="audio" re=6417878.482666 lastse=6417878.482666667
console.ts:40 SI: current audio inventory timeline:
6417843.95|A|6417848.43 ~ 6417848.43|B|6417878.48
[A] P: 1671377 || R: 4(129327)
[B] P: yo-1.0.1 || R: 4(128000)
console.ts:40 SI: Pushing segment strictly after previous one. t="video" pse=6417871.48 ss=6417871.48
console.ts:40 SI: synchronizing video buffered ranges: 6417843.96-6417875.32
console.ts:40 SI: found true buffered end t="video" re=6417875.32 lastse=6417875.32
console.ts:40 SI: current video inventory timeline:
6417843.96|A|6417848.44 ~ 6417848.44|B|6417875.32
[A] P: 1671377 || R: 5(2960000)
[B] P: yo-1.0.1 || R: 5(2960000)
console.ts:40 ABR: new bandwidth estimate bitrate=2960000 representation="5"
console.ts:40 Stream: new video bitrate estimate received from ABR bitrate=12034012.518459575
console.ts:40 media: Current media element state tick. evt="timeupdate" position=6417846.844 seeking=1 internalSeek=true rebuffering=true freezing=false ended=false paused=true playbackRate=0 readyState=1 pendingPosition=null
console.ts:40 media: current playback timeline:
6417843.96|==31.36==|6417875.32
                ^6417846.844 
timeupdate
console.ts:40 SI: synchronizing video buffered ranges: 6417843.96-6417875.32
console.ts:40 SI: current video inventory timeline:
6417843.96|A|6417848.44 ~ 6417848.44|B|6417875.32
[A] P: 1671377 || R: 5(2960000)
[B] P: yo-1.0.1 || R: 5(2960000)
console.ts:40 SI: synchronizing audio buffered ranges: 6417843.954667-6417878.482666
console.ts:40 SI: current audio inventory timeline:
6417843.95|A|6417848.43 ~ 6417848.43|B|6417878.48
[A] P: 1671377 || R: 4(129327)
[B] P: yo-1.0.1 || R: 4(128000)
console.ts:40 Stream: full "empty" AdaptationStream bufferType="text" periodEnd=6417848.44 position=6417846.844 wantedBufferAhead=30
console.ts:40 ABR: new bandwidth estimate bitrate=2960000 representation="5"
console.ts:40 Stream: new video bitrate estimate received from ABR bitrate=12034012.518459575
console.ts:40 ABR: new bandwidth estimate bitrate=2960000 representation="5"
console.ts:40 Stream: queuing push order t="v" p="yo-1.0.1" a="1485523442" r="5" ss=6417875.32 se=6417878.42
console.ts:40 Stream: now pushing t="v" p="yo-1.0.1" a="1485523442" r="5" ss=6417875.32 se=6417878.42
console.ts:40 mse: receiving order to push data to the SourceBuffer type="video"
console.ts:40 mse: updating codec prevCodec="video/mp4;codecs=\"avc1.4D401E\"" newCodec="video/mp4;codecs=\"avc1.64001f\""
console.ts:40 mse: could not update codec prevCodec="video/mp4;codecs=\"avc1.4D401E\"" newCodec="video/mp4;codecs=\"avc1.64001f\""
console.ts:40 mse: pushing segment type="video"
console.ts:40 SF: Segment request ended with success t="v" p="yo-1.0.1" a="1485523442" r="5" ss=6417875.32 se=6417878.42
console.ts:40 SI: Pushing segment strictly after previous one. t="video" pse=6417875.32 ss=6417875.32
console.ts:40 SI: synchronizing video buffered ranges: 6417843.96-6417878.44
console.ts:40 SI: found true buffered end t="video" re=6417878.44 lastse=6417878.44
console.ts:40 SI: current video inventory timeline:
6417843.96|A|6417848.44 ~ 6417848.44|B|6417878.44
[A] P: 1671377 || R: 5(2960000)
[B] P: yo-1.0.1 || R: 5(2960000)
console.ts:40 ABR: new bandwidth estimate bitrate=2960000 representation="5"
console.ts:40 Stream: new video bitrate estimate received from ABR bitrate=12377282.652093407
console.ts:40 media: Current media element state tick. evt="timeupdate" position=6417846.844 seeking=1 internalSeek=true rebuffering=true freezing=false ended=false paused=true playbackRate=0 readyState=1 pendingPosition=null
console.ts:40 media: current playback timeline:
6417843.96|==34.48==|6417878.44
                ^6417846.844 
timeupdate
console.ts:40 SI: synchronizing video buffered ranges: 6417843.96-6417878.44
console.ts:40 SI: current video inventory timeline:
6417843.96|A|6417848.44 ~ 6417848.44|B|6417878.44
[A] P: 1671377 || R: 5(2960000)
[B] P: yo-1.0.1 || R: 5(2960000)
console.ts:40 SI: synchronizing audio buffered ranges: 6417843.954667-6417878.482666
console.ts:40 SI: current audio inventory timeline:
6417843.95|A|6417848.43 ~ 6417848.43|B|6417878.48
[A] P: 1671377 || R: 4(129327)
[B] P: yo-1.0.1 || R: 4(128000)
console.ts:40 Stream: full "empty" AdaptationStream bufferType="text" periodEnd=6417848.44 position=6417846.844 wantedBufferAhead=30
console.ts:40 ABR: new bandwidth estimate bitrate=2960000 representation="5"
console.ts:40 Stream: new video bitrate estimate received from ABR bitrate=12377282.652093407
console.ts:40 ABR: new bandwidth estimate bitrate=2960000 representation="5"
console.ts:40 media: Current media element state tick. evt="timeupdate" position=6417846.844 seeking=1 internalSeek=true rebuffering=true freezing=false ended=false paused=true playbackRate=0 readyState=1 pendingPosition=null
console.ts:40 media: current playback timeline:
6417843.96|==34.48==|6417878.44
                ^6417846.844 
timeupdate
console.ts:40 SI: synchronizing video buffered ranges: 6417843.96-6417878.44
console.ts:40 SI: current video inventory timeline:
6417843.96|A|6417848.44 ~ 6417848.44|B|6417878.44
[A] P: 1671377 || R: 5(2960000)
[B] P: yo-1.0.1 || R: 5(2960000)
console.ts:40 SI: synchronizing audio buffered ranges: 6417843.954667-6417878.482666
console.ts:40 SI: current audio inventory timeline:
6417843.95|A|6417848.43 ~ 6417848.43|B|6417878.48
[A] P: 1671377 || R: 4(129327)
[B] P: yo-1.0.1 || R: 4(128000)
console.ts:40 Stream: full "empty" AdaptationStream bufferType="text" periodEnd=6417848.44 position=6417846.844 wantedBufferAhead=30
2console.ts:40 ABR: new bandwidth estimate bitrate=2960000 representation="5"
console.ts:40 MF: Refreshing the Manifest in "unsafeMode" for the 4 consecutive time.
console.ts:40 utils: XHR GET https://tv2play-live-ls02-yos.akamaized.net/csm/extlive/tv2noprd01,LO_d9e2e…45A3430F99544AFA2C71A5.csm-e-cesharedlsestolived-89857912.bln1.yospace.com type=arraybuffer to=30 cto=15
console.ts:40 dash: WASM MPD Parser not initialized. Running JS one.
console.ts:40 manifest: Filtering Representation due to representationFilter video Adaptation: 1485523442 Representation: 2 (8000000)
console.ts:40 manifest: Filtering Representation due to representationFilter video Adaptation: 1485523442 Representation: 3 (6000000)
console.ts:40 manifest: Filtering Representation due to representationFilter video Adaptation: 1485523442 Representation: 2 (8000000)
console.ts:40 manifest: Filtering Representation due to representationFilter video Adaptation: 1485523442 Representation: 3 (6000000)
console.ts:40 manifest: Filtering Representation due to representationFilter video Adaptation: 1485523442 Representation: 2 (8000000)
console.ts:40 manifest: Filtering Representation due to representationFilter video Adaptation: 1485523442 Representation: 3 (6000000)
console.ts:40 manifest: Filtering Representation due to representationFilter video Adaptation: 1485523442 Representation: 2 (8000000)
console.ts:40 manifest: Filtering Representation due to representationFilter video Adaptation: 1485523442 Representation: 3 (6000000)
console.ts:40 MF: Manifest parsed in 165.81000000005588ms
console.ts:40 media: Current media element state tick. evt="timeupdate" position=6417846.844 seeking=1 internalSeek=true rebuffering=true freezing=false ended=false paused=true playbackRate=0 readyState=1 pendingPosition=null
console.ts:40 media: current playback timeline:
6417843.96|==34.48==|6417878.44
                ^6417846.844 
timeupdate
console.ts:40 SI: synchronizing video buffered ranges: 6417843.96-6417878.44
console.ts:40 SI: current video inventory timeline:
6417843.96|A|6417848.44 ~ 6417848.44|B|6417878.44
[A] P: 1671377 || R: 5(2960000)
[B] P: yo-1.0.1 || R: 5(2960000)
console.ts:40 SI: synchronizing audio buffered ranges: 6417843.954667-6417878.482666
console.ts:40 SI: current audio inventory timeline:
6417843.95|A|6417848.43 ~ 6417848.43|B|6417878.48
[A] P: 1671377 || R: 4(129327)
[B] P: yo-1.0.1 || R: 4(128000)
console.ts:40 Freeze: Freeze detected freezeStart=1356639.4500000002 timeFrozen=36396.89999999991
console.ts:40 Freeze: A recent flush seemed to have no effect on freeze, checking for transitions
2console.ts:40 Freeze: Freeze when beginning to play a content, try avoiding this quality
console.ts:40 Stream: Aborting SegmentSink bufferType="audio"
console.ts:40 Stream: Calling `dispose` on the SourceBufferInterface
console.ts:40 Stream: Aborting SegmentSink bufferType="video"
console.ts:40 Stream: Calling `dispose` on the SourceBufferInterface
console.ts:40 text: Stopping HTMLTextDisplayer
console.ts:40 media: Clearing HTMLMediaElement's src
console.ts:40 media: Revoking previous URL
console.ts:40 Track: Resetting Period Objects
console.ts:40 mse: Creating MediaSource
console.ts:40 media: Attaching MediaSource URL to the media element handleType="media-source"
console.ts:40 media: Current media element state tick. evt="timeupdate" position=0 seeking=0 internalSeek=false rebuffering=true freezing=false ended=false paused=true playbackRate=1 readyState=0 pendingPosition=null
console.ts:40 media: current playback timeline:

^0 
timeupdate
console.ts:40 media: Current media element state tick. evt="timeupdate" position=0 seeking=0 internalSeek=false rebuffering=true freezing=false ended=false paused=true playbackRate=1 readyState=0 pendingPosition=null
console.ts:40 media: current playback timeline:

Full file
logs.txt

[peaBerberian]

Hi @mkochman,

I looked at the logs, it seems we are having issues playing the new ad Period, leading to what we call "freezing" situations (playback does not advance despite decodable data being in the buffer).
Our usual strategy when encountering those is to first do a small seek and if that does not work, we completely reload (change the MediaSource and create new buffers - leading to a black screen at first).

Such freeze are generally the consequence of the device having some decoding issue with that particular content.

Yet here that doesn't fix the issue either so we do it a lot of time until it works.

What's very surprising here is that the freeze happens ~4 seconds before the next Period (it happens at 6417844.32 seconds first though the next Period begins at 6417848.44, and we don't even switch quality around the current position).
So possibly the freeze happens when Tizen begins to feed the following data in its lower-level buffers?

One way to avoid this freezing issue would be to find out what encoding parameter make Tizen having issues like this. Is it only some ad? Is it encrypted or clear?
We could iterate to find what raises the risk of such freezes happening

[mkochman]

This problem only occurs on LG 2019/2020 webos, for Samsung Tizen it works normally.
I've tried different qualities and got the same result(one filtered quality per check) so it doesn't seem to be lower-level buffers 🤔
Stream is encrypted