Bug: Video titles appearing as squares

[FabioPedretti]

YTAF information

• YTAF version: 0.6.9

TV information

• webOS version: 3.9

Issue description

Incorrect character encoding in video titles:

• The Air Force Releases Stunning Video of 𝗕-𝟮𝟭 𝗥𝗮𝗶𝗱𝗲𝗿 in action - the "𝗕-𝟮𝟭 𝗥𝗮𝗶𝗱𝗲𝗿" text is replaced with ☒☒☒☒☒ characters.
• Un Caffé ☕️ in FERRARI Testarossa | 2 miti Italiani - the ☕️ character is replaced with a ☒ character.

NOTE: issue already reported at webosbrew#256 with a partial patch available at webosbrew#257

[NicholasBly]

I'm working on this. Got a fix for the '𝗕-𝟮𝟭 𝗥𝗮𝗶𝗱𝗲𝗿' text, however the twemoji fix is buggy. It doesn't render the emoji immediately and seems to only work if the app is open for at least 5 minutes. Refreshing doesn't help. Is this the same behavior on webosbrew version? It might be normal on real TV hardware as I am testing on webOS 3 emulator.

[NicholasBly]

So the emoji issue was the jsdelivr content delivery network requiring secure networking. WebOS 3's internal list of trusted internet certificates is out of date. Luckily I found a workaround - we can use cdnjs.cloudflare.com which still supports older SSL certificates.

The only issue is that cdnjs,cloudflare.com doesn't have the latest version of twemoji/api, 15.1.0 is the newest it has available from when twitter maintained it, while 17.0.2 is the latest. Not a big deal, it will miss newer emojis, but will look into supporting the latest version.

[NicholasBly]

Test version available with fixes

#53 (comment)

[NicholasBly]

Fixed in 0.7.2

[FabioPedretti]

Thanks for looking into this!

I tried 0.7.2.

The B21 video is now rendering properly.

In the Ferrari video, however

• the ☕️ is not after the Caffè word (where there is empty space), but after FERRARI word
• also, "in FERRARI" appears again after the ☕️

This is the image I already posted in webosbrew#256 (comment), current text rendering is similar:

[NicholasBly]

Wow looks like you still have the old YouTube UI / layout. Can you show me what it looks like on your end when you get a chance? From my testing on webOS 3 I didn't observe this on the new UI. I did see your webosbrew comment about this, so it was one of the things I tested to make sure it looked normal and functioned properly. It's very likely the YouTube layout. This is how it looks for me:

[FabioPedretti]

Here is actual photos on my TV.

When playing video:

Preview:

[NicholasBly]

Can you try to set the YouTube app language to English US to see if that fixes the issue? If it does, then I can figure out why it's doing that and implement a fix. Thanks

[FabioPedretti]

I tried English (US) (as well as English (UK)), and unfortunately the problem is still reproducible.

[NicholasBly]

Ok I think I identified the issue. The code was running two different types of parsing loops simultaneously looking for emojis - one using twemoji and one for child elements of the document. This caused the text to be processed twice.

I'm thinking it affects the real webOS 3 TV since the hardware is slower than my virtual machine and it was essentially bumping into each other and producing the wrong result before one of them could finish first.

I tested with just twemoji doing the parsing and so far good results - should be much faster and fix the bug. Just need your input to verify.

Here is 0.7.3 test build 1, let me know if that fixes the issue - #55 (comment)

[marianmargraf]

I've tested 0.7.3 build 2 with the two videos. Titles are displayed the same as in @FabioPedretti last screenshots on my webOS 3 TV with the app set to English US.

[NicholasBly]

Hmm wonder if it's twemoji's parse code? I'll take a look at their source code as well