Requesting video info is broken

[iexavl]

The body in parseVideoAndroid function is broken. It gets a faulty response from youtube with no streamData.
I checked pytube and replaced it with this:

        String body =
                "{" +
                "  \"videoId\": \"" + videoId + "\"," +
                "  \"context\": {" +
                "    \"client\": {" +
                "      \"hl\": \"en\"," +
                "      \"gl\": \"US\"," +
                "      \"clientName\": \"ANDROID_MUSIC\"," +
                "      \"clientVersion\": \"5.16.51\"," +
                "      \"androidSdkVersion\": 30" +
                "    }" +
                "  }" +
                "}";

With that it works.

[iexavl]

Never mind. I thought it worked, I was wrong. Also I just noticed that pytube also doesn't work for me. Is this a problem of mine or is it broken for everyone?

[iexavl]

Okay it actually appears to be broken for one particular video? The playability status of that video is 'This video is not available', but it is available in youtube. If I go to the video through the browser it works.

[sealedtx]

@iexavl it may require age verification or smth like that, try it in browser without login (incognito tab)

[iexavl]

@iexavl it may require age verification or smth like that, try it in browser without login (incognito tab)

Not age restricted. It's also not only that video, but it's also not every video. It's kind of weird. Originally it was this video:
https://www.youtube.com/watch?v=ZxnD5YrMIgI, but then I found a couple more that don't work

yes the downloader no longer works ): videoInfo is allways null.

[iexavl]

yes the downloader no longer works ): videoInfo is allways null.

It can work by deleting the part that uses innertube, in other words commenting out parseVideoAndroid, but that makes things quite slow since the downloader has to parse the html.

[iexavl]

https://github.com/iv-org/invidious/blob/a021b93063f3956fc9bb3cce0fb56ea252422738/src/invidious/yt_backend/youtube_api.cr#L483
I found this and tried it. The only thing I am missing is serviceIntegrityDimensions, because from what I can tell it's generated. Maybe I will try to add it tomorrow. The error did change a bit, but it's still an error.

[sealedtx]

@iexavl have a look at https://github.com/ytdl-org/youtube-dl there might be a recent fix for this that we can implement here

[wiojosjosd]

@sealedtx can u fix that now?hope soon.

[iexavl]

@iexavl have a look at https://github.com/ytdl-org/youtube-dl there might be a recent fix for this that we can implement here

I looked it over and tried what I could find. Unless I missed something there hasn't been a fix yet. This seems to be something specific to the android client, probably some additional argument. I tried the IOS client and it works:

String body =
                "{" +
                "  "videoId": "" + videoId + ""," +
                "  "context": {" +
                "    "client": {" +
                "      "hl": "en"," +
                "      "gl": "US"," +
                "      "clientName": "IOS"," +
                "      "clientVersion": "17.36.4"," +
               // "      "androidSdkVersion": 30" +
                "    }" +
                "  }" +
                "}";

Unfortunately it seems to be quite constrained for qualities. On 1080p 60fps video I got 720p 30fps max.
I find it slightly odd that I can't see any recent issues on the github page for youtube-dl or any other projects that use the googleapis.

but with this i dont have sound

bestVideoWithAudioFormat returns zero with the IOS client. I think we need a better solution here.

String body =
"{" +
" "videoId": "" + videoId + ""," +
" "context": {" +
" "client": {" +
" "hl": "en"," +
" "gl": "US"," +
" "clientName": "ANDROID_MUSIC"," +
" "clientVersion": "5.16.51"," +
" "androidSdkVersion": 30" +
" }" +
" }" +
"}";
with this it works

[iexavl]

String body = "{" + " \"videoId\": \"" + videoId + "\"," + " \"context\": {" + " \"client\": {" + " \"hl\": \"en\"," + " \"gl\": \"US\"," + " \"clientName\": \"ANDROID_MUSIC\"," + " \"clientVersion\": \"5.16.51\"," + " \"androidSdkVersion\": 30" + " }" + " }" + "}";

with this it works

It doesn't work for everything. It works for some videos, for others not. And the IOS is indeed a bad option. I have no idea what they did though and I am running out of ideas as to how to find it. Perhaps we should wait for the youtube-dl guys to notice or just post an issue there.

and yes you're right unfortunately it doesn't work with every video ):