TGIF-QA evaluation crashing

[geomlyd]

Hello there,

Thanks for releasing your code and data! I've been trying to evaluate your checkpoints on the data you linked in #57 and I've been encountering some issues.

1. The most important one is that evaluating on TGIF-QA seems to be crashing with some ffmpeg related error, which seems to come from moviepy and is of the general form ("invalid continuation byte") described here. In addition, to even get the code to run in the first place, I had to change this line, since if I'm not mistaken there's no such subdirectory in TGIF-QA. Any idea what might be up here? I changed the subdirectory to videos, but I'm not sure if I should have used one of the other two subdirectory names (videos_mp4, video_gif) instead.

2. When evaluating on ActivityNet, the script does end successfully but displays several errors of the form mmco: unref short failure, which may be coming from the decord package. Is this a concern?

Thanks in advance!

[byminji]

Hi @geomlyd, I am encountering the same issues as yours. Were you able to find solutions for TGIF-QA evaluation?

[geomlyd]

Hello @byminji, it's been a while since I worked on this, I don't remember with 100% certainty but I think I didn't manage to solve it :/

[byminji]

@geomlyd Thanks a lot!