Audio projection

[manushree635]

Is there any reason for using a q former for audio projection layer instead of linear layer like for image

[carboncoo]

Thank you for your interest in our work. Regarding the choice of projector type for audio, as it's not the main focus of our work, we directly followed some previous works and chose to use QFormer. If you're interested, we did try training with a linear projector in early versions, and there was no significant difference observed between the two (although we did not conduct a comprehensive evaluation).