chai for llama2

[rippleD030]

Hi, have you tried implementing the Chai structure on models like LLaMA2 or any other models besides LLaMA and OPT? Looking forward to your response, thanks.

[iidsample]

We have primarily done experiments on LLaMA-1. Although we did do some additional experiments and saw favorable results on LLama2-70B for GQA.