feedback-prize

This was a Named Entity Recognition competition hosted on Kaggle by George State University

What did I do ❓

• I used Pytorch Lightning ⚡ framework along with DeepSpeed plugin - fp optim, scheduler, etc.. - to fasten the training framework ⏩
• Wandb used to monitor training
• Trained on BigBird, Longformer, Ensemble of them
• Two Longformers ensemble was submitted