Questions about training

[XiaozhenQiao]

This is very interesting work, but I encountered a problem when reproducing the training on PI3: the results are similar to PI3 during full sequence training, but once I enable chunking, the model's performance drops significantly, and I don't know why.

[panxkun]

I tried training the first stage based on the pretrained Pi3 model, but from the loss curve it seems that the loss can no longer keep decreasing. Should I continue waiting for it to go down, or does this indicate that there might be some issue?