Train code + data

[Martovark]

Guys, are you planning to opensource the training code/data? :)

• I think it makes sense to update the architecture: add RoPE, RMSNorm, qk-norm, etc.
• Experiments with loss, include post training, for example RLVR (reward the model for generating correct domains).