How to load two loras

[2016110071]

How to load two loras , one for reference model , one for training

[Jayce-Ping]

It is not directly support yet. You can modify the checkpoint-loading logic and initialization of reference-parameter in models/abc.py for your custom demand.

[2016110071]

It is not directly support yet. You can modify the checkpoint-loading logic and initialization of reference-parameter in models/abc.py for your custom demand.

Thanks, I will try it.