About the prediction layer weight

[02hyc]

Recently I want to use the prediction layer weight in chengyuBERT as the initial idiom embedding in my work, however im struggling to it. Can you give an instruction? Thank you.

[Vimos]

Can you illustrate more on your task and what you have tried?