模型参数计算
num_param = sum(p.numel() for p in model.parameters() if p.requires_grad) / 1e6
num_total_param = sum(p.numel() for p in model.parameters()) / 1e6
print('Number of total parameters: {} M, tunable parameters: {} M'.format(num_total_param, num_param))
模型参数计算