Hi,
Thank you for sharing your excellent work. I have been trying to reproduce the results reported in the paper with default parameters in sample.py. However, I noticed some discrepancies in the results I obtained compared to those in the paper:
MJHQ-30k FID and CLIP-Score: Paper reports 5.38 and 29.09, I reproduced 9.87 and 27.70.
Geneval overall: Paper reports 0.56, I reproduced 0.51.
DPG-Bench: Paper reports 80.89, I reproduced 66.74.
If there are any additional steps or configurations required to reproduce the exact results?
Thank you for your time and assistance!
Hi,
Thank you for sharing your excellent work. I have been trying to reproduce the results reported in the paper with default parameters in sample.py. However, I noticed some discrepancies in the results I obtained compared to those in the paper:
MJHQ-30k FID and CLIP-Score: Paper reports 5.38 and 29.09, I reproduced 9.87 and 27.70.
Geneval overall: Paper reports 0.56, I reproduced 0.51.
DPG-Bench: Paper reports 80.89, I reproduced 66.74.
If there are any additional steps or configurations required to reproduce the exact results?
Thank you for your time and assistance!