CUDA out of memory on 24GB

[DanilaAniva]

I get an out-of-memory error with 24GB VRAM.

python test_osediff.py 
-i "../full dataset/upscale_banners_test" 
-o "../full dataset/upscale_banners_output" 
--osediff_path preset/models/osediff.pkl
 --pretrained_model_name_or_path preset/models/sd21base 
--ram_ft_path preset/models/dape.pth 
--ram_path preset/models/ram_swin_large_14m.pth

How much VRAM do I need for inference?
Do you have any ideas for running with lower VRAM?

[cswry]

You can try using gradient checkpointing to reduce memory usage. For more details, please refer to this issue comment where it's discussed further.

[shenyongkun]

You can try using gradient checkpointing to reduce memory usage. For more details, please refer to this issue comment where it's discussed further.你可以尝试使用梯度检查点来减少内存使用。更多细节请参阅本议题评论 ，其中有进一步讨论。

你好我有一些复现的问题想问您可以吗：
数据集是LSDIR和FFHQ_firs10k裁剪成512，是不是意味着一张图可以裁剪成多张512x512的图片，总训练图片会增加？