figure 11

[chichengfengxue]

Thank you for your excellent work! May I ask how Figure 11 was drawn? Is it about drawing a single picture or calculating the average of the entire dataset? Thank you again! -- Fans of Xiaohongshu

[Linwei-Chen]

Thanks for your interest. You can draw it by calculating the power of each set of frequencies, or you can simply choose the diagonal frequency (refer to ICLR 2022, "How Do Vision Transformers Work?") on the entire dataset.

[chichengfengxue]

"How Do Vision Transformers Work?" The x-coordinate ranges from 0 to 1. Why is the x-coordinate range in your Figure 11 from 0 to 0.5? And why the Nyquist frequency is at the 0.25 position. Looking forward to your reply!

[Linwei-Chen]

I use Normalized Frequency (0 to 0.5) for brevity, and it can be easily converted to the 0-π range by multiplying by 2π🤓.