Remove obsolete arm64 workflow logic

[vineelsai26]

Summary

• remove the leftover arm64-specific build path from the workflow
• keep the build running only on ubuntu-latest, which is already the active matrix entry

Testing

• not run locally