Refactor SkyPilot Multi-Tenant Project and SkyPilot EKS App

[roulbac]

Summary

This PR refactors the SkyPilot multi-tenant project and the SkyPilot EKS application for better modularity and maintainability.

Key Changes:

• Project Refactor (projects/skypilot-multi-tenant/):
  • Extracted configuration models and loaders to config.py.
  • Simplified __main__.py by offloading configuration logic.
• SkyPilot App Refactor (pulumi_eks_ml/eks_apps/skypilot/):
  • Created config_builder.py for Helm values and config generation.
  • Created credentials.py (as a ComponentResource) for admin credentials management.
  • Created iam.py for IAM policy documents.
  • Updated api_server.py to use these new modules, significantly reducing its complexity.
• IAM Enhancements:
  • Added S3 read/write permissions to the SkyPilot API server's IAM policy to support data-intensive workloads.

Test Plan

• Verified configuration loading in skypilot-multi-tenant.
• Validated SkyPilotAPIServer instantiation with the new modular structure.
• Inspected generated IAM policies for correctness.

Made with Cursor