From 51f0e2f2202a3f7659c66f86d43ff8c12506eabd Mon Sep 17 00:00:00 2001 From: Francois Lanusse Date: Wed, 22 Oct 2025 00:40:09 +0200 Subject: [PATCH 1/6] improving Readme for release --- README.md | 28 ++++++---------------------- 1 file changed, 6 insertions(+), 22 deletions(-) diff --git a/README.md b/README.md index 549d4d8..04713ee 100644 --- a/README.md +++ b/README.md @@ -3,10 +3,10 @@
[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT) -[![Python 3.10+](https://img.shields.io/badge/python-3.10+-blue.svg)](https://www.python.org/downloads/) [![PyTorch](https://img.shields.io/badge/PyTorch-≥2.4.0-ee4c2c.svg)](https://pytorch.org/) [![Tests](https://github.com/PolymathicAI/AION/actions/workflows/test.yaml/badge.svg)](https://github.com/PolymathicAI/AION/actions/workflows/test.yaml) [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/PolymathicAI/AION/blob/main/notebooks/Tutorial.ipynb) +[![Model on HF](https://huggingface.co/datasets/huggingface/badges/resolve/main/model-on-hf-sm.svg)](https://huggingface.co/polymathic-ai/aion-base) **Polymathic's Large Omnimodal Model for Astronomy** @@ -24,21 +24,6 @@ AION-1 is a cutting-edge large omnimodal model specifically designed for astronomical surveys. It seamlessly integrates multiple data modalities, and enables simple adaptation to a wide range of astronomical tasks. -## Alpha Testing - -AION-1 model weights are hosted on Huggingface behind gates during the alpha testers phase. First, ensure that you have access to the Hugginface model weights. If you don't have access, you can request it directly on the [hugginface repo here](https://huggingface.co/polymathic-ai/aion-base). - -Once you have access, you will need to set up a huggingface token locally. This can be done by first installing hugginface_hub: -```bash -pip install huggingface_hub -``` - -and then logging in via -```bash -huggingface-cli login --token YOUR_HF_TOKEN -``` -All of the ensuing steps should work out of the box after this point. - ## 🚀 Quick Start Assuming you have PyTorch installed, you can install AION trivially with: @@ -82,7 +67,6 @@ preds = model( Start with our interactive tutorial: - **[Open in Google Colab](https://colab.research.google.com/github/PolymathicAI/AION/blob/main/notebooks/Tutorial.ipynb)** - Learn AION basics interactively, no local setup required! -For detailed guides, see the [online documentation](https://polymathic-ai.github.io/AION/). ## 🔬 Scientific Overview @@ -114,11 +98,11 @@ AION-1’s tokenizers cover **39 distinct data types**, grouped by survey and da ### 📈 Model Variants -| **Variant** | **Encoder Blocks** | **Decoder Blocks** | **Model Dim** | **Heads** | **Total Params** | -|------------:|-------------------:|-------------------:|--------------:|----------:|-----------------:| -| **Base** | 12 | 12 | 768 | 12 | 300 M | -| **Large** | 24 | 24 | 1024 | 16 | 800 M | -| **XLarge** | 24 | 24 | 2048 | 32 | 3 B | +| **Variant** | **Encoder Blocks** | **Decoder Blocks** | **Model Dim** | **Heads** | **Total Params** | **Model** | +|------------:|-------------------:|-------------------:|--------------:|----------:|-----------------:|-----------| +| **Base** | 12 | 12 | 768 | 12 | 300 M | [aion-base](https://huggingface.co/polymathic-ai/aion-base) | +| **Large** | 24 | 24 | 1024 | 16 | 800 M | soon | +| **XLarge** | 24 | 24 | 2048 | 32 | 3 B | soon | > **Pretraining** > – Global batch size: 8 192 From 7c617c21a180d9d444de1831ea706d8d6f7aeeac Mon Sep 17 00:00:00 2001 From: Francois Lanusse Date: Wed, 22 Oct 2025 00:41:20 +0200 Subject: [PATCH 2/6] small update --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 04713ee..84d1999 100644 --- a/README.md +++ b/README.md @@ -10,7 +10,7 @@ **Polymathic's Large Omnimodal Model for Astronomy** -[🚀 Quick Start](#-quick-start) • [🔬 Scientific Overview](#-scientific-overview) • [📦 Advanced Installation](#-advanced-installation) +[🚀 Quick Start](#-quick-start) • [🎓 Tutorials](#-tutorials) • [🔬 Scientific Overview](#-scientific-overview) • [📦 Advanced Installation](#-advanced-installation)
From 2e2c2799670f700b077b281600b22cf2d5fefe2f Mon Sep 17 00:00:00 2001 From: Francois Lanusse Date: Wed, 22 Oct 2025 00:52:24 +0200 Subject: [PATCH 3/6] fix alignment --- README.md | 12 +++++++----- 1 file changed, 7 insertions(+), 5 deletions(-) diff --git a/README.md b/README.md index 84d1999..b4be61b 100644 --- a/README.md +++ b/README.md @@ -2,11 +2,13 @@
-[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT) -[![PyTorch](https://img.shields.io/badge/PyTorch-≥2.4.0-ee4c2c.svg)](https://pytorch.org/) -[![Tests](https://github.com/PolymathicAI/AION/actions/workflows/test.yaml/badge.svg)](https://github.com/PolymathicAI/AION/actions/workflows/test.yaml) -[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/PolymathicAI/AION/blob/main/notebooks/Tutorial.ipynb) -[![Model on HF](https://huggingface.co/datasets/huggingface/badges/resolve/main/model-on-hf-sm.svg)](https://huggingface.co/polymathic-ai/aion-base) +

+ License: MIT + PyTorch + Tests + Open In Colab + Model on HF +

**Polymathic's Large Omnimodal Model for Astronomy** From 1578db3e12b3051e2cdf07b53a4f59d49091ee03 Mon Sep 17 00:00:00 2001 From: Francois Lanusse Date: Wed, 22 Oct 2025 00:56:34 +0200 Subject: [PATCH 4/6] simplify --- README.md | 12 +++++------- 1 file changed, 5 insertions(+), 7 deletions(-) diff --git a/README.md b/README.md index b4be61b..0663532 100644 --- a/README.md +++ b/README.md @@ -2,13 +2,11 @@
-

- License: MIT - PyTorch - Tests - Open In Colab - Model on HF -

+[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT) +[![PyTorch](https://img.shields.io/badge/PyTorch-≥2.4.0-ee4c2c.svg)](https://pytorch.org/) +[![Tests](https://github.com/PolymathicAI/AION/actions/workflows/test.yaml/badge.svg)](https://github.com/PolymathicAI/AION/actions/workflows/test.yaml) +[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/PolymathicAI/AION/blob/main/notebooks/Tutorial.ipynb) +[![Model on HF](https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Model-yellow)](https://huggingface.co/polymathic-ai/aion-base) **Polymathic's Large Omnimodal Model for Astronomy** From 0f59153b78a6a5325c312fd98e9d941f526c17c1 Mon Sep 17 00:00:00 2001 From: Francois Lanusse Date: Wed, 22 Oct 2025 01:07:53 +0200 Subject: [PATCH 5/6] adding acknowledgements --- README.md | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/README.md b/README.md index 0663532..806e92e 100644 --- a/README.md +++ b/README.md @@ -225,7 +225,8 @@ This project is licensed under the MIT License - see the [LICENSE](LICENSE) file ## 🌟 Acknowledgments -AION is developed by [Polymathic AI](https://polymathic-ai.org/), advancing the frontier of AI for scientific applications. +AION is developed by [Polymathic AI](https://polymathic-ai.org/), advancing the frontier of AI for scientific applications. We would like to acknowledge the support of the Simons Foundation and of Schmidt Sciences. This project was provided with computer and storage resources by GENCI at IDRIS thanks to the grant 2024-GC011015468 on the supercomputer +Jean Zay’s H100 partition. Additionally, some of the computations in this work were run at facilities supported by the Scientific Computing Core at the Flatiron Institute, a division of the Simons Foundation. ## 📬 Contact From 56c05dfaf81c6b1e269b15d0ef2fd96b8ffe6bd6 Mon Sep 17 00:00:00 2001 From: Francois Lanusse Date: Wed, 22 Oct 2025 02:14:29 +0200 Subject: [PATCH 6/6] adding arxiv link --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index 806e92e..90237bf 100644 --- a/README.md +++ b/README.md @@ -5,6 +5,7 @@ [![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT) [![PyTorch](https://img.shields.io/badge/PyTorch-≥2.4.0-ee4c2c.svg)](https://pytorch.org/) [![Tests](https://github.com/PolymathicAI/AION/actions/workflows/test.yaml/badge.svg)](https://github.com/PolymathicAI/AION/actions/workflows/test.yaml) +[![arXiv](https://img.shields.io/badge/arXiv-2510.17960-b31b1b.svg)](https://arxiv.org/abs/2510.17960) [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/PolymathicAI/AION/blob/main/notebooks/Tutorial.ipynb) [![Model on HF](https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Model-yellow)](https://huggingface.co/polymathic-ai/aion-base)