Skip to content

STAC catalog: parquet schema fixes, morton indexing, spatial matching, and full season YAML coverage #73

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
espg merged 29 commits into from
Apr 22, 2026
Merged

STAC catalog: parquet schema fixes, morton indexing, spatial matching, and full season YAML coverage #73

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
29 commits
Select commit Hold shift + click to select a range
aa33aef
fix parquet schema to valid types on null columns
espg Feb 18, 2026
a6f7066
rename thumbnails to thumbnail in schema
espg Feb 18, 2026
5bf937d
new parquet stac logic for spatial overlap
espg Mar 4, 2026
2e7ff80
linting fixes
espg Mar 4, 2026
239fb47
another linting fix...
espg Mar 4, 2026
199eed0
updating scripts to source.coop endpoints
espg Mar 9, 2026
ffba973
fixing duckdb bug from deps version update
espg Mar 9, 2026
8f89734
ruff fixes
espg Mar 9, 2026
661cb30
adding 2008_Antarctica_BaslerJKB.yml catalog template for reproducibi…
Mar 9, 2026
17df8c7
updated docs, code clean up to remove old code
espg Mar 9, 2026
a581aed
docs edits
espg Mar 9, 2026
04b1dd8
adding 2010 and 2009 Antarctica DC8 yaml's
Mar 9, 2026
60d71e2
fixing geometry simplification bug
espg Mar 9, 2026
68e842b
slow prototype code for bedmap to opr layer data matching
espg Mar 10, 2026
c4121b6
ruff fixes
espg Mar 10, 2026
8614147
example CMR + stac intersection example
espg Apr 15, 2026
e2d306f
updated to take in array of points
espg Apr 15, 2026
02d50bb
adding yml for antarctica 2011-2014, 2016, 2019
Apr 20, 2026
122acef
refactor and full coverage of yml ingest files
espg Apr 20, 2026
11035c3
km line badge fix
espg Apr 20, 2026
26468fa
enforcing new schema in both tests and at catalog generation time
espg Apr 20, 2026
f0f3c3c
bug-fix for bedmap points in our docs
espg Apr 20, 2026
dbf48f1
second pass fixes for yaml's
espg Apr 20, 2026
7383a3a
fix for caching bug
espg Apr 22, 2026
80809b4
fixing merge conflict
espg Apr 22, 2026
6479df0
bumping workflow versions to silence depreciation warnings
espg Apr 22, 2026
f81783b
bumping workflow versions to non-hallucinated tags
espg Apr 22, 2026
eb458ae
catalog positional bug fix
espg Apr 22, 2026
7fcf2a3
fixing preview docs bug...
espg Apr 22, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions .github/workflows/codspeed.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -20,11 +20,11 @@ jobs:
github.event_name == 'workflow_dispatch'
runs-on: codspeed-macro
steps:
- uses: actions/checkout@v4
- uses: actions/checkout@v6

- uses: astral-sh/setup-uv@v4
- uses: astral-sh/setup-uv@v7

- uses: actions/setup-python@v5
- uses: actions/setup-python@v6
with:
python-version: "3.13"

Expand Down
20 changes: 16 additions & 4 deletions .github/workflows/docs-preview-comment.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -69,12 +69,12 @@ jobs:
runs-on: ubuntu-latest
steps:
- name: Checkout PR
uses: actions/checkout@v4
uses: actions/checkout@v6
with:
ref: ${{ needs.check-comment.outputs.pr_sha }}

- name: Install uv
uses: astral-sh/setup-uv@v4
uses: astral-sh/setup-uv@v7

- name: Set up Python
run: uv python install
Expand Down Expand Up @@ -102,7 +102,19 @@ jobs:
# Create deployment structure with /xopr/ subdirectory
mkdir -p surge-deploy/xopr
cp -r docs/_build/html/* surge-deploy/xopr/


# Remove JSON files that conflict with directory routes
# MyST generates both file.json and file/index.html, causing routing issues
for json in surge-deploy/xopr/*.json; do
if [ -f "$json" ]; then
base=$(basename "$json" .json)
if [ -d "surge-deploy/xopr/$base" ]; then
echo "Removing conflicting JSON file: $json"
rm "$json"
fi
fi
done

# Create redirect index at root
cat > surge-deploy/index.html << 'EOF'
<!DOCTYPE html>
Expand Down
16 changes: 8 additions & 8 deletions .github/workflows/docs.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -25,10 +25,10 @@ jobs:
test:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4
- uses: actions/checkout@v6

- name: Install uv
uses: astral-sh/setup-uv@v4
uses: astral-sh/setup-uv@v7

- name: Set up Python
run: uv python install 3.12
Expand All @@ -46,7 +46,7 @@ jobs:
uv run pytest --cov=xopr --cov-report=html --cov-report=xml --cov-report=term

- name: Upload coverage artifacts
uses: actions/upload-artifact@v4
uses: actions/upload-artifact@v7
with:
name: coverage-report
path: ./htmlcov
Expand All @@ -56,10 +56,10 @@ jobs:
needs: test
steps:
- name: Checkout
uses: actions/checkout@v4
uses: actions/checkout@v6

- name: Install uv
uses: astral-sh/setup-uv@v4
uses: astral-sh/setup-uv@v7

- name: Set up Python
run: uv python install 3.12
Expand Down Expand Up @@ -90,7 +90,7 @@ jobs:
echo "API documentation generated at docs/_build/html/api/"

- name: Download coverage artifacts
uses: actions/download-artifact@v4
uses: actions/download-artifact@v8
with:
name: coverage-report
path: ./coverage-temp
Expand Down Expand Up @@ -152,7 +152,7 @@ jobs:

# Upload artifact for all builds (PR and main)
- name: Upload docs artifact
uses: actions/upload-artifact@v4
uses: actions/upload-artifact@v7
with:
name: docs-html-${{ github.sha }}
path: docs/_build/html
Expand Down Expand Up @@ -181,7 +181,7 @@ jobs:
pull-requests: write
steps:
- name: Download docs artifact
uses: actions/download-artifact@v4
uses: actions/download-artifact@v8
with:
name: docs-html-${{ github.sha }}
path: ./docs-html
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/lint.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ jobs:
name: ruff
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4
- uses: actions/checkout@v6

- uses: benny123tw/action-ruff@v1
with:
Expand Down
18 changes: 9 additions & 9 deletions .github/workflows/publish.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -31,18 +31,18 @@ jobs:
private-key: ${{ secrets.RELEASE_APP_PRIVATE_KEY }}

- name: Checkout code
uses: actions/checkout@v4
uses: actions/checkout@v6
with:
fetch-depth: 0
token: ${{ steps.app-token.outputs.token }}

- name: Set up Python
uses: actions/setup-python@v5
uses: actions/setup-python@v6
with:
python-version: "3.11"

- name: Install uv
uses: astral-sh/setup-uv@v5
uses: astral-sh/setup-uv@v7
with:
enable-cache: true

Expand Down Expand Up @@ -244,20 +244,20 @@ jobs:
runs-on: ubuntu-latest

steps:
- uses: actions/checkout@v4
- uses: actions/checkout@v6
with:
ref: ${{ github.ref }}
fetch-depth: 0
- name: Set up Python
uses: actions/setup-python@v5
uses: actions/setup-python@v6
with:
python-version: "3.11"
- name: Install pypa/build
run: python3 -m pip install build --user
- name: Build a binary wheel and a source tarball
run: python3 -m build
- name: Store the distribution packages
uses: actions/upload-artifact@v4
uses: actions/upload-artifact@v7
with:
name: python-package-distributions
path: dist/
Expand All @@ -277,7 +277,7 @@ jobs:

steps:
- name: Download all the dists
uses: actions/download-artifact@v4
uses: actions/download-artifact@v8
with:
name: python-package-distributions
path: dist/
Expand All @@ -302,7 +302,7 @@ jobs:

steps:
- name: Download all the dists
uses: actions/download-artifact@v4
uses: actions/download-artifact@v8
with:
name: python-package-distributions
path: dist/
Expand All @@ -320,7 +320,7 @@ jobs:

steps:
- name: Checkout code
uses: actions/checkout@v4
uses: actions/checkout@v6
with:
ref: main
fetch-depth: 0
Expand Down
6 changes: 3 additions & 3 deletions .github/workflows/test.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15,10 +15,10 @@ jobs:
python-version: ['3.11', '3.12', '3.13']

steps:
- uses: actions/checkout@v4
- uses: actions/checkout@v6

- name: Install uv
uses: astral-sh/setup-uv@v4
uses: astral-sh/setup-uv@v7

- name: Set up Python ${{ matrix.python-version }}
run: uv python install ${{ matrix.python-version }}
Expand Down
6 changes: 3 additions & 3 deletions .github/workflows/traffic-analytics.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,10 +22,10 @@ jobs:
runs-on: ubuntu-latest
steps:
- name: Checkout repository
uses: actions/checkout@v4
uses: actions/checkout@v6

- name: Setup Python
uses: actions/setup-python@v4
uses: actions/setup-python@v6
with:
python-version: '3.11'

Expand Down Expand Up @@ -238,7 +238,7 @@ jobs:
python .github/scripts/generate_slack_report.py /tmp/traffic-data

- name: Upload artifacts for debugging
uses: actions/upload-artifact@v4
uses: actions/upload-artifact@v7
if: failure()
with:
name: traffic-data-debug-${{ github.run_number }}
Expand Down
6 changes: 3 additions & 3 deletions .github/workflows/update-km-badge.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,12 +16,12 @@ jobs:
pull-requests: write

steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v6
with:
token: ${{ secrets.GITHUB_TOKEN }}

- name: Set up Python
uses: actions/setup-python@v4
uses: actions/setup-python@v6
with:
python-version: '3.11'

Expand Down
Loading
Loading