[Chore] Merge Argilla v2.8.0

.devcontainer/docker-compose/docker-compose.yml

@@ -18,7 +18,7 @@ services:
     network_mode: host
 
   elasticsearch:
-    image: docker.elastic.co/elasticsearch/elasticsearch:8.15.0
+    image: docker.elastic.co/elasticsearch/elasticsearch:8.17.0
     ports:
       - "9200:9200"
       - "9300:9300"

.github/copilot-instructions.md

@@ -160,7 +160,6 @@ When contributing to Extralit, consider these guidelines:
    - Keep database models focused on structure, not behavior
    - Use validators for input validation
 4. **Write tests**: Add tests for new functionality in the appropriate test directories
-5. **Document your changes**: Update documentation when adding or changing features
 
 ## Common Development Tasks
 
@@ -185,4 +184,3 @@ When contributing to Extralit, consider these guidelines:
 2. Create or update components in `components/features/`
 3. Connect to the backend using services in `v1/infrastructure/services/`
 4. Add tests for the new functionality
-

.github/workflows/README.md

@@ -0,0 +1,86 @@
+# GitHub Actions Workflows
+
+This directory contains GitHub Actions workflows for building, testing, and deploying the Extralit project. The workflows are designed to run on various events, such as pushes to specific branches, pull requests, and manual triggers.
+
+## Key Workflows
+
+### `argilla.yml`
+
+Builds and publishes the `argilla` SDK Python package.
+
+- **Trigger**: Push to main/develop/releases branches, pull requests, or manual dispatch
+- **Python versions**: 3.9, 3.10, 3.11, 3.12, 3.13
+- **Key steps**:
+  - Build and test the package
+  - Upload test coverage to Codecov
+  - Publish to PyPI
+
+#### Python 3.13 Compatibility
+
+Python 3.13 support requires special handling due to some dependencies not yet being fully compatible:
+
+- The `spacy` dependency is specified with version conditions based on the Python version (v3.8.0+ for Python 3.13)
+- These conditional dependencies ensure the package can be built and tested on Python 3.13
+
+### `argilla-server.yml`
+
+Builds and publishes the `argilla-server` package.
+
+- **Trigger**: Push to main/develop/releases branches, pull requests, or manual dispatch
+- **Key steps**:
+  - Run Elasticsearch, PostgreSQL, Redis, and MinIO services
+  - Build and test the server package
+  - Build Docker images
+  - Publish to PyPI
+- **Frontend integration**: Includes steps to build the frontend and incorporate it into the server package
+
+## Caching Strategy
+
+The workflows use multiple caching strategies to improve build performance:
+
+1. **PDM cache**: Through the `setup-pdm` action
+2. **UV cache**: Through the `actions/cache` action
+   - Key format: `{os}-uv-{python-version}-{pdm_hash}` for argilla
+   - Key format: `{os}-uv-server-{pdm_hash}` for argilla-server
+   - Paths cached: `~/.cache/uv`, `~/.cache/pip`
+
+The UV cache uses the PDM lockfile hash to ensure the cache is invalidated when dependencies change. This approach provides more precise cache invalidation than date-based keys.
+
+## Environment Variables
+
+The workflows set various environment variables:
+
+- `UV_CACHE_DIR`: Location of the UV cache
+- `UV_NO_WAIT`: Prevent UV from waiting for operations to complete (improves CI performance)
+- `UV_SYSTEM_PYTHON`: Use the system Python instead of a virtual environment
+- `PDM_IGNORE_ACTIVE_VENV`: Ignore active virtual environments
+
+Additional environment variables are set in specific workflows:
+- For `argilla-server.yml`: Database connection variables for Postgres, Elasticsearch, Redis, and MinIO
+- For `argilla.yml`: HuggingFace credentials for integration tests
+
+## Common Issues & Solutions
+
+### Package caching not working
+
+If dependencies are still being downloaded despite cache hits:
+
+1. Ensure `pdm.lock` is up-to-date with `pyproject.toml` (run `pdm lock --no-sync`)
+2. Make sure the `pdm.lock` file is committed to the repository (not gitignored)
+3. Check that the cache key properly includes the lockfile hash
+4. Verify that both directories (`~/.cache/uv` and `~/.cache/pip`) are being cached
+
+### Incompatible dependencies
+
+For Python 3.13 or newer Python versions:
+
+1. Use conditional dependencies in `pyproject.toml` with version specifiers
+2. Add special handling in workflows for these Python versions
+3. Skip tests that depend on incompatible packages
+
+## Best Practices
+
+1. Always commit the `pdm.lock` file to ensure reproducible builds
+2. Use conditional dependencies for Python version compatibility
+3. Use caching effectively with proper invalidation strategies
+4. Set up proper test coverage reporting

.github/workflows/argilla-frontend.deploy-environment.yml

@@ -6,7 +6,7 @@ on:
       image-name:
         description: The name of the Docker image to deploy.
         type: string
-        default: argilla/argilla-quickstart-for-dev
+        default: extralit/argilla-quickstart-for-dev
       image-version:
         description: The version of the Docker image to deploy. In the form pr-<PR_NUMBER>.
         type: string

.github/workflows/argilla-frontend.yml

@@ -65,10 +65,20 @@ jobs:
         run: |
           npm run lint
 
-      - name: Run tests 🧪
+      - name: Run tests with coverage 🧪
+        id: run-tests
         continue-on-error: true
         run: |
-          npm run test
+          npm run test:coverage
+
+      - name: Upload frontend test coverage
+        if: always()
+        uses: codecov/codecov-action@v5.4.3
+        with:
+          files: ./coverage/lcov.info
+          flags: frontend
+          token: ${{ secrets.CODECOV_TOKEN }}
+          fail_ci_if_error: false
 
       - name: Build package 📦
         env:
@@ -85,7 +95,7 @@ jobs:
           path: argilla-frontend/dist
 
   build_dev_docker_image:
-    name: Build development argilla-fronted docker image
+    name: Build development argilla-frontend docker image
     needs: build
     uses: ./.github/workflows/argilla-frontend.build-push-dev-frontend-docker.yml
     if: |

.github/workflows/argilla-server.yml

@@ -35,7 +35,7 @@ jobs:
 
     services:
       elasticsearch:
-        image: docker.elastic.co/elasticsearch/elasticsearch:8.15.0
+        image: docker.elastic.co/elasticsearch/elasticsearch:8.17.0
         ports:
           - 9200:9200
         env:
@@ -88,15 +88,26 @@ jobs:
       - name: Checkout Code 🛎
         uses: actions/checkout@v4
 
+      - name: Install uv
+        uses: astral-sh/setup-uv@v5
+        with:
+          pyproject-file: "argilla-server/pyproject.toml"
+          enable-cache: true
+          cache-local-path: ~/.cache/uv
+          cache-dependency-glob: "argilla-server/pdm.lock"
+
       - name: Setup PDM
         uses: pdm-project/setup-pdm@v4
         with:
           python-version-file: argilla-server/pyproject.toml
-          cache-dependency-path: argilla-server/pdm.lock
           cache: true
+          cache-dependency-path: argilla-server/pdm.lock
 
       - name: Install dependencies
-        run: pdm install
+        run: |
+          pdm config use_uv true
+          pdm config python.install_root "$(uv python dir)"
+          pdm install --dev
 
       - name: Run tests 📈
         id: run-tests
@@ -107,13 +118,13 @@ jobs:
           ARGILLA_DATABASE_URL=postgresql://postgres:postgres@localhost:5432/argilla
           ARGILLA_ELASTICSEARCH=http://localhost:9200
           ARGILLA_SEARCH_ENGINE=elasticsearch
-          pdm test tests/unit -vs --cov=argilla_server --cov-report=xml:coverage.xml --junitxml=junit.xml -o junit_family=legacy --tb=short
+          pdm test-cov tests/unit
 
       - name: Upload test coverage
         if: always()
-        uses: codecov/codecov-action@v4
+        uses: codecov/codecov-action@v5.4.3
         with:
-          file: coverage.xml
+          files: coverage.xml
           flags: argilla-server
           token: ${{ secrets.CODECOV_TOKEN }}
 

.github/workflows/argilla-v1.yml

@@ -34,9 +34,9 @@
         uses: actions/checkout@v4
 
       - name: Setup Conda Env 🐍
-        uses: conda-incubator/setup-miniconda@v2
+        uses: conda-incubator/setup-miniconda@v3
         with:
-          miniforge-variant: Mambaforge
+          miniforge-variant: Miniforge3
           miniforge-version: latest
           use-mamba: true
           activate-environment: argilla
@@ -72,19 +72,19 @@
       - name: Run unit tests 📈
         continue-on-error: true
         run: |
-          pip install -e ".[server,listeners]"
+          uv pip install -e ".[server,listeners]"
           pytest tests/unit -vs
 
       - name: Run tests with pandas v2 📈
         continue-on-error: true
         run: |
-          pip install "pandas~=2.0" pytest-custom_exit_code
+          uv pip install "pandas~=2.0" pytest-custom_exit_code
           pytest --suppress-no-test-exit-code tests/unit -vs
 
       - name: Run tests with pydantic v2 📈
         continue-on-error: true
         run: |
-          pip install "pydantic~=2.0" pytest-custom_exit_code
+          uv pip install "pydantic~=2.0" pytest-custom_exit_code
           pytest --suppress-no-test-exit-code tests/unit -vs
 
       - name: Build Package 🍟

.github/workflows/argilla.yml

@@ -29,7 +29,7 @@ jobs:
   build:
     services:
       argilla-server:
-        image: extralitdev/argilla-hf-spaces
+        image: extralitdev/argilla-hf-spaces:develop
         ports:
           - 6900:6900
         env:
@@ -38,6 +38,10 @@ jobs:
           USERNAME: argilla
           PASSWORD: 12345678
           API_KEY: argilla.apikey
+          # Configure storage to use local files instead of MinIO
+          ARGILLA_S3_ENDPOINT: ""
+          ARGILLA_S3_ACCESS_KEY: ""
+          ARGILLA_S3_SECRET_KEY: ""
     runs-on: ubuntu-22.04
     defaults:
       run:
@@ -48,6 +52,15 @@ jobs:
         python-version: ["3.9", "3.10", "3.11", "3.12", "3.13"]
     steps:
       - uses: actions/checkout@v4
+      - name: Install uv
+        uses: astral-sh/setup-uv@v5
+        with:
+          pyproject-file: "argilla/pyproject.toml"
+          python-version: ${{ matrix.python-version }}
+          enable-cache: true
+          cache-local-path: ~/.cache/uv
+          ignore-nothing-to-cache: true
+          cache-dependency-glob: "argilla/pdm.lock"
       - name: Setup PDM
         uses: pdm-project/setup-pdm@v4
         with:
@@ -56,22 +69,61 @@ jobs:
           cache-dependency-path: |
             argilla/pdm.lock
       - name: Install dependencies
+        env:
+          PDM_IGNORE_ACTIVE_VENV: 1
         run: |
+          pdm config use_uv true
+          pdm config python.install_root "$(uv python dir)"
+
+          # Special handling for Python 3.13
+          if [[ "${{ matrix.python-version }}" == "3.13" ]]; then
+            uv pip install --only-binary=:all: spacy thinc pyarrow
+          fi
+
           pdm install
+          uv cache prune --ci
       - name: Wait for argilla server to start
         run: |
           while ! curl -XGET http://localhost:6900/api/_status; do sleep 5; done
+          # Create a directory for local storage that the container can access
+          mkdir -p /tmp/argilla-files
+          chmod -R 777 /tmp/argilla-files
       - name: Set huggingface hub credentials
         run: |
           echo "HF_TOKEN_ARGILLA_INTERNAL_TESTING=${{ secrets.HF_TOKEN_ARGILLA_INTERNAL_TESTING }}" >> "$GITHUB_ENV"
           echo "Enable HF access token"
       - name: Run unit tests
+        id: tests-unit
+        continue-on-error: true
         run: |
-          pdm run test tests/unit
+            pdm run test-cov tests/unit
+
       - name: Run integration tests
+        id: tests-integration
         continue-on-error: true
         run: |
-          pdm run test tests/integration
+            pdm run test-cov tests/integration
+
+      - name: Generate coverage report
+        if: always()
+        continue-on-error: true
+        run: |
+          pdm run coverage xml -o coverage.xml
+          pdm run coverage report
+
+      - name: Upload test coverage
+        if: always()
+        uses: codecov/codecov-action@v5.4.3
+        with:
+          files: coverage.xml
+          flags: argilla
+          token: ${{ secrets.CODECOV_TOKEN }}
+          fail_ci_if_error: false
+
+      - name: Check test status
+        if: steps.tests-unit.outcome == 'failure'
+        run: exit 1
+
       - name: Build package
         run: |
           pdm build
@@ -87,7 +139,7 @@ jobs:
   publish_release:
     name: Publish Release
     runs-on: ubuntu-latest
-    if: ${{ github.ref == 'refs/heads/main' || github.event_name == 'workflow_dispatch' }}
+    if: ${{ github.ref == 'refs/heads/main' || github.event_name == 'workflow_dispatch' }}
 
     permissions:
       # This permission is needed for private repositories.

.gitignore

@@ -138,7 +138,6 @@ sw.*
 
 # yarn & npm
 yarn.lock
-package-lock.json
 
 # App generated files
 src/**/server/static/

argilla-frontend/CHANGELOG.md

@@ -14,6 +14,14 @@ These are the section headers that we use:
 * "Security" in case of vulnerabilities.
 -->
 
+## [Extralit] [0.5.0](https://github.com/extralit/extralit/compare/v0.4.1...v0.5.0)
+
+
+## [Argilla] [2.8.0](https://github.com/argilla-io/argilla/compare/v2.7.1...v2.8.0)
+
+### Added
+
+- Added Japanese language ([#5816](https://github.com/argilla-io/argilla/pull/5816)). Contributed by @Tomoya-Matsubara.
 
 ## [Argilla] [2.7.1](https://github.com/argilla-io/argilla/compare/v2.7.0...v2.7.1)
 

argilla-frontend/__mocks__/styleMock.js

@@ -0,0 +1 @@
+module.exports = {};