Skip to content

SingleDraw/trino-iceberg-catalogs

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Trino Iceberg Catalogs

Modular Trino + Iceberg environments powered by Postgres and MinIO, supporting Hive Metastore, REST, and JDBC catalog variants with ClickHouse integration. Provides ready-to-use setups for testing and development with Trino against Iceberg and ClickHouse.


Features

  • Multiple Iceberg catalog configurations:
    • JDBC catalog (Postgres backend)
    • Hive Metastore
    • REST catalog
  • Trino query engine
  • MinIO S3 storage
  • ClickHouse analytics/serving layer
  • Predefined Docker images for reproducible environments

Prerequisites

  • Docker & Docker Compose installed
  • make command available

Usage

  1. Initialize environment:
make init-env
  1. Pull all required Docker images:
make pull-images
  1. Run a selected setup (jdbc, rest, or hms):
make run-<tag>
  1. Run test queries against the catalog:
make test-<tag>
  1. Tear down the setup and remove volumes:
make down-<tag>
  1. Generate a complete merged docker-compose.yml for the selected setup:
make gen-com-<tag>

Notes on Tags

  • [jdbc | rest | hms] — choose the catalog backend:

    • jdbc → Postgres-backed Iceberg catalog
    • rest → Iceberg REST catalog
    • hms → Hive Metastore catalog

Known Issues

  • ClickHouse compatibility: Using clickhouse/clickhouse-server:25.10-alpine or newer may fail with Trino:

    Query <id> failed: Error listing schemas for catalog clickhouse: java.io.IOException: Magic is not correct - expect [-126] but got [123]
    

    Works with clickhouse/clickhouse-server:24.8-alpine.


Contributing

Feel free to open issues or pull requests for:

  • Adding new catalog variants
  • Updating image versions
  • Improving test queries

License

MIT License

About

Modular Trino + Iceberg environments powered by Postgres and MinIO, supporting Hive Metastore, REST, and JDBC catalog variants with ClickHouse integration.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors