Skip to content

Build libmeos via the shared provision-meos action #21

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
estebanzimanyi merged 1 commit into from
Jul 10, 2026
Merged

Build libmeos via the shared provision-meos action #21

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
56 changes: 22 additions & 34 deletions .github/workflows/maven.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -20,40 +20,28 @@ jobs:
java-version: "21"
cache: maven

# Prefer apt.postgresql.org over the runner's preinstalled PostgreSQL so
# the postgresql-server-dev package resolves cleanly. Only pg_config is
# needed here — pgPointCloud produces a static libpc.a, no server.
- name: Remove existing PostgreSQL installations [prefer apt.postgresql.org]
run: |
sudo service postgresql stop || true
sudo apt-get --purge remove postgresql* -y || true
sudo rm -rf /var/lib/postgresql/ /etc/postgresql/ \
/var/log/postgresql/ || true

- name: Add PostgreSQL APT repository
run: |
sudo apt-get install -y curl ca-certificates gnupg
curl https://www.postgresql.org/media/keys/ACCC4CF8.asc \
| sudo apt-key add -
sudo sh -c 'echo "deb http://apt.postgresql.org/pub/repos/apt/ \
$(lsb_release -cs)-pgdg main" > /etc/apt/sources.list.d/pgdg.list'

- name: Install MEOS build dependencies
run: |
sudo apt-get update -qq
sudo apt-get install -y \
cmake build-essential \
libjson-c-dev libgeos-dev libproj-dev libgsl-dev \
libh3-dev libgdal-dev libxml2-dev \
autoconf automake libtool pkg-config \
postgresql-17 postgresql-server-dev-17

- name: Build libmeos.so + JMEOS.jar from the tracked commit
# build-jmeos.sh builds libmeos from the recorded MobilityDB commit, builds the
# JMEOS jar from JMEOS main, installs the jar into the local Maven repo, and stages
# libmeos.so under kafka-streams-app/lib. MOBILITYDB_REF is read from the single
# recorded surface commit so no SHA is duplicated in this workflow.
run: MOBILITYDB_REF="$(tr -d '[:space:]' < tools/meos-source-commit.txt)" JOBS=2 ./build-jmeos.sh
# Read the pinned MobilityDB commit from the single recorded surface file
# so no SHA is duplicated across this workflow.
- name: Read the pinned MobilityDB commit
id: meos
run: echo "sha=$(tr -d '[:space:]' < tools/meos-source-commit.txt)" >> "$GITHUB_OUTPUT"

# Build and install libmeos (all families, + spatial_ref_sys.csv /
# ways1000.csv under /usr/local/share) through the shared MEOS build
# recipe instead of an inline copy of it. build-jmeos.sh then only builds
# the JMEOS jar against this installed libmeos.
- name: Build and install libmeos via the shared provision-meos action
uses: MobilityDB/MEOS-API/.github/actions/provision-meos@master
with:
mobilitydb-ref: ${{ steps.meos.outputs.sha }}
build-libmeos: "true"

- name: Build JMEOS.jar against the installed libmeos
# libmeos is already built and installed under /usr/local by the
# provision-meos action, so build-jmeos.sh skips its own libmeos build
# and only builds the JMEOS jar from JMEOS main, installs it into the
# local Maven repo, and stages libmeos.so under kafka-streams-app/lib.
run: JOBS=2 ./build-jmeos.sh

- name: Test the Kafka Streams app
# The generated MeosOps* facades forward to the installed JMEOS jar; the tests
Expand Down
95 changes: 53 additions & 42 deletions build-jmeos.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -93,48 +93,59 @@ clone_at() {
}

# ---------------------------------------------------------------------------
# 1. Build libmeos.so from MobilityDB.
# ---------------------------------------------------------------------------
MDB_DIR="${WORK_DIR}/MobilityDB"
clone_at "${MOBILITYDB_REPO}" "${MOBILITYDB_REF}" "${MDB_DIR}"

# Build every optional MEOS family via -DALL so the facades link against a
# libmeos with the full symbol surface (circular buffers, H3, JSON, network
# points, pgPointCloud, geoposes, quadbin, raster, rigid geometries, Arrow).
# H3 is pinned to the distro's system library (the CI apt step installs
# libh3-dev); pgPointCloud's vendored libpc.a needs pg_config, pinned to the
# apt.postgresql.org PostgreSQL 17 the CI workflow installs. Override via
# MEOS_CMAKE_ARGS for a non-Debian layout.
MEOS_CMAKE_ARGS="${MEOS_CMAKE_ARGS:--DALL=ON -DH3_LIBRARY=/usr/lib/x86_64-linux-gnu/libh3.so -DH3_INCLUDE_DIR=/usr/include/h3 -DPOSTGRESQL_PG_CONFIG=/usr/lib/postgresql/17/bin/pg_config}"

log "Building libmeos.so (MEOS=ON ${MEOS_CMAKE_ARGS})"
rm -rf "${MDB_DIR}/build"
cmake -S "${MDB_DIR}" -B "${MDB_DIR}/build" -DMEOS=ON ${MEOS_CMAKE_ARGS} >/dev/null
cmake --build "${MDB_DIR}/build" --target meos -j "${JOBS}"

LIBMEOS_SO="$(find "${MDB_DIR}/build" -name 'libmeos.so' -print -quit)"
[ -n "${LIBMEOS_SO}" ] || { echo "error: libmeos.so not produced by the MEOS build" >&2; exit 1; }
log "Built ${LIBMEOS_SO}"

# ---------------------------------------------------------------------------
# 1b. Provision MEOS's SRID/network reference data at its default runtime path.
# ---------------------------------------------------------------------------
# libmeos resolves SRIDs by reading spatial_ref_sys.csv from a fixed default
# path (meos/src/geo/tspatial_transform_meos.c: SPATIAL_REF_SYS_CSV =
# "/usr/local/share/spatial_ref_sys.csv"). A full `cmake --install` would place
# it there (meos/CMakeLists.txt), but this script only builds the `meos` target,
# so the data files are staged explicitly. Without them, any SRID-touching call
# (npoint, tgeompoint) makes libmeos print "Cannot open the spatial_ref_sys.csv
# file" to stdout, which corrupts the surefire fork channel and terminates the
# JVM under test ("The forked VM terminated without properly saying goodbye").
MEOS_DATA_DIR="${MEOS_DATA_DIR:-/usr/local/share}"
log "Provisioning MEOS reference data into ${MEOS_DATA_DIR}"
provision_data() {
local src="$1" dst="$2"
install -Dm644 "${src}" "${dst}" 2>/dev/null || sudo install -Dm644 "${src}" "${dst}"
}
provision_data "${MDB_DIR}/meos/src/geo/spatial_ref_sys.csv" "${MEOS_DATA_DIR}/spatial_ref_sys.csv"
provision_data "${MDB_DIR}/meos/examples/data/ways1000.csv" "${MEOS_DATA_DIR}/ways1000.csv"
# 1. Obtain libmeos.so.
# ---------------------------------------------------------------------------
# When a libmeos is already installed — e.g. CI builds and installs it through
# the shared MobilityDB/MEOS-API provision-meos action, whose `cmake --install`
# also provisions spatial_ref_sys.csv / ways1000.csv under /usr/local/share —
# reuse it and build only the JMEOS jar against it. Otherwise build libmeos from
# the pinned MobilityDB commit here (and stage the reference data explicitly).
INSTALLED_LIBMEOS="${INSTALLED_LIBMEOS:-/usr/local/lib/libmeos.so}"
if [ -f "${INSTALLED_LIBMEOS}" ]; then
LIBMEOS_SO="${INSTALLED_LIBMEOS}"
log "Reusing pre-installed libmeos: ${LIBMEOS_SO} (skipping the MobilityDB build)"
else
MDB_DIR="${WORK_DIR}/MobilityDB"
clone_at "${MOBILITYDB_REPO}" "${MOBILITYDB_REF}" "${MDB_DIR}"

# Build every optional MEOS family via -DALL so the facades link against a
# libmeos with the full symbol surface (circular buffers, H3, JSON, network
# points, pgPointCloud, geoposes, quadbin, raster, rigid geometries, Arrow).
# H3 is pinned to the distro's system library (the CI apt step installs
# libh3-dev); pgPointCloud's vendored libpc.a needs pg_config, pinned to the
# apt.postgresql.org PostgreSQL 17 the CI workflow installs. Override via
# MEOS_CMAKE_ARGS for a non-Debian layout.
MEOS_CMAKE_ARGS="${MEOS_CMAKE_ARGS:--DALL=ON -DH3_LIBRARY=/usr/lib/x86_64-linux-gnu/libh3.so -DH3_INCLUDE_DIR=/usr/include/h3 -DPOSTGRESQL_PG_CONFIG=/usr/lib/postgresql/17/bin/pg_config}"

log "Building libmeos.so (MEOS=ON ${MEOS_CMAKE_ARGS})"
rm -rf "${MDB_DIR}/build"
cmake -S "${MDB_DIR}" -B "${MDB_DIR}/build" -DMEOS=ON ${MEOS_CMAKE_ARGS} >/dev/null
cmake --build "${MDB_DIR}/build" --target meos -j "${JOBS}"

LIBMEOS_SO="$(find "${MDB_DIR}/build" -name 'libmeos.so' -print -quit)"
[ -n "${LIBMEOS_SO}" ] || { echo "error: libmeos.so not produced by the MEOS build" >&2; exit 1; }
log "Built ${LIBMEOS_SO}"

# -------------------------------------------------------------------------
# 1b. Provision MEOS's SRID/network reference data at its default runtime path.
# -------------------------------------------------------------------------
# libmeos resolves SRIDs by reading spatial_ref_sys.csv from a fixed default
# path (meos/src/geo/tspatial_transform_meos.c: SPATIAL_REF_SYS_CSV =
# "/usr/local/share/spatial_ref_sys.csv"). A full `cmake --install` would place
# it there (meos/CMakeLists.txt), but this branch only builds the `meos` target,
# so the data files are staged explicitly. Without them, any SRID-touching call
# (npoint, tgeompoint) makes libmeos print "Cannot open the spatial_ref_sys.csv
# file" to stdout, which corrupts the surefire fork channel and terminates the
# JVM under test ("The forked VM terminated without properly saying goodbye").
MEOS_DATA_DIR="${MEOS_DATA_DIR:-/usr/local/share}"
log "Provisioning MEOS reference data into ${MEOS_DATA_DIR}"
provision_data() {
local src="$1" dst="$2"
install -Dm644 "${src}" "${dst}" 2>/dev/null || sudo install -Dm644 "${src}" "${dst}"
}
provision_data "${MDB_DIR}/meos/src/geo/spatial_ref_sys.csv" "${MEOS_DATA_DIR}/spatial_ref_sys.csv"
provision_data "${MDB_DIR}/meos/examples/data/ways1000.csv" "${MEOS_DATA_DIR}/ways1000.csv"
fi

# ---------------------------------------------------------------------------
# 2. Build JMEOS.jar against that libmeos.so.
Expand Down
Loading