MagnetDB

Tools for creating and manipulating a database designed for Magnet simulations. Data may be partly retreived from Lncmi control and monitoring website. See python_magnetrun for more details

Cloning the depot

git clone ...
git submodule update --init --recursive

Development setup

0. Pre-requisites

On your server:

echo "127.0.0.1 handler.sso.lncmig.local api.manager.sso.lncmig.local manager.sso.lncmig.local sso.lncmig.local test.sso.lncmig.local" | sudo tee -a /etc/hosts
echo "127.0.0.1 magnetdb.lncmig.local" | sudo tee -a /etc/hosts
echo "127.0.0.1 magnetdb-api.lncmig.local" | sudo tee -a /etc/hosts
echo "127.0.0.1 magnetdb-worker.lncmig.local" | sudo tee -a /etc/hosts
echo "127.0.0.1 redis.lncmig.local" | sudo tee -a /etc/hosts
echo "127.0.0.1 postgres.lncmig.local" | sudo tee -a /etc/hosts
echo "127.0.0.1 pgadmin.lncmig.local" | sudo tee -a /etc/hosts
echo "127.0.0.1 minio.lncmig.local" | sudo tee -a /etc/hosts

Create a self signed certificate for the magnetdb server

mkdir -p certs
openssl req -new -x509 -days 365 -nodes -out certs/cert.pem -keyout certs/cert.key
chmod 600 certs/cert.perm certs.cert.key

NB: eventually remove poetry-cache data before starting the services

1. Start the services

docker-compose up

The first time you run the service, you would need to:

• Fix the permissions for pgadmin-data

sudo chown -R 5050:0 pgadmin-data

2. Set timezone in nginx-proxy

docker exec -it magnetdb-nginx-proxy

then run

ln -snf /usr/share/zoneinfo/Europe/Paris /etc/localtime
echo "Europe/Paris" > /etc/timezone

3. Create/Update Database

docker exec -it magnetdb-api /bin/bash

In the container, to perform database migration run:

poetry run python3 manage.py migrate

Eventually, run seeds to populate the database

export DATA_DIR=/data
poetry run python3 -m python_magnetdb.seeds.seeds
poetry run python3 -m python_magnetdb.seeds.seed-again
poetry run python3 -m python_magnetdb.seeds.seed-records

4. Configure LemonLDAP (https://github.com/LemonLDAPNG/lemonldap-ng-docker):

   1. Sign in to http://lemon.magnetdb-dev.local/ with dwho/dwho
   2. Enable OpenID Connect in Administration > WebSSO Manager > General Parameters > Issuer modules > OpenID Connect
   3. Create OpenID relying party in Administration > WebSSO Manager > OpenID Connect Relying Parties > Add OpenID Relying Party
   4. Go in Administration > WebSSO Manager > OpenID Connect Relying Parties > "Name of the relying party" > Options > Basic
   5. Set Client ID to testid
   6. Set Client secret to testsecret
   7. Set Allowed redirection addresses for login to http://localhost:8080magnetdb-dev.local/sign_in

5. Setup pgadmin

Load localhost:5050/ in your web browser add a server for magnetdb

Note: This may be needed to update the magnetdb IP after each restart of docker-compose Check magnetdb ip server with: docker inspect postgres-app | grep IPAddress

6. Custom LemonLDAP settings

docker exec -it lemonldap-app bash

7. To test

To change Lemonldap settings

firefox --private-window http://sso.lncmig.local

To change user role:

firefox --private-window http://localhost:5050/

To start magnetdb:

firefox --private-window http://localhost:8080/

To start magnetdb swagger UI:

firefox --private-window http://localhost:8000/docs

NB: see https://fastapi.tiangolo.com/tutorial/metadata/ to custom swagger UI