-
Notifications
You must be signed in to change notification settings - Fork 5
1.7.3 #196
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
1.7.3 #196
Changes from all commits
Commits
Show all changes
35 commits
Select commit
Hold shift + click to select a range
baf38e8
initial service file commit
digitalghost-dev 58980ea
initial commit
digitalghost-dev 572bf86
initial dagster config commit
digitalghost-dev ecb172d
adding footnotes extension
digitalghost-dev 473d845
updating version numbers
digitalghost-dev 60e2df1
updating page weight
digitalghost-dev 401c463
updating test data
digitalghost-dev 6075b5a
adding instructions for Elastic IPs and EventBridge
digitalghost-dev 85d5c5c
adding project creation steps
digitalghost-dev 8abe524
adding cloud deployment page
digitalghost-dev e9d9a92
removing files
digitalghost-dev ea93523
adding file path comment
digitalghost-dev 6814339
updating weights and headers
digitalghost-dev 4d2425d
updating version numbers
digitalghost-dev b720f6b
adding custom .svg image
digitalghost-dev 343a8fb
adding stylesheet extension
digitalghost-dev 031ed58
initial commit
digitalghost-dev 7a4e8ce
updating version numbers
digitalghost-dev c0fc72f
Updating to Go v1.24.6 (#192)
digitalghost-dev 7f4f791
updating secret name
digitalghost-dev 36d3d4b
adding systemd instructions
digitalghost-dev 035d6a8
initial commit
digitalghost-dev 4e7179e
adding secrets manager section
digitalghost-dev 32db79a
fixing formatting
digitalghost-dev f75ccce
fixing incorrect function call (#193)
digitalghost-dev dd8929a
removing hardcoded `baseURL` (#194)
digitalghost-dev 6402b82
adding exit code to error handling (#195)
digitalghost-dev 8d8cde8
updating modernc.org/sqlite dependency
digitalghost-dev 91ed75d
updating function call (#193)
digitalghost-dev 229062a
adding prerequisite steps
digitalghost-dev 49fd819
restrict container styling to admonitions and details only
digitalghost-dev 672e5e0
fixing typo
digitalghost-dev 11fd7ee
add security hardening directives to dagster service
digitalghost-dev 7f3dc99
fixing formatting inconsistencies, reflecting new `start-dagster.sh` …
digitalghost-dev 95ab90f
validate secrets before starting Dagster
digitalghost-dev File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,12 @@ | ||
| storage: | ||
| postgres: | ||
| postgres_db: | ||
| username: postgres | ||
| password: | ||
| env: AWS_RDS_PASSWORD | ||
| hostname: | ||
| env: AWS_RDS_HOSTNAME | ||
| db_name: postgres | ||
| port: 5432 | ||
| params: | ||
| sslmode: require |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,25 @@ | ||
| # /etc/systemd/system/dagster.service | ||
| [Unit] | ||
| Description=Dagster Development Server | ||
| After=network-online.target | ||
| Wants=network-online.target | ||
|
|
||
| [Service] | ||
| Type=simple | ||
| User=ubuntu | ||
| WorkingDirectory=/home/ubuntu/card_data/card_data | ||
| Environment="AWS_DEFAULT_REGION=us-west-2" | ||
| Environment="PATH=/home/ubuntu/card_data/card_data/.venv/bin:/usr/local/bin:/usr/bin:/bin" | ||
| NoNewPrivileges=true | ||
| PrivateTmp=true | ||
| ProtectSystem=strict | ||
| ProtectHome=read-only | ||
| ExecStartPre=/home/ubuntu/wait-for-rds.sh | ||
| ExecStart=/home/ubuntu/start-dagster.sh | ||
| Restart=on-failure | ||
| RestartSec=10 | ||
| StandardOutput=journal | ||
| StandardError=journal | ||
|
|
||
| [Install] | ||
| WantedBy=multi-user.target |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,58 @@ | ||
| #!/bin/bash | ||
|
|
||
| # Fetch secrets from AWS Secrets Manager | ||
| SUPABASE_SECRETS=$(aws secretsmanager get-secret-value \ | ||
| --secret-id supabase \ | ||
| --region us-west-2 \ | ||
| --query SecretString \ | ||
| --output text) | ||
|
|
||
| AWS_RDS_SECRETS_PW=$(aws secretsmanager get-secret-value \ | ||
| --secret-id '<secret-name>' \ | ||
| --region us-west-2 \ | ||
| --query SecretString \ | ||
| --output text) | ||
|
|
||
| AWS_RDS_SECRETS_HN=$(aws secretsmanager get-secret-value \ | ||
| --secret-id rds-hostname \ | ||
| --region us-west-2 \ | ||
| --query SecretString \ | ||
| --output text) | ||
|
|
||
| # Extract values | ||
| SUPABASE_PASSWORD=$(echo "$SUPABASE_SECRETS" | jq -r '.password') | ||
| if [ -z "$SUPABASE_PASSWORD" ] || [ "$SUPABASE_PASSWORD" = "null" ]; then | ||
| echo "ERROR: missing SUPABASE_PASSWORD from supabase secret" >&2 | ||
| exit 1 | ||
| fi | ||
| export SUPABASE_PASSWORD | ||
|
|
||
| SUPABASE_USER=$(echo "$SUPABASE_SECRETS" | jq -r '.user') | ||
| if [ -z "$SUPABASE_USER" ] || [ "$SUPABASE_USER" = "null" ]; then | ||
| echo "ERROR: missing SUPABASE_USER from supabase secret" >&2 | ||
| exit 1 | ||
| fi | ||
| export SUPABASE_USER | ||
|
|
||
| AWS_RDS_PASSWORD=$(echo "$AWS_RDS_SECRETS_PW" | jq -r '.password') | ||
| if [ -z "$AWS_RDS_PASSWORD" ] || [ "$AWS_RDS_PASSWORD" = "null" ]; then | ||
| echo "ERROR: missing AWS_RDS_PASSWORD from RDS secret" >&2 | ||
| exit 1 | ||
| fi | ||
| export AWS_RDS_PASSWORD | ||
|
|
||
| AWS_RDS_HOSTNAME=$(echo "$AWS_RDS_SECRETS_HN" | jq -r '.hostname') | ||
| if [ -z "$AWS_RDS_HOSTNAME" ] || [ "$AWS_RDS_HOSTNAME" = "null" ]; then | ||
| echo "ERROR: missing AWS_RDS_HOSTNAME from rds-hostname secret" >&2 | ||
| exit 1 | ||
| fi | ||
| export AWS_RDS_HOSTNAME | ||
|
digitalghost-dev marked this conversation as resolved.
|
||
|
|
||
| DAGSTER_HOME=/home/ubuntu/card_data/card_data/ | ||
| export DAGSTER_HOME | ||
|
|
||
| # Activate the virtual environment | ||
| source /home/ubuntu/card_data/card_data/.venv/bin/activate | ||
|
|
||
| # Start Dagster | ||
| exec dg dev --host 0.0.0.0 --port 3000 | ||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,22 @@ | ||
| #!/bin/bash | ||
|
|
||
| MAX_TRIES=20 | ||
| COUNT=0 | ||
|
|
||
| RDS_HOST="<rds-instance-id>.<region>.rds.amazonaws.com" | ||
|
digitalghost-dev marked this conversation as resolved.
|
||
| RDS_PORT=5432 | ||
|
|
||
| echo "Checking if RDS is available..." | ||
|
|
||
| while [ $COUNT -lt $MAX_TRIES ]; do | ||
| if nc -z -w5 $RDS_HOST $RDS_PORT 2>/dev/null; then | ||
| echo "RDS is available!" | ||
| exit 0 | ||
| fi | ||
| COUNT=$((COUNT + 1)) | ||
| echo "Attempt $COUNT/$MAX_TRIES - RDS not ready yet..." | ||
| sleep 10 | ||
| done | ||
|
|
||
| echo "RDS did not become available in time" | ||
| exit 1 | ||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,5 +1,5 @@ | ||
| name: 'poke_cli_dbt' | ||
| version: '1.7.2' | ||
| version: '1.7.3' | ||
|
|
||
| profile: 'poke_cli_dbt' | ||
|
|
||
|
|
||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.