Skip to content

DL 124 delete tascomi glue jobs and fix rentsense trigger issue#2708

Merged
Tian-2017 merged 7 commits intomainfrom
DL-124-delete-tascomi-glue-jobs
Apr 1, 2026
Merged

DL 124 delete tascomi glue jobs and fix rentsense trigger issue#2708
Tian-2017 merged 7 commits intomainfrom
DL-124-delete-tascomi-glue-jobs

Conversation

@Tian-2017
Copy link
Copy Markdown
Contributor

@Tian-2017 Tian-2017 commented Mar 31, 2026

Changes:

  • Delete the Tascomi Glue jobs.
  • 12-aws-s3-scripts.tf‎: Delete resource "aws_s3_object" "hackney_bank_holiday
  • Move the Tascomi database creation from the 24-aws-glue-tacomi-data.tf to 61-aws-glue-catalog-database.tf.
  • Keep all the crawlers for debugging purposes, as they may help us quickly recreate some tables. We could delete them after a while. Rename them and move them to 34-aws-glue-crawlers.tf.
  • 43-aws-glue-job-rentsense.tf: Fix a bug caused by the removal of two housing Glue jobs. No crawler works as the trigger for the RentSense jobs. The RentSense jobs will be triggered from Airflow.
  • 50-aws-iam-policies.tf: Added permission to start Glue jobs and get job runs, which will be used in Airflow to start the two RentSense jobs.

@Tian-2017 Tian-2017 requested review from a team as code owners March 31, 2026 12:45
@Tian-2017 Tian-2017 changed the title DL 124 delete tascomi glue jobs DL 124 delete tascomi glue jobs and fix Rentsense trigger issue Mar 31, 2026
@Tian-2017 Tian-2017 changed the title DL 124 delete tascomi glue jobs DL 124 delete tascomi glue jobs and fix Rentsense trigger issue Mar 31, 2026
@Tian-2017 Tian-2017 changed the title DL 124 delete tascomi glue jobs and fix Rentsense trigger issue DL 124 delete tascomi glue jobs and fix rentsense trigger issue Mar 31, 2026
@sonarqubecloud
Copy link
Copy Markdown

@Tian-2017 Tian-2017 merged commit cae05cc into main Apr 1, 2026
11 of 14 checks passed
@Tian-2017 Tian-2017 deleted the DL-124-delete-tascomi-glue-jobs branch April 1, 2026 14:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants