Skip to content

DS-2171: Enhance TaskedSpaceBasedStep - task query recovery for serve…#1857

Merged
mchrza merged 8 commits into
masterfrom
DS-2171_6
Jul 17, 2026
Merged

DS-2171: Enhance TaskedSpaceBasedStep - task query recovery for serve…#1857
mchrza merged 8 commits into
masterfrom
DS-2171_6

Conversation

@mchrza

@mchrza mchrza commented Jun 8, 2026

Copy link
Copy Markdown
Contributor

…rside killed queries.

Change job_data table layout - add new columns: unknown_query_state_cnt,retry_attempts,started_at,updated_at. TaskProgress: extend Model with startedNotFinalizedTaskIds - to be able to know the exact running taksIds. SQLQuery: add areRunning() method to check multiple queries if they are running. TaskedSpaceBasedStep:

  • update all job_data write queries to maintain new timestamps
  • add a new taskId label to the running taskQueries
  • improve getExecutionState() handling. Use expected taskIds to check if the related Queries are running. Add a retry mechanism for queries which are disappeared (eg. server side termination)

@mchrza
mchrza requested a review from a team as a code owner June 8, 2026 14:35
Comment thread xyz-jobs/xyz-job-steps/src/main/resources/jobs/transport.sql Outdated
Comment thread xyz-jobs/xyz-job-steps/src/main/resources/jobs/transport.sql Outdated
Comment thread xyz-util/src/main/java/com/here/xyz/util/db/SQLQuery.java Outdated
mchrza added 7 commits July 17, 2026 10:42
…rside killed queries.

Change job_data table layout - add new columns: unknown_query_state_cnt,retry_attempts,started_at,updated_at.
TaskProgress: extend Model with startedNotFinalizedTaskIds - to be able to know the exact running taksIds.
SQLQuery: add areRunning() method to check multiple queries if they are running.
TaskedSpaceBasedStep:
* update all job_data write queries to maintain new timestamps
* add a new taskId label to the running taskQueries
* improve getExecutionState() handling. Use expected taskIds to check if the related Queries are running. Add a retry mechanism for queries which are disappeared (eg. server side termination)

Signed-off-by: mchrza <maximilian.chrzan@here.com>
Signed-off-by: mchrza <maximilian.chrzan@here.com>
Signed-off-by: mchrza <maximilian.chrzan@here.com>
Signed-off-by: mchrza <maximilian.chrzan@here.com>
Signed-off-by: mchrza <maximilian.chrzan@here.com>
Signed-off-by: mchrza <maximilian.chrzan@here.com>

Signed-off-by: mchrza <maximilian.chrzan@here.com>
Signed-off-by: mchrza <maximilian.chrzan@here.com>

Signed-off-by: mchrza <maximilian.chrzan@here.com>
Signed-off-by: mchrza <maximilian.chrzan@here.com>

Signed-off-by: mchrza <maximilian.chrzan@here.com>
@mchrza
mchrza merged commit 698b74c into master Jul 17, 2026
3 checks passed
@mchrza
mchrza deleted the DS-2171_6 branch July 17, 2026 14:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants