Skip to content

Keep jobs running across queue restarts #35

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
taagarwa-rh wants to merge 13 commits into
base: main
Choose a base branch
from
Open

Keep jobs running across queue restarts #35

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
86e922a
Keep jobs running across queue restarts
taagarwa-rh Sep 1, 2026
898ae95
Fix persistent queue recovery cleanup
taagarwa-rh Sep 1, 2026
ece212d
Merge branch 'main' into feat/queue-persistence
taagarwa-rh Sep 2, 2026
f0b98cf
Fix locking when adopting Nebius instances
taagarwa-rh Sep 3, 2026
779aaa4
Remove stale active job references
taagarwa-rh Sep 3, 2026
df263e4
Bound recovery cleanup retries
taagarwa-rh Sep 3, 2026
7d6547c
Document Nebius restart cleanup policy
taagarwa-rh Sep 3, 2026
88c6368
Scope legacy Harbor pod cleanup
taagarwa-rh Sep 3, 2026
c30d2ea
Isolate recovery test imports
taagarwa-rh Sep 3, 2026
b0c6e05
Preserve OpenRouter job environment
taagarwa-rh Sep 3, 2026
c662dd8
Bound recovered job inspection retries
taagarwa-rh Sep 3, 2026
98ed20f
Delete Nebius instance on job cancellation
taagarwa-rh Sep 3, 2026
c859522
Merge branch 'main' into feat/queue-persistence
taagarwa-rh Sep 4, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
11 changes: 8 additions & 3 deletions deploy/job-queue-service.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,9 @@ metadata:
name: job-queue
app: job-queue
spec:
replicas: 1
strategy:
type: Recreate
selector:
matchLabels:
app: job-queue
Expand All @@ -33,6 +36,7 @@ spec:
app: job-queue
component: api
spec:
terminationGracePeriodSeconds: 60
serviceAccountName: harbor-orchestrator
securityContext:
fsGroup: 1001
Expand All @@ -45,9 +49,10 @@ spec:
mkdir -p ~/.ssh && \
([ -f /app/data/nebius-ssh-key ] || ssh-keygen -t ed25519 -f /app/data/nebius-ssh-key -N "" -q) && \
chmod 600 /app/data/nebius-ssh-key && \
NEBIUS_SSH_PUBLIC_KEY_PATH=/app/data/nebius-ssh-key.pub \
NEBIUS_SSH_PRIVATE_KEY_PATH=/app/data/nebius-ssh-key \
uv run uvicorn coding_agent_bench.api:app --host 0.0.0.0 --port 8443 \
exec env \
NEBIUS_SSH_PUBLIC_KEY_PATH=/app/data/nebius-ssh-key.pub \
NEBIUS_SSH_PRIVATE_KEY_PATH=/app/data/nebius-ssh-key \
uv run uvicorn coding_agent_bench.api:app --host 0.0.0.0 --port 8443 \
--ssl-certfile /etc/job-queue/tls/tls.crt \
--ssl-keyfile /etc/job-queue/tls/tls.key
resources:
Expand Down
Loading