Skip to content

Job pods stick around after completion #8

@cubic3d

Description

@cubic3d

Some (currently 4 out of 20) volsync job pods seem to be stuck/awake after === Done === is logged for a while. In my case somewhere between 2 and 10 hours according to logs (see timestamp difference in the last two lines):

2025-09-05T06:02:45.211453310Z kopia Retention policy applied successfully
2025-09-05T06:02:45.211803949Z kopia Kopia completed in 12s
2025-09-05T06:02:45.211866841Z kopia === Done ===
2025-09-05T08:15:12.304959797Z stream closed EOF for automation/volsync-src-home-assistant-nas-2rnkj (kopia)
---
2025-09-04T22:02:09.251557045Z kopia Retention policy applied successfully
2025-09-04T22:02:09.251595170Z kopia Kopia completed in 5s
2025-09-04T22:02:09.251599417Z kopia === Done ===
2025-09-05T08:16:22.284030313Z stream closed EOF for media/volsync-src-bazarr-nas-zz6ss (kopia)

Those pods, after they complete, are not collected/removed by volsync. Volsync seems to pull logs from those pods despite this:

manager 2025-09-05T08:28:08.322Z    INFO    controller.ReplicationSource    Getting logs for pod    {"replicationsource": {"name":"home-assistant-nas","namespace":"automation"}, "method": "Kopia", "jobName": "volsync-src-home-assistant-
nas", "podName": "volsync-src-home-assistant-nas-2rnkj", "pod": {"namespace": "automation", "name": "volsync-src-home-assistant-nas-2rnkj"}}

There are no new snapshots created for those (should be hourly):
Image
Those completed pods are not cleaned up on the next scheduled run, so there are no new backups. After removing the jobs manually (jobs, removing pods has no effect) volsync immediately recreates and reruns the jobs. Unfortunately I lost the volsync manager logs on this event.

I'm on holiday for the next week and can't dig into this right now :)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions