Add hoglake as a write destination - #141

Merged

jghoman merged 41 commits into

mainfrom

jakob/hoglake-sink

Sep 23, 2026

Commits on Sep 18, 2026

deps: add pyhoglake >=1.1.0 for the hoglake destination
jghoman
committed
017d54d
sink: recover the destination seam from final-iceberg
jghoman
committed
5711d2a
config: hoglake destination block
jghoman
committed
a17243e
hoglake: HoglakeSink backend (text-only) + make_sink dispatch
jghoman
committed
86b754a
hoglake: refuse VARIANT config at startup; count files per append
jghoman
committed
9e7418a
test: hoglake integration suite against a real server stack
jghoman
committed
eb18424
test: hoglake e2e — full pipeline through main.py
jghoman
committed
e965826
docs: hoglake destination reference
jghoman
committed
87591d9
hoglake: stop reserving year/month/day/hour; cap column names at 128
jghoman
committed
41d8e82
config: own MILLPOND_HTTP_PORT; scope the group id and error labels by destination
jghoman
committed
5d8a32a
hoglake: wire the failure classifier into the retry loop; own the retry budget
jghoman
committed
fbf63ab
hoglake: add new columns in one alter, not one commit each
jghoman
committed
7001e88
hoglake: make the spec declaration atomic-or-recoverable and reconcile it on every resolve
jghoman
committed
c169441
hoglake: publish each flush under an idempotency key derived from its Kafka offsets
jghoman
committed
18358d0
ci: run both hoglake suites, and fail rather than skip when the stack is missing
jghoman
committed
e3c7c69
docs: correct the hoglake delivery and cleanup claims; document the new knobs
jghoman
committed
ff89656
hoglake: raise instead of assert on the prepared-payload invariant
jghoman
committed
9c2b51f
hoglake: null-fill against the schema the commit is aligned to
jghoman
committed
bca5125
hoglake: make the sink's own refusals permanent, not "unknown"
jghoman
committed
8f078d6
hoglake: make the idempotency key name the rows it publishes
jghoman
committed
3229f94
docs: say what the idempotency key buys, and where it stops
jghoman
committed
45fe229
test: cover the seams the mutation run walked straight through
jghoman
committed
47fb036
hoglake: unbury the server's backpressure signal, and bound the knobs
jghoman
committed
7c52829
docs: the knob table follows the knobs
jghoman
committed
4595dc6
test: size the two ordering tests so the mutants actually die
jghoman
committed
bc1d560
test: exercise the reused-key branch against the real server
jghoman
committed
29694c7
hoglake: name every guard from the incarnation the flush resolved
jghoman
committed
30b396b
hoglake: one exception arm for the refusals the server answered
jghoman
committed
286c687
hoglake: retire the KeyError arm the null-fill made unreachable
jghoman
committed
bf698ff
hoglake: drop the dead _prepared_key state
jghoman
committed
ceed622
test: pin the four seams the mutation run still walked through
jghoman
committed
26cbadd
docs: correct the offset-identity, jitter and collision claims
jghoman
committed
4833067
test: exercise the stale-handle recreation against the real server
jghoman
committed
cd00fcc
docs: state what the recreation and partial-upload rows now mean
jghoman
committed
3873616
hoglake: stop booking orphans for uploads that never happened
jghoman
committed
8f73728
docs: say what the orphan counter actually counts
jghoman
committed
5f7251e
hoglake: drop the alignment guard no input can take
jghoman
committed
f4ab7ab
Merge remote-tracking branch 'origin/main' into jakob/hoglake-sink
jghoman
committed
231249c
deps: floor pyhoglake at 1.1.1 for its upload accounting
jghoman
committed
0c4c258
hoglake: count the orphans a failed prepare really left, and name them
jghoman
committed
20bc09e
docs: the orphan counter is exact now, and the prefix is not the sweep unit
jghoman
committed
d06df7c