Fold hourly 0049 HIGH - #60
Conversation
Open-Jev JevBench public-subset densify on §125 (HEAD f46ff; 231 ≠ 534). kev night-2 35B MMLU-Pro 0.550 densify on §45 (evaluate.load bf16 honour). Novel HIGH first cards for browser-use, routers, Gemma heads, recruiter. notes.md §136 / composition 585–600 / findings batch #118. *theirs* not Harbor. Co-authored-by: Basit Mustafa <24601@users.noreply.github.com>
|
Testing gate: PASS Independent adversarial review + tests on head Prior twenty-two uniqueness locks (0843–2347 + Open-Jev densify) + REVISIT_LOCK are byte-identical vs
IDs. Claimed Adversarial
Notes, not FAILs. Star-noise after snapshot: Open-Jev 28★ still matches; kev 1260★ vs fold 1252★; jev-browser-use 284★ vs fold 282★; jev-router 271★ vs fold 270★. JevRouter 124★ / daseinlabs/open-jev 75★ still match. Hub archerhume/4rcherhume HTTP 401 this pass (fold 401). kev description/README gitblobs still match. Open-Jev live HEAD/README moved after the 06:58Z snapshot (see above). JevLoop live HEAD is now Ready for parent review. PR stays open. Do not merge from this agent. |
Off latest
mainafter merged #59 (28d5c81Fold hourly 2347 HIGH). Do not reopen or amend PR #23–#59. Do not bump 0.5.0.Hourly 0049 HIGH fold. Jev is the exemplar of a backend-agnostic class of categorization/scoring/typed-decision models, not the whole mandate. REVISIT densifies original cards:
Zefan-Cai/Open-Jevon §125,jaredpalmer/kevon §45. Do not mint sibling first sightings. SHA move is not a replica. Third-party benches stay theirs.REVISIT densify (theirs)
Zefan-Cai/Open-JevJevBench public-subset baselines. Live 28★. HEAD48346d/ promptafb5226982c7→ livef46ff604f794(hard-data pipeline; new model gains have not been measured). README SHAce1a587219e4→e32c4bbd519c. Quote theirs: Publish audited JevBench public-subset baselines; community benchmark plan. 231 public tasks (72 original / 48 easy / 111 hard). Full 534 has 303 private unavailable; do not report full-534. 2B 150/231 64.94%; 9B 179/231 77.49%; Jev 200/231 86.58%; Luna 206/231 89.18%; Astra 231/231 100.00% theirs. Brier / ECE / P50 as listed. Candidate order differs 119 of 139 Choice. native vs verbalized. public-subset ≠ Harbor. 231 ≠ 534. Open-Jev TREC pending. 27B training not complete. LoRA ≠ RLCD replica. Qwen3.5-2B ≠ Archer. Qwen3.5-9B ≠ Archer. densify §125 not a sibling first sighting.jaredpalmer/kevnight-2 35B/36B MMLU-Pro transfer. Live 1252★ (was 1244★; star-noise is not the fold). HEADc09666→e0bcf50153f1. README SHA unchanged84b872488915. Quote theirs: PLAN correct 35B MMLU-Pro (0.550). Kev Qwen3.6-35B-A3B 0.550 vs Kev-9B 0.545 vs Jev 0.840 theirs. evaluate.load honour weights_dtype=bf16 (bf16 backbone, adapter unmerged). Not shipped. Qwen3.6 ≠ Archer. Hub --revision is a pin not a replica.Novel HIGH (first-sighting)
wy-coliney/jev-browser-use282★. Quote theirs: Jev clicks, Codex thinks and verifies. 5-10× at EZCollegeApp theirs not Harbor. wy-coliney/jev-browser-use ≠ browser-use/jev-ultrafast ≠ Mrlyk/jev-browser ≠ akras14/jevbro.gargpratyush/jev-router270★ first card (was namesake-only of 33Audits/jev-auto in 0947). fail-open routing ≠ permission. 33Audits/jev-auto ≠ gargpratyush/jev-router.BillionsBobby/JevRouter124★ Toolathlon 38%/44% vs DeepSeek 24% theirs not Harbor. ordered routing ≠ end-to-end. BillionsBobby/JevRouter ≠ gargpratyush/jev-router. routing ≠ permission. does not execute.daseinlabs/open-jev75★ Gemma 3 4B MLX. softmax next-token ≠ calibrated Noul. head 0.970 ECE 0.027 theirs; shuffled-context 0.258. daseinlabs/open-jev ≠ Zefan-Cai/Open-Jev ≠ razorback16/openjev ≠ zhlei07/openjev.akash-kamat/system-one-gemma64.4% ECE 0.047 theirs. 200x theirs not Harbor.abhixhek/jevcalthreshold on held-out; simulator not a Jev bench; fail-closed without fallback.skeptrunedev/jev-recruiterpotential_match ≠ hiring decision.Premo-Cloud/typesafe-sdk-javaunofficial.AgentBuff/awesome-jevcatalog ≠ endorsement; AgentBuff/awesome-jev ≠ yibie/awesome-jev ≠ heyjunpenn/awesome-jev.Alpha-Harper-Franklin/jev-drive≠ VennIntelligence/jev-drive.AntonioCoppe/jev-harness(§33/§44). Do not mint siblings.zhlei07/openjevempty SHA;khmuhtadin/n8n-nodes-jev-classificationempty SHA.Skip Archer (
promised_not_landed). Hub archerhume/4rcherhume HTTP 401.IDs
notes.md§136 (densify cards stay on §125 / §45)Class recipes (not Jev-only)
Without Augustus: treat 231 as the full 534, 0.550 as Harbor, 5-10× as a replica, fail-open routing as a grant, or softmax next-token as a calibrated Noul.
With Augustus: public-subset ≠ Harbor; 231 ≠ 534; evaluate.load honour bf16; 5-10× theirs not Harbor; routing ≠ permission; softmax next-token ≠ calibrated Noul; potential_match ≠ hiring decision; catalog ≠ endorsement; theirs not Harbor. Same split for any Choice/Score/Noul-style head.
Honesty: theirs on bench numbers; catalog ≠ endorsement; soft judgment never sole veto.
Does not bump 0.5.0. Skip Archer.
invented_signal: false.