All issues

Search results

conv-26: two mislabeled category-5 (adversarial) questions — answerable in the transcript, complementing the cat 1-4 audits in #27/#35

Status: Open.

#43 In snap-research/locomo;

· kepler-somnium opened on Aug 24, 2026

Data typo in sample_id conv-41 answer field

Status: Open.

#42 In snap-research/locomo;

· qqplot opened on Jul 23, 2026

Evaluation results — EXIA GHOST V2.7.2 on LoCoMo (84.16%, full pipeline, strict scoring)

Status: Open.

#39 In snap-research/locomo;

· francisdu53 opened on May 17, 2026

Engram v0.1.3: 93.9% R@5 on LoCoMo — zero-LLM retrieval, $0/query

Status: Open.

#38 In snap-research/locomo;

· Nitin-Gupta1109 opened on Apr 17, 2026

文档：如何将 LoCoMo 数据集翻译为简体中文（translate_locomo_zh.py）

Status: Open.

#37 In snap-research/locomo;

· huyyxy opened on Apr 17, 2026

conv-26: two additional ground truth errors + audit of ambiguous/underspecified items

Status: Open.

#35 In snap-research/locomo;

· jordicor opened on Apr 6, 2026

EXIA GHOST Full Pipeline: 95.27% overall (cats 1-5), 100% Category 5

Status: Open.

#34 In snap-research/locomo;

· francisdu53 opened on Mar 26, 2026

NEXO Brain benchmark results on LoCoMo — first MCP memory server evaluation

Status: Open.

#33 In snap-research/locomo;

· wazionapps opened on Mar 24, 2026

EXIA GHOST Results: 89.94% (Cat 1-4), first Cat 5 evaluation (71.52%)

Status: Open.

#31 In snap-research/locomo;

· francisdu53 opened on Mar 22, 2026

Bug in locomo/task_eval/gpt_utils.py line 277: duplicated condition

Status: Open.

#30 In snap-research/locomo;

· SJTUfei opened on Dec 18, 2025

Correct label errors in locomo10.json QA

Status: Open.

#27 In snap-research/locomo;

· dial481 opened on Dec 6, 2025

Official SOTA Submission: VAC Memory System Reaching 80.1% on LoCoMo (Generous Judge)

Status: Open.

#26 In snap-research/locomo;

· vac-architector opened on Nov 24, 2025