Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
18 changes: 9 additions & 9 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,9 +10,9 @@
[![Papers](https://img.shields.io/badge/papers-989-brightgreen.svg)](papers/index.md)
[![PDFs](https://img.shields.io/badge/local_PDFs-534-orange.svg)](papers/pdfs/)
[![Memory products](https://img.shields.io/badge/memory%20products-38-purple.svg)](products/)
[![Benchmarks](https://img.shields.io/badge/benchmarks-21-blueviolet.svg)](benchmarks/)
[![Benchmarks](https://img.shields.io/badge/benchmarks-23-blueviolet.svg)](benchmarks/)
[![Surveys](https://img.shields.io/badge/meta_surveys-6-yellow.svg)](docs/meta-surveys.md)
[![Updated](https://img.shields.io/badge/updated-2026--07-lightgrey.svg)](docs/signals.md)
[![Updated](https://img.shields.io/badge/updated-2026--08-lightgrey.svg)](docs/signals.md)

</div>

Expand Down Expand Up @@ -55,13 +55,13 @@ separate buckets.

| Area | Current coverage | Entry point | Use it when you need to |
|---|---:|---|---|
| Paper index | 989 scraped papers + manual radar additions through 2026-07 | [`papers/index.md`](papers/index.md) | Searchable entry point for agent-memory papers; the 989 count is the 2026-05 scrape baseline. |
| Paper index | 989 scraped papers + manual radar additions through 2026-08 | [`papers/index.md`](papers/index.md) | Searchable entry point for agent-memory papers; the 989 count is the 2026-05 scrape baseline. |
| Paper stubs | 988 stubs | [`papers/stubs/`](papers/stubs/) | Track papers that are covered but not yet fully read. |
| Local PDFs | 534 files | [`papers/pdfs/`](papers/pdfs/) | Re-read sources and audit paper notes. |
| Full / seed paper notes | 7 full + 15 seed | [`papers/`](papers/) | Use human-read notes for architectural decisions. |
| Full / seed paper notes | 7 full + 19 seed | [`papers/`](papers/) | Use human-read notes for architectural decisions. |
| Memory product notes | 38 notes | [`products/`](products/) | Compare memory layers, memory SDKs, managed memory, and memory-enabled agents. |
| Product page archives | 37 snapshots | [`products/archives/`](products/archives/) | Audit product claims after source pages change. |
| Benchmark catalog | 21 catalog rows | [`benchmarks/index.md`](benchmarks/index.md) | First-class benchmark records plus stub-backed candidate rows and a usage-claim ledger. |
| Benchmark catalog | 23 catalog rows | [`benchmarks/index.md`](benchmarks/index.md) | First-class benchmark records plus stub-backed candidate rows and a usage-claim ledger. |
| Claims ledger | Structured YAML ledger | [`benchmarks/claims/claims.yaml`](benchmarks/claims/claims.yaml) | Separate vendor claims, paper evaluations, critiques, and reproductions. |
| Cost-savings lane | Seed landscape | [`docs/cost-savings-landscape.md`](docs/cost-savings-landscape.md) | Find agent-memory papers, methods, code paths, and products that reduce token, latency, or runtime cost. |
| Survey and taxonomy | 1 living survey + 6 meta-survey records | [`docs/agent-memory-survey.md`](docs/agent-memory-survey.md) · [`docs/meta-surveys.md`](docs/meta-surveys.md) | Build a field-level view before choosing an implementation. |
Expand All @@ -74,7 +74,7 @@ Start with the path that matches your question:
| Goal | Read these first |
|---|---|
| Get the field overview | [`docs/agent-memory-survey.md`](docs/agent-memory-survey.md), then [`docs/taxonomy.md`](docs/taxonomy.md) |
| Read the latest source refresh | [`docs/memory-radar-2026-07.md`](docs/memory-radar-2026-07.md), then [`docs/signals.md`](docs/signals.md) |
| Read the latest source refresh | [`docs/memory-radar-2026-08.md`](docs/memory-radar-2026-08.md), then [`docs/signals.md`](docs/signals.md) |
| Find relevant papers | [`papers/index.md`](papers/index.md), then full notes under [`papers/`](papers/) |
| Compare memory products | [`docs/products-landscape.md`](docs/products-landscape.md), [`docs/product-memory-architectures.md`](docs/product-memory-architectures.md), [`docs/product-architecture-diagrams.md`](docs/product-architecture-diagrams.md) |
| Check why a product was included or rejected | [`docs/product-discovery-log.md`](docs/product-discovery-log.md) |
Expand Down Expand Up @@ -159,7 +159,7 @@ flowchart LR
| [`docs/taxonomy.md`](docs/taxonomy.md) | Shared vocabulary for classifying agent-memory systems and memory-kernel responsibilities. |
| [`docs/meta-surveys.md`](docs/meta-surveys.md) | External meta-survey index from late 2025 through 2026 H1. |
| [`docs/research-radar.md`](docs/research-radar.md) | Workflow for turning papers, products, and benchmark evidence into ImpactReports and ADR inputs. |
| [`docs/memory-radar-2026-07.md`](docs/memory-radar-2026-07.md) | 2026-07 weekly refresh across papers, products, GitHub projects, and reviewer decisions. |
| [`docs/memory-radar-2026-08.md`](docs/memory-radar-2026-08.md) | 2026-08 weekly refresh across papers, products, GitHub projects, and reviewer decisions. |
| [`docs/cost-savings-landscape.md`](docs/cost-savings-landscape.md) | Focused lane for agent-memory token reduction, budgeted retrieval, runtime-cost methods, code paths, and product practice signals. |
| [`docs/information-sources.md`](docs/information-sources.md) | Source catalog for papers, products, communities, and zh-CN information channels. |
| [`docs/related-work.md`](docs/related-work.md) | Discovery-input attribution and scrape provenance. |
Expand All @@ -180,11 +180,11 @@ flowchart LR

| Path | Purpose |
|---|---|
| [`papers/`](papers/) | 7 full paper notes, 15 seed notes, and the master [`index.md`](papers/index.md). |
| [`papers/`](papers/) | 7 full paper notes, 19 seed notes, and the master [`index.md`](papers/index.md). |
| [`papers/stubs/`](papers/stubs/) | 988 generated stubs for papers not yet fully read. |
| [`papers/pdfs/`](papers/pdfs/) | 534 archived PDFs, about 1.8 GB. See the archival policy below. |
| [`papers/_scrape/`](papers/_scrape/) | Reproducibility artifacts: scrape script and dedup JSON. |
| [`benchmarks/`](benchmarks/) | 21 benchmark catalog rows, including protocol notes, stub-backed candidate rows, and the note template. |
| [`benchmarks/`](benchmarks/) | 23 benchmark catalog rows, including protocol notes, stub-backed candidate rows, and the note template. |
| [`benchmarks/claims/`](benchmarks/claims/) | Usage-event ledger for benchmark mentions, vendor claims, critiques, and reproductions. |
| [`benchmarks/archives/`](benchmarks/archives/) | Optional source-page snapshots for benchmark pages, repositories, or dataset cards. |
| [`docs/benchmarks-landscape.md`](docs/benchmarks-landscape.md) | Benchmark landscape by capability, usage type, and evidence independence. |
Expand Down
18 changes: 9 additions & 9 deletions README_cn.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,9 +10,9 @@
[![Papers](https://img.shields.io/badge/papers-989-brightgreen.svg)](papers/index.md)
[![PDFs](https://img.shields.io/badge/local_PDFs-534-orange.svg)](papers/pdfs/)
[![记忆产品](https://img.shields.io/badge/memory%20products-38-purple.svg)](products/)
[![Benchmarks](https://img.shields.io/badge/benchmarks-21-blueviolet.svg)](benchmarks/)
[![Benchmarks](https://img.shields.io/badge/benchmarks-23-blueviolet.svg)](benchmarks/)
[![Surveys](https://img.shields.io/badge/meta_surveys-6-yellow.svg)](docs/meta-surveys.md)
[![Updated](https://img.shields.io/badge/updated-2026--07-lightgrey.svg)](docs/signals.md)
[![Updated](https://img.shields.io/badge/updated-2026--08-lightgrey.svg)](docs/signals.md)

</div>

Expand Down Expand Up @@ -53,13 +53,13 @@

| 板块 | 当前覆盖 | 入口 | 适合用来 |
|---|---:|---|---|
| 论文索引 | 989 篇抓取论文 + 截至 2026-07 的手工 radar 新增 | [`papers/index.md`](papers/index.md) | 搜索 agent-memory 论文和发现线索;989 是 2026-05 抓取基线。 |
| 论文索引 | 989 篇抓取论文 + 截至 2026-08 的手工 radar 新增 | [`papers/index.md`](papers/index.md) | 搜索 agent-memory 论文和发现线索;989 是 2026-05 抓取基线。 |
| 论文 stub | 988 个 stub | [`papers/stubs/`](papers/stubs/) | 跟踪已覆盖但尚未 full 阅读的论文。 |
| 本地 PDF | 534 个文件 | [`papers/pdfs/`](papers/pdfs/) | 复读来源和审计论文笔记。 |
| full / seed 论文笔记 | 7 个 full + 15 个 seed | [`papers/`](papers/) | 为架构决策引用人工阅读笔记。 |
| full / seed 论文笔记 | 7 个 full + 19 个 seed | [`papers/`](papers/) | 为架构决策引用人工阅读笔记。 |
| 记忆产品笔记 | 38 个笔记 | [`products/`](products/) | 对比 memory layer、memory SDK、managed memory 和带记忆的 agent 产品。 |
| 产品页面快照 | 37 个快照 | [`products/archives/`](products/archives/) | 在源页面变化后审计产品 claims。 |
| Benchmark 目录 | 21 个 catalog 行 | [`benchmarks/index.md`](benchmarks/index.md) | 理解 memory benchmark、stub-backed 候选行及其 claims 来源。 |
| Benchmark 目录 | 23 个 catalog 行 | [`benchmarks/index.md`](benchmarks/index.md) | 理解 memory benchmark、stub-backed 候选行及其 claims 来源。 |
| Claims ledger | 结构化 YAML ledger | [`benchmarks/claims/claims.yaml`](benchmarks/claims/claims.yaml) | 区分厂商自报、论文评测、方法批评和独立复现。 |
| 成本节省专题 | seed landscape | [`docs/cost-savings-landscape.md`](docs/cost-savings-landscape.md) | 查找能减少 token、延迟或运行成本的 agent-memory 论文、方法、代码和产品。 |
| 综述与 taxonomy | 1 份活综述 + 6 条 meta-survey 记录 | [`docs/agent-memory-survey.md`](docs/agent-memory-survey.md) · [`docs/meta-surveys.md`](docs/meta-surveys.md) | 在选型或设计前建立领域视角。 |
Expand All @@ -72,7 +72,7 @@
| 目标 | 先读这些 |
|---|---|
| 快速理解领域 | [`docs/agent-memory-survey.md`](docs/agent-memory-survey.md),再读 [`docs/taxonomy.md`](docs/taxonomy.md) |
| 阅读最新来源刷新 | [`docs/memory-radar-2026-07.md`](docs/memory-radar-2026-07.md),再看 [`docs/signals.md`](docs/signals.md) |
| 阅读最新来源刷新 | [`docs/memory-radar-2026-08.md`](docs/memory-radar-2026-08.md),再看 [`docs/signals.md`](docs/signals.md) |
| 找相关论文 | [`papers/index.md`](papers/index.md),再看 [`papers/`](papers/) 下的 full note |
| 比较记忆产品 | [`docs/products-landscape.md`](docs/products-landscape.md)、[`docs/product-memory-architectures.md`](docs/product-memory-architectures.md)、[`docs/product-architecture-diagrams.md`](docs/product-architecture-diagrams.md) |
| 查看产品为什么入库或被拒绝 | [`docs/product-discovery-log.md`](docs/product-discovery-log.md) |
Expand Down Expand Up @@ -154,7 +154,7 @@ flowchart LR
| [`docs/taxonomy.md`](docs/taxonomy.md) | 分类 agent-memory 系统和 memory-kernel 职责的共享词表。 |
| [`docs/meta-surveys.md`](docs/meta-surveys.md) | 2025 年末到 2026 H1 的外部 meta-survey 索引。 |
| [`docs/research-radar.md`](docs/research-radar.md) | 把论文、产品、benchmark 证据转成 ImpactReport 和 ADR 输入的工作流。 |
| [`docs/memory-radar-2026-07.md`](docs/memory-radar-2026-07.md) | 2026-07 周更来源刷新,覆盖论文、产品、GitHub 项目和 reviewer 分流结论。 |
| [`docs/memory-radar-2026-08.md`](docs/memory-radar-2026-08.md) | 2026-08 周更来源刷新,覆盖论文、产品、GitHub 项目和 reviewer 分流结论。 |
| [`docs/cost-savings-landscape.md`](docs/cost-savings-landscape.md) | agent-memory token reduction、预算检索、运行成本方法、代码路径和产品实践信号专题。 |
| [`docs/information-sources.md`](docs/information-sources.md) | 论文、产品、社区和中文信息源 catalog。 |
| [`docs/related-work.md`](docs/related-work.md) | 发现线索归因和抓取来源记录。 |
Expand All @@ -175,11 +175,11 @@ flowchart LR

| 路径 | 用途 |
|---|---|
| [`papers/`](papers/) | 7 个 full 论文笔记、15 个 seed 笔记和主索引 [`index.md`](papers/index.md)。 |
| [`papers/`](papers/) | 7 个 full 论文笔记、19 个 seed 笔记和主索引 [`index.md`](papers/index.md)。 |
| [`papers/stubs/`](papers/stubs/) | 988 个尚未 full 阅读论文的生成 stub。 |
| [`papers/pdfs/`](papers/pdfs/) | 534 个本地 PDF,约 1.8 GB。详见下方存档策略。 |
| [`papers/_scrape/`](papers/_scrape/) | 可复现产物:抓取脚本和 dedup JSON。 |
| [`benchmarks/`](benchmarks/) | 21 个 benchmark catalog 行,包含协议笔记、stub-backed 候选行和笔记模板。 |
| [`benchmarks/`](benchmarks/) | 23 个 benchmark catalog 行,包含协议笔记、stub-backed 候选行和笔记模板。 |
| [`benchmarks/claims/`](benchmarks/claims/) | benchmark 提及、厂商自报、方法批评和复现的 usage-event ledger。 |
| [`benchmarks/archives/`](benchmarks/archives/) | benchmark 页面、repo 或 dataset card 的可选审计快照。 |
| [`docs/benchmarks-landscape.md`](docs/benchmarks-landscape.md) | 按能力、使用方式和证据独立性整理的 benchmark 全景。 |
Expand Down
40 changes: 40 additions & 0 deletions benchmarks/claims/claims.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -703,3 +703,43 @@ events:
- benchmarks/memprobe.md
- https://arxiv.org/abs/2606.24595
extract_confidence: medium
- event_id: memsecbench-origin-2026
benchmark_id: memsecbench
source_kind: paper
source_id: benchmarks/memsecbench.md
source_date: 2026-07
actor: MemSecBench authors
actor_type: paper_authors
usage_type: originates_benchmark
claim_direction: methodological_only
compared_systems: []
reported_metrics: []
experimental_setup: "Memory-poisoning lifecycle benchmark from persistence to downstream consequence and selective repair; local note is seed quality."
reproduction_status: not_reproduced
evidence_level: primary_pdf
independence_class: survey_only
comparability_notes: "Origin protocol only; attack set, backend comparisons, and repair scores are not normalized in this ledger."
evidence_refs:
- benchmarks/memsecbench.md
- https://arxiv.org/abs/2607.27080
extract_confidence: medium
- event_id: setoka-origin-2026
benchmark_id: setoka
source_kind: paper
source_id: benchmarks/setoka.md
source_date: 2026-07
actor: Setoka authors
actor_type: paper_authors
usage_type: originates_benchmark
claim_direction: methodological_only
compared_systems: []
reported_metrics: []
experimental_setup: "Hierarchical user-understanding benchmark for personalized agents over heterogeneous data; local note is seed quality."
reproduction_status: not_reproduced
evidence_level: primary_pdf
independence_class: survey_only
comparability_notes: "Origin protocol only; data provenance, privacy boundary, and persona-inference labels are not normalized."
evidence_refs:
- benchmarks/setoka.md
- https://arxiv.org/abs/2607.27056
extract_confidence: medium
2 changes: 2 additions & 0 deletions benchmarks/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -49,6 +49,8 @@ official repository, dataset card, or independent reproduction.
| MemSyco-Bench | seed | paper-origin | memory-induced sycophancy | scope / conflict resolution / update / valid personalization | [`memsyco-bench.md`](memsyco-bench.md) | yes |
| MemLeak | seed | paper-origin | multimodal deletion leakage | deletion compliance / provenance / residual image leakage | [`memleak.md`](memleak.md) | yes |
| MemDelta | seed | paper-origin | memory-evaluation baseline control | component delta / model-family sensitivity / write-path cost | [`memdelta.md`](memdelta.md) | yes |
| MemSecBench | seed | paper-origin | memory poisoning lifecycle | persistence / consequence / selective repair | [`memsecbench.md`](memsecbench.md) | yes |
| Setoka | seed | paper-origin | hierarchical user understanding | explicit retrieval / abstract persona inference / heterogeneous data grounding | [`setoka.md`](setoka.md) | yes |

## Evidence Ledgers

Expand Down
72 changes: 72 additions & 0 deletions benchmarks/memsecbench.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,72 @@
---
title: MemSecBench — memory poisoning persistence-to-repair benchmark
benchmark_id: memsecbench
name: MemSecBench
aliases:
- MemSecBench
status: seed
origin_type: paper_origin
origin_source: https://arxiv.org/abs/2607.27080
first_public_date: 2026-07
domain: memory_security
modality: text
task_grain: poisoning_persistence_consequence_repair
capability_axes:
- persistence
- downstream_consequence
- selective_repair
- memory_backend_comparison
data_nature: attack_and_repair_tasks
metrics:
- persistence_rate
- consequence_rate
- repair_success
judge_type: source_protocol_check
code_available: check
data_available: check
license: check
known_limitations:
- seed note; attack set, backend setup, and repair metrics need full read
canonical_sources:
- https://arxiv.org/abs/2607.27080
confidence: medium
memory_modules:
- evaluator-benchmark
- policy-privacy
- memorydiff-generator
last_revised: 2026-08-03
---

# MemSecBench

## What It Measures

MemSecBench evaluates memory poisoning across the full lifecycle from
persistence, to downstream action consequence, to selective repair.

## Protocol

The arXiv abstract frames the benchmark around malicious instructions that enter
long-term memory, are recalled later, and influence real actions. It emphasizes
tracking the same malicious semantics across persistence, consequence, and
repair, with comparisons across memory backends.

## Baselines and Reported Results

No normalized scores are logged here. Any reported backend comparison remains a
paper-origin claim until the setup is fully mapped.

## Validity / Contamination / License Caveats

Seed note only. The attack corpus, memory backends, repair mechanism, and judge
protocol must be reviewed before use as a production security gate.

## Related Papers

- Paper:https://arxiv.org/abs/2607.27080

## Impact Use

- `policy-privacy`:candidate benchmark for persistent memory poisoning.
- `memorydiff-generator`:repair semantics may inform selective rollback.
- Ready for ImpactReport:no, upgrade after full protocol read.
73 changes: 73 additions & 0 deletions benchmarks/setoka.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,73 @@
---
title: Setoka — hierarchical user-understanding benchmark
benchmark_id: setoka
name: Setoka
aliases:
- Setoka
status: seed
origin_type: paper_origin
origin_source: https://arxiv.org/abs/2607.27056
first_public_date: 2026-07
domain: personalized_agent_memory
modality: heterogeneous_user_data
task_grain: hierarchical_user_understanding
capability_axes:
- explicit_fact_retrieval
- abstract_persona_inference
- heterogeneous_data_grounding
- personalization
data_nature: heterogeneous_personal_data_tasks
metrics:
- retrieval_accuracy
- persona_understanding
- inference_quality
judge_type: source_protocol_check
code_available: check
data_available: check
license: check
known_limitations:
- seed note; data provenance, privacy boundary, and task construction need full read
canonical_sources:
- https://arxiv.org/abs/2607.27056
confidence: medium
memory_modules:
- evaluator-benchmark
- retriever-reranker
- policy-privacy
last_revised: 2026-08-03
---

# Setoka

## What It Measures

Setoka evaluates whether personalized agents can infer hierarchical user
understanding from heterogeneous data, rather than only retrieve facts explicitly
stated in conversations.

## Protocol

The arXiv abstract positions Setoka as a benchmark for deeper user
understanding: explicit memory retrieval plus abstract personal characteristics
needed for personalized assistance.

## Baselines and Reported Results

No normalized results are recorded. Treat any paper scores as origin-protocol
claims until the benchmark setup and data construction are fully reviewed.

## Validity / Contamination / License Caveats

Personalized memory benchmarks can encode sensitive user data assumptions. Full
review should check data provenance, consent model, privacy risks, and whether
abstract-persona labels are stable enough for kernel decisions.

## Related Papers

- Paper:https://arxiv.org/abs/2607.27056

## Impact Use

- `evaluator-benchmark`:candidate protocol for user-modeling depth.
- `policy-privacy`:privacy and consent caveats are first-order.
- Ready for ImpactReport:no, upgrade after full protocol read.
Loading