Skip to content

Plan: sign-language papers network vault#164

Merged
AmitMY merged 2 commits into
masterfrom
plan/papers-network
Apr 28, 2026
Merged

Plan: sign-language papers network vault#164
AmitMY merged 2 commits into
masterfrom
plan/papers-network

Conversation

@AmitMY
Copy link
Copy Markdown
Contributor

@AmitMY AmitMY commented Apr 28, 2026

Summary

  • Adds papers/PLAN.md, the design for an Obsidian-style vault under papers/ that captures every sign-language paper as one markdown node.
  • Seeds: every entry in src/references.bib plus all 2014 sign-language papers found via Semantic Scholar paper/search/bulk. Traversal is BFS over /references and /citations, expanding only SL nodes (or our bib entries), with a citation cap.
  • Per-paper file schema, BibTeX selection rule (ours > SS > synthesized), topics-as-wikilinks, and a full-text priority ladder: ar5iv → Semantic Scholar → PDF → agent web search → abstract-only.
  • Files stay text-only — every figure is an external link (ar5iv or figures.semanticscholar.org), never an inlined bitmap.
  • Plan also specifies a QA sub-agent pass that reviews every md file post-crawl and fixes/flags missing abstracts, missing bibtex, broken figure links, missing topics, dangling wikilinks.

No code yet — this PR is the plan only. Implementation will follow iteratively (small scripts + Claude-in-the-loop), respecting the Semantic Scholar 100 req / 5 min limit.

Test plan

  • Confirm the plan reads cleanly and the schema captures everything we'll need (frontmatter fields, sections, link rules)
  • Decide open questions before implementation: free SS API key (for higher rate limit), attribution footer for SS abstracts/full text

🤖 Generated with Claude Code

Plan for an Obsidian-style vault under papers/ that captures every
sign-language paper as a markdown node, seeded from references.bib and
a 2014 SL sweep, traversed via Semantic Scholar references/citations.
Covers schema, full-text ladder (ar5iv -> SS -> PDF -> web), and a QA
sub-agent pass. No code yet — just the plan.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Comment thread papers/PLAN.md Outdated

1. Every entry in `src/references.bib` (~301), resolved to an SS
paperId via DOI / arXiv / title search.
2. Every 2014 SL paper from SS `paper/search/bulk` across queries
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

every paper from 2014 and onwards

Comment thread papers/PLAN.md Outdated

```yaml
---
semanticScholarId, bibKey, year, title, doi, arxivId
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe those should also be yaml keys:

semanticScholarId: ...
bibKey: ...

Comment thread papers/PLAN.md Outdated

## Rules

- **Wikilink only when target exists.** Otherwise list under "not in
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

always link. it is ok to have links that are not resolved (we can filter them later)

Comment thread papers/PLAN.md Outdated
to find a URL feeding 1–3, or transcribe the abstract.
5. Otherwise `abstract-only`.
- **Text only, no bitmaps.** Every image is an external link. Hard cap
on file size (~80+ pages or >500 KB md → `abstract-only`).
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

make the max size 1MB of text

Comment thread papers/PLAN.md Outdated

## Open

- Free SS API key for higher limit?
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

use the free SS API, which limits us for 100/5 minutes

Comment thread papers/PLAN.md Outdated
## Open

- Free SS API key for higher limit?
- Attribution footer for SS abstracts/full text?
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

attribute the sources for every piece of information

…ution

- Seed sweep: 2014 and onward, not only 2014
- Traversal: no year filter — follow SL citations of any vintage
- Always emit [[ssid]] wikilinks; unresolved targets are filtered later
- Frontmatter as proper YAML keys
- File-size cap raised to 1 MB
- Use a free SS API key (still 100 req / 5 min)
- Per-field provenance in frontmatter.sources + a ## Sources footer

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
@AmitMY AmitMY merged commit 67d5e28 into master Apr 28, 2026
2 checks passed
@AmitMY AmitMY deleted the plan/papers-network branch April 28, 2026 09:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant