Skip to content

@ai-systems-notes ai-systems-notes

All

    Repositories list

    5 repositories

    • CPT_SFT

      Public
      Python
      •
      Apache License 2.0
      •0•0•0•0•Updated Sep 11, 2026Sep 11, 2026

    • local-llm-rag-cag-benchmark

      Public
      ローカルLLM（RTX 4070 + vLLM / Qwen3.5-4B-FP8）で RAG と CAG を同一条件で比較する、再現可能な日本語ベンチマーク。自作小説50問を正答率・TTFT・トークンコストで実測。
      Python
      •0•0•0•0•Updated Jul 5, 2026Jul 5, 2026

    • rtx4070-35b-moe-hybrid-bench

      Public
      RTX4070 12GBVRAMマシンで35BMoEを動かすデモ
      Python
      •0•0•0•0•Updated Jul 3, 2026Jul 3, 2026

    • ollama-prefill-kv-cache-reuse

      Public
      Implemented prefill KV cache reuse in Ollama to accelerate text processing.
      Python
      •0•0•0•0•Updated Jun 24, 2026Jun 24, 2026

    • ollama-prefill-kv-restore

      Public
      Opt-in KV-cache (prefill) save/restore for Ollama — reproducible TTFT benchmark, up to 417× on a fixed system prompt. 固定 system prompt の再プレフィルを KV 復元で置き換え、TTFT …
      Python
      •0•0•0•0•Updated Jun 21, 2026Jun 21, 2026
    ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.