Issues

• Critical token estimation

  enhancement
  the-crypt-keeper/LLooM#10 · Filter by author the-crypt-keeper opened on Dec 6, 2024

• Suggestion beams parts containing a : breaks the graphviz visualization

  bug
  the-crypt-keeper/LLooM#9 · Filter by author the-crypt-keeper opened on Jun 12, 2024

• Proper vllm prompt caching (sglang support?)

  enhancement
  the-crypt-keeper/LLooM#8 · Filter by author the-crypt-keeper opened on Jun 2, 2024

• Add the ablity to continue generation.

  enhancement
  the-crypt-keeper/LLooM#7 · Filter by author cuyler72 opened on May 30, 2024
  1

• Explore applying a chat template

  enhancement
  the-crypt-keeper/LLooM#3 · Filter by author the-crypt-keeper opened on May 28, 2024

• Clicking a node in the viz should filter options to those passing through that node

  enhancement
  the-crypt-keeper/LLooM#2 · Filter by author the-crypt-keeper opened on May 27, 2024
  1

• Track the full probability chain along each beam instead of only the final string and accumulated probability mass

  enhancement
  the-crypt-keeper/LLooM#1 · Filter by author the-crypt-keeper opened on May 27, 2024
  1