Skip to content

[Easy] sanitizer.py: add utf-8 encoding and log invalid regex in .termstoryignore (fixes #297) #326

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
bitflicker64 merged 2 commits into from
Jul 19, 2026
Merged

[Easy] sanitizer.py: add utf-8 encoding and log invalid regex in .termstoryignore (fixes #297) #326

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
410babb
fix: add utf-8 encoding and log invalid regex in .termstoryignore loa…
Mubashir78 Jul 18, 2026
33de8e2
Merge branch 'main' into fix/297-sanitizer-utf8-logging
bitflicker64 Jul 19, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 4 additions & 2 deletions termstory/sanitizer.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,8 +1,11 @@
import logging
import re
import os
import math
from typing import List, Tuple, Optional

logger = logging.getLogger(__name__)

# Load custom redaction patterns from .termstoryignore
# IMPORTANT: This loads once at module import time (called at the bottom of this file).
# Edits to ~/.termstoryignore take effect only after restarting TermStory — there is no
Expand All @@ -16,7 +19,7 @@ def load_custom_ignore_rules() -> tuple:
for path in paths:
if os.path.exists(path):
try:
with open(path, 'r') as f:
with open(path, 'r', encoding='utf-8') as f:
for line in f:
line = line.strip()
if line and not line.startswith('#'):
Expand All @@ -27,7 +30,6 @@ def load_custom_ignore_rules() -> tuple:
except Exception:
pass
return tuple(local_patterns)

CUSTOM_REDACTION_PATTERNS = load_custom_ignore_rules()
# Blacklist patterns - if a command matches any of these, the entire session is dropped from AI
BLACKLIST_PATTERNS = [
Expand Down