Skip to content

Recompose real webpages with local Qwen and voice - #8

Merged
Phloraxx merged 54 commits into
mainfrom
feature/recompose-voice
Jul 25, 2026
Merged

Recompose real webpages with local Qwen and voice#8
Phloraxx merged 54 commits into
mainfrom
feature/recompose-voice

Conversation

@Phloraxx

@Phloraxx Phloraxx commented Jul 24, 2026

Copy link
Copy Markdown
Owner

Goal

Turn Make This Mine from a light accessibility restyle into the event wow moment: preserve the real website and its controls underneath while AURA presents a substantially different interface around the person and their current goal.

Implemented

  • four non-diagnostic judge presets plus the user's learned profile
  • full-page trusted AURA Recompose surface mapped back to real data-aura-id controls
  • immediate deterministic redesign, local Qwen 3.5 4B MLX fast path, and deeper GPT-5.6 Luna refinement in parallel
  • safe same-document View Transition updates where supported
  • push-to-talk dictation through gpt-4o-mini-transcribe
  • optional short spoken AURA replies using local browser/macOS speech synthesis
  • reliable Original/AURA restore without reload
  • event promo-film visual language carried into the recomposed experience
  • strict local-model schema validation and fail-closed fallback behavior
  • hardened conversation composer so Enter sends the actual current textbox value across navigation/rerenders

Verification

GitHub CI is green on the final head: lint, typecheck, unit/integration tests, build, Playwright system dependencies, and Electron E2E all pass. The E2E flow covers Learn Me, Recompose presets, Talk to AURA, remembered preferences, navigation, and Original restore.

No live OpenAI provider calls run in CI, so this does not consume the event API budget.

Research / architecture

See docs/browser/12-RECOMPOSE-VOICE.md for the implementation plan and primary-source references.

The remaining event-only validation is the final credentialed smoke test on the actual Apple Silicon Mac and event network/hotspot.

Phloraxx added 30 commits July 24, 2026 23:15
Phloraxx added 24 commits July 24, 2026 23:53
@Phloraxx
Phloraxx marked this pull request as ready for review July 25, 2026 00:37
@Phloraxx
Phloraxx merged commit dfe289c into main Jul 25, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant