Skip to content

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

24 Commits
 
 
 
 
 
 

Repository files navigation

Instruction-Conditioned Separation & Displacement — Qwen2.5-7B

Falsifiable Interpretability

Interactive preprint exploring Instruction-Conditioned Separation & Displacement in Qwen2.5-7B.

Live Page

https://soyuz43.github.io/input-conditioned-gain/

Key Result

Bifurcated gain geometry:

Layer 6 → maximal separability
Layer 26 → maximal amplification


Citation:

@online{stetar2026mechanistic,
  author = {Stetar, William},
  title = {Mechanistic Measurements: Instruction-Conditioned Separation \& Displacement Across Layers},
  year = {2026},
  month = {March},
  url = {https://soyuz43.github.io/input-conditioned-gain/},
  urldate = {2026-04-17},
  note = {Interactive summary of layerwise linear separability (AUC) and displacement norms ($\|v^*\|$) in Qwen2.5-7B models}
}

About

This project measures how different system prompts (instruction vs. base behavior) alter hidden state geometry in Qwen2.5-7B. Using pre-extracted directional vectors (v*), I track linear separability (AUC) and displacement norms (‖v*‖) layer-by-layer across TriviaQA.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages