Research
Underway
Steering What Models Learn
underwayLive, concept-level control of training runs: watch features form mid-run, then steer with data, loss, gradient, and representation interventions. First milestone on fine-tuning with a spurious shortcut.
Replication of Single-Nucleus Transcriptomic Findings
underwayCross-study replication of snRNA-seq findings. Uniform pipeline, replication table, CSF/plasma biomarker shortlist. Target December 2026.
Papers
Attention as Routing Graph: Circuit Extraction from Single Forward Pass
papersTreat attention as a routing map from one forward pass, keep a small subgraph aimed at the answer, and check it under ablation. On induction and IOI across GPT-2 Small/Medium and Pythia-410M, extracted edges hurt far more than random sets of the same size. arXiv:2609.25285.
Finding Usable Weight Mechanisms with Tiled SVD
papersWe extract mechanism mounts directly from weight sites by column-tiled SVD — each mount a triple (v, u, {σ}) as trigger, write, and strength. Pre-registered A/B/C eval on Gemma-2-2B (WikiText-2): 182/182 GO. arXiv:2608.06969.
Applied Research
Interpretability
appliedApplied research on AQIT: transformers and LLMs, attribution, sparse autoencoders, simulation, live training watch, embedding models, evals, security, and benchmarks. Full original writeups in one article.
Experimental Weight Editor
appliedAgentic ROME on Pythia 2.8B: causal trace layer location, rank-one MLP updates, and a three-check validation loop that rolls back and retries on failure. Includes case studies on factuality, bias correction, and censor auditing.
Use cases of aq
Simulating LLM Behaviour in Different Environments
usecasesFour environments for studying LLM behaviour: activation steering for bias reduction, Chess Agents Simulation, Echoes gossip RPG, and Among Us Agents Simulation.
Structuring Social Data for AI
usecasesHow Reddit, X, and Hacker News discussions around Meta Ray-Ban glasses were turned into a structured JSONL training dataset, processed through a multi-stage pipeline end-to-end.
