'for' before a span of time
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 22 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'for' when it comes before a length of time, as in 'known for years' or 'for decades'. Turned up, the model drifted into lists of numbers and the word 'many', which fits a counting theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
and challenges for these individuals truly is a spectrum that can range from a completely nonverbal kindergartner, to a professor of linguistics.⏎We’ve known for more than 20 years that the lion’s share of the risk for developing
-
kids busy. Look around you and spot something ANYTHING that either you don’t see often or haven’t seen in awhile (not a person) and get excited while smiling and saying, “OM
-
佘孟兰 Sheh Meng-lan); Mark F. Watson)<|endoftext|>By Cary Groner⏎3D printing has been waiting to disrupt the orthotics market for years. Only time will tell if the pandemic’s pause afforded clinicians the opportunity to
-
England, in 1813 and made a career for himself as a renowned architect, engineer and surveyor. After living in Dublin for several years in the early 1830s, Lanyon moved
-
Global Environment at Harvard’s School of Public Health.⏎As global temperatures rise and extreme heat waves become more common, so does heat illness. But while doctors have known for decades about the adverse effects of some medications on how the body regulates temperature, little
-
only hinted at by the book.⏎I have admired Dick’s work for years, but this is his best. He delves more thoroughly into many themes
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: 333 many many many 33 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
-8 rigid rays. The long second dorsal fin has 21-24 branched, soft rays. The anal fin has one spiny ray and 24-26 soft rays. The caudal fin is truncated.⏎
-
Medical-Surgical Nursing at a Glance is ideal for nursing students looking for a clear and visual summary of care of the adult patient.⏎Results 1-5 of 41⏎The nurse practitioner is skilled at
-
color-coded congressional districts showing the average annual change in employment from 2011 to 2020. Each district within a state is given one of four distinct shades of reddish brown, with the darkest color indicating the most job
-
forests with little herbaceous growth, but with a ground cover thick with ferns, mosses, and lichens. The female is believed to give birth to a single young. The species comes down seasonally to the gullies,
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L21:1647 strongly excites
- L19:2492 strongly excites "one of" before a group
- L18:2183 strongly suppresses
- L21:2090 strongly suppresses
- L20:1404 excites
- L17:2655 excites
- L18:1578 excites
- L20:1800 suppresses
- L20:2136 excites
- L14:2494 suppresses
- L19:2056 suppresses
- L20:1788 suppresses
- L21:822 suppresses
- L19:2841 suppresses
- L19:2503 suppresses
- L19:2151 excites
- L20:1219 suppresses
- L20:1787 suppresses
- L21:1102 excites 'one or more' before a count noun
- L16:2111 excites
- L20:2830 excites
- L19:2727 excites
- L20:2316 suppresses
- L19:2842 suppresses
Feeds later layers
- L24:826 strongly suppresses
- L26:1083 strongly suppresses
- L27:810 strongly suppresses
- L23:2230 suppresses
- L24:587 suppresses
- L25:572 suppresses
- L26:1784 suppresses
- L27:696 suppresses
- L24:2948 suppresses
- L25:2915 suppresses
- L25:2902 suppresses
- L24:722 suppresses 'about' or 'approximately' before a number
- L23:808 suppresses
- L25:1046 excites
- L23:888 suppresses
- L23:538 suppresses
- L23:1404 suppresses
- L24:1826 suppresses
- L25:2527 suppresses
- L26:2537 suppresses
- L23:1178 suppresses
- L27:1226 suppresses
- L24:680 suppresses
- L24:1848 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- หาร
- 号线
- tera
- مناسب
- .Helper
- zym
- hop
- [file
- лик
- heels
Suppresses
- several
- many
- 若干
- three
- 几个
- 多个
- many
- three
- two
- dozens