unclear: words inside program or organisation names
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 19 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron is hard to pin down. It fires on words in the middle of official program, agency or title names, like 'and' in 'Planning and Partnerships' or 'of' in 'Management of Health'. Turning it up made the text repetitive and unfocused.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
. Each performance task test is scored by two trained readers.⏎You can see some of the 2006 tests at The Florida Department of Education’s Assessment and School Performance page.⏎When is the FCAT given?⏎The FCAT is given
-
Board Learning Session⏎Leaders from Stillwater Area High School and Lake Elmo Elementary School provided an update on the successes of the BARR - Building Assets, Reducing Risks - program.⏎BARR is a research-based approach to meeting students’
-
. He paved the way for post-modern artists to develop their own vocabulary, drawing upon traditional sources and creating a new language that liquefied the barriers between old and new. His work titled ‘Shah Jahan’, a triptych
-
The Oakland Food Policy Council takes a comprehensive approach toward improving food access and urban agriculture in disadvantaged communities.⏎- Urban Forests: Urban Releaf and Friends of the Urban Forest are two grassroots organizations that beautify our neighborhoods by planting trees.⏎- Aqu
-
for smaller organizations or communities with limited resources.⏎What is MAPP?⏎The development of the Mobilizing for Action through Planning and Partnerships (MAPP) process was a joint project of the non-profit National
-
.⏎Whilst the specific process of preparing a formal risk assessment is not a requirement of the CDM regulations, regulation 3(6)(a) of the Management of Health and Safety at Work Regulations does require that risks are controlled in the workplace,
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: A part of a certain old, very old, and, in the past, always, still, and, in the past and, in the still, and, in the past, and, in the, in this, and, in
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
Black, Brown, and Beige. Originally debuted at Carnegie Hall on January 23rd, 1943, the composition received mixed, if not critical feedback.⏎Much of that criticism weighed on the "pretentiousness" such
-
eye, and often affects your vision. At the first sign of any visual disturbance, including flashes, floaters, a curtain over your eye, or the sudden or gradual onset of blurred vision, your eye doctor should be consulted immediately.⏎The retina
-
Christ’s redemptive sacrifice for our sins). Jesus did not come only<|endoftext|>WEDNESDAY, July 4 (HealthDay News) -- For safety's sake, Americans should avoid using fireworks of any kind this Independence Day, experts say
-
?⏎- How do land use practices and management efforts interact with natural disturbances and climatological cycles to affect estuarine water quality and suitability for ecologically (and economically) important species?<|endoftext|>Not Just for Kids⏎The
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L18:569 suppresses
- L0:1224 excites
- L0:1301 excites
- L18:269 excites
- L3:591 excites
- L18:529 excites
- L6:17 weakly excites
- L18:77 weakly excites
- L0:178 weakly excites
- L2:1321 weakly excites
- L2:75 weakly excites
- L14:874 weakly suppresses
- L14:312 weakly excites
- L4:33 weakly excites
- L14:343 weakly suppresses
- L14:801 weakly excites 'and' or 'or' joining list items
- L6:2355 weakly excites
- L18:396 weakly excites
- L14:323 weakly suppresses
- L1:3019 weakly excites
- L0:313 weakly excites "and" joining paired nouns
- L5:133 weakly suppresses
- L18:164 weakly excites
- L14:2651 weakly excites
Feeds later layers
- L20:1865 weakly suppresses
- L21:749 weakly suppresses
- L25:1801 weakly suppresses
- L21:498 weakly suppresses
- L23:610 weakly excites
- L20:1957 weakly suppresses
- L20:1292 weakly suppresses
- L21:2692 weakly suppresses
- L24:2607 weakly suppresses
- L22:205 weakly excites
- L23:2699 weakly suppresses
- L20:22 weakly excites
- L21:909 weakly suppresses
- L20:2119 weakly excites
- L20:1174 weakly suppresses
- L20:379 weakly excites digits inside dates
- L21:729 weakly excites
- L20:2016 weakly suppresses
- L20:953 weakly suppresses
- L20:1727 weakly suppresses
- L20:2418 weakly suppresses
- L20:1922 weakly suppresses
- L20:873 weakly suppresses
- L21:1591 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 预
- quir
- comed
- amps
- chy
- коль
- đệ
- 掠
- ughty
- кро
Suppresses
- nonetheless
- nevertheless
- istically
- 技术研发
- ará
- ** ⏎
- enie
- --> ⏎
- Himself
- 还有一些