"and" in noun lists, "through" in ranges
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 1 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the "and" at the end of a list of nouns, such as "researchers, and government officials". Its strongest negative reaction is on the word "through" in ranges like "Sections 1 through 8". The steering outputs did not clearly reflect either pattern.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
ulture.⏎Now in its ninth year, the event drew 40 per cent of its attendees from the seafood business. Industry personnel joined conservationists, researchers, and government officials in discussing a range of sustainability issues - marine spatial planning, traceability
-
Problem of Childhood Obesity Within a Generation. The task force, part of the First Lady’s Let’s Move campaign, offers goals, benchmarks, and measureable outcomes that will help the country tackle the childhood obesity epidemic one child,
-
. The topography, rainfall and water supply were different from that of the East. The Easterners had a forest background. The traditions, laws, weapons, and the general approach to current problems were different. In this environment the influence of ge
-
56 caregiving failures) from 1985 to 2003. The fatality data was gathered from media reports, legal cases, and state records. Three forms of child care were investigated: child care centers, n
-
his international fame as<|endoftext|>“Paradise Found and Lost” from Daniel J. Boorstin’s The Discoverers, embodies Columbus’ emotions, ideas, and hopes. Boorstin, a former Librarian of Congress, leads the
-
actual picture of the Biggest Beaver Dam in the World:<|endoftext|>Editorial and Revision Process⏎Preparing an Inquiry article for publication is a collaboration between authors, editors, and faculty mentors. The authors of Inquiry articles often begin with a report or essay describing
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have been thinking about lately, and I have been thinking about lately. So I will do my part of the task. Okay, I have been thinking about lately, and I have been thinking about lately. So I will do my part
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
29 CFR 1910.1200. The SDS preparers may also include additional information in various section(s).⏎Sections 1 through 8 contain general information about the chemical, identification, hazards, composition, safe
-
programs. Posters and interpretive texts provide additional information, context and commentary.⏎Exhibit panels are organized in sections falling into two major groups. Sections 1 through 7 tell the story of agriculture and farmworkers in our area by decade over
-
8 and 10 students take a writing test which consists of an essay and multiple choice questions. A reading and mathematics test is given in grades 3 through 10. In grades 5, 8
-
, summarizing the essential findings. The SRREN consists of 11 chapters. Chapter 1 sets the context for RE and climate change; Chapters 2 through 7 provide information on six RE technologies, and Chapters 8 through 1
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L0:1224 suppresses
- L0:1301 suppresses
- L0:178 suppresses
- L0:605 weakly suppresses 'of' after an action noun
- L0:2426 weakly suppresses
- L0:1 weakly suppresses
- L0:493 weakly suppresses
- L0:1888 weakly excites
- L0:1523 weakly suppresses
- L0:993 weakly excites
- L0:1866 weakly excites
- L0:1037 weakly excites
- L0:582 weakly suppresses
- L0:451 weakly suppresses
- L0:1454 weakly excites
- L0:853 weakly excites
- L0:1513 weakly suppresses
- L0:2450 weakly excites
- L0:1309 weakly excites
- L0:647 weakly excites
- L0:2571 weakly suppresses
- L0:1343 weakly suppresses
- L0:525 weakly excites
- L0:2227 weakly suppresses
Feeds later layers
- L17:3031 suppresses
- L11:527 excites
- L2:1684 weakly excites
- L2:2302 weakly suppresses
- L13:656 weakly suppresses 'and' or comma between paired items
- L4:385 weakly excites multiplication and scaling in math
- L11:1325 weakly suppresses
- L22:306 weakly excites
- L23:716 weakly suppresses
- L10:1967 weakly excites
- L24:2760 weakly excites
- L2:2654 weakly excites
- L13:35 weakly suppresses
- L3:1333 weakly excites
- L5:46 weakly excites
- L7:2121 weakly suppresses
- L10:2938 weakly excites
- L4:627 weakly excites
- L4:457 weakly excites
- L7:2458 weakly suppresses
- L10:2118 weakly excites
- L18:1091 weakly excites
- L8:841 weakly excites
- L8:2371 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ="⏎
- .Raw
- Natural
- jr
- .jasper
- =__
- andes
- cost
- icals
- иков
Suppresses
- نا
- ourselves
- haft
- 息
- etCode
- elem
- ""),
- ATE
- Explore
- elem