the word 'list' and list-like nouns
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 25 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron responds to the word 'list' and to nouns that name a list or a set of items, such as 'species list' or 'the following list'. Turning it up did not give a clear, list-related change in the output.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
's steamship. […]⏎2008 Americas Most Endangered Historic Places Two locations in New York State have been listed on the National Trust for Historic Preservation's annual list of America's Most Endangered Places. The non-profit membership organization […]
-
: hills, woods⏎and lakes. Furthermore they boast very important works of art like frescos and statues.⏎UNESCO World Heritage Committee has put the Site on its List for the following reasons:⏎The realization of an architectural and sacred art’s work
-
an essay.⏎3. Make a list of the characteristics of the educated person as presented in the Commitment. Identify where
-
so on, in industries related to food, drugs, military equipment, manufacturing, computer equipment, software, household appliances, floor coverings, and paint, just to name a few. However, one area that's historically
-
Inc.⏎Some researchers have found that the following factors increase your chance of developing HG. If you have any of these risk factors, tell your doctor:⏎The following list of symptoms are general and may be caused by other, less serious health conditions.
-
easy as with other programming languages.⏎To create a list of integers, create a new variable and:⏎That’s simple right? And that
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the concept of a branchingancheancheancheancheancheancheancheancheancheancheancheancheancheancheancheancheancheancheancheancheancheancheancheancheancheancheancheancheancheancheancheancheancheancheancheancheancheancheancheancheancheancheanche
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
with the arrival of the new national director of TNC, Julio Cárcamo. However the current status of the project is unclear.⏎Main policy lessons⏎Tulio Monterroso, AMUPROLOAGO: mailto:firstname.lastname
-
f/f; corresponds to the Dirac delta function, δ(t), the unit element of the set of generalized functions.⏎(To be continued.)⏎HOME PAGE OF Thayer Watkins<|endoftext|>Pakistan is a Republic founded in 1947 and located
-
youth, citizens and policy makers are coming together to find solutions for creating a sustainable society.⏎Take a sustainability course this semester!⏎Looking to incorporate sustainability into your courseload? For historical comparison, UAF offered 157 sustainability focused and
-
published online today in Open Biology⏎, the open-access journal of Great Britain’s Royal Society.This image compares glioblastoma cells untreated or treated with antisense oligonucleotides (ASO) that modulate splicing for PK-M
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L21:2773 strongly suppresses
- L24:594 suppresses
- L20:686 excites
- L23:710 excites
- L17:917 excites
- L22:1151 excites
- L22:740 excites
- L17:1947 suppresses
- L17:1944 suppresses
- L18:2067 excites
- L20:1756 excites
- L18:2465 excites
- L18:968 excites
- L23:1103 suppresses
- L17:3028 excites
- L17:1789 suppresses
- L18:1256 suppresses
- L13:2788 suppresses
- L17:1436 suppresses
- L19:1909 weakly excites
- L17:2555 weakly excites
- L17:1727 weakly excites
- L22:1369 weakly excites
- L23:3013 weakly excites
Feeds later layers
- L27:989 strongly suppresses
- L27:1462 suppresses
- L27:1804 weakly suppresses
- L26:2931 weakly suppresses
- L26:2383 weakly suppresses
- L27:2202 weakly suppresses
- L27:2138 weakly suppresses
- L27:1122 weakly suppresses
- L27:1688 weakly suppresses
- L27:1344 weakly suppresses
- L26:829 weakly excites
- L26:1381 weakly excites
- L26:112 weakly excites
- L27:2684 weakly suppresses
- L27:2577 weakly suppresses
- L26:805 weakly excites
- L27:1395 weakly suppresses
- L27:1581 weakly excites
- L26:2258 weakly suppresses
- L27:2114 weakly excites
- L27:824 weakly suppresses
- L26:2683 weakly suppresses
- L26:1779 weakly excites
- L26:1077 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- uate
- از
- ️
- ес
- ogui
- asctime
- ño
- 跷
- <%=
- laşma
Suppresses
- list
- 列表
- list
- lists
- List
- List
- .list
- -list
- _list
- Lists