commas in lists of six items
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 11 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the comma that separates items in a list, especially when the list has six things, such as six symptoms or six types. Turning it up made the text drift into lists and numbers, though the link to the theme is loose.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
least three of the following six symptoms associated with the anxiety on more days than not in the last six months: restlessness, fatigue, irritability, muscle tension, difficulty sleeping and difficulty concentrating.⏎Obsessive Compulsive Disorder (OCD)⏎
-
writing skills. The CD is divided into six sections, each focusing on a different part of speech: nouns/pronouns, verbs, adjectives, adverbs, conjunctions, and prepositions. Each section:⏎- Defines the part of speech
-
180, and 200, resulting in stepping angles of 30, 15, 5, 2.5, 2, and 1.8° per step.⏎Step angle = 3
-
. According to the online Encyclopedia of Business, 2nd edition, there are six basic types of teams. These include informal, traditional, self-directed, leadership, problem solving and virtual teams. Each specific type of team requires its own individual type
-
six grade-appropriate math problems: one each of addition, subtraction, multiplication, division, fractions, and percents. I stressed "grade-appropriate" because single digit
-
.⏎UK Politics: The UK’s six main political parties-the Liberal Democrats, the Labour Party, the Conservatives, the Scottish National Party, the Liberal Party of Australia and New Zealand’s Labor Movement – compete for power through
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: "I am a digital estate, and I have no control over what is stored in my digital estate, but I want to preserve the information I can't, and I am doing this for the purpose of the first phase of the project,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
,500 SMART Boards and interactive projectors have been installed in schools since the Referendum was renewed.
-
being.⏎What is blood cholesterol? Also referred to simply as cholesterol, blood cholesterol refers to how much of a lipid (fat) called cholesterol we have per deciliter of blood. Cholesterol is basically
-
| M | N | O | P | Q | R | S | T | U | V | W | X | Y | Z | 0-9⏎21 results for Schools: |⏎See previous results⏎See results 1
-
for 5-10 days. During this time in the bed bug life cycle, they do not feed but instead digest their meal, mate, and lay eggs. ~ source⏎You may notice a bed bug infestation in your home if
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L10:559 suppresses
- L5:158 weakly suppresses
- L5:86 weakly suppresses
- L3:1373 weakly excites 'be' after 'to' in infinitives
- L10:944 weakly excites
- L8:3 weakly excites
- L3:50 weakly excites
- L1:747 weakly suppresses
- L2:86 weakly excites
- L6:2596 weakly suppresses
- L5:1877 weakly suppresses
- L9:1183 weakly suppresses
- L9:2421 weakly suppresses
- L10:24 weakly suppresses
- L8:2264 weakly excites
- L5:1359 weakly excites
- L7:901 weakly excites
- L7:2691 weakly suppresses
- L6:2213 weakly suppresses
- L4:3051 weakly excites
- L7:1491 weakly suppresses
- L10:2112 weakly excites
- L10:88 weakly excites
- L6:2620 weakly suppresses
Feeds later layers
- L12:1440 strongly suppresses
- L14:1623 strongly suppresses
- L13:2423 strongly excites commas in lists of names or items
- L13:1941 suppresses
- L16:808 excites
- L12:1854 excites
- L16:2442 suppresses
- L14:1215 excites
- L12:1977 excites
- L15:3020 suppresses
- L14:843 excites
- L13:564 excites
- L16:2880 excites
- L12:763 excites
- L15:2349 suppresses
- L13:1112 excites
- L13:899 excites
- L15:941 excites
- L16:1364 excites
- L15:2861 excites 'only' in 'not only ... but'
- L16:1809 excites comma inside a list of names or acronyms
- L13:1389 excites
- L14:1239 excites
- L16:2922 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 和
- pot
- 和技术
- และ
- 或
- 好事
- and
- ITER
- rant
- pekt
Suppresses
- ability
- heimer
- ESA
- unger
- esa
- hazi
- 的新
- umb
- ABILITY
- anness