'that' after 'the good news is'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 3 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word "that" when it introduces a full statement after phrases like "the good news is that" or "keep in mind that". Turning it up made the model write repetitive, circular sentences.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
as well as eggs. Along with beta-carotene and vitamin A, They protect your eyes from ultraviolet rays.⏎Keep in mind that your body needs a bit of healthy fat to best absorb these eye-benefitting
-
Shalgi, PhD, a professor at Technion Israel Institute of Technology and the study’s principal investigator, said in a press release.⏎“The good news is that since the ability is there, we hope future treatments can be developed to activate it
-
THMs). . Chloroform is an example of these TTHM’s. Some of these are either known or believed carcinogens.⏎The good news is that removing chlorine/chloramine also reduces TTHM’s, insecticides, pesticides
-
research interest in healthy ageing, I find that I am always being asked for tips on lifestyle steps to stay well for as long as possible. The good news is that it is never too late to take make changes to improve wellbeing. As our bodies
-
is generally agreed to be responsible for up to 85% of the visible signs of skin aging! The good news is that, in comparison to intrinsic skin aging, it is thought to be the more prevent
-
an underactive or absent thyroid gland. If the condition is not found and treated, children can have mental retardation and growth failure. But the good news is that early diagnosis and proper treatment can prevent these problems. In most cases,
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have been working on this issue, and I have been working on this issue. So, I have been working on this issue, and I have been working on this issue. I have been working on this issue. So, I have
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
speed.⏎So Howard bought two steamersa Stanley and a Doble. He had both shipped to California. He also owned a Cadillac, but he left that in Houston.⏎Like some of today's ecologists, Howard in 19
-
apply knowledge, think critically, imagine, be creative, be confident about being lifelong learners. It’s not simply about memorising facts and being able to recite that which one has memorised; it’s about knowing how to learn and knowing how
-
and try developing my own black and white film again. I don’t think people realize how easy it is, and how little equipment is needed. I’m not that smart; if I can do it, so can you!⏎To be clear,
-
DataTable name exists that matches the case of the search string, it is returned. Otherwise a case-insensitive search is performed, and if a DataTable name is found that matches this search, it is returned.⏎Use the Contains method to determine whether a
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L1:1427 excites 'that' after reporting verbs
- L1:1644 suppresses
- L2:1370 excites
- L1:1496 weakly excites
- L1:633 weakly excites 'that' after 'fact' or 'considering'
- L2:505 weakly excites
- L1:373 weakly suppresses
- L1:598 weakly excites
- L2:1259 weakly suppresses
- L0:1024 weakly suppresses
- L2:277 weakly excites
- L1:1130 weakly excites
- L1:2256 weakly suppresses
- L1:246 weakly excites comma after an introductory time phrase
- L1:1460 weakly excites
- L0:310 weakly suppresses
- L1:939 weakly suppresses
- L1:1620 weakly excites
- L2:2600 weakly excites
- L1:1332 weakly suppresses
- L2:1710 weakly suppresses
- L1:376 weakly excites
- L2:2171 weakly excites
- L1:1342 weakly suppresses
Feeds later layers
- L7:93 excites
- L4:2919 suppresses
- L4:223 weakly excites
- L8:2050 weakly suppresses
- L14:2381 weakly suppresses
- L17:2684 weakly excites
- L7:18 weakly excites
- L6:937 weakly excites
- L11:222 weakly suppresses
- L14:1434 weakly excites
- L6:206 weakly suppresses
- L10:137 weakly suppresses 'the' before a noun after 'of'
- L7:43 weakly excites
- L8:444 weakly excites
- L21:2663 weakly excites
- L20:2750 weakly suppresses
- L21:2303 weakly suppresses
- L12:1733 weakly suppresses
- L18:1063 weakly suppresses
- L5:95 weakly excites
- L14:1887 weakly suppresses
- L18:2604 weakly suppresses
- L4:227 weakly excites
- L10:583 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- äre
- gren
- kü
- comb
- chie
- orm
- oby
- -sp
- die
- (skip
Suppresses
- うちに
- 疝
- FileChooser
- ráf
- JSX
- ixo
- GLFW
- 칙
- cvs
- ozilla