'is' after a long subject phrase
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 16 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the small word 'is' (or 's) that comes right after a long subject, as in 'Making sure your soil is... is important' or 'Interesting fact is that'. When turned up, the model got stuck repeating 'is' or 'was' over and over.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
ability to bring in subtle elements, to pause and consider is vital for their patient.⏎We now have artificial intelligence which can replicate part of the
-
returns, you collect and analyze the information gathered by the instruments you designed. This information is pivotal in gaining a clearer picture of how the aircraft is functioning.⏎This is a job that requires an acute attention to detail. Test flights are
-
got a newsletter from the unmanned-vehicles industry about all the cool things robots are doing to help Japan. It has not a word about the nuclear reactors. That's disgraceful.⏎To head off the next nuclear accident, we need to rethink the
-
were discovered in this isolated location, such as:⏎The mountain acts like an island in the vast sea of jungle, isolating the wildlife on it. Interesting fact is that most wildlife living in the Bosavi Crater show little to no fear of
-
robot to take home with them! For kids entering 2nd-6th grade in fall 2021.<|endoftext|>Create your own garden at home is not easy. Therefore, many people who entrust the construction of gardens on expert
-
pests, and watering your garden more natural and sustainable.⏎Making sure you build your soil so that your crops get adequate nutrients is important—and you can definitely accomplish this goal without buying anything in a package or a
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: is is is is is is is is is is is is is is is is is is is is is is is is is... (this is is is is is is... etc. is is... etc. is... etc. is is
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
do not require the last check, but none of real⏎"I have come to believe that the whole world is an enigma, a harmless enigma⏎that is made terrible by our own mad attempt to interpret it as though it had⏎an
-
women who weigh more or who exercise regularly.⏎Very low calorie diets of fewer than 800 calories per day should not be used unless you are being monitored by your doctor.⏎Healthy Weight Tip⏎Set goals to eat healthy like
-
feeling secure gives children the confidence they need to explore, learn and take on the world!⏎Talk, Sing and Point⏎Babies learn language from the moment they are born. To a newborn baby, speech is just sound. Then, day by
-
Why Lesson Planet?⏎Find quality lesson planning resources, fast!⏎Share & remix collections to collaborate.⏎Organize your curriculum with collections. Easy!⏎Have time to be more creative & energetic with your students!⏎Students participate in a variety of physical activities
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L6:2237 strongly excites
- L4:20 strongly suppresses
- L4:24 excites
- L9:66 excites
- L14:827 suppresses open bracket after a value or citation
- L0:1329 excites
- L3:76 suppresses
- L4:2128 suppresses
- L10:417 suppresses
- L1:301 suppresses
- L1:1814 excites
- L13:897 excites
- L15:286 excites
- L1:1791 suppresses
- L0:207 excites
- L6:858 excites
- L10:206 excites colon or equals sign before a definition
- L4:116 suppresses
- L2:1935 excites
- L10:272 suppresses
- L3:2899 suppresses
- L8:137 weakly suppresses
- L15:599 weakly excites
- L7:3018 weakly suppresses
Feeds later layers
- L19:1613 strongly excites "is" after a sentence-opening "It"
- L17:882 suppresses
- L17:1473 excites
- L19:2656 excites
- L18:857 suppresses
- L20:1253 excites
- L17:227 excites
- L19:1115 suppresses
- L23:1160 excites
- L21:1434 excites
- L19:983 excites
- L19:2450 excites
- L20:1540 excites
- L18:1415 excites
- L17:1851 excites
- L17:1013 excites
- L19:835 excites
- L20:1618 excites 'be' after 'to' or 'need to'
- L23:360 suppresses
- L18:1061 excites
- L27:1368 excites
- L19:2511 excites
- L17:2756 excites
- L18:1036 excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- Permanent
- ards
- 好事
- 些什么
- 一回事
- ursors
- 什麽
- ometrics
- houses
- mdi
Suppresses
- él
- iler
- ullah
- но
- inho
- atz
- 代
- 是
- ه
- 是以