"can" after a noun in a clause
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 19 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word "can" when it follows a noun or pronoun inside a clause, as in "things you can do" or "those that can grow". Turning it up did not produce a clear change in the writing, so the effect is hard to see.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Abandoned Places in the World article.⏎Are you interested in visiting places that have been abandoned? Or is it too creepy? Have you been to any that you can add to the list? Please share below!<|endoftext|>How to tell if lines
-
on has a rating of 4, and Malawai has a rating of 1.3.⏎Working individually, take five minutes to briefly write down what you can surmise from the map, addressing these questions:⏎- What patterns do you see
-
antibiotic. The antibiotic knocks out cells which do not have the resistant marker. Those bacterial colonies that can grow have successfully taken up and expressed the introduced genetic material.⏎An alternative to a
-
is even off the table for those with insufficient literacy skills. 75% of 17-24 year olds in this country can’t meet minimum requirements for military service3.⏎Inability to find employment has long
-
our kids sense of identity, and very importantly, increases their ability to stand up to peer pressure. According to his studies, those children and teenagers that can effectively argue with parents are 40% more likely to say “no”
-
suffered a traumatic brain injury, and is now cared for by her family, 24 hours a day 7 days a week. Hannah wears a diaper, can’t feed herself, talk, or walk. The driver responsible sentenced Hannah to life
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I would like to be more careful about the way I would like to treat the people I am trying to be careful about my intention. I would like to be more cautious when I was trying to the people I was trying to be cautious the
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
sum of money to support them and they both are euqally friendless in the town of Brussels. Will chance once again intervene? Will life<|endoftext|>You can help keep your heart and blood vessels healthy by taking steps toward a healthier lifestyle. These
-
…[Read more]<|endoftext|>To actually reduce pounds in a healthier manner, it is perfect to burn fat gradually. And incredibly, most professionals consent which you can accomplish by using a diet regime. As opposed to a extreme life-style change, the
-
is perfect, implying that the signatures have been guillotine – trimmed on all four edges, it cannot be rebounded in the traditional way. This is because a perfect binding eliminates the folded edge of
-
out your supplies, and follow the rebinding process in this chapter.⏎Inspect your book; whether it is a hardback or paperback, it can easily be rebounded if its signatures are folded and sewn. However, if the binding
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L4:173 strongly suppresses
- L18:1491 strongly suppresses
- L17:953 strongly excites the word 'can' after a subject
- L3:978 suppresses
- L10:384 excites
- L0:1372 suppresses
- L7:2857 excites
- L6:170 excites
- L4:1316 suppresses
- L3:2961 suppresses
- L2:2386 suppresses
- L18:569 excites
- L4:904 excites
- L17:2000 suppresses
- L0:2699 suppresses
- L9:1475 suppresses
- L9:2453 excites
- L16:129 weakly excites
- L13:2339 weakly excites
- L17:2470 weakly excites
- L0:1778 weakly excites
- L17:1755 weakly suppresses
- L16:53 weakly excites
- L16:51 weakly excites
Feeds later layers
- L20:2487 excites
- L24:2814 excites the modal 'can' after 'there' or 'it'
- L21:2007 excites
- L24:766 suppresses
- L22:1892 excites the digit 6 in years 19xx
- L22:1422 suppresses
- L23:833 excites
- L23:2058 suppresses
- L22:277 excites
- L24:789 suppresses
- L22:697 excites
- L21:2203 excites
- L27:774 suppresses
- L23:2161 excites
- L21:1943 suppresses
- L22:2322 excites
- L22:1487 weakly excites
- L22:2543 weakly excites
- L20:1629 weakly suppresses
- L20:1606 weakly excites
- L21:2524 weakly suppresses
- L20:2003 weakly excites
- L23:1277 weakly excites
- L21:2554 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- afford
- \xb
- 't
- Easily
- 夠
- opies
- tered
- lev
- adians
- easily
Suppresses
- 能够
- 能在
- 可以
- 能夠
- 可以用
- 它可以
- NotAllowed
- 能
- aku
- 可用