unclear: mid-sentence words before a verb
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 22 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron gives weak, scattered responses to words in the middle of a sentence, like 'can', 'just' or 'easily', often just before an action verb. There is no clear theme in its strongest examples. Turning it up or down changed the text in ways that did not seem connected to these words.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
are especially likely to have severe problems with RSV.⏎There are several ways to test for RSV. We can grow the virus in cultured cells, or we can look for antibodies to the virus in a patient's blood (although we have to
-
a little broom, which makes this sport unlike any other.⏎What is a bonspiel?⏎A bonspiel is a curling tournament.⏎Why don’t they just call it a curling tournament?⏎“Bonspiel” better captures the specialness
-
in a Venetian gondola. I also owe a deep professional debt to Michael Colacurcio for years of guidance, as well as to Eric Sundquist ...⏎Introduction: Education and the "Alexandrian Library"⏎An Adver
-
being its creator.⏎Cavorite has a greater presence in the comic book world (including a 'Doctor Who' story!), but that is of no use to Toobworld......
-
guess what order they will spot them in!⏎✍Make up the checklist together – we’ve used stickers from our Out and About sticker pack but you can just as easily draw or write on some blank stickers.⏎👀 On your walk, encourage your child
-
with a “Spanish” hat made of velvet.⏎While it is unclear who exactly designed the crown, credit usually goes to the chief designer at Rundells, Philip Liebart. The design incorporates symbols of the three countries of the
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I need to be able to be the most to be the most to be the most to be the most to be the most to be the most to be the most to be the most to be the most to be the most to be the
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
66 the Fisk expedition explored the gold fields of Montana. Illingworth accompanied the expedition as a photographer, and, in spite of the technical challenges this expedition presented for the execution of wetplate negatives, Illingworth managed to create about
-
MA, its name in Spanish), was inaugurated to highlight the voices of women survivors of the clandestine centres, shedding light on the acts of gender-based violence they underwent during their detention, and the impact that it had in their lives after the
-
adholder of Holland, who became King of England but remained passionately Dutch. This article commemorates the 300th anniversary of his death⏎The article you want to access is behind a paywall. You can purchase this article or subscribe
-
roots in different cultures around the world through to the present day. He explores crucial milestones in scientific development and at the same time examines the enormous social and intellectual changes they initiated. Opening with a discussion of the key elements of modern scientific enterprise, the
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L20:1727 excites
- L19:385 suppresses
- L20:1124 suppresses
- L20:1962 excites
- L21:1646 excites
- L21:1416 excites
- L20:2482 suppresses
- L21:935 excites
- L21:914 excites
- L19:504 suppresses
- L19:1769 excites
- L21:600 suppresses
- L19:1166 suppresses
- L21:200 suppresses
- L20:585 excites
- L20:1652 excites
- L16:1153 suppresses
- L19:2567 excites
- L19:2632 suppresses
- L21:487 excites
- L14:659 excites
- L19:1622 suppresses
- L21:1569 excites
- L21:594 excites
Feeds later layers
- L23:1060 excites
- L24:2215 excites
- L24:1263 weakly excites
- L24:393 weakly excites
- L23:2179 weakly suppresses
- L24:57 weakly suppresses
- L27:1487 weakly suppresses
- L27:756 weakly excites
- L25:1161 weakly suppresses
- L24:293 weakly suppresses
- L23:1235 weakly excites
- L25:1641 weakly suppresses
- L25:1311 weakly excites
- L27:1184 weakly suppresses
- L24:565 weakly excites
- L26:3055 weakly excites
- L25:2661 weakly excites
- L25:1849 weakly suppresses
- L23:1815 weakly excites
- L25:1342 weakly suppresses
- L26:1225 weakly excites
- L23:271 weakly suppresses
- L24:1200 weakly suppresses
- L24:302 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- put
- 做
- done
- 有
- 来做
- Put
- 去做
- 说
- doing
- go
Suppresses
- cly
- 实施
- roker
- reu
- ifiant
- 执行
- executing
- 遵循
- eer
- engl