the word 'directly' mid-sentence
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 25 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'directly' in the middle of a sentence, such as 'is directly linked to' or 'directly below'. The steering outputs did not show a clear link to this word: turning it up gave rambling, repeated phrases.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
It would be a two-story, wooden frame building and included not only a general store, but also the town post office. The store manager’s house was constructed directly below the store (see photo). John McMurray Thompson, having sold his store
-
celestial targets. The light-gathering power of an optical telescope (light grasp) is directly linked to the size of your instrument’s aperture.⏎What is the purpose of an
-
the Earth gets hotter. So important is the sun in climate change that half of the 1.5° F temperature increase since 1850 is directly attributable to changes in the sun. According to some NASA scientists, only one-quarter
-
of that memorable day, the 25th of October, that the British cavalry were drawn up under Lord Lucan at the western end of this narrow valley directly under the steep heights of the Chersonese. On the summit, at the
-
for whole wheat flower, brown rice for white, and gluten free pasta. This will help to maintain weight and reduce your risk for heart disease. Cardiovascular health directly contributes to brain health.⏎Leafy green vegetables such as Spinach and Kale should
-
large eyes on the sides of their heads. It allows them to see 360 degrees around them, with a small blind spot directly in front of them. Although this is helpful, their eyes are weak compared to
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: right right right, right right right, right right right right right right right right right right right right right right right right right right right right right right right right right right right right right right right right right right right right right right right right
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
4/2012⏎Back to MedTerms online medical dictionary A-Z List⏎Need help identifying pills and medications?⏎Get the latest health and medical information delivered direct to your inbox FREE!<|endoftext|>November 16, 200
-
- Pages: 3⏎- Word count: 503⏎- Category: Healthy eating⏎A limited time offer! Get a custom sample essay written according to your requirements urgent 3h delivery guaranteedOrder Now⏎When healthy eating is
-
the 300 million tons of plastic is produced globally each year is carelessly discarded and goes from landfills or streets to streams, eventually floating out to sea. The floating
-
, including diabetes, cancer, and eating disorders, can manifest as signs and symptoms inside of the mouth.⏎Learn what those dental words mean.⏎Get dental news feeds delivered directly to your desktop! more...⏎Orthodontics are often necessary to help improve
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L20:2276 suppresses
- L24:2188 excites
- L22:2622 suppresses
- L21:1406 suppresses
- L12:2380 suppresses
- L10:2781 excites
- L23:3052 excites
- L4:252 excites
- L19:1951 suppresses
- L12:3071 weakly suppresses
- L19:2641 weakly excites
- L18:2861 weakly excites
- L23:2970 weakly suppresses
- L21:2774 weakly suppresses "to" after come or brought
- L16:2557 weakly excites
- L21:2637 weakly excites
- L20:1055 weakly suppresses
- L5:2366 weakly suppresses
- L22:2730 weakly suppresses
- L18:2594 weakly suppresses
- L12:1139 weakly excites
- L7:2864 weakly excites
- L19:3010 weakly excites
- L20:784 weakly excites
Feeds later layers
- L26:2116 strongly suppresses
- L26:2325 suppresses
- L27:1296 weakly suppresses
- L26:930 weakly suppresses
- L26:714 weakly excites
- L26:658 weakly suppresses
- L26:1854 weakly suppresses
- L26:557 weakly excites
- L26:943 weakly excites
- L26:814 weakly excites
- L26:917 weakly suppresses
- L26:2917 weakly excites
- L27:1233 weakly excites
- L26:2950 weakly suppresses
- L27:1724 weakly excites
- L27:2123 weakly suppresses
- L27:3016 weakly suppresses
- L27:1873 weakly excites
- L27:1847 weakly suppresses
- L26:2831 weakly suppresses
- L27:1530 weakly suppresses
- L27:144 weakly suppresses
- L27:1386 weakly suppresses
- L26:2857 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ーム
- Prototype
- dney
- stitution
- Ń
- istani
- Gam
- ager
- вест
- <Real
Suppresses
- 直接
- directly
- direct
- Direct
- direct
- Direct
- 直
- .direct
- DIRECT
- DIRECT