"located" after a noun
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 4 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
Fires on the word "located" when it follows a thing being described, like "a country located in Europe." Turning it up made the writing wander into repetitive or unfocused text.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
glands are situated at the entrance to the to help begin the process of digestion.⏎The are a pair of glands located in the of the face overlying the and anterior and inferior to the . The
-
Hotel⏎Construction And Early Years⏎The West Baden Hotel, located in Indiana, USA, has a rich history that dates back to the early
-
.⏎Study with Molly in Kansas City or bring her to you……anywhere on this beautiful planet.⏎Alexander Technique Choreography Dance Movement Performance<|endoftext|>Europe is a continent located totally in the Northern Hemisphere and mostly in the Eastern Hemisphere. It is bordered
-
more necessary antioxidants in the liver.⏎If you love eating oatmeal, then your body has fibers that are essential for normal digestion. Besides, some fibers that are located in oatmeal may help the liver a lot. Oats and oatmeal have
-
cell⏎Regulation of the transport of certain molecules into and out of the cell and its organelles⏎Beet cells red pigment, located in the cell's large central vacuole and surrounded by the tonoplast membrane
-
own perspectives and also drawing on the interviews with 24 mothers in our sample.⏎As we ...<|endoftext|>Portugal, officially the Portuguese Commonwealth, is a country located in Europe, Africa and Asia. The capital city is Lisbon.⏎Portugal is
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: what is the value of the total amount of time that I have been thinking of the year... I have been thinking of about... a book. This book is about a time when I have been thinking about... a book. This book is
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
normal programmed cell death, apoptosis, which usually prevents runaway cell growth. When apoptosis fails normal cells can become cancerous.⏎The researchers explain that they have also found the complex chemical signalling pathways in the cell that are influenced by leptin, which reinforces
-
older. The other age ranges included 18 to 30 and 31 to 40. Compared to these younger women, Remis found the older women have the highest levels of chronic malnutrition and lowest hemoglobin levels among
-
Haoran Major poet during the Tang Dynasty Setting of Spring Dawn⏎Meaning for Line 1 春 : spring 眠 : sleep 不 : not 觉 : to feel, wake up 晓 : dawn⏎Meaning for L
-
10).⏎Article last edited on: 2008-09-09 15:47:35⏎Did you find this article helpful? Yes No⏎How can we improve this article?<|endoftext|>Java tutorials
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L3:1930 suppresses
- L2:1621 weakly suppresses
- L3:2642 weakly excites
- L2:2430 weakly excites
- L3:691 weakly excites
- L3:1615 weakly excites
- L1:1404 weakly suppresses
- L3:50 weakly excites
- L2:1921 weakly suppresses pieces of words split into fragments
- L1:1757 weakly excites
- L3:801 weakly excites
- L1:2875 weakly suppresses
- L3:187 weakly excites
- L3:421 weakly suppresses
- L2:70 weakly excites
- L3:2355 weakly excites "to" after "continues" or "continue"
- L3:2679 weakly excites
- L2:2433 weakly excites
- L0:2284 weakly suppresses
- L2:2985 weakly suppresses
- L3:2213 weakly excites
- L0:2490 weakly excites
- L2:1889 weakly suppresses
- L2:2713 weakly suppresses
Feeds later layers
- L9:1128 excites
- L16:2301 excites
- L5:2564 excites
- L7:2890 weakly excites
- L10:417 weakly suppresses
- L11:1723 weakly excites
- L9:793 weakly excites
- L5:237 weakly suppresses
- L19:2834 weakly excites
- L23:1654 weakly excites
- L6:2109 weakly suppresses
- L5:1998 weakly suppresses
- L12:2505 weakly excites
- L24:1181 weakly excites
- L15:1328 weakly excites
- L22:2284 weakly suppresses
- L20:3055 weakly suppresses
- L13:767 weakly suppresses
- L19:1730 weakly excites
- L19:166 weakly suppresses
- L17:778 weakly suppresses
- L21:645 weakly excites
- L14:3037 weakly suppresses
- L6:764 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 正处于
- анс
- anness
- aland
- 躺在床上
- 荡
- waiting
- 腾
- lands
- Stateless
Suppresses
- moth
- obel
- 彗
- its
- ointments
- rible
- 恐
- ointment
- /oct
- it