'and' or 'to' before a second verb
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 14 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron responds to the word 'and' (or 'to') that links one action to another, as in 'turn and look' or 'pause and consider'. Turning it up did not produce a visible pattern in the output.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
-month-olds.⏎If your baby admires his reflection in a mirror and you suddenly appear behind him, he's likely to turn and look for you instead of believing that you're in the mirror.⏎A simple game
-
-old Eric Mohat killed himself. His suicide occurred on the same day a fellow student ridiculed him in class by saying, “Why don’t you go home and shoot yourself, no one will miss you.”⏎Fourteen-year-old Jeremiah Lasater
-
ability to bring in subtle elements, to pause and consider is vital for their patient.⏎We now have artificial intelligence which can replicate part
-
polygonal transects remains elusive.⏎Keywords: Boundary overlap, Inclusion region, Reflection method, Transect configuration⏎- We recommend that you also print this page and attach it to the printout of the article
-
is then delivered to the condenser, where it is cooled, dissipating the heat and steadily converting the gas back to a liquid state. A liquid receiver captures and stores the refrigerant between the condenser and the metering device.⏎Note:
-
ospitable area, the Spanish soon inaugurated the practice of sending regular military parties inland to subdue the increasingly hostile natives.⏎Members of the indigenous population were captured and enslaved to support the fledgling colony. The object of Columbus’ desire changed
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the thing that I think is very interesting, and then I have been thinking about it, and then I have been thinking about it, and then I have been thinking about it... and then I have been thinking about it... and then I
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
on, Drupal stores all the HTML code for any page visited by an anonymous user directly into the database. When another request for the same page comes along, Drupal knows to fetch this page out of the database rather than re-generating it from scratch
-
of any kind, including, without limitation, representations and warranties as to the functionality of the translation feature or the accuracy or completeness of the translations.⏎Translations are not retained in our system. Your use of this feature and the translations is subject
-
such as cookies and analytics, to customise content, advertising and provide social media features. This will be used to analyse traffic to the website, allowing us to understand visitor preferences and improving our services. Learn more<|endoftext|>Acknowledged as one of
-
unable to make enough thyroid hormone have congenital hypothyroidism, meaning they are born with an underactive or absent thyroid gland. If the condition is not found and treated, children can have mental retardation and growth failure. But the good
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L13:2677 suppresses
- L13:2929 excites
- L13:433 excites
- L12:2384 excites
- L13:2398 excites
- L12:1812 suppresses
- L12:650 weakly suppresses
- L13:1523 weakly excites
- L12:185 weakly excites
- L12:313 weakly suppresses
- L12:1279 weakly excites
- L8:2810 weakly suppresses
- L13:3031 weakly excites
- L11:2908 weakly excites
- L7:893 weakly suppresses
- L12:2207 weakly excites
- L11:2006 weakly excites
- L13:341 weakly excites
- L13:2096 weakly suppresses
- L11:814 weakly suppresses
- L1:1735 weakly excites
- L12:120 weakly suppresses
- L12:2439 weakly excites
- L5:26 weakly excites
Feeds later layers
- L15:273 excites
- L16:3060 suppresses
- L17:2911 suppresses
- L16:2167 suppresses
- L17:2495 excites
- L16:2550 suppresses
- L16:1207 weakly suppresses
- L15:1176 weakly excites
- L19:2726 weakly suppresses
- L18:529 weakly excites
- L16:2762 weakly excites
- L16:2753 weakly suppresses
- L16:2447 weakly suppresses
- L19:1991 weakly excites
- L16:357 weakly excites
- L15:3040 weakly suppresses
- L17:3058 weakly excites
- L25:119 weakly excites
- L16:2420 weakly suppresses
- L15:2225 weakly suppresses
- L25:245 weakly excites
- L15:2363 weakly suppresses
- L16:457 weakly suppresses
- L16:1687 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- aker
- umer
- Greater
- ものは
- ount
- onas
- Enh
- ��
- noop
- SqlParameter
Suppresses
- назначен
- zeitig
- جين
- ;!
- 下来
- icated
- ubic
- 热度
- gio
- 学到