"to" or "for" linking into a following phrase
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 11 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on small linking words like "to" or "for" when they lead into the next part of a sentence, such as "to find", "to Mars" or "to himself". When it was turned up, the writing did not clearly change in any obvious way.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
others when using the ecosystem approach as a basis for projects and programmes. The searchable component of the ecosystem approach sourcebook⏎can be used in addition to this guide to find information on case studies and tools which have been used to meet the principles of
-
scientists suffer programmatic whiplash whenever the human spaceflight program is redirected; investigations of the Moon, say, may be abandoned in favor of robotic precursor missions to Mars
-
hissing and clawing), to, finally, that level of self-communion in which the husband will seek to explain his wife’s behavior and their crumbling marriage to himself.⏎Last, there is the narrator’s ambiguous silence, looking on dispass
-
chemical substance that contains aluminum sulfate and a second chemical, usually potassium sulfate. It is used to shrink tissues, to stop bleeding, and to boost the immune response to a vaccine.<|endoftext|>Wand Chhakna / Wand Ke Chhak
-
decide whether to<|endoftext|>Stunning new data not yet publicly released shows Louisiana losing its battle with rising seas much more quickly than even the most pessimistic studies have predicted to date.⏎While state officials continue to argue over restoration projects to save the state’s
-
you might return "(False, reason)". Often, you can use exceptions to handle this situation.⏎Sometimes you might want to return objects of different types based on arguments to the function. For instance, did the caller ask for the data in this format
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I know that the problem is to be solved with a right angle. The problem is to be solved with a right angle. The problem is to be solved with a right angle. The problem is to be solved with a right angle. The
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
sold as fresh grapefruit.<|endoftext|>AC — see alternating current.⏎Alternating Current (AC) — A type of electrical current, the direction of which is reversed at regular intervals or cycles. Electricity transmission networks use AC because voltage can be controlled with
-
at:http://www.msfc.nasa.gov/news⏎The above story is based on materials provided by NASA's Marshall Space Flight Center. Note: Materials may be edited for content and length.⏎Cite This Page:<|endoftext|>By A. M. Sullivan
-
as play, as well as sleep and time to rest, are important factors influencing a child's growth and developmental outcomes.⏎Play is defined as engaging in an activity for enjoyment purposes and should come naturally to children.⏎But when a child is confined in
-
(in part or in whole) was last reviewed on 4 February 2012.⏎Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.3 or any
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L9:161 excites
- L8:577 excites
- L9:1358 excites
- L6:1752 excites
- L10:1609 weakly suppresses
- L4:152 weakly excites
- L9:103 weakly excites "as" or "since" giving a reason
- L8:772 weakly suppresses "it" as a subject pronoun
- L7:1903 weakly excites
- L9:2726 weakly suppresses
- L9:1890 weakly excites
- L8:705 weakly excites
- L8:151 weakly excites
- L8:230 weakly excites
- L5:20 weakly suppresses
- L2:840 weakly suppresses
- L6:655 weakly excites
- L0:2685 weakly excites
- L7:337 weakly excites
- L4:801 weakly excites
- L8:115 weakly suppresses
- L10:132 weakly excites
- L6:447 weakly suppresses
- L2:2630 weakly suppresses
Feeds later layers
- L14:674 excites
- L13:918 excites
- L15:161 excites
- L16:749 excites
- L14:419 excites
- L18:1154 excites
- L17:964 excites
- L16:509 suppresses
- L16:1026 weakly excites
- L14:2349 weakly excites
- L14:1133 weakly excites unclear: commas and nouns before an aside
- L16:928 weakly excites
- L16:1315 weakly excites word or phrase being named or defined
- L15:1902 weakly suppresses
- L14:1025 weakly excites
- L15:2247 weakly excites
- L15:360 weakly excites
- L16:507 weakly excites
- L15:1041 weakly excites
- L13:961 weakly excites
- L14:660 weakly excites
- L19:1294 weakly excites
- L19:663 weakly excites
- L12:644 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ransition
- 丰富
- REEN
- SG
- ОО
- 尽可能
- GR
- MERCHANTABILITY
- rendering
- reen
Suppresses
- ely
- ولا
- 的模样
- sometimes
- aldi
- yped
- ameda
- 的样子
- 唆
- iores