'in' after a noun or participle
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 16 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word 'in' (or 'into') when it follows a word like 'present', 'contained', 'hidden' or 'laden' and names where something is located or contained. When it was turned up, the written text drifted into unrelated topics, so the push did not clearly bring out this idea.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
a rule regarding the sale and distribution of flavor-infused vaping cartridges. Parents need to be aware of the health risks associated with vaping, and share information about chemicals in vaping products with their children.⏎Because vaping devices can be easily concealed and are small
-
at Stanford University and the prestigious Cyclotron Road program at Lawrence Berkeley National Lab, recently announced the advancement of a new electrochemical technology that converts the carbon dioxide content in raw bi
-
foods that contain gluten. Gluten is a protein present in a certain number of cereals: wheat, rye, oats and barley.
-
ist hate speech in the print and electronic media”.⏎The UN committee asked the Australian Government to report back to it in detail in the<|endoftext|>Discover the words hidden in the grid, written through one another in eight horizontal, vertical and diagonal directions.
-
.⏎Foods with added probiotics have are also recently available:-⏎– like probiotic chocolate, snack bars and teabags⏎– the probiotic bacteria in these foods is often freeze dried⏎– these foods aren’t fermented, but they
-
of mesothelioma in the Iron Range miners.⏎The textile industry used asbestos in heat resistant products like heat–resistant pads, asbestos gloves, and woven into cloth coverings and protective blankets.⏎There was extensive use of asbestos in brake pads
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: my family of the family of my home. I think of my family of my school. my school. my school. my university. my university. my college. my college. my college. my college. my university. my university.
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
SON MANUAL (1993)||⏎previous taxon |⏎Jepson Interchange (more information)⏎©Copyright 1993 by the Regents of the University of California⏎AND IS MAINTAINED FOR ARCHIVAL PURPOSES ONLY
-
of E. canguzua.⏎• Marcus, Er. (1955) Opisthobranchia from Brazil. Boletim da Fac
-
liberty of contract” in a 5-4 decision.⏎Justice Oliver Wendell Holmes Jr, dissenter in the case, and Roscoe Pound (Dean of Harvard Law School), expressed views around the time that were termed “sociological
-
Volcanism Program, 2007. Report on Macdonald (Undersea Features) (Wunderman, R., ed.). Bulletin of the Global Volcanism Network, 32:1. Smithsonian Institution. https
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L15:871 suppresses
- L15:1464 suppresses
- L12:2833 excites
- L15:632 excites
- L14:1728 suppresses "of" after a numbered section or title
- L11:2207 suppresses "of" after a noun in trademark and title phrases
- L12:2807 suppresses
- L12:1040 excites
- L12:1904 suppresses
- L12:2756 excites "of" after a noun of quantity or container
- L11:1174 suppresses
- L15:2361 excites
- L9:2862 suppresses
- L12:2889 suppresses
- L15:2330 excites
- L9:2219 suppresses
- L9:2545 suppresses
- L11:2037 excites
- L8:3068 suppresses
- L15:3006 excites
- L15:942 suppresses
- L9:1909 excites
- L14:2512 excites
- L9:1595 excites
Feeds later layers
- L19:1733 suppresses
- L17:2405 excites
- L17:1574 suppresses
- L17:2733 excites
- L24:490 excites
- L17:2906 suppresses
- L18:1674 suppresses
- L17:1045 excites
- L19:2937 suppresses unclear: mixed possessives and fragments
- L27:886 suppresses
- L21:2481 suppresses
- L18:2472 suppresses
- L17:2314 suppresses
- L19:1354 suppresses
- L18:604 excites
- L21:2075 suppresses
- L21:933 excites
- L21:2846 suppresses 'at' after a job title, before an institution
- L18:2090 suppresses
- L17:1363 excites
- L18:158 suppresses
- L17:932 suppresses
- L17:978 suppresses
- L17:2199 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 男孩子
- ables
- 建筑材料
- 什么东西
- şı
- ucus
- 再见
- nextProps
- reeze
- 汉子
Suppresses
- courts
- gium
- {'
- 加工厂
- {"
- Northern
- museums
- crib
- 含
- warehouses