'host' or 'number' before 'of'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 5 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word that comes after 'a' in phrases like 'a whole host of' and 'a number of', right before the word 'of'. It goes quiet or negative where a percentage or figure should follow 'a', as in 'up to a 90 percent cut'. Turning it up made the model fall into repeated 'of the' phrasing.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
.⏎Water is the essence of life, but not just human life. Almost every living thing on the planet must have water to survive, and that includes a whole host of bacteria and microorganisms that can wreak havoc on human health.
-
hygiene. Read on to learn more.⏎Negative Effects of Poor Sleep⏎Aside from feeling cranky, tired and generally out of sorts, sleep deprivation can cause a host of physical issues. Loss of sleep can affect everything from short-term memory to one
-
many petals then had fallen?<|endoftext|>At EdPlace we are passionate about planning and preparation to avoid undue stress to students, whatever their age.⏎There are a whole host of reasons why a 6-week learning plan may be useful to your child and
-
that is not reflected by any Latin character. In such cases, combination of Latin characters are often used to represent such sound.⏎- Macro Language⏎There are a number of different Chinese “Dialects”, some which differ so much from each other
-
and third, a significant nummber of Christians who became later targets. Such a combination of factors did not exist anywhere
-
Unit 13 1. 1 Describe the different types of documents that may be produced from the notes and the formats to be followed. There are a number of different types of documents, below is a table which shows the types of documents
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have a 3250 word problem in this question. You can check this. Answer: The answer is "How to find 3250 words." Please find this. Answer: The user uploaded an image with this
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
ner’s grandparents, aunt and uncles. If he hadn’t been able to escape to the United States, Goldner says he would have had a less than 7 percent chance of survival in Germany.⏎Jessica Sternbach, president of the Jewish
-
2.7 m3 per MWh, but wind power uses only a fraction of these amounts.⏎In the US, the Department of Energy estimates that with a 20% share of wind power in
-
change emissions by up to 30 percent, according to the Portland Bureau of Planning and Sustainability. RNG’s climate benefits are even greater, offering up to a 90 percent cut in climate pollution.⏎The term “renewable” refers
-
the daily value for saturated fat. Eating too much total fat and saturated fat elevates your blood cholesterol levels and increases your risk for heart disease. Also, a 100-gram serving of tamales delivers approximately 3.1
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L3:2559 suppresses
- L4:392 suppresses
- L4:49 excites
- L4:764 weakly suppresses
- L2:1003 weakly suppresses
- L1:740 weakly suppresses
- L3:858 weakly suppresses
- L4:1537 weakly suppresses
- L2:533 weakly excites
- L4:21 weakly excites
- L2:493 weakly suppresses
- L2:984 weakly suppresses
- L2:851 weakly suppresses
- L2:501 weakly excites
- L4:367 weakly suppresses
- L3:286 weakly excites
- L0:2008 weakly suppresses
- L2:579 weakly suppresses
- L3:272 weakly excites
- L0:161 weakly suppresses
- L4:229 weakly excites
- L1:427 weakly excites
- L1:951 weakly excites
- L4:19 weakly suppresses
Feeds later layers
- L7:224 strongly excites
- L8:1021 excites
- L8:202 excites
- L8:1029 excites
- L6:1588 excites
- L12:1561 excites
- L8:1368 excites
- L20:2519 excites "of" after quantity nouns (millions of, amount of)
- L10:1465 excites
- L10:707 excites
- L15:2739 weakly excites
- L22:142 weakly suppresses 'of' after a quantity or noun phrase
- L17:1246 weakly excites
- L10:1153 weakly excites
- L16:1009 weakly excites
- L8:678 weakly excites
- L17:1516 weakly excites
- L7:1524 weakly excites
- L15:1896 weakly suppresses
- L14:1108 weakly suppresses
- L25:1679 weakly excites
- L13:1273 weakly suppresses
- L6:586 weakly excites
- L6:325 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- rac
- 人群中
- ued
- ensed
- quarters
- uetooth
- ながら
- 人群
- quarters
- bien
Suppresses
- inem
- 在玩家
- administrator
- theirs
- .Actions
- .setState
- .DataBindings
- .googleapis
- designers
- 您的