the article 'a' before a noun
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 21 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron reacts to the word 'a' (or 'an') in the middle of a sentence, right before the noun it describes. Turning it down made the model get stuck repeating the word 'a' over and over, which fits its focus on that small word.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
some extent and organize state or national lotteries. Lottery prizes are typically paid in cash, although some states also award goods or services. In many cases, a winner must pay taxes on the prize amount before receiving it.⏎Lottery tickets can
-
obtain an “A grade” or perform well in the office. But if their standards aren’t met, they get upset. Perfectionists don’t care about a company’s goal. It doesn’t matter to them. So they’ll always put
-
a single winner or a small group of winners, while others offer a large number of smaller prizes. The prizes can be cash or goods. In some cases, a percentage of the total pool is reserved for costs related to organizing and promoting the lottery
-
ucky' and 'Red Globe'.⏎Photographed in author's garden.<|endoftext|>- Health Library⏎- PetMD U⏎|8 Common Snacks That Will Prompt a Portly Pet||Overweight Pets: Addressing the Epidemic||How to
-
the outcome, I don't think we would have had such a comprehensive service from any other law firm, and you took the worry away...I do not regret a single second of the whole process, apart from the bit before you got involved.⏎
-
created to an industrial model. They were built to ensure that kids could competently deal with the routine tasks that were necessary in factories. Some kids would succeed in a different way; but in the main, we were educating kids to be employed in
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: A a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
considerations to be taken into account when writing a technical report are highlighted. This section will briefly address the following points:⏎What is a technical report?⏎In simple terms, a report is a document that presents or communicates to a target audience the findings (
-
of the trust. The Houston living trust lawyers at Mendel Law Firm, L.P. explain when and how a living trust terminates.⏎What Is a Living Trust?⏎The person who creates a trust goes by many names. They can be referred to
-
a central eye. Depending on their location and strength, the storms are called different things. What gets dubbed a hurricane in the Atlantic, for example, would be called
-
In this article, we will delve into the main differences between microcontrollers and FPGAs, as well as their advantages and disadvantages.⏎What is a Microcontroller?⏎A microcontroller is a small computer on a single integrated circuit that is designed to
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L19:684 strongly suppresses
- L19:654 excites
- L19:2808 suppresses
- L18:873 excites
- L19:2269 suppresses
- L19:626 excites
- L19:1030 suppresses
- L20:2609 suppresses
- L18:2590 suppresses
- L20:2092 suppresses
- L7:2593 excites
- L20:1857 suppresses
- L19:1743 suppresses
- L19:1695 suppresses
- L19:2522 suppresses
- L19:859 excites
- L19:959 suppresses
- L18:2451 suppresses
- L20:1863 excites 'a' before an object noun
- L18:140 suppresses
- L19:1817 excites
- L20:1972 suppresses 'of' in 'of course'
- L19:639 suppresses
- L17:1278 suppresses
Feeds later layers
- L25:1586 strongly suppresses
- L27:797 strongly suppresses
- L25:45 strongly excites
- L24:2538 strongly suppresses
- L27:663 strongly suppresses
- L22:103 strongly excites
- L26:484 strongly suppresses
- L24:823 suppresses
- L27:231 excites
- L27:709 suppresses
- L25:1132 excites
- L27:173 excites
- L22:2889 suppresses
- L22:2302 suppresses
- L26:213 excites
- L22:171 suppresses
- L27:1044 suppresses
- L27:854 suppresses
- L26:411 excites
- L27:2396 suppresses
- L22:303 suppresses
- L22:247 suppresses
- L25:549 suppresses
- L25:568 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- わけです
- qrstuvwxyz
- pelo
- ép
- ро
- 蹙
- 黍
- ulous
- 럴
- ê
Suppresses
- a
- an
- 一个
- →an
- →a
- -a
- 是一个
- )a
- 一个小
- 也是一个