word after an introductory phrase
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 16 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron tends to fire on the word or comma that comes right after a short lead-in phrase, like 'In such cases,' or 'For this reason'. It goes quiet on modal words such as 'can' or 'should' after a hopeful or evaluative clause. Turning it up made the model repeat itself and drift.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
.⏎The command for unzipping the .tgz file using the .tar utility:⏎tar -xvzf <File name>.tgz⏎In this command -xvzf flags are used, and these flags pass commands to the
-
benefited from this Ritchie Dental Group blog article and look forward to your next visit.<|endoftext|>Sometimes it makes sense for a function to return multiple things. In such cases, it's common to just return them in a tuple: "return (count
-
are designed to enhance understanding andor to provide additional practice. Each rule or line in an accesslist provides a condition, either permit or deny. In computer networking, port numbers are part of the addressing information used to identify the senders and receivers
-
. In many cases, both events are similarly included. For example, in a publication created by a team of contributors, each contributor has the lawful right to sell his/her job under a copyright task contract
-
format applies to every source type⏎Reproduced from https://style.mla.org/whats-new/⏎Author. When a source has three or more authors, only the first one shown in the source is normally given
-
cover the period from the French colonial era of the seventeenth century to the creation of Nunavut in 1999.⏎The map descriptions provided below have been reproduced from the original maps.⏎First successful French settlements in North America: Port
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: if we look at the average of the numbers that are at least the average of the numbers that are a minimum to the average of the numbers that are a minimum to the average of the numbers that are a minimum, etc. So, the
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
Israel Institute of Technology and the study’s principal investigator, said in a press release.⏎“The good news is that since the ability is there, we hope future treatments can be developed to activate it and employ the body’s own tools to cure these
-
useful tools for teachers and school leaders?⏎Teacher Evaluation 2.0 tackles this key question. It proposes six design standards that any rigorous and fair teacher evaluation system should meet. It offers a blueprint for better evaluations that can help every teacher succeed in
-
the sound of croaking Gartraps looking for mates. Each mated female Gartrap lays two eggs and defends them with her life. Very few creatures will even try to eat a Gartrap’s eggs. They can live for up to
-
fat chart are based on the biggest serving size available.⏎- These nutrition facts came directly from the USDA or manufacturer/restaurant.⏎- If you're using a calorie counter, remember that Fat, Carbs, and Protein calories are just close estimations
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L15:284 suppresses
- L15:862 excites
- L14:96 excites
- L13:1625 excites
- L14:699 suppresses
- L12:2825 excites
- L14:1574 excites
- L14:2863 suppresses
- L15:1478 suppresses
- L15:2564 suppresses
- L15:2684 suppresses
- L14:855 excites
- L15:1098 suppresses
- L14:2247 suppresses
- L14:2381 excites
- L15:1261 excites
- L1:646 suppresses
- L7:2262 weakly suppresses
- L14:2290 weakly suppresses
- L12:1466 weakly suppresses
- L14:2176 weakly excites
- L15:176 weakly suppresses
- L12:2026 weakly suppresses
- L13:1212 weakly suppresses
Feeds later layers
- L17:2220 suppresses
- L20:1156 suppresses
- L17:1886 suppresses
- L18:2880 suppresses
- L22:1922 weakly suppresses
- L21:2248 weakly suppresses
- L18:1751 weakly suppresses
- L19:1285 weakly suppresses
- L17:2672 weakly suppresses
- L22:2214 weakly suppresses
- L25:978 weakly suppresses
- L24:1262 weakly suppresses
- L17:2451 weakly suppresses
- L23:1156 weakly suppresses
- L21:2403 weakly suppresses
- L22:186 weakly suppresses
- L21:1183 weakly suppresses
- L18:1446 weakly suppresses
- L21:221 weakly suppresses
- L17:2106 weakly suppresses 'is' in a definition sentence
- L22:2851 weakly suppresses
- L18:371 weakly suppresses
- L18:529 weakly suppresses
- L18:1194 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- acity
- プログ
- ric
- ublic
- рост
- לבד
- arter
- argins
- Expansion
- WB
Suppresses
- referencing
- 借鉴
- ��
- iona
- 参照
- .Equal
- %"><
- =$
- 趋
- adhere