abbreviations in parentheses
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 21 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the short letters inside brackets that stand for a term, like 'gbh' or 'PPCPs' or 'IEQ', in the spot where an acronym is being introduced. When turned up, the output became scrambled text full of capital letters.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
also analyzes the impact of various tree functional traits on liana colonization success in the PCWS. All trees ≥ 10 cm girth at breast height (gbh) was measured along with lianas (≥ 1 cm diameter at
-
alienates feminism, and the discrimination it fights, from the very current issues of gendered violence, rape culture, sexual objectification, men’s rights activists (MRAs) and the very real but less-explicit-than-they-once-w
-
health.”⏎In September, Governor Schwarzenegger signed into law legislation banning sales of children’s jewelry that contain more than 300 parts per million (ppm) total cadmium. In advocating for the law, which had bipartisan and
-
stress and to resist disease.”⏎The most popular IF methods include:⏎- Alternate day fasting⏎- 5/2 fasting, which
-
GreatSchools.org School Profiles.⏎What are the Sunshine State Standards (SSS)?⏎The Sunshine State Standards are Florida’s version of statewide learning standards which define
-
treating nausea, motion sickness and a variety of skin issues. Dramamine or Bonine are also useful for dogs suffering from motion sickness. Before giving your dog an OTC medication, check with your vet, since they could worsen certain conditions or
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: A lot of people are **constrated** to a **short** **length** to **elegant** **length**. It's a **constrated** **length** to **elegant** **length** to **
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
analyses of experiments to improve the understanding of the phenomenology.⏎The Large Atomic/Molecular Massively Parallel Simulator (LAMMPS) is a Discrete Element Method (DEM) code developed at
-
results are based on the widely accepted Greenhouse Gas Protocol [GHGP] established by the World Resources Institute [WRI] and World Business Council for Sustainable Development [WBCSD and were announced during an AMD sponsored media panel on energy efficient information
-
s. This case study investigates the resolution of the conflict. Questions remain as to precisely how this was achieved. Once these questions are resolved<|endoftext|>Wi-Fi Protected Access (WPA), Wi-Fi Protected Access II (WPA2), and Wi-Fi
-
of three concepts undergoing preliminary studies for the three-year, €7 million ($9 million) European hypersonic research project, Long Term Advanced Propulsion Concepts and Technologies (LAPCAT).⏎With €4 million from the European Commission and the rest from
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L19:1829 suppresses opening bracket before an acronym
- L16:812 excites
- L16:722 suppresses
- L19:1011 excites
- L20:912 suppresses
- L17:148 suppresses
- L20:2862 excites
- L19:1778 excites
- L16:369 excites
- L8:1976 suppresses
- L17:2755 suppresses
- L19:2368 excites
- L19:409 excites
- L6:1478 weakly suppresses
- L14:2419 weakly excites
- L20:366 weakly excites
- L20:18 weakly excites
- L20:556 weakly suppresses
- L18:1733 weakly excites
- L10:86 weakly suppresses
- L20:225 weakly suppresses
- L20:987 weakly suppresses
- L10:310 weakly excites
- L17:342 weakly excites
Feeds later layers
- L23:404 excites
- L24:699 excites
- L24:1278 excites
- L25:246 excites
- L25:200 excites
- L26:761 excites
- L23:349 excites comma after author surname in citations
- L25:446 excites
- L25:735 excites
- L24:355 excites
- L24:288 excites
- L27:379 excites
- L26:1597 excites
- L23:180 excites
- L26:816 excites
- L27:782 excites
- L25:617 weakly excites
- L23:630 weakly excites
- L24:2002 weakly excites
- L22:1393 weakly excites
- L22:1784 weakly excites
- L24:1970 weakly excites
- L24:481 weakly excites
- L26:23 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- FP
- RL
- SI
- CB
- C
- oS
- cs
- DC
- BT
- TF
Suppresses
- iaux
- idade
- ướng
- ieten
- INCT
- urers
- productName
- icular
- 多余的
- ******************************************************************************⏎