opening parenthesis after a term
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 18 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on an open bracket placed right after a name or term that is about to be shortened, as in Sustainable Development Goals (SDGs). It is very similar to a neighbouring neuron that does the same job, and turning it up produced unrelated text.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Brix Orolfo⏎Winner, Geology rocks drawing competition 2011, secondary school category<|endoftext|>The recently adopted United Nation’s Sustainable Development Goals (SDGs) set the new global development agenda for the next 15 years
-
sensitivity, says Cowley: "This work really does point to pursuing that as a<|endoftext|>(NaturalNews) Ohio farmers are more reluctant to plant genetically modified organisms (GMOs) in their fields than their counterparts in other Midwestern states,
-
now at least 877 times the background extinction rate over geological time.⏎BioScience, published monthly, is the journal of the American Institute of Biological Sciences (AIBS; www.aibs.org). BioScience is a forum for integrating
-
, and be creative and get the gift accordingly.⏎- Creativity wins:⏎You<|endoftext|>How integrated learning systems benefit teachers⏎Subscribe to our newsletter⏎Integrated Learning Systems (ILS) are solutions that deliver instructional content. They may be offline or online
-
-23/the-future-of-automation-in-the-mining-industry/8550636<|endoftext|>Service Oriented Architecture⏎Service-oriented architecture (SOA) is an evolution of distributed computing based on the
-
didn’t realize it at the time, but he was already practicing socially responsible investing.⏎What is Socially Responsible Investing?⏎Socially responsible investing (sometimes also called Ethical Investing) is exactly what it sounds like. It’s
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have a 2012, 2012, 2012, 2012, 2012, 2012, 2012, 20
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
33) has a total length of 125,982 bp, and it is located in the 7q31 locus of chromosome 7. MET is transcribed into a 6,641 bp mature
-
were issued.⏎The Revenue Act of 1862⏎On July 1, 1862, President Abraham Lincoln signed the Revenue Act of 1862 into law, to help fund the Civil War.⏎Narc
-
's Board of Missions of the Interior, located in Chicago (WBMI), the Woman's Board of Missions for the Pacific, located in San Francisco (WBMP), and the Woman's Board of Missions for the Pacific Islands, located
-
intended for use in massive concrete structures, such as large gravity dams, where the temperature rise resulting from heat generated during hardening must be minimized. Type V: Type V portland cement is used in concrete exposed to severe sulfate environments (princip
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L17:1794 suppresses
- L17:2806 suppresses
- L15:2704 suppresses
- L15:185 suppresses
- L17:2002 suppresses
- L17:2444 suppresses
- L17:440 excites
- L17:1191 suppresses
- L16:1181 excites
- L17:239 suppresses
- L15:1901 suppresses
- L14:595 excites
- L17:532 excites
- L17:1022 suppresses
- L17:2264 suppresses
- L16:2591 suppresses
- L17:1948 suppresses
- L17:873 excites
- L14:707 excites
- L17:987 suppresses
- L16:1045 suppresses
- L13:2908 excites
- L15:1684 excites
- L12:2132 suppresses
Feeds later layers
- L19:1673 excites
- L20:867 excites
- L20:1189 excites
- L22:106 excites
- L19:653 suppresses
- L19:225 suppresses
- L24:104 excites
- L19:1428 excites
- L20:681 weakly suppresses
- L19:762 weakly suppresses
- L21:451 weakly suppresses
- L19:355 weakly suppresses
- L20:1458 weakly excites
- L23:133 weakly suppresses
- L23:348 weakly excites
- L20:294 weakly suppresses
- L19:940 weakly excites
- L22:73 weakly suppresses
- L20:697 weakly excites
- L19:1055 weakly excites
- L20:1372 weakly excites
- L19:731 weakly excites
- L19:392 weakly suppresses
- L20:872 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- Cam
- getC
- sem
- chos
- cid
- Gol
- rat
- uc
- cam
- cel
Suppresses
-  
- StringComparison
- Bakanlığı
- 끗
- 学者
- /animations
- iado
- Autodesk
- 经过多年
- embros