unclear: citation and list-field gaps
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 8 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron is hard to pin down. It sometimes fires at the start of a gap in a citation, list entry or caption, like a spot where a number or name is missing. Turning it up gave wandering text with no clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
) – and is generally considered the world's first general-purpose machine gun (GPMG).⏎[''Military Small Arms of the 20th Century''. 7th Edition. Ian V. Hogg & John S. Weeks. Kra
-
a good footnote and give you a place to start if you develop constant and persistent joint pain, but they are not predictive and certainly not diagnostic.⏎| Related: 9 Everyday Surprises When RA Enters Your Life |⏎Many of these risk factors
-
diffuse is a verb meaning to spread.)<|endoftext|>- Course type⏎- Paid course⏎- 16 lessons⏎- Available on completion⏎- Course author⏎- Programming Tut
-
81908049490 | 1908049499⏎- Cover: Paperback⏎- Copyright:
-
at Lachine and cuts through the southwestern part of the island, it 1970 it was closed to shipping. Lachine was replaced by the
-
. Some great websites for finding free 3D printable models are MyMiniFactory.com, Thingiverse.com, and Y
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have been thinking about my own life. I have been thinking about my own life as a series of moments. I have been thinking about my own life as a series of moments, and I have been thinking about my own life as a
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
125°C and the IC NE555 is used for where the temperature ranges from 0° to 70°C. [Read more…]⏎Nowadays, attend system in schools and colleges is generally based on paper.
-
in the United States has surged dramatically—thanks largely to technological advances such as high-volume hydraulic fracturing, more commonly known as “fracking.” This rapid increase has generated widespread debate, with proponents touting economic and energy
-
Porcelain⏎Process – Raw Porcelain is rolled to create the tile, each letter is hand imprinted into the clay, which
-
When your German Shepherd is overweight, it overworks the lungs and heart. This makes them work irregularly and could lead to surgical complications when your dog gets anesthetized.⏎- ACL injuries: The excess fat from obesity puts too much pressure
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L7:1513 weakly excites
- L4:1791 weakly excites
- L1:2475 weakly suppresses
- L4:2502 weakly suppresses
- L6:2721 weakly suppresses
- L3:2219 weakly excites
- L3:2595 weakly suppresses
- L2:1540 weakly excites
- L1:2683 weakly excites
- L2:1548 weakly suppresses
- L0:973 weakly excites
- L0:3049 weakly suppresses
- L5:623 weakly suppresses
- L7:929 weakly suppresses
- L2:1930 weakly suppresses
- L7:2893 weakly excites
- L7:2626 weakly suppresses
- L3:3035 weakly excites
- L3:3 weakly suppresses
- L6:2738 weakly excites
- L0:1392 weakly excites
- L0:281 weakly excites
- L6:2410 weakly excites
- L7:375 weakly suppresses
Feeds later layers
- L9:1991 excites
- L12:2015 weakly excites
- L10:2374 weakly excites
- L13:1814 weakly excites
- L18:3038 weakly excites
- L22:746 weakly excites
- L24:2631 weakly suppresses
- L20:2448 weakly excites
- L9:2015 weakly excites
- L10:873 weakly suppresses
- L24:442 weakly excites
- L12:2931 weakly excites
- L9:2680 weakly excites
- L14:1727 weakly excites
- L17:1441 weakly excites
- L11:1459 weakly excites
- L23:63 weakly excites
- L24:926 weakly excites
- L10:2573 weakly excites
- L11:889 weakly excites
- L10:718 weakly excites
- L24:2211 weakly suppresses
- L24:2757 weakly excites
- L16:2652 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- DEFIN
- _param
- Euras
- pell
- hattan
- _PARAM
- displayText
- бол
- _mex
- paramMap
Suppresses
- alyze
- 级别的
- cth
- -Cs
- Lv
- ไหน
- 陉
- น
- Culture
- ế