word fragments inside longer words
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 2 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on a piece of a longer word that has been split apart, like the middle of 'Ajzen', 'irrevocable' or 'ISRO'. Turning it up made the model's writing drift into repetitive loops, so the effect is hard to read.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
975) Theory of Reasoned Action (TRA) and Ajzens (Ajzen 1985) extended Theory of Planned Behavior (TP
-
round⏎- A photo of someone you love⏎- Something you love to play with<|endoftext|>The report’s focus is on perceptions of changes among pastoralists and agropastoralists in Borana, Ethiopia and Gao and Mopti,
-
It can be at any time and for any reason. However, if the trust is an irrevocable living trust the Settlor does not have the authority to terminate the
-
concern when considering the changing demographics.⏎The intention to perform a behavior is the most important factor to actually engaging in future behavior, according to Fishbein and Ajzens (Fishbein & Ajzen 1
-
6 satellite into orbit to process information on climate, soil, seas and crop location.⏎The Spot 6 satellite is currently situated at Indian Space Research Organization (ISRO) facilities awaiting its scheduled launch in September.⏎Mexico also will have information delivered from
-
in the pipeline, even if much of the energy they produce is destined for export.⏎On past trends, deforestation and soil erosion will follow, along with irrevocable changes to the course and character of untamed rivers, a quarter of
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have been thinking about the same as I have been thinking about... I have been thinking about... I have been thinking about... I have been thinking about... I have been thinking about... I have been thinking about... I have been thinking
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
be chromatically opposite, a very basic 3D stereoscopic effect is created.⏎Passive Technology (aka Polarised)⏎If you’ve been to an IMAX 3D cinema, then this is the technology you would have witnessed. It
-
, which is life as usual for a Python programmer.⏎if not server_response['successful']:⏎etag = server_response['file_handle'].info().getheader('ETag')⏎xml_document = server_response['xml_document']<|endoftext|>Deepak Vashish
-
ureau of Labor Statistics, U.S. Department of Labor, The Economics Daily, Demographics of Gulf War-era II veterans at https://www.bls.gov/opub/ted/2010/ted_201008
-
artificial shapes, as is, unfortunately, too often the case.⏎C. PURPUREUS.—Purple Broom. Austria, 1792. Alow, spreading shrub, with long wiry shoots, clothed with neat trif
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L0:503 excites
- L0:614 weakly excites
- L1:126 weakly excites
- L1:1418 weakly suppresses
- L0:374 weakly suppresses
- L1:1593 weakly suppresses
- L1:384 weakly excites
- L1:1769 weakly excites
- L0:1369 weakly suppresses
- L0:63 weakly suppresses
- L0:250 weakly suppresses
- L1:2648 weakly excites
- L1:1855 weakly suppresses
- L0:978 weakly excites
- L0:545 weakly excites
- L0:1850 weakly excites
- L0:2305 weakly excites
- L1:728 weakly excites
- L1:2068 weakly suppresses
- L0:2770 weakly suppresses
- L0:1084 weakly excites "the" at the start of a fragment
- L1:1055 weakly excites
- L1:2094 weakly suppresses
- L0:112 weakly suppresses
Feeds later layers
- L7:991 suppresses
- L7:1759 suppresses
- L4:395 suppresses
- L5:219 suppresses
- L10:1762 weakly suppresses
- L4:2952 weakly excites
- L11:2120 weakly excites
- L3:276 weakly excites
- L26:1970 weakly excites
- L16:1847 weakly suppresses
- L14:1899 weakly suppresses
- L5:712 weakly suppresses
- L5:1954 weakly suppresses
- L22:1175 weakly excites
- L20:1201 weakly excites
- L27:1340 weakly suppresses
- L20:2704 weakly excites
- L20:2198 weakly excites
- L21:1434 weakly excites
- L4:1519 weakly suppresses
- L6:270 weakly suppresses
- L3:28 weakly suppresses
- L20:888 weakly excites
- L24:1327 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- etheless
- pose
- joke
- 后的
- junction
- pires
- rice
- ��
- )[:
- Fly
Suppresses
- ouver
- еть
- ubar
- Param
- _Param
- Param
- شه
- .getParameter
- -param
- OUTH