word fragments inside split words
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 7 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the middle or end piece of a word that the model splits into several pieces, such as 'incision', 'peregrine', 'chemist' or 'breadboard'. Turning it up made the output loop on numbers and odd phrases, which does not clearly connect to that pattern.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
uses a laparoscope, a viewing instrument with a light, to see your uterus and pelvis. The laparoscopy is inserted through a small incision in your belly. This procedure is generally performed under general anesthesia in a hospital.⏎
-
amarins are about 6-12 inches long, with tail being almost 16 inches! Their fur is dark brown and they have white tuft of hair on the top of their heads. Cotton Top Tamarins live for
-
face covering should cover the nose and mouth and should fit with no gaps.⏎4. Secure the face covering to the face with straps, tie in the back or loop over ears. Avoid touching the front of the face covering.⏎5. Try not
-
Arfwedson, a Swedish chemist.⏎It’s silvery white, soft and can store more energy than traditional metals
-
falcon nest.⏎The birds are on Forest Service land accessed through Iron Horse Trail State Park and near Olallie State Park. The peregrine is designated a sensitive species and requires the Forest Service to protect its breeding habitat.⏎
-
signed "Gutzon Borglum 1929 (illegible) AKUNST FDY NYC". The back of the base is inscribed: "NORTH CAROLINA".⏎A 1913 North Carolina
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the main problem is at the center of the main length of the segment, so If is it otherwise, a check would be too big. If is the data rectangle of the element, height of 22, width height of 1
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
much insulin or diabetes medication. A lot of physical activity can also cause low blood sugar, even hours later. In severe cases, low blood sugar can lead to seizures or passing out.⏎Everyone’s symptoms are different. Your child may feel dizzy,
-
days the Polynesian Seismic Network (RSP for Réseau Sismique Polynésien) recorded
-
just may be that rheumatoid arthritis sufferers will benefit from early prediction in the future. The 2018 annual conference of the European League Against Rheumatism (EULAR) approached this topic with two different studies that looked into molecular
-
produce neonatal encephalopathy in⏎boys. The encephalopathy is characterized by seizures, cortical myoclonus,⏎hypotonia and central apnea. R
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L6:441 suppresses
- L5:218 excites
- L5:2755 suppresses
- L4:101 suppresses
- L3:442 suppresses
- L6:2235 suppresses
- L6:380 excites
- L3:515 suppresses
- L6:122 excites
- L6:1812 excites
- L6:2425 excites
- L3:346 suppresses
- L6:566 suppresses
- L6:113 excites
- L3:730 suppresses
- L3:845 suppresses
- L6:237 suppresses
- L5:215 suppresses
- L6:2251 weakly suppresses
- L3:1012 weakly excites
- L3:822 weakly suppresses
- L6:1960 weakly suppresses
- L6:222 weakly excites
- L6:2769 weakly excites
Feeds later layers
- L10:248 strongly excites
- L10:318 excites
- L8:285 suppresses
- L8:245 excites
- L10:961 excites
- L10:451 suppresses
- L9:242 suppresses
- L10:919 suppresses
- L11:92 suppresses
- L11:531 excites
- L8:1385 excites
- L9:150 excites
- L10:1067 excites
- L15:164 suppresses
- L10:658 excites
- L9:1296 excites
- L14:2104 weakly excites
- L11:1682 weakly excites
- L8:1459 weakly excites
- L10:173 weakly excites
- L9:2562 weakly excites
- L8:1209 weakly excites
- L9:1000 weakly suppresses
- L8:1088 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 理智
- lector
- ainers
- 才能
- UGHT
- ocrat
- reeNode
- 功
- hands
- 一幕
Suppresses
- uja
- umes
- aceutical
- ewood
- <unsigned
- toUpperCase
- UME
- oda
- idos
- 鹉