'well' after 'most' or 'and'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 5 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires weakly on the word 'well' in phrases like 'most well-known' or 'a large and well-defined'. Its activations are small compared with the strongest neurons here. Turning it up did not bring out these phrases in the output.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
the offspring of the original polyp remain connected to each other, by a stolonal network or coenosarc. Some species are solitary.⏎While the most well-known zo
-
dairy are often considered one of the most important components, and for good reason considering all the essential vitamins and nutrients found in milk. Calcium is one of the most well known ones, but according to Dr. Noreen Iftikhar from
-
." Japanese-speaking listeners, albeit with more variability, were more<|endoftext|>Growth Trends for Related Jobs⏎Physicians and surgeons are some of the highest-paid and most well-educated individuals in the country. According to the Bureau of Labor Statistics, there were
-
ELL.)⏎To turn cat-in-pan. To turn traitor, to be a turncoat. The phrase seems to be the French tourner côte en peine (to turn sides in trouble). I do not think it refers to
-
on this and that the celery is safe for cats to eat.⏎Cats can definitely eat celery and benefit from it. Cats can eat some veggies in moderate, well, actually, small amounts. Cats can eat celery
-
ropical cyclone status, with winds at 40 mph (65 km/h). According to the NHC, that morning the storm maintained a large and well-defined circulation, but had been without organized deep convection for at least 2
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: Let me up there first place: Let me try to get a better look at? Well, encrypted? Maybe it is okay to be able to do with out of the daylight box: Let me be able to do it without the day
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
on HIV/AIDS, held two high-level briefings as part of a three-part series to expand awareness of the global AIDS agenda outside of the health community, particularly within foreign policy and development circles.⏎World
-
proud to share that many of my students will switch to a 100 MIX of addition and subtraction today
-
system and how HIV functions. The questions that basic or bench science seek to determine are how a drug might be effective in preventing infection, treating HIV, or curing AIDS. These questions provide researchers with a concept around which they can start to develop a
-
of the puzzle in pinpointing the earliest signs of autism,” said Dr. Schultz. “Understanding how autism begins and unfolds in the first years of life will pave the way for more effective interventions and better long-term outcomes for individuals with autism and their
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L4:949 weakly excites
- L4:557 weakly suppresses
- L3:1377 weakly suppresses
- L3:2437 weakly suppresses
- L3:2463 weakly excites
- L3:441 weakly excites
- L4:1891 weakly suppresses
- L2:194 weakly excites
- L3:822 weakly excites
- L3:1661 weakly suppresses
- L4:1090 weakly suppresses
- L4:251 weakly suppresses
- L2:59 weakly excites
- L0:891 weakly excites
- L0:1752 weakly excites
- L4:2872 weakly suppresses
- L2:623 weakly excites
- L3:1000 weakly excites
- L0:1783 weakly suppresses
- L4:838 weakly excites
- L0:1820 weakly suppresses
- L3:1244 weakly excites
- L4:117 weakly suppresses
- L4:922 weakly excites
Feeds later layers
- L16:592 suppresses
- L6:809 suppresses
- L17:259 suppresses
- L6:2164 suppresses second half of multi-word proper names
- L9:929 suppresses 'each' in 'each other'
- L6:1198 suppresses
- L8:852 suppresses comma inside large numbers
- L7:7 suppresses
- L9:116 suppresses
- L6:2656 weakly suppresses
- L6:108 weakly suppresses
- L10:1316 weakly suppresses
- L6:1100 weakly suppresses
- L7:8 weakly suppresses
- L6:2069 weakly suppresses
- L8:423 weakly suppresses
- L20:252 weakly excites
- L6:184 weakly suppresses
- L6:785 weakly suppresses
- L17:1161 weakly suppresses
- L7:9 weakly suppresses
- L6:35 weakly suppresses
- L10:346 weakly suppresses "each" in "each other" phrases
- L17:446 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- rians
- .setParameter
- Passion
- 的意义
- .setFont
- onyms
- 万元以上
- yny
- HorizontalAlignment
- maç
Suppresses
- وث
- drops
- hole
- edly
- vieille
- itta
- -window
- 隔热
- illard
- razor