unclear: mixed possessives and fragments
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 19 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on a grab bag of words, mostly ones that come right before a noun, such as 'its', 'their' or 'your' in business and web text. It is hard to say what ties them together. When it was turned up, the model's text drifted into rambling, repetitive phrases with no clear link to the neuron.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
is meant by "hashing function"? How is it used in hash data clusters and hash joins?⏎By submitting your personal information, you agree that TechTarget and its partners may contact you regarding relevant content, products and special offers.⏎A hashing function
-
you know a student who could benefit from or may need assistive technology support or services?Your building's core team can help! Every district in Grant Wood AEA also has AT team members to support building core teams in designing accommodations that best match
-
these conditions for America's working men and women by setting and enforcing standards, and providing training, education and assistance. For more information, visit www.osha.gov.<|endoftext|>End of the year math review for 2nd grade can be
-
tree will<|endoftext|>Safety Data Sheet Information⏎Employers must ensure that the Safety Data Sheet (SDSs) are readily accessible to employees for all hazardous chemicals in their workplace. This may be done in many ways. For example, employers may keep
-
every day. Leaning against the ears, so there is almost no harm to the human body.<|endoftext|>DUARTE, Calif.--(BUSINESS WIRE)--The American Association for Cancer Research (AACR) released its inaugural Cancer Dispar
-
as well,” said Kevin Krewell, principal analyst, Tirias Research. “AMD made an audacious promise fifteen months ago to improve the energy efficiency of their processors by 25 times by 2020. A projected
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the United States of America have the right to the United States Air Service for the United States Air Force, the United States Air Agency, the United States Air Service for the United States Air Department, and the United States Air Force Service Association,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
37's.⏎After the fall of Poland, the German military incorporated 20 captured 7TPs into Tank Battalion 203 of the 1st Panzer Division, as the PzKpfw 73
-
findings. The project, known as Bolshoi, is led by Anatoly Klypin of New Mexico State University and Joel Primack of the University of California, Santa Cruz
-
Marxism/Leninism. Although Albania operated under the facade of constitutional rule, the communist party, led by Enver Hoxha, who was also president of Albania, actually controlled all aspects of the political, social, and economic systems.
-
.⏎The greatest president that has ever served the United States is George Washington. He was not only the first president of the United States but also the commander in chief of the Continental Army during the American Revolutionary War. He was victorious over the British and
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L18:1227 excites
- L18:1510 suppresses
- L16:1830 excites
- L18:2529 excites
- L18:1931 suppresses
- L16:2810 suppresses
- L10:2558 suppresses
- L18:1667 suppresses
- L17:2747 excites
- L17:2086 suppresses
- L8:2585 suppresses
- L18:2012 excites
- L9:763 excites
- L10:1205 suppresses
- L12:2889 suppresses
- L18:2375 excites
- L16:2852 suppresses 'in' after a noun or participle
- L17:1522 suppresses
- L18:2072 excites
- L18:1507 excites
- L17:3041 excites
- L10:1318 excites
- L11:1994 excites
- L17:978 excites
Feeds later layers
- L22:2837 suppresses
- L21:2846 suppresses 'at' after a job title, before an institution
- L22:2134 suppresses
- L22:712 suppresses
- L20:2605 excites
- L27:886 suppresses
- L20:2778 suppresses
- L24:1655 suppresses
- L25:3048 suppresses
- L26:995 suppresses
- L20:2381 suppresses
- L26:1299 suppresses
- L22:2787 suppresses
- L24:2720 suppresses
- L23:2697 suppresses
- L20:1247 suppresses
- L21:372 suppresses
- L21:2944 suppresses
- L24:2460 suppresses
- L20:893 suppresses
- L24:1208 suppresses
- L24:1049 suppresses
- L21:1244 excites
- L23:1257 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 患者
- 人参
- ancellor
- 一杯
- eBook
- başv
- ToJson
- resumes
- 瓢
- 地图
Suppresses
- company
- 公司的
- 公司
- company
- companies
- Company
- 公司在
- 团队
- Company
- 团