'something' as an object
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 17 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'something' when it follows a verb or preposition, as in 'try something new' or 'the start of something'. Turning it up gave output that did not clearly show this word pattern.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
. He also refused to touch the stock of tobacco companies, even when they were all the rage in the 00s. Again, he felt there was something wrong with profiting from a company that essentially poisons its customers. As a
-
abbiness surrounding her. Her first social evening is also a disappointment, for she finds the conversation of both men and women personal and trivial. She tries to introduce something different. On the way home, however, she is lectured by her husband
-
on their chemistry, and the unique way that individual reactions coalesce into something different in each class section in any given semester. It’s a fluid, organic
-
interests, and ultimately motivate your student to tackle summer work with a renewed sense of creativity.⏎Whether students are doing artwork, exploring the world around them, or performing something they made,
-
be more ambitious about adding to your activities.⏎Go here for more info⏎There are many ways to fit exercise and physical activity into your regular routine:⏎- Try something new: If you baby-sit for your grandchildren, how about walking to the
-
the best defenses - virus protection programs, firewalls and such - but it is almost inevitable. Just as human germs vary, your computer may become infected with something minor - like a trojan - or major - like a worm. When something
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have to (for the experience) to be in a different country to experience the difference between the other country to know in peace, but also to know the other country to understand, to know it to love, and to know it to
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
, college, and post-college.⏎To view this DRM protected ebook on your desktop or laptop you will need to have Adobe Digital Editions installed. It is a free software. We also strongly recommend that you sign up for an AdobeID at
-
mathematical problems as mathematical problems.⏎To view this DRM protected ebook on your desktop or laptop you will need to have Adobe Digital Editions installed. It is a free software. We also strongly recommend that you sign up for an AdobeID at
-
ebook on your desktop or laptop you will need to have Adobe Digital Editions installed. It is a free software. We also strongly recommend that you sign up for an AdobeID at the Adobe website. For more details please see FAQ 1&
-
Compute Module actuates a series of motors and grippers, while also running a two-phase algorithm from Herbert Kociemba. Aside from that, the ATmega328 board was employed to control an LDR-based scanner which consists of
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L11:416 strongly suppresses
- L14:1422 strongly suppresses
- L6:2443 suppresses
- L13:504 suppresses
- L16:2715 suppresses
- L12:1006 excites
- L6:2785 excites
- L9:1633 excites
- L15:65 excites
- L13:1057 excites 'more' after 'a' or 'prefer a'
- L9:758 suppresses
- L6:479 suppresses
- L3:31 excites
- L10:39 suppresses
- L5:2841 suppresses
- L14:1265 suppresses
- L8:1801 suppresses
- L10:382 excites
- L10:363 excites
- L3:1090 suppresses
- L1:2420 suppresses
- L1:1797 suppresses
- L8:15 suppresses unclear: mid-phrase words across many languages
- L14:1248 weakly suppresses
Feeds later layers
- L19:3017 strongly excites
- L19:914 strongly suppresses
- L20:1991 excites
- L22:1798 excites
- L19:2331 excites
- L20:983 excites
- L26:375 excites
- L24:704 excites
- L19:1620 excites
- L20:880 excites
- L21:736 excites
- L19:1268 excites
- L21:225 suppresses
- L19:3034 excites
- L21:916 excites
- L23:473 excites
- L19:2208 excites
- L24:150 excites
- L24:546 excites
- L19:1657 excites
- L21:1722 excites
- L19:249 suppresses
- L25:1208 excites
- L20:161 excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ort
- transient
- non
- def
- ORT
- trig
- kin
- ir
- abstract
- prim
Suppresses
- Presidency
- Equality
- Equality
- Cities
- equality
- ivities
- 管理水平
- ignment
- uhan
- 껏