"of" in "on top of"
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 2 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word "of" when it comes right after "on top", as in "on top of the soil" or "on top of each other". Turning it up made the model's writing drift into rambling, unrelated text, so the steering did not show a clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
ontan came in a predictable shape.⏎One could easily stack a few briquettes on top of each other in a stove and leave them burning slowly for hours. In addition,
-
arsenide. “We now demonstrate why it isn’t going to work”, Ron Jansen says. “If you put a layer of magnetic material directly on top of silicon, a barrier will form and the resistance is a factor of 10
-
you’d like to see.⏎You can create inverted alpha mattes on top of objects to effectively cut holes into other objects if you were to place one on top of another. If you want to duplicate a layer or layers, highlight the ones you
-
starts. There are many such alarms that incorporate vibrating sensations or audible alarms triggered by wet-detection devices that are attached to the underwear or a special pad on top of the bedding. The concept of the alarm treatment uses classic conditioning technique.⏎Once the
-
mattress construction.⏎How Memory Foam Beds Are Made⏎Memory foam mattresses are made up of regular polyurethane as the base layer. The memory foam sits on top of this, along with any other padding layers the mattress may need. Manufacturers often use
-
your pile and then wait for it to break down. No, you have to wait for the pile to break down before adding more dog waste on top of it.⏎So bottom line is, the nutrients in worm castings are good<|endoftext|>
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: to the present, how to get the application? 24 students. the college course (CS. 4 � law you exam (1 to 1注册考试() f (
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
on November 8 in the year of 1908 Raja Rao was a famous writer. The place was Hassan, in the state of Mysore in south India, into a well-known Brahman family. He post-grad
-
Hindu traces the phrase back to a seminal 1955 essay by the sociologist M N Srinivas titled 'The Social System of a Mysore Village', quoting
-
be said of cyberspace.⏎Reflective Essay On Cyber Ethics⏎Essay On Cyberspace - Words | Cram⏎Parents of students and teachers should be
-
9: Differentiate between www and internet.⏎problem 10: What do you mean by Usenet? List out main categories of it?⏎problem 11: Define an OS. Describe in
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L1:770 excites
- L1:1354 excites
- L0:191 weakly suppresses
- L1:666 weakly suppresses
- L0:1124 weakly suppresses
- L0:1778 weakly suppresses
- L1:2276 weakly excites
- L1:189 weakly suppresses
- L1:2318 weakly suppresses
- L1:754 weakly excites
- L1:2615 weakly excites
- L0:217 weakly suppresses
- L1:1208 weakly suppresses
- L1:1591 weakly excites
- L0:2455 weakly excites
- L1:2140 weakly excites
- L1:3003 weakly excites
- L1:1341 weakly excites
- L1:2574 weakly suppresses
- L0:1558 weakly excites
- L0:1809 weakly suppresses
- L1:1979 weakly suppresses
- L0:504 weakly excites
- L1:53 weakly excites
Feeds later layers
- L7:546 strongly suppresses
- L10:190 suppresses
- L3:318 excites
- L8:495 suppresses
- L9:144 suppresses
- L9:2483 suppresses
- L23:397 suppresses
- L16:692 suppresses
- L9:1625 suppresses
- L17:664 suppresses
- L19:1228 suppresses
- L20:500 suppresses
- L9:812 suppresses
- L10:1154 suppresses
- L24:2021 suppresses
- L24:2292 suppresses
- L18:177 excites
- L26:1783 suppresses
- L24:2599 weakly suppresses
- L11:2985 weakly suppresses
- L6:1504 weakly suppresses
- L24:2278 weakly suppresses 'Indian' before Ocean or subcontinent
- L21:901 weakly suppresses
- L9:453 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ^
- dT
- forgetting
- {}
- .UserService
- dd
- Bel
- name
- d
- Name
Suppresses
- lakh
- crore
- 男子
- haar
- Rajasthan
- antha
- ennai
- Gujar
- Jain
- arna