unclear: verbs and particles mid-phrase
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 13 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on words in the middle of a common phrase, like 'come and go', 'break apart' or 'into space'. The pattern is hard to see, and turning it up only made the text repeat words, so treat it as unexplained.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
’s Department of Earth Sciences, that reveals how “ghost glaciers” have protected Greenland’s ancient bedrock landscapes from the island’s ice sheet.⏎“These ghost glaciers come and go, and leave very little evidence of their presence,” Corbett tells LiveScience
-
But when we calculate the forces available from plate tectonics, we find that they are not large enough to do the job. We know that continents break apart and have done so repeatedly in the geological past. So, how
-
03 and repeated it a few times since then.⏎But there were two new dimensions of the recent flight. One, it carried a Chinese woman astronaut into space for the first time. Secondly and far more significantly, it demonstrated China's capability
-
ances⏎· Species movements and life stages⏎· Ecosystem processes⏎· Climate change<|endoftext|>What is Encryption?⏎Encryption is a process by which we use software to scramble sensitive information while it is in transit to Dell.⏎Please take a moment to read
-
is a new obj. instance var vh.i = 10 and HENCE v.i=10. LOCAL VARIABLE i is assigned value 0 on entry to method another() so printing these values gives 10 and 0 respectively.
-
individual school and on a system-wide basis.⏎Some of the challenges to working with parents:⏎1. By nature, they are a moving target: each year parents enter and depart the school system as they sequence from elementary, to middle, to high
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: what if it was possible to make a supercomputer? I have been thinking about this, so I know that it would be impossible, but I have been thinking about this, so I know that it would be impossible. I have been thinking
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
you click on your city. The satellite or spacecraft name, local date, and time fields are self-explanatory.⏎Duration is the length of time the satellites will be visible in your sky on a clear night. The maximum elevation is how high
-
to respect others. Begin with the basics (saying "please" and "thank you"), then try these six other strategies.<|endoftext|>This archived Web page remains online for reference, research or recordkeeping purposes. This page will not be altered or
-
creating your Spark projects and collaborating with other data scientists. When you sign up, you get free access to Watson Studio and all other IBM services for 30 days. Start now and take advantage of this offer.⏎- Learn how it performs at
-
then instructed to close his eyes and maintain balance for up to 30 seconds.1⏎The number of seconds that the patient/client is able to maintain this position is recorded. Termination or a fail test is recorded if 1) the
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L10:1499 excites
- L12:2377 excites
- L11:2317 excites
- L12:2221 excites
- L11:1141 suppresses
- L12:136 suppresses
- L12:2571 excites
- L12:2901 excites
- L9:2152 excites
- L11:2050 suppresses
- L11:3049 suppresses
- L7:2923 weakly suppresses
- L12:882 weakly suppresses
- L12:2183 weakly suppresses
- L12:2111 weakly excites
- L11:118 weakly excites
- L7:1440 weakly excites
- L11:186 weakly excites
- L10:24 weakly suppresses
- L3:251 weakly suppresses
- L12:1078 weakly suppresses
- L9:1928 weakly excites
- L11:1215 weakly excites
- L12:2530 weakly suppresses
Feeds later layers
- L15:1280 strongly excites
- L17:872 strongly excites
- L14:2033 strongly excites
- L14:1299 strongly excites
- L14:2969 excites
- L17:1078 excites
- L14:2924 excites
- L14:1882 excites
- L14:1239 excites
- L16:1920 excites
- L14:2544 excites
- L15:2832 excites
- L15:454 suppresses
- L16:2253 excites
- L14:2225 excites
- L14:843 excites
- L14:2354 excites
- L16:2902 excites
- L15:485 excites
- L14:862 excites
- L14:2236 excites
- L15:3005 excites
- L15:1675 excites
- L15:2367 excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- LinkId
- :href
- 固定的
- 小编一起
- @Id
- /frontend
- /end
- /disable
- /archive
- Tran
Suppresses
- v
- 跃
- alom
- k
- owell
- oval
- Kelley
- ind
- j
- ample