"to" after "used" (purpose)
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 21 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word "to" when it comes right after "used" and introduces a purpose, as in "used to treat" or "used to analyze". Turning it up made the model's writing collapse into loops of the word "use", so the link to the text it writes is weak.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
in electrical current—can plunge the results of the most carefully designed experiment into ambiguity.⏎Consider the laser, one of the workhorse tools of modern research, used to analyze, print, scan, cool, heat, and more. Variations in
-
Carpobrotus virescens). The fruit provided a sweet, thirst quenching, summer food and an infusion of the crushed leaves was used to treat stomach cramps and diarrhoea.⏎Quandong (Santalum
-
found in kitchens all around the world. But did you know that black pepper is not only the world’s most traded spice, but that it can also be used to illustrate some important science principles such as surface tension?⏎Here’s a fascinating home science
-
theft. It can be both a state crime and a federal crime.⏎- Credit Card Fraud⏎When a credit card is stolen, forged or in any way used to pay for something without the permission of the card owner, it is credit card fraud
-
flower, or fruit from which they are derived. Some, like Lavender and rose, are used to soothe and calm. Other essential oils are more invigorating — basil and
-
iterpenes, phenolic compounds, carotenoids, steroids, and ketones. Its branches and leaves are often used to produce essential oils and metabolic extracts employing different organic solvents (Ferreira et
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: use a use a use a use a use a use a use a use a use a use a use a use a use a use a use a use a use a use a use a use a use a use a use a use a
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
their citizens of ethnicity Y who have contacts in State B are supporters of State B, and try to identify, capture and interrogate them to have information that may be helpful to suppress any opposition.⏎[F4] Security services of State A hack into
-
will cut pollution, and that decision could have a significant impact on the money each state earns under RGGI pollution permit auctions. That money earned in turn can be directed toward clean energy programs to help industry and residents cut their energy bills.⏎R
-
to start a dialogue about racial representation and stereotypes.⏎The program follows student participation in an education partnership with the West Chicago City Museum. All proceeds from the performance will be donated to the school’s Multicultural Sensitivity Club.⏎Thoughts on the program
-
a broad range of cancer cells. It enables the cancer cell to consume far more glucose than normal, while using little of it for energy. Instead, the rest is used to<|endoftext|>The turn of the twentieth century is often referred to as the nad
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L16:2526 suppresses
- L19:2824 suppresses
- L17:405 suppresses
- L19:2736 suppresses
- L20:1623 excites
- L18:2963 excites
- L11:2908 excites
- L19:2495 suppresses
- L8:2102 excites
- L16:716 weakly suppresses
- L6:2897 weakly suppresses
- L18:2515 weakly suppresses
- L12:1633 weakly suppresses
- L19:1689 weakly suppresses
- L13:2757 weakly suppresses
- L10:2412 weakly suppresses
- L19:544 weakly excites
- L20:246 weakly suppresses
- L18:2419 weakly suppresses
- L14:1872 weakly excites
- L18:2469 weakly excites
- L17:1187 weakly excites
- L15:1700 weakly suppresses
- L2:636 weakly excites
Feeds later layers
- L25:899 strongly suppresses
- L27:642 strongly suppresses
- L26:1033 strongly suppresses
- L23:663 strongly suppresses
- L27:2875 suppresses
- L26:1125 suppresses
- L24:1804 suppresses
- L22:2421 suppresses
- L24:2695 suppresses
- L22:2187 suppresses middle pieces of split surnames
- L22:2305 excites
- L27:883 suppresses
- L25:301 weakly suppresses
- L22:2145 weakly suppresses
- L23:2911 weakly suppresses
- L23:684 weakly suppresses
- L24:1237 weakly suppresses
- L22:478 weakly suppresses
- L24:1666 weakly suppresses
- L23:292 weakly excites
- L26:2600 weakly suppresses
- L23:422 weakly suppresses
- L22:1922 weakly suppresses
- L24:1055 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- erah
- fühl
- efault
- тов
- atalog
- .rawValue
- aviest
- й
- ate
- ólogo
Suppresses
- use
- use
- 使用
- 用
- using
- using
- →use
- .use
- Use
- Use