'of' after 'benefits' or 'features'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 7 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'of' when it follows a phrase like 'benefits', 'main features' or 'basic principles', right before the topic named. Turning it up gave text that does not clearly carry this pattern.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
code, and automatically creates, changes, and manages the defined resources by parsing and executing the template to reach the goal of automated O&M.⏎Learn the main features of Terraform, you can refer to Getting Started with Terraform with Alibaba Cloud:
-
you will be familiar with the relevant documents on measurements and calibrations and will be able to determine measurement uncertainty to perform measurement tasks.⏎You learn the basic principles of evaluating measurement uncertainty according to
-
in coffee strengthen body organs, useful against inflammation and uplift our muscles and skin. People who consume coffee regularly are expected to live a long life. Six amazing benefits of coffee are given below: –⏎- Coffee helps reduce depression and make you happier
-
their back, especially a few weeks after being born. If they’re not lying on their backs, they are being carried or swaddled. A few benefits of tummy time include strengthening of neck, back, and upper body muscles.⏎Sp
-
and fully benefit from their participation by becoming equal partners in the negotiating process. The course will provide a comprehensive overview of the concept of negotiations, background and special characteristics of multilateral trade negotiations in
-
loads will be completed in the cloud.⏎Cloud computing initiates a grand shift from the old traditional IT management systems to new and improved digitally-powered administration. Some benefits of cloud computing include:⏎- Reduction of capital costs⏎- Improved functioning speed⏎-
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I know I have been thinking about what to do with this. I know, I feel confident that I can answer now with something. If I need to, I can answer within 10 minutes. So, what if I thought of
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
how to develop a design. We will also explain in details the important phase of making construction document. Then finally we will be actually designing a home using an extremely easy yet powerful and free 3Ds program
-
000 calorie diet. Please remember this when using this information to make healthy food choices for your diet.⏎Calories -
-
the following properties or attributes:⏎- Expiration Date⏎- Symbol or Underlying⏎- Strike Price⏎- Type: Call or Put⏎The contract has an expiration date. This is how long the option contract lives.⏎The contract also has an
-
not only mathematicians - like to consider more specific questions in order to get some feeling for what is happening. In this article we will reflect about a special class of Lunda-designs.⏎On the day before my daughter Likilisa's fourth
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L6:1672 excites
- L5:1150 weakly excites
- L6:313 weakly excites
- L0:428 weakly suppresses
- L4:538 weakly suppresses
- L6:2585 weakly excites
- L6:1683 weakly excites
- L5:1384 weakly suppresses
- L6:1571 weakly excites
- L5:1131 weakly suppresses
- L6:397 weakly excites
- L5:439 weakly suppresses
- L5:1252 weakly excites
- L5:1556 weakly excites
- L4:1018 weakly suppresses
- L5:75 weakly excites
- L6:240 weakly suppresses
- L3:1709 weakly suppresses
- L1:700 weakly suppresses
- L1:1407 weakly suppresses
- L5:2849 weakly suppresses
- L4:2801 weakly excites
- L2:1973 weakly excites
- L5:2181 weakly suppresses
Feeds later layers
- L8:1179 excites
- L13:2498 excites
- L17:2548 weakly excites
- L12:2543 weakly excites
- L20:1324 weakly excites
- L10:2128 weakly excites
- L12:2892 weakly excites
- L13:2081 weakly excites
- L19:2212 weakly excites "what" after verbs of knowing
- L9:1474 weakly excites
- L9:1441 weakly excites
- L20:1016 weakly excites
- L9:488 weakly excites
- L11:1650 weakly excites
- L9:1852 weakly excites
- L20:2920 weakly excites
- L10:1174 weakly suppresses
- L22:1900 weakly excites
- L8:323 weakly excites
- L8:133 weakly excites
- L18:1815 weakly suppresses
- L26:463 weakly excites digits inside years and numbers
- L13:1263 weakly suppresses
- L17:2438 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- oeff
- 刍
- briefly
- <body
- 옹
- rch
- los
- ồn
- izador
- во
Suppresses
- marginTop
- paddingHorizontal
- 族自治
- xl
- hành
- }'.
- jest
- Accountability
- _reporting
- ;');⏎