subjects of conditional or advice clauses
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 19 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
It fires on the word that introduces who or what a conditional or possible situation is about, such as 'you' in 'or you may require' or 'they' in 'they can arrange'. Turning it up pushed the text toward hypothetical scenarios, and turning it down pushed it toward 'recent studies' phrasing.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
be. For example, you may be happy with a confidence level of 95 percent (giving a margin error of 0.05), or you may require a tighter accuracy of a 98 percent confidence level (a margin
-
it is high probability that the hypothesis has been refuted.⏎If the hypothesis failed in their experiments, repeatedly, the scientist can do one of two things:⏎- He
-
a little and sometimes nothing at all. For example, we may know that a population is normally distributed (e.g., for heights, weights or IQs), we may know that there is a bimodal distribution (as often happens with class
-
The period during which a cell or battery is capable of operating above a specified capacity or efficiency performance level. Life may be measured in cycles and/or years, depending on the type of service for which the cell or battery is intended.⏎Btu (
-
fine particles⏎- Mix detergent with warm water, according to the instructions on the label⏎- Use a sponge or rag to apply the detergent
-
provides critical feedback to teachers about how well students are performing in the concepts taught by them. If teachers find that most students are going wrong in a particular concept, they can arrange for remedial classes for such concepts and help students gain proficiency in the
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the current version of the original $A$ and $B$ do not have an exact mathematical proof, but have been noted recently in the article [1] that a recent mathematical paper by the authors of the 2016 and
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
as Rheumatoid Arthritis (RA). We’ve seen great medical advances in the treatment of and even preventing certain diseases once we’re able to predict that a person is prone to getting the disease.⏎It just may be that rheumatoid arthritis
-
need to be naturalized if born in the U.S.⏎- Census The 1900 and 1910 censuses ask if a person is⏎naturalized and 1920 further asks the year of natural
-
tested. Talking to their health care providers may help parents identify the option that is right for them.⏎All U.S. states have neonatal screening for CA
-
any of the components listed above are not belt driven, you must:⏎- Tell the examiner which component(s) are not belt driven.⏎- Make sure component(s) are operating properly, are not damaged or leaking, and are mounted securely.⏎-
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L18:1338 suppresses
- L17:1611 suppresses
- L13:1506 excites
- L16:837 excites
- L15:1879 excites
- L16:730 excites
- L15:742 excites
- L16:835 suppresses
- L18:2656 suppresses
- L15:878 suppresses
- L15:782 excites
- L17:1945 suppresses
- L17:951 excites
- L14:1477 excites
- L15:607 suppresses
- L15:1641 excites
- L16:3069 suppresses
- L17:788 suppresses
- L16:2332 suppresses
- L18:1038 suppresses
- L12:611 excites
- L12:717 excites
- L13:1153 excites
- L15:1623 excites
Feeds later layers
- L20:589 suppresses
- L20:388 excites
- L21:1093 suppresses
- L21:1461 suppresses
- L20:2973 excites
- L20:2318 suppresses 'recent' in time phrases
- L20:1396 suppresses
- L20:2894 suppresses
- L23:1173 excites
- L20:2110 suppresses
- L20:2939 suppresses
- L20:1666 suppresses
- L24:499 suppresses
- L20:726 suppresses
- L21:2121 excites
- L21:1034 suppresses
- L21:2506 suppresses
- L23:1982 suppresses
- L21:2592 suppresses
- L21:169 excites
- L20:990 suppresses
- L21:1729 suppresses
- L22:2268 suppresses empty slot before a number
- L22:1358 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 会
- owning
- omm
- sume
- 있을
- 就会
- Hanna
- 会长
- 会有
- 一定会
Suppresses
- recent
- lately
- recently
- 至今
- 近年来
- recent
- 近年
- 著名的
- 到现在
- amous