opening parenthesis after a noun
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 10 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on an opening bracket that comes right after a noun, especially when the bracket is about to give a short alternative name, a size, or an abbreviation, such as '1 cup (8 ozs.)' or 'the Commission (the Commission)'. Turning it up did not make the text clearly about brackets; the output drifted into unrelated sentences.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
oxide in warm distilled water once to twice a week to remove even chronic yeast infections.⏎Colonic or Enema:⏎For a colonic, add 1 cup (8 ozs.) 3% H202 to 5 gallons warm
-
-sense considerations will make your trail-travel safer and more enjoyable for everyone:⏎- Share the trail. Show consideration for others.⏎- Please keep to the right except when passing⏎- Control your speed⏎- Warn others when passing⏎- Keep
-
soapy water so they are very clean. You can also disinfect them with a mild bleach solution.⏎- yoghurt containers – the small 8 ounce (250ml) single serving sized ones are
-
of protein function have undergone a marked transformation with the discovery of an aspect of enzyme evolution called "moonlighting." That is, a protein can acquire a second (moonlighting) function without concomitantly losing all or part of its
-
remedy given by the trial judge was improper. The process will now be remitted back to the planning stage that was previous to the Peel Watershed Planning Commission’s (the “Commission”) Final Recommended Report (“Final Recommended Plan”), instead of being rem
-
on the calyx and stem end of the fruit.<|endoftext|>The American Lung Association's (ALA's) Not-On-Tobacco (N-O-T) web site asserts
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the past, present, and future, the three of them, the three of them, the three, the three of them, the three, the three, the three, the three, the three, the three, the three, the
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
⏎geologic time frame relating to amber formation,⏎based on Jean Langenheim's work with amber/botanical affinities reproduced in⏎Rice: Amber the Golden Gem of the Ages, the Polish Academy of Sciences:⏎Amber in Nature
-
make best use of the earnings they can get out of their job, yet lots of traditional publishers choose to publish their books with a huge publishing house.⏎Many authors that select to self-publish their books locate typical publishers and also agents to be a valuable
-
from conflict to cyclone relief.”⏎Senior emergency response specialist, United Nations Office for the Coordination of Humanitarian Affairs⏎Cyclones Idai and Kenneth that swept across southern Africa in 2019 are examples of how the climate
-
in an easy and fun manner. In this course I do just that and with one of the most useful IDEs coupled with the Java programming language.⏎Java, a wonderfully simple programming language that has encouraged many programmers to pursue careers involving Java over any
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L7:365 excites
- L7:685 excites
- L8:577 excites
- L8:444 excites
- L9:1903 suppresses
- L6:155 excites
- L7:616 suppresses
- L4:211 suppresses
- L9:738 weakly suppresses
- L9:865 weakly suppresses
- L6:342 weakly suppresses
- L7:1854 weakly suppresses
- L6:996 weakly suppresses
- L2:105 weakly excites
- L5:976 weakly excites
- L3:1193 weakly suppresses
- L9:132 weakly suppresses
- L2:1588 weakly excites
- L2:1564 weakly suppresses
- L4:89 weakly suppresses
- L2:89 weakly suppresses
- L6:829 weakly excites
- L6:217 weakly excites
- L8:309 weakly suppresses
Feeds later layers
- L11:578 suppresses
- L14:728 suppresses
- L15:304 excites
- L15:2792 suppresses
- L11:1327 suppresses
- L15:1551 excites
- L17:2216 suppresses
- L11:413 excites
- L14:602 suppresses
- L15:1571 suppresses
- L11:948 suppresses
- L12:731 weakly suppresses
- L16:731 weakly excites
- L11:782 weakly excites
- L11:398 weakly excites
- L13:652 weakly excites
- L13:628 weakly suppresses
- L14:1487 weakly suppresses
- L15:681 weakly suppresses
- L12:2605 weakly suppresses
- L14:850 weakly suppresses
- L14:2402 weakly suppresses
- L15:2568 weakly suppresses
- L13:1914 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 其中之一
- offs
- hesion
- hoped
- 每位
- iswa
- є
- 鼓励
- ixture
- minLength
Suppresses
- Presidency
- <header
- '''⏎⏎
- uw
- RemoteException
- zn
- ippet
- ',⏎
- 上调
- ',⏎⏎