unclear: word pieces near 'tag' and Q&A breaks
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 27 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
Its top examples are a mix: a line break after a question about Tagetes, the word 'in' in a translation, and pieces of longer words like 'lasagna' and 'stereotactic' in the negative side. The link is unclear. Turning it down made the model repeat 'tag'.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
starting any server application, the machine will still respond to a ping request from other hosts.⏎10.4 The inetd<|endoftext|>What is Tagetes used for?⏎Tagetes has been traditionally used for stomach problems,
-
school one can imagine that families might be hard-pressed to see the logic of it.⏎That means that education is<|endoftext|>News By Tag⏎News By Place⏎Ebook “Fizzyx for Fun” Makes Physics Accessible for
-
person’s full name is John Smith. A nickname or epithet added to a person’s name.⏎What is surname in Tagalog?⏎Translation for word Surname in Tagalog is : apelyido.⏎Is a surname a middle name?⏎There
-
the classroom and also to calculate the time resides in the class. In this proposed system, every student is allotted with an RFID tag. The process of attendance can be done by placing the card near the RFID reader. This
-
Tagetes flowers are stunning little stars of yellow, orange and red. Both the flowers and leaves are edible which means that they can be displayed as little sprigs.⏎Is Tagetes erecta edible?⏎This species is widely cultivated for ornamental,
-
blend into a foot bath with warm, not hot, water, and agitate to disperse the oils. This bend is beneficial for fungal infestions.⏎Is Tagetes same as marigold?⏎Although commonly known as pot marigold
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: tag tag tag tag tag tag tag tag tag tag tag tag tag tag tag tag tag tag tag tag tag tag tag tag tag tag tag tag tag tag tag tag tag tag tag tag tag tag tag tag tag tag tag tag tag tag tag tag
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
flour and milk. It is often poured over freshly cooked pasta, oven-roasted chicken, fish or roasted vegetables. Moreover, it is an integral component of a lasagna recipe. You can find the sauce in between the layers.⏎It comes in
-
dimensions are as latero-lateral (x), dorso-ventral (y) and rostro-caudal (z). Another one is a stereotactic device or apparatus which uses a set of three coordinates (x, y and
-
sure to consult a calendar for exact dates if you are making plans.⏎There are spring parades that occur some three weeks before Easter. These are called Sommertagszug (Summer Day Parade) and are basically a time when people tell winter
-
. Instead of removing the tumor, stereotactic radiotherapy damages the DNA of tumor cells. In this way malignant and metast
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L26:2979 strongly suppresses
- L22:1959 excites
- L22:2004 excites
- L23:1918 excites
- L24:1706 weakly excites
- L8:14 weakly excites
- L5:216 weakly suppresses
- L24:727 weakly excites
- L22:2250 weakly excites
- L3:915 weakly excites
- L18:569 weakly excites
- L22:1105 weakly excites
- L3:50 weakly excites
- L22:2474 weakly suppresses
- L12:2072 weakly excites
- L6:2354 weakly suppresses
- L23:2400 weakly suppresses
- L10:31 weakly excites
- L6:1002 weakly excites
- L26:748 weakly excites
- L21:2511 weakly excites
- L5:169 weakly excites
- L19:1912 weakly excites
- L10:461 weakly excites
Feeds later layers
None: this is the last layer.
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- sole
- heten
- landscape
- icone
- oland
- 腈
- wich
- izu
- odynamic
- kul
Suppresses
- tag
- tags
- tag
- Tag
- Tags
- Tag
- tags
- [tag
- Tags
- _tag