unclear: relative 'that' and list items
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 21 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
The strongest responses are weak and point at words like 'that' starting a clause, but the negative side is much stronger and fires on items inside a list, like 'servers' in a list of cloud services. The overall idea is not clear. Turning it down made the model produce strings of commas and 'which', and turning it up gave generic sentences.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
this blog is not intended to be a substitute for professional medical advice, diagnosis, or treatment. Always seek the advice of qualified health providers with questions you may have regarding medical conditions.<|endoftext|>The Amendment Process and the African American
-
because they have higher kilojoule needs due to ongoing growth and development; women<|endoftext|>There are many cases in which you need a 2 dimensional lookup. That means, if you want to get a value from a specific row-column combination with
-
money mistakes I made as an early twenty-something. I want better for my kids. Here are 10 ways to teach financial literacy to your tween (that I wish someone taught me).⏎#1. Talk to Them About Financial Literacy
-
can build strength in your muscles, increase the amount of lean muscle in your body, manage your weight more easily and lower your risk of injury.⏎Examples of Weight-Training Exercises⏎You can perform weight-training exercises with free weights -- dumbbells
-
, recognize creatures and establish the parts of a vehicle, and a lot more.⏎You are able to customize them to meet up with your child’s specific requirements. That is amongst the most important good thing about the numbers worksheets. This can be accomplished
-
Click to take a picture of your objects. 4. Click then type more on the object that has the bigger capacity. 5. Click then type less on the object that
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I, the, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
far better thinker and<|endoftext|>Take any point P inside an equilateral triangle. Draw PA, PB and PC⏎from P perpendicular to the sides of the triangle where A, B and C⏎are points on the sides. Prove that PA +
-
, cloud computing is a technology used for storing and accessing data, application and programs over the Internet. Cloud computing refers to the delivery of hosted and computing services including servers, storage, databases, networking, analytics, and intelligence over
-
ventral (y) and rostro-caudal (z). Another one is a stereotactic device or apparatus which uses a set of three coordinates (x, y and z). And the last one is stereotactic localization and placement
-
male, based on the warty pig Species Survival Plan coordinator’s recommendation to improve the<|endoftext|>Learning the Relationship Between Culture and Relationships⏎Culture is the total set of beliefs, values, manners and customs that are discovered and distributed by
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L19:1089 strongly excites
- L20:1083 strongly suppresses
- L19:1394 strongly excites
- L20:610 strongly suppresses
- L19:3066 strongly excites
- L19:2704 strongly suppresses
- L18:1508 strongly suppresses
- L19:2835 suppresses
- L19:492 suppresses
- L20:1744 suppresses comma after a sentence's subject
- L18:120 suppresses
- L20:2864 suppresses
- L19:1813 suppresses
- L19:164 suppresses
- L20:822 suppresses
- L15:132 suppresses
- L20:2865 suppresses
- L19:2552 excites
- L17:2323 excites
- L19:290 excites
- L19:1510 excites
- L15:2999 excites
- L20:132 suppresses
- L18:957 excites
Feeds later layers
- L26:236 strongly suppresses
- L27:86 strongly excites
- L26:22 strongly excites the 'res' fragment inside words
- L22:368 strongly suppresses
- L24:216 strongly suppresses
- L25:438 strongly suppresses
- L27:286 strongly suppresses
- L25:328 strongly suppresses
- L27:358 strongly suppresses
- L27:191 strongly suppresses
- L22:940 strongly suppresses
- L25:1221 strongly suppresses
- L24:572 strongly suppresses
- L26:80 strongly excites
- L26:307 excites
- L25:969 excites
- L27:130 excites
- L24:304 suppresses
- L22:158 excites
- L24:6 excites
- L26:345 suppresses
- L24:32 suppresses
- L25:346 excites
- L27:291 excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 、“
- "),"
- )、
- '),('
- 、、
- 😉⏎⏎
- """),⏎
- ;-)
- ";//
- ;m
Suppresses
- ,
- ,
- (),
- ,h
- ،
- ,
- ,\
- ,在
- ++,
- ,',