'a' right after 'being'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 5 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the small word 'a' when it comes straight after 'being', as in 'Being a student'. It also fires a little on 'form' in 'formulating'. It dips on 'be' in 'happen to be' and on 'as' in 'the same as'. Turning it up did not produce any clear related theme in the text.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
of the parabola. The procedure requires only local information of the artificial neuron to which it is applied. The -th approximation step is given by:⏎Being the neuron weight of its input and is the loss function.⏎The Quickprop algorithm is
-
Other editions. Enlarge cover. Error rating book.⏎Browse more videos⏎Human Anatomy and Physiology are two most-related subjects in the field of medical sciences. Being a student, one thing you are definitely going to need is a good textbook on the
-
. Since every profession requires you to make good decisions, being a critical thinker, you can handle situations firmly. For example, a doctor without critical
-
” and the theory of “satisficing.” He applied psychology to statistics, operations, and decision-making scenarios to help define the process that people go through when formulating solutions to problems.⏎Herbert Simon was born in Milwaukee, Wisconsin, on
-
that could impact waste isolation.⏎During her review of the report<|endoftext|>The Heilwood Company store was a product of necessity. Being a rural, isolated area, the newly created town needed a central place to purchase the
-
it has enabled us to be a better organization as we try draw attention to the needs of our communities.⏎Here are
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the number of the book "The Art of the Computer Science" (A.T.C.) for the course of the student's knowledge, and the fact that the students are taking their first year of CS courses. It seems that the student is
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
to seekers of knowledge.<|endoftext|>When you here the term Skinhead you probably think about young rebels⏎wearing big black boots and Nazi symbols. These happen to be a few trademarks⏎but across the world "Skinhead" refers to
-
torque readings can be directly compared to the readings taken on some other day, or even taken at some other altitude.⏎That is, the corrected readings are the same as the result that you would get by taking the car (or engine) to a
-
communicate information on these hazards. The information contained in the SDS is largely the same as the MSDS, except now the SDSs are required to be presented in a
-
most ancient attraction.⏎A unique treasure, situated in beautiful Victoria Park in the west of the city, the fossil trees uncovered by removal of the surrounding rocks are the remains of an ancient forest, around than 330 million years old.
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L4:24 excites
- L4:20 suppresses
- L4:2209 weakly suppresses
- L4:1274 weakly excites word right before a term's name
- L2:2195 weakly suppresses
- L4:161 weakly suppresses
- L3:470 weakly suppresses
- L3:3013 weakly excites
- L4:805 weakly suppresses
- L4:2699 weakly excites
- L4:120 weakly suppresses
- L4:2128 weakly suppresses
- L3:2881 weakly excites
- L4:701 weakly suppresses
- L4:2196 weakly excites
- L2:379 weakly excites "the" right after "without"
- L0:1073 weakly excites
- L4:998 weakly suppresses
- L2:2405 weakly suppresses
- L3:659 weakly excites
- L2:1809 weakly excites
- L2:277 weakly excites
- L1:2118 weakly excites
- L3:2960 weakly excites
Feeds later layers
- L6:2082 suppresses
- L14:2079 weakly suppresses prepositions after comparison words
- L6:773 weakly suppresses
- L7:1981 weakly suppresses
- L18:2573 weakly excites
- L8:469 weakly suppresses
- L9:2096 weakly suppresses 'the' or 'as' before a superlative role
- L13:2430 weakly suppresses
- L12:2459 weakly excites
- L12:1692 weakly suppresses
- L9:1939 weakly excites
- L12:1531 weakly excites
- L7:1919 weakly suppresses
- L8:2347 weakly excites
- L11:1988 weakly excites
- L23:406 weakly suppresses
- L16:511 weakly suppresses
- L19:1354 weakly excites
- L17:2747 weakly excites
- L7:1016 weakly suppresses 'something' after is or not
- L10:999 weakly suppresses
- L8:2775 weakly excites
- L15:1292 weakly suppresses
- L16:731 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 度
- inst
- 斯基
- UIL
- grinder
- getic
- lets
- uil
- lic
- fulness
Suppresses
- :"+
- :")⏎
- erald
- cased
- SECOND
- UMAN
- ($__
- :")
- Moo
- COR