'and' joining a pair of options
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 13 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word 'and' (or 'or') that links two halves of a pair, especially after phrases like 'two key factors' or 'two models'. Turning it up made the model produce loops of text, so the steering adds little here.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
it in the START menu on the bottom left corner of your computer screen.Ad⏎2Go to modelspace. There are two views in AutoCAD: modelspace and paperspace. Your drawing should always be made in modelspace, and dimensions that
-
the substrate that it will catalyse. There are two models that describe the relationship between the active site and the substrate and they are the lock and key model and induced fit hypothesis.⏎- The shape of the active site is determined primarily by the
-
pair.<|endoftext|>This is a blog post on how to hook up or connect your battery. This article will be broken into two parts, the "How-to" and the "Why." The How-to section features detailed instructions with illustrations, including what
-
women and girls.<|endoftext|>Microcontroller vs FPGA: Understanding the Key Differences⏎When it comes to embedded systems design, two technologies that often come up are microcontrollers and field-programmable gate arrays (FPGAs). While both serve similar purposes
-
’s job.⏎See how to implement NIST CSF<|endoftext|>Minimum & single dose⏎In homeopathy two important principles are employed when prescribing medicines: the minimum dose and the single dose.⏎The principle that only ‘the minimum dose’ should be employed
-
spindle?⏎At present, the primary control of the FANUC system’s spindle motor has two interfaces: analog (DC0 ~ 10v) interface and digital (serial transmission) interface. The analog interface is driven by a frequency converter
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: if I have a question, I will say that question, and I will say that question, and I will say that question. and this question, and I will say that question, and this question, and I will say that question,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
of Minnesota students. You can see all of the details involved in making it in the video below.<|endoftext|>Create a Graph⏎Library Home || Full Table of Contents || Suggest a Link || Library Help⏎|National Center for Education Statistics (NC
-
the raw materials used in production. Such<|endoftext|>The Leading eBooks Store Online⏎for Kindle Fire, Apple, Android, Nook, Kobo, PC, Mac, BlackBerry ...⏎DK Eyewitness Books: Gorilla⏎Here is a spectacular and informative
-
a matrix⏎Find nth maximum⏎Matlab Basics II - Create a vector with a repeated entry⏎Create sequnce 1 4 9 16 25.........⏎Basics: Divide integers to get
-
ocean...⏎and hydrologic sciences⏎Hydrology is the study of the movement, distribution, and quality of water on Earth and other planets, including the hydrologic cycle, water
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L12:51 excites
- L12:2808 suppresses
- L12:1235 suppresses commas inside numbers and lists
- L12:2548 excites
- L12:1212 suppresses
- L12:1197 excites
- L9:212 excites
- L12:1095 suppresses
- L8:131 suppresses
- L8:70 excites 'and' between stacked superlatives
- L12:1246 suppresses
- L9:1449 suppresses
- L8:809 excites
- L12:2409 excites
- L12:2934 suppresses
- L12:2171 excites
- L11:1431 excites commas and 'and' in noun lists
- L12:1062 suppresses
- L12:2058 excites
- L6:1084 suppresses
- L12:1629 excites
- L9:1820 excites
- L12:2891 excites
- L8:185 suppresses
Feeds later layers
- L15:1948 excites
- L14:783 excites
- L16:1074 excites
- L14:672 excites
- L15:3062 excites
- L16:925 excites
- L15:611 excites
- L14:1060 suppresses
- L16:316 excites
- L14:491 suppresses
- L15:989 weakly suppresses
- L14:686 weakly suppresses
- L18:1013 weakly excites
- L14:747 weakly suppresses
- L16:1294 weakly excites
- L14:53 weakly excites
- L16:2177 weakly suppresses
- L14:453 weakly suppresses
- L17:747 weakly suppresses
- L15:2476 weakly suppresses
- L16:340 weakly excites
- L14:660 weakly suppresses
- L15:2449 weakly suppresses line breaks mid-sentence
- L22:637 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- erval
- TargetException
- verständlich
- uracy
- 个工作
- eder
- ometric
- ierte
- edBy
- ted
Suppresses
- yll
- 纲
- ласт
- 法则
- đích
- олос
- -class
- ฎ
- ells
- rün