unclear: mid-phrase words, no common theme
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 25 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on a grab bag of words in the middle of phrases, such as 'than' in a comparison or 'into' after 'divided'. The examples do not share a clear topic, and turning it up or down gave no consistent change in the writing.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
it very clear how much faster the heat pulse solution will be.⏎The heat pulse technique is still at the prototype stage, but has been demonstrated to work using magneto-optical microscopy on thin films. Although it is expected to scale to ter
-
pain are as follows-⏎- Central and peripheral nervous systems: Nerve damage of serious nature may occur due to anomalies in visceral functions and perceptions (visceral hyperalgesia
-
identification⏎More: Simple Safe Practices Promoted by "Safe Hospital"⏎11 - Measures to prevent catheter and tubing misconnections⏎12 - Evaluation of risk of development of pressure ulcers⏎1
-
for bacteria which in turn produce methane gas.⏎Methane gas is a greenhouse gas that traps heat much better than carbon dioxide does. Methane gas (CH4) traps about 34
-
of the main concerns about PET bottles is the potential for chemicals to leach from the plastic into the contents of the bottle. PET is a type of polymer, which means it is made up of long chains of molecules called monomers
-
current or under power relays, directional or reverse current relays differential relays, and distance relays.⏎According to timing characteristics the relays can be divided into instantaneous, definite time lag, inverse time lag and inverse definite minimum time (ID
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I think that the integration of an individual into the system of the micro-loan system may be an indi- pride system into the system. The micro-loaners who integrate into the system could be thought of as the micro-loan
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
ces, New Mexico.⏎The ORNL DAAC announces the release of two new data sets and two revised data sets from Phase 2 of the Vegetation/Ecosystem Modeling and Analysis Project (VEMAP).⏎The ORNL DAAC has
-
produce on desalination by 2050.⏎The dominant desalination technology at present, with around 60% of global capacity, is Reverse Osmosis (
-
connected with copper refrigeration lines, which basically, transfer heat to the outside, via freon.⏎The efficiency of an air conditioner is rated in SEER and EER. The higher the SEER rating and EER rating, the higher efficient
-
; Basílio da Gama; eighteenth century jesuits.<|endoftext|>Texas Kidneywood Flower⏎image by Jim Gober⏎Texas kidneywood (Eysenhardtia texana) grows up to 10 feet tall with
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L18:1287 weakly suppresses
- L8:2141 weakly excites
- L10:126 weakly suppresses
- L8:1417 weakly excites
- L15:1404 weakly excites
- L4:840 weakly suppresses
- L17:1774 weakly excites
- L18:336 weakly excites
- L22:509 weakly excites
- L22:2082 weakly excites
- L12:2158 weakly excites
- L5:2263 weakly excites
- L9:1452 weakly excites
- L20:461 weakly suppresses
- L4:3065 weakly excites
- L6:2533 weakly excites
- L10:378 weakly suppresses
- L11:833 weakly suppresses
- L21:2364 weakly suppresses
- L1:1389 weakly suppresses
- L18:1170 weakly suppresses
- L8:1250 weakly excites
- L20:414 weakly excites
- L13:1469 weakly suppresses
Feeds later layers
- L26:1537 weakly excites word fragments like ev and v
- L27:285 weakly excites
- L27:2127 weakly suppresses
- L26:2989 weakly excites
- L26:759 weakly excites
- L27:2 weakly excites
- L26:2801 weakly excites
- L26:2305 weakly excites
- L27:1772 weakly excites
- L26:1881 weakly excites
- L27:1236 weakly excites
- L27:2276 weakly excites
- L27:3007 weakly excites
- L26:545 weakly excites
- L27:1004 weakly excites
- L27:1439 weakly excites
- L26:2136 weakly suppresses
- L27:1365 weakly suppresses
- L26:1969 weakly suppresses
- L26:726 weakly excites
- L27:125 weakly excites
- L26:1529 weakly suppresses
- L27:2464 weakly excites
- L27:557 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- reign
- aclass
- (start
- rzy
- (char
- phas
- (Class
- ecl
- IGN
- starting
Suppresses
- izzazione
- egrate
- 埇
- >}</
- popcorn
- Panc
- ."</
- lesen
- 氿
- 俚