the word 'some' before a noun
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 2 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word 'some' in phrases like 'exposed to some of the' or 'derived from some ancient'. Turning it up made the output loop on words like 'some' and 'and', so the word itself seems to be what it pushes toward.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
, a hash function takes pieces of data and "randomly" maps them to integers. Generally, the resulting integers, called hashes or hash codes, are of some specified fixed number of bits. For example, Java collections use 32-bit
-
Foundries began using some double patterning, while Intel went with immersion lithography. What’s changing for
-
checking your browser's SSL/TLS client results.⏎At Denison, you will initially continue your high school Calculus education, but you will quickly be exposed to some of the more fascinating questions that really excite mathematicians. Mathematics is the study
-
symptoms of Chronic kidney disease develops slowly over a long period of time.⏎Polycystic Kidney disease: In this condition, the kidneys reduce its functionality to some extent. Also, it may lead to kidney failure. Polycystic Kid
-
a profit. In a collectivist economy, manufacturing is more frequently directed by the state to supply a centrally planned economy. In free market economies, manufacturing occurs under some degree of government regulation.⏎Modern manufacturing includes all intermediate processes required for the production and
-
that uses cornstarch instead. It involves some complex<|endoftext|>The Deep South is astonishingly lovely in the heady days of mid
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have been a student in the past, and I was always trying to learn about how to make a better decision about what I was learning. I have a lot of experience from a past experience in my life, but I can't get
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
uming a DataGrid is displaying more than one table, ' get its DataSet. Dim thisDataSet As DataSet = CType(DataGrid1.DataSource, DataSet) ' Get the DataTableCollection. Dim tablesCollection As DataTableCollection = thisDataSet.Tables ' Get a
-
can zip and unzip files in Windows 10 easily. To zip files:⏎Step 1: Go to File Explorer and go to the files and media you want to zip.⏎Step 2: On an empty space on the screen, right
-
Compiler Command Line Tools⏎- Installing and running the Command Line Tools⏎- Run freecommandlinetools.exe; choose the drive and folder into which you want to install the free C++Builder 5 command line tool development system.⏎-
-
⏎- Subject: Drama - World⏎- Type: Essay⏎- Paper: #877
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L1:1468 weakly suppresses
- L1:1546 weakly suppresses
- L1:1948 weakly excites
- L0:430 weakly excites
- L1:2370 weakly excites
- L1:2683 weakly excites
- L0:3014 weakly excites
- L1:634 weakly excites
- L1:766 weakly excites
- L0:1520 weakly suppresses
- L1:1377 weakly suppresses placeholder example email domain
- L1:138 weakly excites
- L0:611 weakly excites
- L0:2865 weakly suppresses
- L0:1344 weakly excites
- L1:882 weakly suppresses
- L0:1892 weakly suppresses
- L0:2175 weakly suppresses
- L0:3000 weakly excites
- L1:2957 weakly suppresses
- L1:1422 weakly excites
- L0:221 weakly excites
- L0:450 weakly suppresses
- L1:1906 weakly excites
Feeds later layers
- L4:121 suppresses
- L8:642 suppresses
- L3:136 suppresses
- L10:222 suppresses
- L12:1779 suppresses weak end of document signal
- L3:177 suppresses
- L6:2438 weakly suppresses
- L8:168 weakly suppresses
- L14:510 weakly suppresses
- L9:475 weakly suppresses
- L7:1005 weakly suppresses
- L8:338 weakly excites
- L8:392 weakly excites
- L18:382 weakly excites
- L3:17 weakly suppresses
- L16:926 weakly excites
- L25:1530 weakly excites
- L16:2117 weakly excites
- L12:2911 weakly excites
- L18:203 weakly suppresses
- L3:180 weakly suppresses
- L3:1622 weakly excites
- L24:1120 weakly suppresses
- L16:1547 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- luxe
- 装扮
- 经营者
- Silk
- 샵
- 廪
- slugg
- 一经
- llx
- Bale
Suppresses
- agrid
- iate
- table
- istant
- alyze
- argon
- stra
- uristic
- pherd
- nghị