'as' in 'as low as' and 'as far as'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 22 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'as' in set phrases such as 'as low as', 'as far as' and 'as early as'. Turning it up made the model produce long strings of the word 'as'.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
McKinley or Denali (its Koyukon Athabaskan name meaning “The Great One”). The majestic mountain, which has extremely cold weather with temperatures as low as -75.5 °F (−60 °C)
-
shade the window lightly with a sheer curtain.⏎Keep the room temperature between 65 and 80 degrees Fahrenheit. Although tropical houseplants can survive in temperatures as low as 55 F, growth will be stunted. Avoid putting tropical
-
company’s DNA testing kit you use which determines how far back a DNA test will go. Another factor is what type of test you use, as some can go as far back as your original origins, though there are restrictions on what you can find
-
markets and many nonprofit organizations have coalesced in support of open source software. Even governments have heralded their support of open source software and some have even gone as far as to initiate mandates that render the distribution of open source software all but compulsory
-
existence and origin of life in terms of mere coincidences. the roots of this philosophy go back as far as antiquity and ancient Greece.⏎All atheist philosophies that deny creation,
-
the device cools down, making it self-regenerating. Most importantly, their approach works at temperatures as low as 30 degrees Celsius.⏎“Other researchers have studied electrochemical heat
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: zip zip zip zip zip zip zip zip zip zip zip zip zip zip zip zip zip zip zip zip zip zip zip zip zip zip zip zip zip zip zip zip zip zip zip zip zip zip zip zip zip zip zip zip zip zip zip zip
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
5 4 3 2 1⏎We need to use the range function to iterate over the array using a for loop. The range() function returns a sequence of numbers starts from a given number to another given number with a given step
-
is not necessary to know it,⏎but in some cases the difference between shared and separated objects yields different orders of space or time complexity.⏎Consider the infinite list⏎let x =
-
or not and take the default route. Here’s an example of⏎mwhen for Monoids:⏎-- Important numbers!⏎xs = [6, 9, 13, 42]⏎-- Without
-
to reduce values, e.g. lists have the very popular⏎foldr. This package provides that same function for the⏎Bool data type; a function called⏎bool function is a replacement for the build-in⏎if then else-syntax. However
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L20:1918 suppresses opening bracket after a unit conversion
- L19:1222 suppresses
- L17:1859 suppresses
- L8:1430 weakly excites
- L19:2701 weakly suppresses
- L18:569 weakly excites
- L1:290 weakly suppresses
- L1:2080 weakly excites
- L15:2797 weakly suppresses
- L21:1797 weakly suppresses
- L4:750 weakly excites
- L11:2008 weakly suppresses
- L20:2184 weakly excites
- L20:2834 weakly suppresses
- L2:1825 weakly excites
- L15:865 weakly excites
- L14:459 weakly excites
- L15:1139 weakly suppresses
- L12:1709 weakly excites
- L16:833 weakly excites
- L0:2060 weakly excites
- L1:2096 weakly excites
- L9:1815 weakly excites
- L7:2094 weakly excites
Feeds later layers
- L26:588 excites
- L26:2729 suppresses
- L27:849 suppresses
- L27:471 excites
- L25:1157 excites
- L27:679 suppresses
- L25:2236 suppresses
- L23:390 weakly excites
- L24:1904 weakly suppresses
- L25:2003 weakly suppresses
- L23:1246 weakly excites
- L24:797 weakly suppresses
- L23:1422 weakly excites
- L27:1862 weakly suppresses
- L23:710 weakly suppresses
- L25:2641 weakly suppresses music and art genre words
- L26:2494 weakly excites
- L25:620 weakly excites
- L24:2939 weakly suppresses
- L25:2240 weakly suppresses
- L24:734 weakly suppresses
- L23:2179 weakly suppresses
- L24:2380 weakly suppresses
- L26:1281 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- as
- 作为
- far
- As
- As
- →as
- -as
- AS
- as
- 作為
Suppresses
- zip
- (zip
- zip
- Zip
- Zip
- .zip
- ZIP
- enumerate
- ZIP
- _zip