'the' after place prepositions
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 12 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word "the" after phrases like "at the bottom", "at the end" or "at the edge", where a place or position word is expected next. Turning it up pushed the text into repeated phrases like "the first day of the".
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
sources in the river.⏎Getting a File from HydroShare⏎· Open up Internet Explorer. To do this, type in “Internet Explorer” into the bar at the bottom left of the screen and click on it. It should open up after clicking
-
or family name.⏎Is surname your last name?⏎In the English-speaking world, a surname is commonly referred to as a last name because it is usually placed at the end of a person’s full name, after any given names.⏎What exactly is
-
and the spread of the virus is prevented.⏎The research shows that the active site of the endonuclease is shaped like a cave with two metal ions at the bottom.⏎Dr Cusack and his team found that all the inhibitors they studied
-
the anchor and the ship swung around to face the breeze, the master ordered several blasts from the priest’s rams horn trumpet. Soon, dim shapes appeared at the edge of the forest. Then after while
-
’s lines, and Mees’ lines, and “it is not uncommon to have one [type of] nail change." But, "having three changes at the same time is rare."⏎A variety of conditions and treatments induce alterations to nail appearance
-
post can be understood, without time constraints standing in the way like a bad case of toothache.⏎Writing timeless and evergreen content
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: "I Am Socratic" and the User of Web Services, but I Am Online Privacy - Information, and the Government of Transparency, and the EU Data, and the EU Privacy, and the EU Data Protection, which is the EU Data
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
.g., diaper-changing tables, toilets, bathroom sinks and diaper pails).⏎The material can be downloaded from https://waterandhealth.org/wp-content/uploads/2019
-
. Good on ya, skinks! And G’day!⏎***** For more 90-SECOND SCIENCE FACTS, click here.*****⏎Follow us on Twitter!<|endoftext|>Definition and Basic Concept Contact current refers
-
, tagged them, and collected sperm and eggs for captive rearing. For more photos, visit: https://www.flickr.com/photos/usfwssoutheast/albums/72157667442533
-
91 rules of grammar indicative mood subjunctive mood⏎Published on January 17, 2022<|endoftext|>For most of his writing
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L6:3070 suppresses
- L9:1025 excites
- L10:3005 suppresses
- L8:2038 suppresses
- L7:2192 excites
- L11:701 weakly suppresses
- L8:2551 weakly suppresses
- L5:1789 weakly excites
- L4:1269 weakly excites
- L11:2397 weakly excites 'into' or 'to' after verbs of placing
- L10:262 weakly suppresses
- L3:703 weakly excites
- L4:2555 weakly suppresses
- L6:1995 weakly excites comma after a 'that' or 'who' clause
- L6:1114 weakly suppresses
- L8:1857 weakly excites
- L4:660 weakly suppresses
- L8:1991 weakly suppresses
- L6:285 weakly excites
- L8:2793 weakly excites "life" after origins or search phrases
- L8:1003 weakly excites "the" or "of" before a noun phrase
- L5:1365 weakly suppresses
- L9:2759 weakly suppresses
- L4:649 weakly suppresses
Feeds later layers
- L18:2492 excites
- L17:1744 excites
- L13:1401 excites
- L20:2201 excites 'the' in location phrases like 'at the end'
- L16:2530 suppresses
- L19:2448 excites
- L13:2638 excites
- L19:1908 suppresses
- L21:1570 excites
- L15:2810 excites
- L18:905 excites
- L17:1809 excites
- L13:1083 excites
- L14:1265 excites
- L19:2238 weakly excites
- L20:956 weakly suppresses
- L24:810 weakly excites
- L25:1660 weakly excites
- L21:1596 weakly excites
- L19:1967 weakly excites
- L16:1406 weakly excites
- L24:1488 weakly excites
- L16:372 weakly excites
- L17:2667 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 右侧
- vor
- 左侧
- 头上
- locations
- forefront
- 어디
- corners
- opposite
- ####⏎
Suppresses
- 小游戏
- polys
- ump
- ılan
- 走下去
- bitrary
- .JSONArray
- 洋洋
- ifiers
- итет