the verb 'keep' meaning maintain
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 17 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word 'keep' (or 'keeps', 'keeping') when it means holding something in a good state, like keeping food cool or tyres inflated. It switches off hard on 'go' or 'gone', and turning it up made the model's text wander without a clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
A recommended fridge temperature of 5 degrees C is advised. There are thermometers available at reasonable price which can help you determine the temperature. A report suggests that keeping the fridge cool at 5 degrees C or below can prevent germs from growing
-
the tires. Have your wheels aligned and keep your tires properly inflated. Low tire pressure wastes over two million gallons of gasoline in the U.S. every day. Keeping your tires properly inflated raises your car’s gas mileage by about 3.3
-
inate your food.⏎4. Do not store expired food products⏎Storing products post their “use-by’ dates not only clutters your fridge, but also keeps fresh items out of your reach. Consuming expired meat products, smoked fish and
-
to keep an eye out for signs that your succulent is thirsty. To keep your succulents healthy and happy. you must know how to water them.⏎Keep a record of your waterings⏎Keeping track of the proper watering for succul
-
at this year’s school science fair!⏎Science Projects For Children In Kindergarten⏎Here are some easy and age-appropriate science fair project ideas for kids that will keep your kid excited about learning.⏎1. Lava Lamp⏎Image Credit: fun
-
Add video calls, various methods of communication and chatting, or simply spending too much time trying to figure out the technology involved, and it can be pretty challenging to keep students’ attention focused on classwork. An online survey revealed that 84
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the fact that, in the end, the end of the end of the end of the end of the end of the end ... in the end, that the end of the end of the end ... (and the same for the end of
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
were particularly good. This is a nice way to clarify or build upon the previous lecture’s material. Some of the questions are really fantastic, and I have to go and work on the answers because I don’t know them at all. I think
-
, was Netscape Navigator. The browser that preceded that was Mosaic, which was co-founded by venture capitalist and millionaire, Marc Andreessen. He would actually go on to co-found Netscape.⏎What eventually killed Netscape was Microsoft’s Internet
-
their markets and many nonprofit organizations have coalesced in support of open source software. Even governments have heralded their support of open source software and some have even gone as far as to initiate mandates that render the distribution of open source software all but
-
the vice president of K-12 marketing for the company Blackboard, Common Core is a clear bonus for e-learning companies because “We don’t have to go and do 50 updates.” So this is a win-win for computer companies
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L16:739 excites
- L16:2227 suppresses
- L11:153 suppresses
- L13:2299 suppresses
- L6:388 excites
- L14:149 suppresses
- L2:832 suppresses
- L8:216 excites
- L15:675 excites
- L2:157 excites
- L14:1385 weakly suppresses
- L9:413 weakly excites
- L15:2118 weakly suppresses
- L15:957 weakly excites
- L16:2831 weakly excites
- L15:210 weakly excites
- L9:1009 weakly excites
- L15:3044 weakly suppresses
- L12:1378 weakly excites
- L16:2948 weakly excites
- L1:2607 weakly excites
- L5:2904 weakly excites
- L16:797 weakly suppresses
- L13:1161 weakly excites
Feeds later layers
- L20:2084 excites
- L18:867 excites
- L19:2397 excites
- L18:1199 excites
- L20:2229 excites
- L20:593 excites
- L18:2842 excites
- L20:599 excites
- L18:2869 excites
- L18:2908 excites
- L18:509 excites
- L18:172 suppresses
- L19:1617 excites
- L19:1434 excites
- L18:1401 excites
- L20:2435 excites
- L19:947 suppresses
- L22:1124 excites
- L21:2089 excites
- L20:1972 excites 'of' in 'of course'
- L18:2233 excites
- L23:2212 weakly excites
- L18:1143 weakly suppresses
- L18:1953 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- jub
- áo
- StateToProps
- throwable
- xed
- 新常态
- etur
- 留给
- imization
- 回事
Suppresses
- 一
- S
- والا
- mar
- Once
- get
- --
- ---------
- gang
- g