verb right after 'will' or 'we'll'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 19 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the action word that comes straight after a 'will', 'we'll' or 'and' in blog-style sentences, like 'we'll take a closer look' or 'will equip you'. It is quiet, and sometimes strongly negative, on verbs that follow 'to', such as 'try searching' or 'prefer to purchase'. Turning it up gave unrelated text, so the steering does not add much.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
all of this? Next time a sense of glum hits, roll up those sleeves, find an inspiring recipe from your favourite wellness guru and hit the kitchen to bake up a serious storm. After all, is there anything better
-
Tips to Crack HSC Exams.⏎We had also shared Important Questions Bank for HSC Examination 2016 and students have really appreciated it and showered us with love last year.⏎Today, we are posting the Economics– Important Questions
-
but they didn’t realize those were the earliest movies.⏎3. The invention of Kinetoscopes⏎Edison managed his plans to create a device that would do “for the Eye what the phonograph does for the Ear”. He invited the
-
hold the promise of transforming industries, revolutionizing the way we live and work, and addressing some of society’s most pressing challenges. In this blog, we’ll take a deep dive
-
Tsoy and Wilbert Swinkels has developed. Inspired by other DIY cube solvers comprised of LEGO and Fischertechnik, the Makers brought their creation
-
components such as assets, liabilities, and equity. By delving into the importance of the bilan comptable for financial analysis and decision-making, this article will equip you with the knowledge needed to make informed financial decisions.
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the ability to in between between between between between between between between between between between between between between between between between between between between between between between between between between between between between between between between between between between between between between between between between between between between
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
therapeutic dose is 15 mg/kg, 5 times daily for 5 days.⏎Best of luck---⏎Search for questions⏎Still looking for answers? Try searching for what you seek or ask your own question.⏎Posted 31 Aug
-
playing cards needed: SKIP, DRAW TWO, REVERSE, WILD⏎|This resource is also available for purchase on Teacher Pay Teachers. If you prefer to purchase it there, follow this link.|⏎How to assemble and use this resource:⏎
-
moisture meter is a great tool to help you keep track of your plant’s watering routine. Using one of these is a lot less hassle than trying to remember to water your succulents every day.⏎How to Water Succul
-
cool, but it requires both the sender and recipient to be running the app. In addition, it's not open with what it can send or where it can send it--it only works from phone to phone, and while there are many options
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L18:1601 strongly suppresses
- L16:2227 suppresses
- L18:2153 suppresses
- L15:675 excites
- L11:153 suppresses
- L6:375 suppresses
- L13:2299 suppresses
- L14:149 suppresses
- L6:388 excites
- L14:526 suppresses
- L17:5 excites
- L5:146 excites
- L16:739 excites
- L18:2787 excites
- L2:491 excites
- L8:216 excites
- L12:336 suppresses
- L9:413 excites
- L17:790 suppresses
- L8:2000 suppresses
- L14:1148 excites
- L15:957 excites
- L2:2539 weakly excites
- L9:584 weakly suppresses
Feeds later layers
- L20:833 suppresses
- L23:570 suppresses
- L22:132 suppresses
- L20:2484 suppresses
- L20:1972 weakly suppresses 'of' in 'of course'
- L21:801 weakly suppresses
- L20:1974 weakly suppresses
- L25:1963 weakly excites
- L23:326 weakly suppresses
- L26:585 weakly suppresses
- L20:1061 weakly suppresses
- L22:353 weakly excites
- L21:140 weakly excites
- L21:1339 weakly excites
- L20:680 weakly suppresses
- L25:277 weakly suppresses
- L25:806 weakly suppresses
- L25:247 weakly suppresses
- L21:2342 weakly suppresses
- L25:802 weakly excites
- L24:859 weakly excites
- L20:1123 weakly excites
- L26:496 weakly excites
- L23:539 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- (@(
- 跟她
- sWith
- Body
- okin
- {{--<
- 碼
- 我都
- 嗬
- ưu
Suppresses
- through
- ability
- between
- neider
- ние
- ibility
- according
- between
- ability
- 通过