word just before 'future'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 26 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
It lights up on the word right before 'future' in phrases like 'in the future' or 'current and foreseeable future'. Turning it down made the model repeat the word 'future' over and over, so this neuron seems to hold back that word when it isn't wanted.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Artificial intelligence concepts may sound futuristic. Yet by analyzing and exploring the key technologies that spur it, evaluating the impact of AI today, and understanding AI predictions for the future can give you a clear picture on how much transformation artificial intelligence has brought in
-
, and education.⏎5. I may be a product of a single- or no-parent household, but I will not hold anyone responsible for my present, or allow anyone to interfere with my future. Others succeed under conditions far worse than mine
-
the space program through gaming.⏎Ars spoke with Daniel Laughlin, project manager of Learning Technologies, to learn more about the game and what we can expect to see in the future.⏎The game was codeveloped by Army Game Studio and Virtual Heroes
-
⏎Machine Learning can be performed using multiple approaches. Even if you are not planning to become a machine learning developer, knowing these techniques can enable you how your current or future AI project will be built.⏎The four basic techniques of ML are: supervised
-
.⏎Optimization is a business analytics tool. Analytics is considered to predict the future whereas optimization does not predict any future.⏎Future of Analytics Industry⏎Major components for the analysis of web data are current search engines like Google. They are able to search
-
also impact the ways in which current and foreseeable future group individuals understand and interpret information that they receive. As a result,
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
1883. News of the discovery by Professor Robert Koch in Germany of the germ that caused tuberculosis prompted von Ruck to return to Germany to work under Koch. He spent about eight months in
-
as those in Germany, the sanitarium soon was receiving patients from all over the United States.⏎After Koch discovered a serum for the treatment of tuberculosis, von Ruck was the first physician to obtain it for use in a private institution. Together
-
in Scotland originated with Anglo-Norman knights bearing the de Beauville or, more commonly, de Boyville name from Beauville, near Ca
-
, Muscovy who, according to tradition, were descendants of the Varangian prince Rurik, who had been invited by the people of Novgorod to rule
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L25:2579 strongly excites
- L22:2914 strongly suppresses the '0' in years like 2050
- L21:2675 excites
- L21:1824 suppresses
- L16:2965 suppresses
- L22:2874 excites
- L21:2429 suppresses
- L18:1892 excites
- L17:1623 excites
- L18:2817 excites
- L21:2426 suppresses
- L18:3047 suppresses
- L21:1699 suppresses
- L19:564 excites
- L14:2691 suppresses
- L18:2623 suppresses
- L20:966 suppresses
- L17:2964 suppresses
- L18:1226 suppresses
- L12:2594 suppresses
- L8:920 excites
- L20:1878 excites
- L10:2029 weakly excites
- L15:2338 weakly excites
Feeds later layers
- L27:2471 weakly suppresses
- L27:1015 weakly suppresses
- L27:1397 weakly suppresses "the" in "to the next"
- L27:3055 weakly excites lowercase 'l' starting a word
- L27:2333 weakly suppresses
- L27:682 weakly suppresses
- L27:1248 weakly excites
- L27:1535 weakly excites
- L27:1063 weakly excites
- L27:2585 weakly excites
- L27:2634 weakly excites
- L27:899 weakly excites
- L27:1717 weakly excites 'st' starting a word fragment
- L27:544 weakly suppresses
- L27:2136 weakly excites capital M inside abbreviations
- L27:1640 weakly suppresses
- L27:2552 weakly excites capital L starting a word
- L27:1864 weakly suppresses
- L27:2184 weakly excites
- L27:1956 weakly excites
- L27:555 weakly excites
- L27:2997 weakly suppresses
- L27:2273 weakly suppresses
- L27:1573 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- rases
- icone
- riteln
- plevel
- auprès
- итель
- NOTICE
- ertext
- WithOptions
- inois
Suppresses
- future
- 未来
- future
- Future
- 未来的
- Future
- 未來
- _future
- futuro
- 在未来