Neuron Explorer

Qwen3-0.6B

word just before 'future'

A neuron in layer 26 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featured, so it has steering outputs.

What this neuron does

It lights up on the word right before 'future' in phrases like 'in the future' or 'current and foreseeable future'. Turning it down made the model repeat the word 'future' over and over, so this neuron seems to hold back that word when it isn't wanted.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    Artificial intelligence concepts may sound futuristic. Yet by analyzing and exploring the key technologies that spur it, evaluating the impact of AI today, and understanding AI predictions for the future can give you a clear picture on how much transformation artificial intelligence has brought in

  2. #2 peak

    , and education.⏎5. I may be a product of a single- or no-parent household, but I will not hold anyone responsible for my present, or allow anyone to interfere with my future. Others succeed under conditions far worse than mine

  3. #3 peak

    the space program through gaming.⏎Ars spoke with Daniel Laughlin, project manager of Learning Technologies, to learn more about the game and what we can expect to see in the future.⏎The game was codeveloped by Army Game Studio and Virtual Heroes

  4. #4 peak

    ⏎Machine Learning can be performed using multiple approaches. Even if you are not planning to become a machine learning developer, knowing these techniques can enable you how your current or future AI project will be built.⏎The four basic techniques of ML are: supervised

  5. #5 peak

    .⏎Optimization is a business analytics tool. Analytics is considered to predict the future whereas optimization does not predict any future.⏎Future of Analytics Industry⏎Major components for the analysis of web data are current search engines like Google. They are able to search

  6. #6 peak

    also impact the ways in which current and foreseeable future group individuals understand and interpret information that they receive. As a result,

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future future

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    1883. News of the discovery by Professor Robert Koch in Germany of the germ that caused tuberculosis prompted von Ruck to return to Germany to work under Koch. He spent about eight months in

  2. #2 peak

    as those in Germany, the sanitarium soon was receiving patients from all over the United States.⏎After Koch discovered a serum for the treatment of tuberculosis, von Ruck was the first physician to obtain it for use in a private institution. Together

  3. #3 peak

    in Scotland originated with Anglo-Norman knights bearing the de Beauville or, more commonly, de Boyville name from Beauville, near Ca

  4. #4 peak

    , Muscovy who, according to tradition, were descendants of the Varangian prince Rurik, who had been invited by the people of Novgorod to rule

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L25:2579 strongly excites
  2. L22:2914 strongly suppresses the '0' in years like 2050
  3. L21:2675 excites
  4. L21:1824 suppresses
  5. L16:2965 suppresses
  6. L22:2874 excites
  7. L21:2429 suppresses
  8. L18:1892 excites
  9. L17:1623 excites
  10. L18:2817 excites
  11. L21:2426 suppresses
  12. L18:3047 suppresses
  13. L21:1699 suppresses
  14. L19:564 excites
  15. L14:2691 suppresses
  16. L18:2623 suppresses
  17. L20:966 suppresses
  18. L17:2964 suppresses
  19. L18:1226 suppresses
  20. L12:2594 suppresses
  21. L8:920 excites
  22. L20:1878 excites
  23. L10:2029 weakly excites
  24. L15:2338 weakly excites

Feeds later layers

  1. L27:2471 weakly suppresses
  2. L27:1015 weakly suppresses
  3. L27:1397 weakly suppresses "the" in "to the next"
  4. L27:3055 weakly excites lowercase 'l' starting a word
  5. L27:2333 weakly suppresses
  6. L27:682 weakly suppresses
  7. L27:1248 weakly excites
  8. L27:1535 weakly excites
  9. L27:1063 weakly excites
  10. L27:2585 weakly excites
  11. L27:2634 weakly excites
  12. L27:899 weakly excites
  13. L27:1717 weakly excites 'st' starting a word fragment
  14. L27:544 weakly suppresses
  15. L27:2136 weakly excites capital M inside abbreviations
  16. L27:1640 weakly suppresses
  17. L27:2552 weakly excites capital L starting a word
  18. L27:1864 weakly suppresses
  19. L27:2184 weakly excites
  20. L27:1956 weakly excites
  21. L27:555 weakly excites
  22. L27:2997 weakly suppresses
  23. L27:2273 weakly suppresses
  24. L27:1573 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -25.55 and -24.461 values between -22.29 and -21.201 values between -19.02 and -17.941 values between -17.94 and -16.851 values between -15.76 and -14.681 values between -14.68 and -13.591 values between -13.59 and -12.501 values between -10.33 and -9.241 values between -9.24 and -8.154 values between -8.15 and -7.074 values between -7.07 and -5.985 values between -5.98 and -4.896 values between -4.89 and -3.8116 values between -3.81 and -2.7226 values between -2.72 and -1.6377 values between -1.63 and -0.542900 values between -0.54 and 0.54825 values between 0.54 and 1.6321 values between 1.63 and 2.724 values between 2.72 and 3.813 values between 3.81 and 4.893 values between 4.89 and 5.982 values between 7.07 and 8.151 values between 8.15 and 9.241 values between 11.42 and 12.501 values between 16.85 and 17.94offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. rases
  2. icone
  3. riteln
  4. plevel
  5. auprès
  6. итель
  7. NOTICE
  8. ertext
  9. WithOptions
  10. inois

Suppresses

  1. future
  2. 未来
  3. future
  4. Future
  5. 未来的
  6. Future
  7. 未來
  8. _future
  9. futuro
  10. 在未来