Neuron Explorer

Qwen3-0.6B

the 'therm' stem in thermo- words

A neuron in layer 23 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron lights up on the start of words built from 'therm', such as 'thermometer', 'thermionic' or 'thermophilic', which are about heat. Turning it up gave replies about temperature and heat in a few cases, but many were unrelated.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    out more.⏎1. Maintain the Fridge Temperature⏎A recommended fridge temperature of 5 degrees C is advised. There are thermometers available at reasonable price which can help you determine the temperature. A report suggests

  2. #2 peak

    Roman god who served as messenger for the other gods. The silver-white chemical is the only common metal that is a liquid at room temperature. It is used in thermometers,

  3. #3 peak

    today it still features in commercial and domestic microwave ovens seven decades after its introduction. In fact, the magnetron belongs to a broader Class of products known as thermionic valves, or ‘tubes’. Valves were relegated to specialist applications once

  4. #4 peak

    ; the indirect techniques only calculate it from other indirect indicators.⏎Image Credit: Soonthorn Wongsaita / Shutterstock⏎Many devices for LOD measurement use the thermogravimetric principle. This uses the total loss of weight incurred by the

  5. #5 peak

    the machine configuration file for assembly binding, see How the Runtime Locates Assemblies.⏎An application configuration file contains settings that are specific<|endoftext|>Mercury is used in thermometers, fluorescent light bulbs, and some electrical switches.⏎"Mercury" is

  6. #6 peak

    use of epoxy-based resins and may be classified as the thermosetting epoxide polymer. Exteriors that receive this coating are resistant to

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: at some moment, at least one of the two atypoeyypierym entries at the more than two than two compared to atypoeyy atyypierym atyypierymat compared to atypo

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    , Mithra, was adopted and developed by the Zoroastrians as an angelic

  2. #2 peak

    no ultimate evil, only delusions represented by demons, who need to be guided back on the Buddhist path. Represent<|endoftext|>Tam Nông is a district of Đồng Tháp province, part of the once very vast area called Đồng Tháp Mười

  3. #3 peak

    rule in Britain at the beginning of the fifth century.⏎|DEO L SENTIVS CASTVS > LEG VI D P|⏎|"For the god [Mithras], Sentius Castus, centurion of the Sixth Legion makes this

  4. #4 peak

    Guisers (children disguising themselves at Halloween) in Scotland sang:⏎If ye dinnae let us in,⏎We will bash yer windies in.⏎"Whuppity Scooorie in Lanark is a festival, believed to have survived

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L4:52 excites
  2. L16:792 excites "the" inside a prepositional phrase
  3. L22:1882 excites
  4. L17:30 suppresses
  5. L20:361 weakly excites
  6. L18:799 weakly excites
  7. L0:87 weakly excites
  8. L3:2846 weakly excites
  9. L19:1064 weakly suppresses
  10. L20:792 weakly excites
  11. L16:419 weakly excites
  12. L10:1210 weakly suppresses
  13. L18:648 weakly suppresses
  14. L19:472 weakly excites
  15. L15:2129 weakly suppresses
  16. L9:24 weakly excites "the" before a named organisation or title
  17. L21:614 weakly excites
  18. L20:211 weakly excites
  19. L7:122 weakly excites
  20. L22:1044 weakly excites
  21. L5:1952 weakly excites
  22. L2:2780 weakly excites
  23. L20:1079 weakly suppresses
  24. L20:894 weakly excites

Feeds later layers

  1. L25:3011 weakly suppresses
  2. L27:1215 weakly suppresses
  3. L27:1100 weakly suppresses
  4. L24:223 weakly suppresses
  5. L27:599 weakly suppresses
  6. L24:1627 weakly suppresses
  7. L24:13 weakly excites
  8. L26:2914 weakly excites
  9. L26:577 weakly suppresses
  10. L26:1637 weakly excites
  11. L25:2325 weakly suppresses
  12. L27:359 weakly excites
  13. L24:911 weakly suppresses
  14. L25:501 weakly excites
  15. L24:2722 weakly suppresses
  16. L25:656 weakly excites
  17. L26:2182 weakly suppresses
  18. L25:2774 weakly excites
  19. L25:1172 weakly excites
  20. L27:731 weakly suppresses
  21. L26:1915 weakly excites
  22. L26:2621 weakly suppresses
  23. L24:2187 weakly excites
  24. L25:850 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

2 values between -10.02 and -9.111 values between -9.11 and -8.214 values between -7.30 and -6.395 values between -6.39 and -5.494 values between -5.49 and -4.585 values between -4.58 and -3.6823 values between -3.68 and -2.7715 values between -2.77 and -1.8745 values between -1.87 and -0.961514 values between -0.96 and -0.062160 values between -0.06 and 0.8559 values between 0.85 and 1.7628 values between 1.76 and 2.6612 values between 2.66 and 3.5710 values between 3.57 and 4.474 values between 4.47 and 5.383 values between 5.38 and 6.282 values between 6.28 and 7.192 values between 7.19 and 8.092 values between 8.09 and 9.001 values between 9.00 and 9.911 values between 9.91 and 10.811 values between 12.62 and 13.531 values between 13.53 and 14.431 values between 14.43 and 15.341 values between 15.34 and 16.241 values between 17.15 and 18.051 values between 25.30 and 26.20offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. Liberation
  2. tle
  3. ).__
  4. rello
  5. ervention
  6. =count
  7. Means
  8. 就是在
  9. NEL
  10. ADI

Suppresses

  1. ew
  2. yst
  3. irst
  4. er
  5. ered
  6. wards
  7. erb
  8. 頭
  9. iei
  10. ir