Neuron Explorer

Qwen3-0.6B

'of' in organisation names like 'Ministry of'

A neuron in layer 5 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on 'of' inside the names of government bodies and institutions, like 'Ministry of Health' or 'School of Music'. Turning it up didn't produce a clear theme in the sample text.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    1921-School of Music organized.⏎1923-School of Business organized.⏎195

  2. #2 peak

    year, WAVES program stated that “African countries lead on natural capital accounting”. The recent flurry of activity on the continent appears to support this.⏎The Ministry of Finance and WAVES organized a training as part of ongoing efforts to implement NCA

  3. #3 peak

    2,200 people, according to the World Health Organization. Because a dead body can transmit the virus for up to a week after death, the Ministry of Health prohibited all traditional burials,

  4. #4 peak

    2021 and 2022, respectively.⏎This speed is far below the speed required to achieve the US decarbonization target. The Ministry of Energy’s solar energy research shows that the new installed capacity in the next five years

  5. #5 peak

    a health facility without a skilled birth provider. Consequently, teaching basic newborn care along with other basic health skills to community care providers is a vital part of the Ministry of Public Health's national strategy.⏎Together, USAID and the Afghan Ministry of Health

  6. #6 peak

    large number of local manifestations of the element are inscribed on the National List of Intangible Cultural Heritage administered by the Department of Intangible Cultural Heritage of the Ministry of Culture.⏎These videos (and many more) can also be consulted through the UNESCO

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: it's not a breaking score. It's a bad one. So, it's not a bad one. So, it's a bad one. So, it's a bad one. So, it's a bad one. So,

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    night to make it to Willamette’s 1929 freshman orientation. A month later the stock market collapsed

  2. #2 peak

    tutorial from the Australia Telescope National Facility, Parkes, New South Wales⏎Amateurfunk, Erde-Mond-Erde, EME

  3. #3 peak

    and we have the power to stop it.”⏎The event is sponsored by the Jewish Student Union and supported by Campus Ambassadors, Students Against Slavery and Willamette University's Religious Studies Department.⏎For more information contact Jessica Sternbach at firstname.lastname

  4. #4 peak

    is approved, endorsed, or authorized by the Central Intelligence Agency. "⏎Many sites have used information and images from the CIA World Factbook, because of its public domain status, including this encyclopedia.⏎Besides the World Factbook, the CIA puts out

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L4:977 suppresses
  2. L0:1695 weakly suppresses
  3. L1:298 weakly suppresses
  4. L0:2278 weakly suppresses
  5. L4:1588 weakly suppresses
  6. L1:506 weakly excites
  7. L1:1414 weakly excites
  8. L4:876 weakly excites
  9. L3:1950 weakly excites
  10. L1:2217 weakly suppresses unclear: mostly weak, Chinese and Greek characters
  11. L3:1033 weakly excites
  12. L2:1306 weakly suppresses
  13. L2:2500 weakly excites
  14. L4:2588 weakly excites
  15. L0:271 weakly suppresses
  16. L3:2053 weakly suppresses
  17. L4:979 weakly suppresses
  18. L2:420 weakly suppresses
  19. L3:554 weakly excites
  20. L3:456 weakly suppresses
  21. L2:2805 weakly suppresses
  22. L4:92 weakly suppresses
  23. L4:2825 weakly suppresses "to" after 'for X' infinitives
  24. L2:2545 weakly excites

Feeds later layers

  1. L6:554 weakly suppresses
  2. L7:581 weakly excites
  3. L13:236 weakly excites
  4. L7:285 weakly excites
  5. L24:2273 weakly excites
  6. L6:201 weakly suppresses
  7. L15:723 weakly suppresses
  8. L8:1682 weakly excites
  9. L16:1992 weakly excites
  10. L7:1403 weakly excites 'to' after attempt or seek verbs
  11. L6:1539 weakly excites
  12. L23:2857 weakly suppresses
  13. L21:1197 weakly excites
  14. L8:1946 weakly excites comma after 'who' or 'which'
  15. L18:3060 weakly excites
  16. L15:1039 weakly excites
  17. L9:80 weakly excites
  18. L22:1621 weakly excites
  19. L6:47 weakly suppresses
  20. L9:817 weakly excites
  21. L14:1474 weakly suppresses
  22. L9:868 weakly suppresses
  23. L13:270 weakly excites
  24. L14:208 weakly excites 'of' or 'the' after 'part of' or 'subset of'

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -1.34 and -1.271 values between -1.27 and -1.211 values between -1.14 and -1.071 values between -1.07 and -1.011 values between -1.01 and -0.942 values between -0.94 and -0.881 values between -0.81 and -0.741 values between -0.74 and -0.684 values between -0.68 and -0.615 values between -0.61 and -0.554 values between -0.55 and -0.482 values between -0.48 and -0.4126 values between -0.41 and -0.3551 values between -0.35 and -0.2890 values between -0.28 and -0.21185 values between -0.21 and -0.15378 values between -0.15 and -0.08756 values between -0.08 and -0.021239 values between -0.02 and 0.05567 values between 0.05 and 0.12298 values between 0.12 and 0.18151 values between 0.18 and 0.2571 values between 0.25 and 0.3238 values between 0.32 and 0.3813 values between 0.38 and 0.456 values between 0.45 and 0.513 values between 0.51 and 0.584 values between 0.58 and 0.653 values between 0.65 and 0.712 values between 0.71 and 0.781 values between 0.78 and 0.841 values between 0.84 and 0.911 values between 1.24 and 1.31offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. getApplication
  2. omon
  3. currentItem
  4. aci
  5. amation
  6. ment
  7. emme
  8. IGATION
  9. informação
  10. 豉

Suppresses

  1. eer
  2. hdl
  3. веч
  4. asl
  5. iful
  6. ush
  7. cosity
  8. ensored
  9. coon
  10. олос