Neuron Explorer

Qwen3-0.6B

'out of' in ratios and rankings

A neuron in layer 15 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the word 'of' in phrases like 'ranked 73 out of 187' or 'nine out of 10'. These are the strongest hits in the set. Turning it up made the model produce number-heavy, list-like text, which fits the pattern.

Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    2013 – a notable improvement from 0.557 in 1980. The index ranks Sri Lanka 73 out of 187 countries and places the country in the high human development category.

  2. #2 peak

    2015.⏎In early 2015, I reported on the 10 largest point source greenhouse gas emitters in Missouri. Nine out of 10 were coal burning electricity generating stations, and together Missouri’s big three

  3. #3 peak

    the presence of blisters. That is why some would call the condition as fever blisters. These can appear anywhere in the body, although almost 9 out of 10 cases will mostly affect the lips and the insides of the mouth

  4. #4 peak

    Bird Hunting and Conservation Stamps — were created in 1934 as federal licenses for hunting migratory waterfowl. Nearly 98 cents out of every dollar collected from the sale of Duck Stamps (and Duck Stamp merchandise)

  5. #5 peak

    experience of paying bribes or using a contact to get a job done in public office.⏎In 2012 India has ranked 94th out of 176 countries in Transparency International's Corruption Perceptions Index, tied with

  6. #6 peak

    Mainland. ...⏎Not exactly what<|endoftext|>War and Peace in the Nuclear Age; Bigger Bang for the Buck, A; Your Defense (Part 1 of 2)⏎Part of War and Peace in the Nuclear Age.⏎Introduction by Secretary of

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: I will do the thing I do (and do it) in the future. So, I will do it (the future) the thing (and do) it (the future) (and do) it (again) and do it

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    been possible, if the industry had been unable to act as a cohesive whole. How this intra-industry cooperation was achieved is not yet fully clear. Be that as it may, the negotiations were successful and led to the world’s first habitat by

  2. #2 peak

    manger.” 13 And suddenly there was with the angel a multitude of the heavenly host praising God and saying,⏎14 “Glory to God in the highest,⏎and on earth peace among those with whom he is pleased!”⏎1

  3. #3 peak

    is recorded in several Roman mosaics.⏎The cookie settings on this website are set to "allow cookies" to give you the best browsing experience possible. If you continue to use this website without changing your cookie settings or you click "Accept"

  4. #4 peak

    planet has never been seen with human eyes or by a telescope. Be that as it may, we realize it exists because of its gravitational draw on its host

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L12:2925 suppresses
  2. L13:2226 suppresses
  3. L11:2547 suppresses
  4. L13:2368 suppresses
  5. L13:2420 excites
  6. L12:1238 suppresses the word 'entry' in reference text
  7. L12:2493 excites
  8. L14:2509 excites
  9. L8:1066 excites the total after "N of" in fractions
  10. L12:2344 weakly excites
  11. L12:2211 weakly excites
  12. L10:2016 weakly suppresses
  13. L3:2846 weakly excites
  14. L7:1476 weakly excites
  15. L12:1484 weakly excites
  16. L11:2083 weakly suppresses
  17. L6:620 weakly excites "and" in lists of three or more
  18. L8:1483 weakly suppresses
  19. L1:602 weakly excites
  20. L13:2171 weakly suppresses
  21. L13:106 weakly suppresses
  22. L1:2361 weakly suppresses
  23. L11:2411 weakly suppresses
  24. L10:2836 weakly excites

Feeds later layers

  1. L18:1680 excites
  2. L18:3048 excites
  3. L17:2984 excites blank before a number in prevalence claims
  4. L17:2677 weakly excites
  5. L16:2578 weakly excites
  6. L16:1921 weakly excites
  7. L17:1932 weakly excites
  8. L16:2380 weakly excites
  9. L20:516 weakly excites
  10. L17:2322 weakly excites
  11. L17:1899 weakly excites
  12. L17:159 weakly excites
  13. L16:2536 weakly excites
  14. L19:173 weakly excites
  15. L17:1506 weakly excites
  16. L21:1430 weakly excites
  17. L18:3018 weakly suppresses
  18. L17:890 weakly excites
  19. L24:2295 weakly suppresses
  20. L16:1128 weakly excites
  21. L18:1517 weakly suppresses
  22. L20:2561 weakly excites
  23. L23:1712 weakly excites
  24. L16:1811 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

3 values between -1.73 and -1.1714 values between -1.17 and -0.621338 values between -0.62 and -0.062491 values between -0.06 and 0.5028 values between 0.50 and 1.0611 values between 1.06 and 1.615 values between 1.61 and 2.177 values between 2.17 and 2.731 values between 2.73 and 3.292 values between 3.29 and 3.841 values between 4.40 and 4.962 values between 4.96 and 5.521 values between 5.52 and 6.071 values between 6.63 and 7.191 values between 7.74 and 8.301 values between 8.86 and 9.421 values between 20.01 and 20.56offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. _TOTAL
  2. 三位
  3. Total
  4. (total
  5. TOTAL
  6. 三位一体
  7. 挂在
  8. 几位
  9. трех
  10. total

Suppresses

  1. inic
  2. ivia
  3. atsu
  4. atcher
  5. patibility
  6. razil
  7. ښ
  8. bao
  9. anse
  10. safety