Neuron Explorer

Qwen3-0.6B

the "9" in years 1930 to 1945

A neuron in layer 21 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the second digit of years from the 1930s and 1940s, especially during the Second World War, such as the "9" in 1945 or 1941. Turning it up pushed the model to talk about World War II, which fits what it fires on.

Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    the might of the German war machine, a plucky but woefully under-equipped little island. It initially suffered setbacks, and finally won the war in 1945 thanks to the intervention of the far more

  2. #2 peak

    ), the Spanish American War (1898), the First World War (1917-1918), the Second World War (1941-45), and events such as the Cuban Missile Crisis (1

  3. #3 peak

    all Jews to be killed. Otto Frank, Anne's father, did not hestitate to wait for the Nazis to come into full power. In 1933, the Franks left Frankfort. Mrs. Frank and the two

  4. #4 peak

    the diesels to recharge the batteries and also to ventilate the boat. Over 214 U-boats were fitted out with the equipment in 1943-1945.⏎This was an U-boat observation rotor

  5. #5 peak

    silence, and then lit candles as part of the action “We remember!” at the monument to medical workers who died in the Great Patriotic War of 1941-1945, on the square in front of the main

  6. #6 peak

    print, sad, it's a great one)⏎And the second is still out and it is: Armaggeddon, the collapse of nazi Germany 1944-45 by Max

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: the case of a single type of a kind of type, and the same kind of type in the other kind of type. That is, a single type, in a single kind, and the same kind in a single type. This is

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    of Weber State University. The county was formed in 1850 and named after the Weber River, which in turn was named for John Henry Weber (1779–1859), a fur trapper and trader in

  2. #2 peak

    catcher mounted on the back of Daniel Webster.⏎The print might have been produced in Boston, a center of bitter opposition to the Fugitive Slave Act in 1850 and 1851.⏎Please post your comment below to

  3. #3 peak

    11 children, born to recently emancipated slaves Aleck and Daphne Alexander on Butler Plantation in MacIntosh County, Georgia, in 1865. Her parents were devout Episcopalians, and also instilled in

  4. #4 peak

    ), altitude above sea level and proximity to oceans.⏎The expert group considers the question: Where and when do bushfires<|endoftext|>Fugitive Slave Act cartoon, 1851⏎The cartoon entitled "Practical illustration of the F

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L20:391 excites
  2. L20:2289 suppresses
  3. L20:1315 suppresses
  4. L20:1089 suppresses
  5. L20:1020 suppresses
  6. L20:1954 suppresses
  7. L8:1776 suppresses
  8. L20:1396 excites
  9. L19:1805 excites
  10. L19:1583 excites
  11. L20:1940 weakly suppresses
  12. L6:2330 weakly suppresses
  13. L8:2911 weakly suppresses
  14. L6:2332 weakly excites
  15. L20:508 weakly excites
  16. L18:1296 weakly suppresses
  17. L5:689 weakly suppresses
  18. L20:1829 weakly suppresses
  19. L5:1739 weakly suppresses
  20. L9:748 weakly suppresses
  21. L9:382 weakly suppresses
  22. L3:464 weakly excites
  23. L5:1447 weakly suppresses
  24. L12:945 weakly suppresses

Feeds later layers

  1. L23:3042 weakly excites
  2. L23:2353 weakly excites
  3. L22:2439 weakly suppresses
  4. L23:1926 weakly suppresses
  5. L23:1880 weakly suppresses
  6. L22:2986 weakly excites
  7. L24:1851 weakly suppresses
  8. L25:2913 weakly suppresses
  9. L23:1582 weakly suppresses
  10. L23:181 weakly excites
  11. L25:2057 weakly suppresses
  12. L27:2199 weakly excites
  13. L24:501 weakly excites
  14. L25:581 weakly suppresses
  15. L23:1774 weakly suppresses
  16. L24:731 weakly excites
  17. L23:800 weakly excites
  18. L27:707 weakly suppresses
  19. L23:2462 weakly suppresses
  20. L26:1545 weakly suppresses
  21. L26:2136 weakly suppresses
  22. L22:2731 weakly excites
  23. L24:223 weakly excites
  24. L24:1048 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -38.47 and -36.502 values between -18.74 and -16.771 values between -16.77 and -14.801 values between -14.80 and -12.825 values between -12.82 and -10.855 values between -10.85 and -8.888 values between -8.88 and -6.919 values between -6.91 and -4.9328 values between -4.93 and -2.9688 values between -2.96 and -0.993618 values between -0.99 and 0.9861 values between 0.98 and 2.9629 values between 2.96 and 4.9314 values between 4.93 and 6.907 values between 6.90 and 8.887 values between 8.88 and 10.854 values between 10.85 and 12.824 values between 12.82 and 14.795 values between 14.79 and 16.772 values between 16.77 and 18.743 values between 22.68 and 24.661 values between 24.66 and 26.631 values between 28.60 and 30.571 values between 30.57 and 32.552 values between 34.52 and 36.491 values between 38.47 and 40.44offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. 二战
  2. WWII
  3. war
  4. War
  5. World
  6. wars
  7. 第二次
  8. 大战
  9. -war
  10. Axis

Suppresses

  1. YPES
  2. ={!
  3. {!
  4. rove
  5. pliers
  6. rical
  7. feeder
  8. tparam
  9. _then
  10. xec