Neuron Explorer

Qwen3-0.6B

'New' in place names

A neuron in layer 26 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the word 'New' when it starts a place name, such as New York, New Mexico or New Madrid. When turned up, the model kept producing the word 'their' over and over, which fits what the neuron seems to push toward.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    Brigade on February 19, 1862. Lt. Col. Tinkham and the 26th Illinois Volunteers engaged Confederate troops at New Madrid, Missouri and took part in the siege of Corinth, Mississippi. On May

  2. #2 peak

    J. Hardee, and General James Longstreet led the way in the South’s fight for its independence. Critical battles at Dalton, Resaca, Dallas, New Hope Church, and Kennesaw Mountain were fought only a short distance from our

  3. #3 peak

    that the terrain affected the formation of the glacier, intensifying the cooling of the ice.⏎Weather cycles also showed seasonal frosts that match data collected by NASA’s New Horizons mission and observations of polar flares seen since 1985

  4. #4 peak

    they couldn’t,” he said.⏎Trujillo enlisted in the U.S. Army in <|endoftext|>On June 12, 1909, New York City began an eight-day celebration of the connection of the East Side of Manhattan

  5. #5 peak

    Earth from a new perspective on 24th October, 1946, when a V-2 rocket lifted the first ever space-bound camera above New Mexico on a short sub-orbital flight. From an altitude of 6

  6. #6 peak

    ens and J.P. "The Big Bopper" Richardson died in a small plane crash near Clear Lake, Iowa. An American Airlines Lockheed Electra crashed into New York's East River, killing 65 of the 73

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: It would be a problem for a few thousand people to be able to look up where and when to get something as easily as Google, but for the few thousand thousandth thousandthth thousandth thousandthth thousandth thousandthth thousand

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    foods, such as peppers and hot sauce, can trigger inflammation and cause redness and flushing in those with sensitive skin. Capsaicin, the compound that gives peppers their heat, can irritate the face and even cause burning and itching. For

  2. #2 peak

    s and roots, e.g. kelp and seaweeds.⏎The cultivation of those plants holds great potential for future use. Microalgae are known for their fast forming of biomass, using only the energy of sunlight, carbon dioxide and

  3. #3 peak

    leopard grows quickly: Cubs are small and helpless when they are born, and do not open their eyes until they are about 7 days old.⏎At 2 months old

  4. #4 peak

    -Alamo.⏎As the scientist indicates, tactics against their hunters are "crucial" so that birds can adapt to their new environment: "Birds should modify their behavior to

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L23:481 strongly excites
  2. L24:183 strongly suppresses
  3. L25:692 strongly excites
  4. L23:1456 strongly suppresses
  5. L21:1091 strongly suppresses
  6. L20:1110 strongly excites
  7. L21:275 strongly excites
  8. L22:448 strongly suppresses
  9. L20:1968 strongly excites
  10. L25:2286 strongly excites
  11. L21:1552 strongly suppresses
  12. L20:1842 strongly suppresses
  13. L19:1422 strongly excites
  14. L24:980 suppresses
  15. L20:2075 suppresses
  16. L19:1629 excites
  17. L24:1437 suppresses
  18. L23:447 excites
  19. L19:2849 suppresses
  20. L6:410 excites
  21. L24:477 excites
  22. L21:1040 suppresses
  23. L7:146 excites
  24. L22:614 suppresses

Feeds later layers

  1. L27:1047 strongly excites
  2. L27:1646 excites
  3. L27:813 excites
  4. L27:578 excites
  5. L27:1102 weakly excites
  6. L27:953 weakly excites
  7. L27:619 weakly excites
  8. L27:1677 weakly excites
  9. L27:1771 weakly suppresses
  10. L27:1950 weakly excites
  11. L27:1906 weakly suppresses
  12. L27:292 weakly excites
  13. L27:990 weakly suppresses
  14. L27:2345 weakly excites
  15. L27:2505 weakly suppresses
  16. L27:1381 weakly excites
  17. L27:1181 weakly excites
  18. L27:1313 weakly excites
  19. L27:1636 weakly excites
  20. L27:2439 weakly excites slash inside web addresses
  21. L27:2988 weakly suppresses capital M starting a word
  22. L27:413 weakly excites
  23. L27:1328 weakly excites
  24. L27:853 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

2 values between -20.58 and -19.812 values between -15.99 and -15.233 values between -13.70 and -12.943 values between -12.94 and -12.172 values between -12.17 and -11.413 values between -11.41 and -10.643 values between -10.64 and -9.886 values between -9.88 and -9.114 values between -9.11 and -8.351 values between -8.35 and -7.592 values between -7.59 and -6.824 values between -6.82 and -6.066 values between -6.06 and -5.2912 values between -5.29 and -4.5315 values between -4.53 and -3.7619 values between -3.76 and -3.0021 values between -3.00 and -2.2429 values between -2.24 and -1.47372 values between -1.47 and -0.711033 values between -0.71 and 0.06855 values between 0.06 and 0.82696 values between 0.82 and 1.59412 values between 1.59 and 2.35225 values between 2.35 and 3.11107 values between 3.11 and 3.8836 values between 3.88 and 4.6418 values between 4.64 and 5.418 values between 5.41 and 6.175 values between 6.17 and 6.941 values between 6.94 and 7.702 values between 7.70 and 8.461 values between 9.23 and 9.99offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. 他们的
  2. their
  3. their
  4. Their
  5. themselves
  6. Their
  7. 她们
  8. 他们在
  9. 他们
  10. 因为他们

Suppresses

  1. hood
  2. alyze
  3. gricult
  4. ))];⏎
  5. LEMENT
  6. umerator
  7. ial
  8. atomy
  9. '])[
  10. ']];⏎