Neuron Explorer

Qwen3-0.6B

"and" inside fixed field names

A neuron in layer 23 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron lights up on the word "and" when it sits inside a fixed name like "earth and planetary science" or "Food and Agriculture Organization". When it was turned up, the model's writing drifted into strange number lists and repeated symbols, so the steering output doesn't show a clear theme.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    series documenting colonization of the gut of a premature newborn, and one of few completely assembled community genomic datasets, said Jill Banfield, a UC Berkeley professor of earth and planetary science and of environmental science, policy and management.⏎"Sequencing of

  2. #2 peak

    including Purdue University, the National Center for Atmospheric Research and the Indian Institute of Technology Delhi.⏎Dev Niyogi, a Purdue associate professor of agronomy and earth and atmospheric sciences, said modeling of a monsoon depression track can have a

  3. #3 peak

    Research, Volume 1⏎Jonathan D. Jaipaul ✉️ Department of Environmental Studies. Faculty of Earth and Environmental Studies. Turkeyen Campus. Greater Georgetown, Guyana.⏎Devya Hem

  4. #4 peak

    the American Society of Mechanical Engineers, ASME is a not-for-profit professional organization promoting the art, science and practice of mechanical and multidisciplinary engineering and allied sciences. ASME develops codes and standards that enhance

  5. #5 peak

    worldwide including Filipino children and lactating mothers. The 2019 Expanded National Nutrition Survey (ENNS) of the Department of Science and technology-Food and Nutrition Research Institute (DOST-FNRI) shows that 1 in

  6. #6 peak

    , India, focused on the empowerment of the rural and urban poor. Between 1976 and 2001, she worked with the Food and Agriculture Organization (FAO) of the United Nations to identify and support innovative NGO

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: I (a) I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    maximum of $22.5 million and a minimum of $13.7 million a year through 2

  2. #2 peak

    structures of data that can aid learning.⏎- The $M$ features of user linguistic response can be saved within a user session as a time series of vectors $\sigma(m, n, t)$.⏎- Those series can be collected across $U

  3. #3 peak

    .⏎You could, of course, reach for a calculator here, but I want to show you how to do it without. You can work out $2.4 \times 100$ by moving the dot two spaces to the right

  4. #4 peak

    ), the nickel ($0.05), the dime ($0.10), the quarter ($0

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L19:329 strongly suppresses
  2. L21:1374 strongly excites
  3. L21:588 excites
  4. L17:719 suppresses
  5. L21:1042 suppresses
  6. L21:162 suppresses
  7. L22:326 excites
  8. L17:527 suppresses
  9. L18:153 weakly suppresses
  10. L19:1040 weakly suppresses
  11. L15:1154 weakly excites
  12. L19:58 weakly excites
  13. L20:269 weakly suppresses
  14. L0:178 weakly suppresses
  15. L0:1224 weakly suppresses
  16. L22:170 weakly excites
  17. L22:972 weakly suppresses
  18. L19:377 weakly excites
  19. L22:2028 weakly excites
  20. L17:742 weakly suppresses
  21. L19:2462 weakly suppresses
  22. L0:1301 weakly suppresses
  23. L18:461 weakly excites
  24. L8:2275 weakly excites

Feeds later layers

  1. L27:295 suppresses
  2. L27:430 suppresses
  3. L24:54 suppresses
  4. L25:560 suppresses
  5. L26:473 suppresses
  6. L25:630 suppresses
  7. L25:487 excites
  8. L26:282 suppresses
  9. L26:245 suppresses
  10. L27:2564 suppresses
  11. L26:639 suppresses
  12. L25:380 weakly suppresses
  13. L25:391 weakly suppresses
  14. L24:256 weakly suppresses
  15. L24:352 weakly excites
  16. L24:22 weakly excites
  17. L24:294 weakly excites
  18. L24:1606 weakly excites
  19. L25:821 weakly excites
  20. L26:609 weakly excites
  21. L27:171 weakly suppresses
  22. L24:3026 weakly excites
  23. L25:264 weakly suppresses
  24. L24:2254 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

2 values between -6.80 and -6.322 values between -5.84 and -5.363 values between -4.89 and -4.411 values between -4.41 and -3.932 values between -3.93 and -3.453 values between -3.45 and -2.975 values between -2.97 and -2.4911 values between -2.49 and -2.0112 values between -2.01 and -1.5323 values between -1.53 and -1.06101 values between -1.06 and -0.58633 values between -0.58 and -0.102130 values between -0.10 and 0.38789 values between 0.38 and 0.86152 values between 0.86 and 1.3420 values between 1.34 and 1.823 values between 1.82 and 2.303 values between 2.30 and 2.785 values between 2.78 and 3.251 values between 3.25 and 3.732 values between 4.21 and 4.692 values between 4.69 and 5.172 values between 7.56 and 8.041 values between 11.87 and 12.35offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. fn
  2. chten
  3. aller
  4. ience
  5. ßen
  6. ße
  7. cos
  8. �
  9. erp
  10. egr

Suppresses

  1. \models
  2. \Table
  3. (\
  4. \@
  5. {}\
  6. (\
  7. \%
  8. 虐
  9. ,\
  10. \Id