Neuron Explorer

Qwen3-0.6B

comma introducing a quoted claim

A neuron in layer 21 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on a comma that comes right before a full statement, especially in quotations from scripture or famous declarations, such as "We hold these truths to be self-evident, that". It is negative on some words inside longer sentences, like "so that you". Turning it up gave text that loosely echoed the trigger but mostly wandered.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    “And, notwithstanding we believe in Christ, we keep the law of Moses, and look forward with steadfastness unto Christ, until the law shall be fulfilled.⏎“For, for this end was the law given; wherefore the law hath become dead unto

  2. #2 peak

    version in the Preamble was saving too much paper. Just sayin….⏎We the People of the United States, in Order to form a more perfect Union, establish Justice, insure domestic Tranquility, provide for the common defence, promote

  3. #3 peak

    He was able to bring them all into existence on day four of Creation with the word of His mouth.⏎“By the word of the Lord the heavens were made, and all the host<|endoftext|>Oxcarbazepine prevents fits.⏎Take it

  4. #4 peak

    have holes and birds have nests, but the Son of Man has no place to rest."⏎American Standard Version⏎And Jesus said unto him, The foxes have holes, and the birds of the heaven have nests; but

  5. #5 peak

    His, not one another's pleasure.⏎This idea found its way into our Declaration of Independence in modified form:⏎We hold these truths to be self-evident, that all men are created equal, that they are endowed by their Creator with certain

  6. #6 peak

    1900); Macallum, On the Detection and Localization of Phosphorus in Animal and Vegetable Cells, Proc. Roy.⏎A curious fact, which may be used for the detection of the minutest quantity of oils and fats

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: I have a lot of different types of data. For example, for the entire range of the day, I may have a lot of data for the entire day, for the entire day of the day, for the entire day of the day

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    is seeking God and His direction for our lives. Praying also helps keep us out of trouble. Jesus told us to pray, "Watch and pray so that you will not fall into temptation." (Matthew 26:41)⏎Read

  2. #2 peak

    you took a hypothetical "walk across Virginia," you would see changes in all of the state's ecosystems, said Roger Mann, director of research at the Virginia Institute of Marine Science in Gloucester Point. From the mountains, to the Piedmont,

  3. #3 peak

    :28 "And you shall say to them, 'This is the nation that did not obey the voice of the LORD their God or accept correction; truth has perished and has been cut

  4. #4 peak

    idis, a researcher in Stanford University's Kavli Institute for Particle Astrophysics and Cosmology, in collaboration with Lucio Mayer of the Swiss Federal Institute of Technology in Zurich and the University of Zurich, Chiara Mastropietro of

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L20:1391 excites
  2. L19:827 suppresses
  3. L18:967 suppresses
  4. L10:315 excites
  5. L10:934 suppresses
  6. L3:34 excites
  7. L18:1956 weakly excites
  8. L10:2370 weakly suppresses
  9. L12:2204 weakly suppresses
  10. L10:446 weakly excites
  11. L12:2744 weakly suppresses
  12. L18:1051 weakly excites
  13. L9:1715 weakly excites
  14. L17:2759 weakly suppresses
  15. L17:1487 weakly excites
  16. L16:1631 weakly suppresses
  17. L1:2591 weakly excites
  18. L5:1889 weakly excites
  19. L2:954 weakly excites
  20. L10:2448 weakly excites
  21. L7:966 weakly suppresses
  22. L7:1023 weakly suppresses
  23. L13:3067 weakly excites
  24. L5:2865 weakly excites

Feeds later layers

  1. L24:2911 weakly suppresses the 'cul' fragment in culprit and culminate
  2. L24:2105 weakly suppresses unix daemons and server services
  3. L23:236 weakly suppresses
  4. L27:1364 weakly excites
  5. L23:2512 weakly suppresses
  6. L27:899 weakly excites
  7. L24:2204 weakly suppresses
  8. L23:1643 weakly suppresses
  9. L22:431 weakly excites
  10. L24:2335 weakly excites
  11. L25:832 weakly suppresses zero before a decimal point
  12. L26:1644 weakly suppresses
  13. L25:223 weakly suppresses
  14. L25:1145 weakly suppresses
  15. L23:1242 weakly suppresses
  16. L23:71 weakly excites
  17. L25:427 weakly suppresses
  18. L23:299 weakly excites
  19. L23:464 weakly suppresses
  20. L25:1459 weakly excites
  21. L25:834 weakly suppresses
  22. L23:2722 weakly suppresses
  23. L26:546 weakly excites
  24. L24:2254 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -11.41 and -10.552 values between -10.55 and -9.681 values between -7.95 and -7.092 values between -7.09 and -6.223 values between -6.22 and -5.352 values between -5.35 and -4.496 values between -4.49 and -3.628 values between -3.62 and -2.7615 values between -2.76 and -1.8951 values between -1.89 and -1.02757 values between -1.02 and -0.162896 values between -0.16 and 0.71128 values between 0.71 and 1.5715 values between 1.57 and 2.447 values between 2.44 and 3.311 values between 3.31 and 4.171 values between 4.17 and 5.042 values between 5.04 and 5.905 values between 5.90 and 6.771 values between 6.77 and 7.632 values between 7.63 and 8.501 values between 13.70 and 14.561 values between 22.35 and 23.22offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. &
  2. (&
  3. &
  4. )&
  5. &a
  6. &m
  7. (&(
  8. &C
  9. zym
  10. aming

Suppresses

  1. :".
  2. :".$
  3. ":"'
  4. 颏
  5. :";⏎
  6. +:
  7. TargetException
  8. ataires
  9. :<
  10. !: