Neuron Explorer

Qwen3-0.6B

stray bracket markers from web pages

A neuron in layer 24 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the odd bracket symbols that scraped web pages leave behind, such as a "[edit]" or "[Update]" tag stuck in the middle of a sentence. It was weakest on copyright lines. When it was turned up, the model produced strings of parentheses or random text.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens an email to the maker with the neuron already filled in).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    is another temple which is located about 500 meters away from the Phnom Da temple in the southwest direction. This temple is made of sandstone.⏎[SinglePic not found]Every year thousands of local and international tourists visit the Ph

  2. #2 peak

    8, with the capitulation of Koguryŏ, was able, for the first time in history, to unify under its rule all the Korean peninsula.⏎[page 2 of the original]⏎Still today in Japanese the state of Paek

  3. #3 peak

    , international humanitarian law, computer data, targeting.⏎Facts[edit | edit source]⏎[F1] Neutrality International (NI), an

  4. #4 peak

    any other living scholar during the 1980–1992 time period. He was the eighth-most cited scholar in any time period.⏎Politics[change | change source]⏎In the 1960s he criticized the

  5. #5 peak

    Next when you are done.⏎[Update: 3/21/2009] If you are

  6. #6 peak

    eness in which people try to seek and give confirmation and support, and to reach consensus. Life is a community, a struggle to preserve intimacy and avoid isolation.⏎[If intimacy says, “We’re close and the same,” and independence says,

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( (

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    the water, were the major factors shaping phytoplankton communities.⏎- Abstract views: 1777⏎- PDF: 842⏎Copyright (c) 2009 Silvia TAVERNINI, Daniele

  2. #2 peak

    . 3, No. 8⏎Copyright © James B. Jordan 1991⏎Chronologies and Kings (

  3. #3 peak

    dietary habits, optimization of management of diabetes and cardiovascular diseases, and conducting continuous surveillance to monitor the trends in NCD prevalence, their risk factors, and treatments.⏎Copyright © 2020 The Royal Society for Public Health. Published by Else

  4. #4 peak

    16, this study identified that the impact of religious education on Taiwanese students' civic values was low, with the main focus being personal and spiritual life development. Copyright © 2021 selection and editorial matter, Kerry J. Kennedy and

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L19:1048 excites
  2. L3:207 suppresses
  3. L23:353 excites
  4. L19:251 excites
  5. L11:171 weakly excites
  6. L20:2699 weakly suppresses
  7. L17:1386 weakly excites
  8. L18:866 weakly suppresses
  9. L9:2579 weakly suppresses
  10. L4:38 weakly suppresses
  11. L21:2905 weakly excites
  12. L6:547 weakly excites
  13. L17:663 weakly suppresses
  14. L11:1909 weakly excites
  15. L18:240 weakly suppresses
  16. L7:1423 weakly suppresses
  17. L16:109 weakly suppresses
  18. L4:169 weakly excites
  19. L13:1818 weakly excites
  20. L14:43 weakly excites
  21. L16:1071 weakly excites "any" in questions and negatives
  22. L15:644 weakly suppresses
  23. L7:268 weakly excites
  24. L19:2919 weakly suppresses

Feeds later layers

  1. L26:13 excites
  2. L26:1374 suppresses
  3. L25:360 weakly suppresses
  4. L26:234 weakly suppresses
  5. L27:218 weakly suppresses
  6. L25:478 weakly excites
  7. L27:1007 weakly excites
  8. L26:1976 weakly excites
  9. L26:2383 weakly excites
  10. L25:1058 weakly suppresses
  11. L25:2737 weakly excites 'a' before 'few' or 'couple'
  12. L25:1792 weakly excites the modal word 'may'
  13. L27:1885 weakly suppresses
  14. L26:1999 weakly excites
  15. L25:179 weakly suppresses
  16. L25:1675 weakly excites
  17. L26:335 weakly suppresses
  18. L25:3050 weakly suppresses unclear: word pieces in medical terms
  19. L26:912 weakly suppresses
  20. L25:2959 weakly suppresses
  21. L26:1566 weakly excites
  22. L26:1677 weakly suppresses
  23. L26:1446 weakly suppresses
  24. L26:770 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -15.58 and -14.971 values between -8.89 and -8.291 values between -7.68 and -7.071 values between -5.86 and -5.251 values between -4.03 and -3.431 values between -3.43 and -2.823 values between -2.82 and -2.212 values between -2.21 and -1.606 values between -1.60 and -1.0069 values between -1.00 and -0.393501 values between -0.39 and 0.22295 values between 0.22 and 0.8318 values between 0.83 and 1.443 values between 1.44 and 2.041 values between 2.04 and 2.652 values between 3.26 and 3.871 values between 3.87 and 4.471 values between 8.12 and 8.73offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. uition
  2. ienza
  3. NECTION
  4. ám
  5. oise
  6. 诿
  7. bstract
  8. ßer
  9. aseline
  10. ourcing

Suppresses

  1. composer
  2. terior
  3. (subject
  4. fare
  5. (rep
  6. atters
  7. entai
  8. adar
  9. lator
  10. Passage