Neuron Explorer

Qwen3-0.6B

end of document marker

A neuron in layer 18 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron lights up when one piece of text ends and an unrelated one begins, at the invisible end-of-document marker. Turning it up made the model's writing break down into repeated words and loops.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    target values⏎removes empty columns⏎imputes missing values with mean values⏎To remove default preprocessing, connect an empty Preprocess widget to the learner.<|endoftext|>Start Date: September 2012⏎Robert Waymouth and Christopher Ch

  2. #2 peak

    for the search of both extant and fossil biomarkers, but sequential extraction would be required to optimize the analysis of each of these in turn.⏎// end //<|endoftext|>Michigan has a diverse animal population because of its prime location between two of the world

  3. #3 peak

    A value of one represents⏎the entire of the character bounding box from the bottom of any⏎possible descenders to the top of any possible ascenders.<|endoftext|>What is Red Data Book?⏎The Red Data Book is a public document which is

  4. #4 peak

    agus níl aon rochtain againn ar shonraí a bhaineann le do chárta creidmheasa.<|endoftext|>WASHINGTON — Ancient bison DNA may help explain a longstanding mystery of North American wildlife

  5. #5 peak

    oid(), take three parameters called width, length and height and apply the relevant formula to calculate and return the volume of a cuboid based on the given dimensions.<|endoftext|>Approximately 35% of the United States population suffers from Divertic

  6. #6 peak

    wellandgood.com.<|endoftext|>The Technology Behind Bella Hadid’s Spray on Dress⏎During the 20

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: the idea of a specific, clearly defined, and successful, and by the end of this, I have found out about the details, and the other information, and the information about the other people, and the other information, and the other

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    100 it gets 1st grade and is very good.⏎If the sheep gets<|endoftext|>|Republic of Latvia⏎|Anthem: Dievs, svētī Latviju!⏎God Bless Latvia!⏎and largest city⏎|Eth

  2. #2 peak

    then else-syntax. However, since it is a function instead of syntax, it can be partially applied and passed around to higher order functions, like so:⏎ghci> :m + Data.Bool.Extras⏎ghci> let yesOrNo

  3. #3 peak

    be achieved with the following code:⏎TYPE List = REF RECORD next: List; value: INTEGER; END;⏎VAR x := NEW(List, value:=1); BEGIN x.next :=

  4. #4 peak

    Old Ind. grīva- “neck,” grīvā- “the back part of the

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L8:493 suppresses
  2. L17:834 excites
  3. L10:1270 excites
  4. L16:496 excites
  5. L15:574 suppresses
  6. L13:643 suppresses
  7. L3:1993 suppresses
  8. L4:1 excites
  9. L16:1295 excites
  10. L4:1605 suppresses
  11. L17:2603 excites
  12. L15:1048 excites
  13. L3:968 weakly excites
  14. L16:871 weakly suppresses
  15. L16:772 weakly suppresses
  16. L6:2467 weakly suppresses
  17. L8:407 weakly excites
  18. L9:1369 weakly suppresses
  19. L8:51 weakly excites
  20. L4:1428 weakly suppresses
  21. L3:1933 weakly excites
  22. L4:1173 weakly excites
  23. L15:524 weakly excites
  24. L3:5 weakly excites

Feeds later layers

  1. L22:1400 excites
  2. L21:341 excites
  3. L20:910 excites
  4. L20:843 excites
  5. L19:1650 excites
  6. L19:796 excites
  7. L22:2957 excites
  8. L20:2199 excites
  9. L20:3033 excites
  10. L20:508 suppresses
  11. L20:2899 excites
  12. L24:2050 excites
  13. L20:2816 excites
  14. L19:3011 excites
  15. L21:3045 excites
  16. L19:1280 excites end-of-document token between unrelated texts
  17. L22:2553 excites
  18. L22:490 excites
  19. L22:1105 weakly excites
  20. L19:1404 weakly excites
  21. L21:1548 weakly excites 'at' in time and occasion phrases
  22. L21:659 weakly excites end of document boundary
  23. L25:733 weakly excites
  24. L21:2243 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

2 values between -1.15 and -0.958 values between -0.95 and -0.7551 values between -0.75 and -0.56230 values between -0.56 and -0.36985 values between -0.36 and -0.172579 values between -0.17 and 0.0332 values between 0.03 and 0.224 values between 0.22 and 0.421 values between 0.42 and 0.612 values between 0.61 and 0.812 values between 0.81 and 1.004 values between 1.20 and 1.391 values between 1.98 and 2.172 values between 2.57 and 2.761 values between 3.54 and 3.741 values between 4.32 and 4.521 values between 4.71 and 4.911 values between 4.91 and 5.101 values between 6.47 and 6.66offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. BoxFit
  2. .lua
  3. !$
  4. aravel
  5. inston
  6. .scala
  7. NGX
  8. .dart
  9. еж
  10. üst

Suppresses

  1. 铅
  2. част
  3. ,char
  4. анны
  5. ,ID
  6. idas
  7. pole
  8. /pi
  9. ónica
  10. (bt