Neuron Explorer

Qwen3-0.6B

end of document token

A neuron in layer 22 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron lights up on the marker that signals the end of one document and the start of an unrelated one. When it was turned up, the model produced long runs of repeated digits, which doesn't tell us much about its job.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    300K Trees in Nicosia”) NGO, Yesil Baris (Cyprus Green Action Group) NGO.⏎Started: February<|endoftext|>Public sector workers earned 1% less per hour, on average, than private

  2. #2 peak

    .⏎They found that only 12.5% were able to correctly answer the questions while some students took six minutes to do so.⏎The average time it<|endoftext|>Since that Egypt is known as the land of civilization, its ancient history along together

  3. #3 peak

    ccoli and mushroom omelette: Saute broccoli florets and sliced mushrooms and fold them into a fluffy egg omelette for a filling and nutritious breakfast.<|endoftext|>Hanukkah begins this year on December 1st, at sundown.

  4. #4 peak

    880 genera and 134 families. Moreover, the assemblage represents approximately 10% of the vascular flora of the Mediterranean.<|endoftext|>Christian Henriot, IAO (first draft,

  5. #5 peak

    yourself a few pretty pennies. For instance, a kilogram of basic carrots will cost you 69p at Sainsburys, 75<|endoftext|>by Lori Valigra⏎Mainebiz news story⏎Maine could stand

  6. #6 peak

    spiritual refuge or seek blessings from Lord Shiva. The calm and serene surroundings of the temple attract a lot of people. Its ancient architecture is even more attractive.<|endoftext|>Japanese art has a rich and varied history, spanning thousands of years and encompassing

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: In I Am I Am But The I I I In I The So This So So So So So I So So So So So I So So So So I So So So So I So So So So So I So So So So So

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    its DataSet. Dim thisDataSet As DataSet = CType(DataGrid1.DataSource, DataSet) ' Get the DataTableCollection. Dim tablesCollection As DataTableCollection = thisDataSet.Tables ' Get a specific table by name. Dim table As DataTable = tablesCollection("

  2. #2 peak

    under CC BY-NC-SA⏎Given an integer , the exponential sum version of the Gauss sum modulo is defined by⏎and the quadratic residue version is defined by⏎where is the Jacobi symbol, which has values

  3. #3 peak

    -south linear vent system over the past 5 million years; the most recent recorded eruption took place between 600 - 700 A.D. Harrat Khaybar contains a wide range of volcanic rock types and spectacular land

  4. #4 peak

    will be placed underwater or be exposed to water consistently.In applications where greater strength and hardness are required.The Difference Between 304 and 316 Stainless Steel Metal results for this questionWhat is electrical conductivity of 304 stainless?

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L18:2164 strongly suppresses
  2. L18:1105 strongly suppresses
  3. L19:909 strongly excites
  4. L21:759 excites
  5. L21:717 suppresses
  6. L21:524 suppresses
  7. L18:2043 excites
  8. L20:505 suppresses
  9. L18:572 excites
  10. L18:1808 suppresses
  11. L16:1579 excites
  12. L17:2706 suppresses
  13. L21:210 excites
  14. L19:1516 suppresses
  15. L20:79 excites
  16. L21:466 suppresses
  17. L20:577 excites
  18. L18:1950 excites opening parenthesis after a name or title
  19. L19:1197 suppresses
  20. L16:2964 suppresses
  21. L17:1772 suppresses
  22. L20:2405 suppresses
  23. L19:1875 suppresses
  24. L19:2090 excites

Feeds later layers

  1. L23:179 strongly suppresses
  2. L24:353 strongly suppresses decimal point inside a number
  3. L27:446 suppresses
  4. L26:114 suppresses
  5. L25:234 suppresses
  6. L27:1637 suppresses
  7. L26:1200 suppresses
  8. L27:137 suppresses
  9. L27:647 suppresses
  10. L27:1588 suppresses
  11. L26:157 excites
  12. L26:517 suppresses
  13. L26:773 suppresses
  14. L23:221 suppresses
  15. L27:452 suppresses
  16. L27:228 suppresses
  17. L27:508 suppresses
  18. L23:374 suppresses
  19. L26:810 suppresses
  20. L27:248 suppresses
  21. L23:298 suppresses
  22. L24:192 excites
  23. L25:484 suppresses
  24. L27:59 suppresses full stops in running text

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -36.66 and -35.551 values between -16.69 and -15.581 values between -12.25 and -11.142 values between -10.03 and -8.922 values between -8.92 and -7.817 values between -7.81 and -6.705 values between -6.70 and -5.598 values between -5.59 and -4.4810 values between -4.48 and -3.3720 values between -3.37 and -2.2648 values between -2.26 and -1.15150 values between -1.15 and -0.042805 values between -0.04 and 1.07829 values between 1.07 and 2.1810 values between 2.18 and 3.292 values between 3.29 and 4.392 values between 4.39 and 5.503 values between 5.50 and 6.612 values between 6.61 and 7.72offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. ·
  2. |
  3. Tube
  4. idelberg
  5. →
  6. .jquery
  7. .
  8. onn
  9. �
  10. 的方向

Suppresses

  1. However
  2. Therefore
  3. Unfortunately
  4. The
  5. This
  6. These
  7. Since
  8. Similarly
  9. Meanwhile
  10. Thus