Neuron Explorer

Qwen3-0.6B

end of document token

A neuron in layer 14 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron lights up on the invisible marker that separates one web page from the next. Turning it up mostly made the model ramble or repeat itself, with no clear link to the marker.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    to large step sizes.⏎- Scott E. Fahlman: An Empirical Study of Learning Speed in Back-Propagation Networks, September 1988<|endoftext|>Cardio and weight

  2. #2 peak

    of your hand.⏎Have an amazing project to share? The Electronics Show and Tell is every Wednesday at 7pm ET! To join, head over to YouTube<|endoftext|>Definition of Parabola

  3. #3 peak

    for dark matter in combination with Cold Dark Matter theory and not on its own.⏎This page was last updated June 27, 2015.<|endoftext|>05-11-2009 / Fluvirin –

  4. #4 peak

    Chapter 6 Exercise 6.5, we have discussed the Pythagoras theorem. Other important topics related to the chapter are covered in the following exercises.<|endoftext|>What you will learn in this module⏎Understand different tasks that have to be

  5. #5 peak

    based in part on a lesson by Artis West of North Cobb High School in Kennesaw, Georgia. That lesson plan is included in Featured Lesson Plans.)<|endoftext|>OnabotulinumtoxinA injection is given as a number of tiny

  6. #6 peak

    that it is likely that both of these arguments are correct.”⏎See Johnson’s report at www.mackblackwell.org/web/research/final-reports.htm.<|endoftext|>September 15, 2013 - Tropical Storm Humberto (

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: And so, the second, and the third, and the fourth, and this, and the first, and the second, and, and, and, and, and, and, and, and, and, and, and, and

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    and the sign of the first term.⏎- Have them develop an explicit formula for each sequence.⏎2. A company is offering to pay you one penny on your first day at work and each day after that your salary would triple. Assume you work

  2. #2 peak

    a matrix⏎Find nth maximum⏎Matlab Basics II - Create a vector with a repeated entry⏎Create sequnce 1 4 9 16 25.........⏎Basics: Divide integers to get integer

  3. #3 peak

    Draw PA, PB and PC⏎from P perpendicular to the sides of the triangle where A, B and C⏎are points on the sides. Prove that PA + PB + PC is a constant.⏎Can you decide whether two lines are perpendicular

  4. #4 peak

    learning!⏎- Line up the bowls on an elevated surface (coffee table, ottoman, TV stand). Put one ball in the first bowl, two balls in the second, and so on. Count aloud as you go.⏎- Do a color

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L12:1884 strongly excites
  2. L11:876 excites 'other' after 'among' in lists
  3. L12:2784 suppresses
  4. L11:1777 suppresses
  5. L11:1178 excites
  6. L13:2412 excites
  7. L13:2787 suppresses
  8. L13:1980 suppresses
  9. L13:996 excites
  10. L13:2517 suppresses
  11. L13:1665 excites
  12. L12:417 excites
  13. L13:1541 excites
  14. L13:940 excites
  15. L12:1603 excites
  16. L12:763 suppresses
  17. L13:2294 excites
  18. L13:1595 suppresses
  19. L13:2891 excites
  20. L12:1505 suppresses
  21. L12:2723 excites
  22. L13:1389 suppresses
  23. L12:765 suppresses
  24. L13:2381 suppresses

Feeds later layers

  1. L17:2726 strongly suppresses
  2. L15:2359 suppresses
  3. L15:457 excites
  4. L15:60 excites
  5. L15:2349 excites
  6. L15:2418 suppresses
  7. L15:234 excites
  8. L16:2327 suppresses
  9. L15:1949 suppresses
  10. L18:2138 suppresses
  11. L15:2737 suppresses
  12. L15:2002 suppresses
  13. L18:2346 suppresses
  14. L15:412 suppresses
  15. L15:1610 suppresses
  16. L15:1067 suppresses
  17. L19:2013 suppresses
  18. L17:1491 suppresses
  19. L15:137 excites
  20. L15:132 excites
  21. L16:1809 suppresses comma inside a list of names or acronyms
  22. L15:1385 suppresses
  23. L15:1431 suppresses
  24. L20:882 suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -4.02 and -3.871 values between -2.99 and -2.841 values between -2.84 and -2.691 values between -2.54 and -2.401 values between -2.25 and -2.101 values between -2.10 and -1.951 values between -1.95 and -1.801 values between -1.80 and -1.665 values between -1.66 and -1.513 values between -1.51 and -1.363 values between -1.36 and -1.213 values between -1.21 and -1.0711 values between -1.07 and -0.9210 values between -0.92 and -0.7715 values between -0.77 and -0.6230 values between -0.62 and -0.4743 values between -0.47 and -0.33140 values between -0.33 and -0.18568 values between -0.18 and -0.031900 values between -0.03 and 0.12947 values between 0.12 and 0.27177 values between 0.27 and 0.4123 values between 0.41 and 0.5610 values between 0.56 and 0.713 values between 0.71 and 0.864 values between 0.86 and 1.002 values between 1.15 and 1.301 values between 1.30 and 1.451 values between 1.59 and 1.741 values between 1.74 and 1.89offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. esub
  2. istinguished
  3. ubs
  4. >true
  5. *out
  6. empo
  7. reffen
  8. ious
  9. Kling
  10. onic

Suppresses

  1. 第五
  2. setVisibility
  3. 铁
  4. third
  5. 第三
  6. handles
  7. 第四
  8. 第七
  9. scores
  10. dera