Neuron Explorer

Qwen3-0.6B

unclear: punctuation before an explanation

A neuron in layer 17 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on small connecting marks, like a colon, bracket or comma, that come right before a detail, a value or a definition. It is hard to pin down more precisely, and turning it up mostly made the text drift into strings of numbers and maths.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    are also used to underline the superlative condition of an adjective (very nice) or it is also possible to turn an adjective into an adverb suffix mind (rapidisamamente).⏎A form of advertising comparisonThe superlative is used

  2. #2 peak

    as an example. It has the following data:⏎- Face value: $1,000⏎- Annual coupon rate: 5%⏎- Coupon Frequency: Annual⏎- Years to maturity: 10 years⏎- Yield to maturity

  3. #3 peak

    Lesson 9⏎9-9.A recognize positions of sides and angles in triangles⏎For any triangle KLM, name:⏎a. the side that is opposite angle KLM.⏎b. the angle whose sides are KL and KM .⏎9-

  4. #4 peak

    attractor describes the conditions that make the system behave chaotically.⏎The equations that govern the Lorenz attractor are⏎Lorenz attractor with r = 28, σ = 10, β<|endoftext|>Parshas Sh

  5. #5 peak

    for actual Olive (with the exception of the porous grain structure, which gives its true identity away easily), because both Ash and Olive are placed in the same family: Oleaceae.⏎The dark-on-light stripes of Olive Ash are also vaguely reminiscent

  6. #6 peak

    ,329 m (10,922 ft) high, though this varies with summit eruptions. It is the highest mountain in Italy south of the Alps. Etna covers an area of 1

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: the 1,400,000,000,000,000,00,0,0,0,0, 0, 0, 0, 0,

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    voltage 48V at the data inputs) can be programmed.⏎Our model no. is 884 with a serial no. of 00139⏎Kindly Donated by Callum Wilson.⏎With

  2. #2 peak

    77, the sequence of numbers such that their powers of 2 do not contain zeros: 1, 2, 3, 4, 5

  3. #3 peak

    |Number Of Pages||408|⏎Write a review⏎Note: HTML is not translated!⏎Rating: Bad Good⏎Enter the code in the box below:<|endoftext|>Everyday researchers around the world look for new therapies in hopes to shape the

  4. #4 peak

    would be "A". Number 2 would be "B". 3 is "C", and so on.⏎- Now, think of a country that starts with the letter you're thinking of<|endoftext|>

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L16:2204 excites
  2. L16:1704 excites
  3. L15:659 excites
  4. L15:1235 suppresses
  5. L13:484 excites
  6. L16:2375 excites
  7. L16:2837 excites
  8. L12:277 excites
  9. L14:3003 suppresses
  10. L16:1081 suppresses
  11. L15:2183 suppresses
  12. L15:1982 suppresses end-of-text token and answer-stating phrases
  13. L14:1104 excites
  14. L15:560 suppresses
  15. L14:1272 excites
  16. L16:2178 suppresses
  17. L15:577 suppresses
  18. L14:636 excites
  19. L15:2482 suppresses
  20. L16:1801 suppresses
  21. L15:1239 suppresses
  22. L16:2886 excites
  23. L16:1124 suppresses
  24. L16:2370 excites

Feeds later layers

  1. L18:1106 suppresses
  2. L20:805 suppresses
  3. L19:2204 suppresses
  4. L20:1001 suppresses
  5. L19:1169 suppresses
  6. L18:1699 suppresses
  7. L18:995 suppresses
  8. L19:1329 suppresses
  9. L18:2361 suppresses
  10. L20:769 suppresses
  11. L18:2768 suppresses
  12. L18:2042 suppresses
  13. L20:2298 suppresses
  14. L18:790 suppresses
  15. L19:248 excites
  16. L18:2843 suppresses
  17. L20:947 suppresses
  18. L20:796 suppresses
  19. L18:2513 suppresses
  20. L20:1406 suppresses
  21. L20:2648 suppresses
  22. L19:2382 suppresses
  23. L24:411 suppresses
  24. L19:1934 suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -3.76 and -3.531 values between -3.08 and -2.862 values between -2.41 and -2.181 values between -2.18 and -1.962 values between -1.96 and -1.742 values between -1.74 and -1.513 values between -1.51 and -1.293 values between -1.29 and -1.0614 values between -1.06 and -0.8417 values between -0.84 and -0.6157 values between -0.61 and -0.39441 values between -0.39 and -0.161936 values between -0.16 and 0.06781 values between 0.06 and 0.29320 values between 0.29 and 0.51140 values between 0.51 and 0.7481 values between 0.74 and 0.9643 values between 0.96 and 1.1924 values between 1.19 and 1.4114 values between 1.41 and 1.648 values between 1.64 and 1.862 values between 1.86 and 2.096 values between 2.09 and 2.313 values between 2.31 and 2.541 values between 2.54 and 2.761 values between 2.76 and 2.991 values between 2.99 and 3.211 values between 3.44 and 3.662 values between 5.01 and 5.23offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. OLF
  2. AppComponent
  3. 鹘
  4. 报记者
  5. 侘
  6. EIF
  7. Married
  8. 的人来说
  9. hurry
  10. ED

Suppresses

  1. ront
  2. MISS
  3. ilter
  4. iron
  5. ilities
  6. ilen
  7. posure
  8. empty
  9. _TEXTURE
  10. nic