Neuron Explorer

Qwen3-0.6B

the word 'later' after a time span

A neuron in layer 21 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the word 'later' when it comes after a time span, like 'three hours later' or 'down the road later'. Turning it down made the model get stuck repeating the word 'later', which shows it is tied to that word.

Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    sustained winds of 75 mph (120 km/h).⏎Humberto’s winds peaked at 85 mph (137 km/h) later that same day, and continued at that strength through September 12 before the

  2. #2 peak

    Antitrypsin Deficiency was on Wednesday, September 4, 2019,” said Aspilche, who lives in Belgium.⏎Later, she received a genetic analysis that confirmed her disease and genotype: ZZ. That

  3. #3 peak

    Institute and father of two of the kids, had been tending to this tree, and was worried that it had suffered irreparable damage. But when he returned later, he was in for a surprise. The holes had been

  4. #4 peak

    raised after Howard had reached Glen Valley, found Cleve and Mick.⏎Within two days the group arrived at Glen Valley where, tragically, Cleve Cole died later that night. In memory of Cleve`s life, and in recognition of his

  5. #5 peak

    Not only does this help reduce injury during sports, it will promote over all comfort and well-being. Starting this habit early will help prevent chronic back and neck pain later on down the road.⏎Although unavoidable, there are

  6. #6 peak

    might also damage nearby organs that are exposed to the beams. This could lead to problems such as heart or lung damage, or even an increased risk of another cancer later on. Doctors do everything they<|endoftext|>Variety of electromagnetic radiation with frequencies between a

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: after a later, later, later, *subsequent* *after* after, after, after, after, later, later, after, after, after, after, later, after, after, after, later, after, after

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    012.⏎Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.3 or any later version published by the Free Software Foundation; with no Invariant Sections, no

  2. #2 peak

    basic treatment was developed by Lifshitz (1946), Zeldovich (1967) and Field (1974) and has been clearly incorporated in the well-known book by Weinberg (1972

  3. #3 peak

    the city, and there she became pregnant; the King decided to call the place "Pla del Bon Repos" ("Plain of good sleep"), a name that has been left to posterity and today is a suburb of Alicante.⏎In

  4. #4 peak

    assertions:⏎— The Founding Fathers didn’t considered the Declaration of independence a piece of propaganda.⏎— Thomas Jefferson didn’t say a word at the convention. And never gave a single speech as president. He would rather write than speak.⏎— Jefferson

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L20:1994 excites
  2. L17:2306 excites
  3. L16:2387 suppresses
  4. L18:1941 excites
  5. L15:2338 excites
  6. L17:2441 excites
  7. L12:1023 suppresses
  8. L16:1992 suppresses
  9. L17:1041 excites
  10. L18:2817 excites
  11. L12:2250 suppresses
  12. L20:1396 excites
  13. L17:1416 suppresses
  14. L20:990 excites
  15. L12:2111 excites
  16. L17:2973 suppresses
  17. L17:2964 suppresses
  18. L20:2530 suppresses
  19. L13:1327 suppresses
  20. L10:456 suppresses
  21. L18:2437 suppresses
  22. L14:1741 weakly excites
  23. L10:2099 weakly suppresses
  24. L11:2065 weakly suppresses

Feeds later layers

  1. L27:2471 strongly suppresses
  2. L23:1256 suppresses
  3. L22:1056 suppresses
  4. L26:865 suppresses
  5. L24:2668 suppresses
  6. L27:885 suppresses
  7. L25:2579 suppresses
  8. L24:693 suppresses
  9. L23:1283 suppresses
  10. L24:810 suppresses
  11. L22:1244 suppresses unclear: syllables inside Sanskrit religious words
  12. L23:462 suppresses
  13. L24:433 suppresses
  14. L25:1396 weakly suppresses
  15. L26:1725 weakly suppresses
  16. L27:1562 weakly suppresses
  17. L22:1607 weakly suppresses
  18. L25:63 weakly excites
  19. L27:1006 weakly suppresses
  20. L26:1673 weakly suppresses
  21. L25:806 weakly suppresses
  22. L22:1748 weakly suppresses
  23. L27:1082 weakly suppresses
  24. L23:3040 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -15.31 and -14.591 values between -14.59 and -13.871 values between -8.82 and -8.102 values between -8.10 and -7.381 values between -7.38 and -6.664 values between -5.94 and -5.2110 values between -5.21 and -4.499 values between -4.49 and -3.7711 values between -3.77 and -3.0521 values between -3.05 and -2.3335 values between -2.33 and -1.6169 values between -1.61 and -0.89874 values between -0.89 and -0.172486 values between -0.17 and 0.56212 values between 0.56 and 1.2847 values between 1.28 and 2.0028 values between 2.00 and 2.7227 values between 2.72 and 3.4411 values between 3.44 and 4.168 values between 4.16 and 4.8811 values between 4.88 and 5.619 values between 5.61 and 6.338 values between 6.33 and 7.054 values between 7.05 and 7.773 values between 7.77 and 8.495 values between 8.49 and 9.212 values between 9.21 and 9.932 values between 9.93 and 10.651 values between 10.65 and 11.384 values between 11.38 and 12.101 values between 12.82 and 13.54offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. phem
  2. ugg
  3. /tiny
  4. ophilia
  5. cura
  6. 奄
  7. vasive
  8. \t
  9. ình
  10. acles

Suppresses

  1. later
  2. 之后
  3. 以后
  4. 后
  5. afterwards
  6. afterward
  7. later
  8. 后的
  9. Later
  10. 後