Neuron Explorer

Qwen3-0.6B

the word 'just' after have or has

A neuron in layer 26 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron lights up on the word "just" when it means "a moment ago", as in "has just arrived" or "had just given birth". When it was turned up, the model's writing got stuck repeating "right" in a loop.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    it settled slowly behind the northern horizon. During the sunset's final minute, this remarkable sequence of 7 images follows the distorted edge of the solar disk as it just disappears against a distant tree line, capturing both a green and blue flash. Not

  2. #2 peak

    goal was to study 40 individual animals over that time in four different categories. The specimens ranged from the plumpest adults to haggard mothers who had just given birth and from doe-eyed pups to those skinny juveniles.⏎Mellish

  3. #3 peak

    half minutes before the rover landed. In the photo, the heat shield is roughly 50 feet (16 meters) away from the spacecraft, and had just been separated about three seconds earlier.⏎The heat shield is 15 feet (

  4. #4 peak

    RSP<|endoftext|>the story? . . . the Morning Glory cloud rolls majestically above Burketown.⏎The season for Morning Glory cloud⏎formations has just begun in the Gulf of Carpentaria and glider pilots and⏎scientists

  5. #5 peak

    Rome from an extended stay in Naples, he wrote that he felt as if "he had just had a cataract removed." For the rest of his stay in Italy,

  6. #6 peak

    in the pancreas by little clusters of cells, known as beta cells. Beta cells sense when there is an excess of glucose in the blood stream, such as just after a meal, and they send insulin

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional traditional

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    by the National Water-Quality Assessment (NAWQA) Program of the U.S. Geological Survey (USGS).1 Chloroform and other trihalomethanes, the most commonly detected compounds, were found in about 9 percent

  2. #2 peak

    , Leptoseris cucullata, and less common Madracis formosa, M. pharensis, M. decactis, Montastraea cavernosa, Porites divaricata, Scolymia cub

  3. #3 peak

    are formed when organic carbon reacts with chlorine, a chemical used to disinfect water against pathogenic organisms. DBPs include the groups of chemicals known as trihalomethanes and haloacetic acids. Health effects from long-term or chronic exposure

  4. #4 peak

    California, Kristin Belair picks the best grapes from 50 acres of vineyards to create high-end cabernet sauvignon and sauvignon blanc wines. Both are part of a growing number

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L20:180 suppresses
  2. L21:2130 suppresses
  3. L21:1226 weakly excites
  4. L18:81 weakly suppresses
  5. L20:1301 weakly suppresses
  6. L5:204 weakly excites
  7. L14:1730 weakly excites
  8. L16:86 weakly excites
  9. L21:2055 weakly suppresses
  10. L17:3034 weakly suppresses
  11. L18:2764 weakly excites
  12. L2:1296 weakly suppresses 'yet' ending a negated clause
  13. L2:1611 weakly suppresses
  14. L4:596 weakly suppresses
  15. L23:1900 weakly excites
  16. L23:2337 weakly suppresses
  17. L24:2727 weakly excites
  18. L23:892 weakly excites "the" in "over the past" time spans
  19. L8:341 weakly excites
  20. L21:2450 weakly excites
  21. L20:990 weakly excites
  22. L2:1374 weakly suppresses
  23. L21:583 weakly suppresses
  24. L19:2223 weakly suppresses

Feeds later layers

  1. L27:1046 strongly excites
  2. L27:1740 weakly excites
  3. L27:2565 weakly excites
  4. L27:1253 weakly suppresses
  5. L27:2667 weakly suppresses
  6. L27:3014 weakly excites
  7. L27:2027 weakly suppresses
  8. L27:1392 weakly excites
  9. L27:1425 weakly suppresses
  10. L27:2735 weakly suppresses
  11. L27:2120 weakly suppresses
  12. L27:951 weakly excites
  13. L27:1296 weakly excites
  14. L27:302 weakly excites
  15. L27:1211 weakly excites
  16. L27:292 weakly excites
  17. L27:1883 weakly suppresses word fragments before a name, 'ma' bias
  18. L27:859 weakly suppresses unclear: token just before a k sound
  19. L27:1254 weakly suppresses
  20. L27:2729 weakly excites
  21. L27:2281 weakly suppresses
  22. L27:2507 weakly excites
  23. L27:2713 weakly excites
  24. L27:195 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

2 values between -21.56 and -20.371 values between -19.18 and -17.991 values between -15.61 and -14.421 values between -14.42 and -13.235 values between -13.23 and -12.042 values between -12.04 and -10.852 values between -10.85 and -9.663 values between -9.66 and -8.472 values between -8.47 and -7.282 values between -7.28 and -6.083 values between -6.08 and -4.8910 values between -4.89 and -3.7012 values between -3.70 and -2.5168 values between -2.51 and -1.321456 values between -1.32 and -0.132161 values between -0.13 and 1.0681 values between 1.06 and 2.2531 values between 2.25 and 3.4419 values between 3.44 and 4.6312 values between 4.63 and 5.828 values between 5.82 and 7.014 values between 7.01 and 8.203 values between 8.20 and 9.394 values between 9.39 and 10.586 values between 10.58 and 11.781 values between 11.78 and 12.971 values between 12.97 and 14.161 values between 14.16 and 15.352 values between 21.30 and 22.491 values between 22.49 and 23.683 values between 24.87 and 26.06offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. just
  2. just
  3. Just
  4. Just
  5. JUST
  6. JUST
  7. "Just
  8. .just
  9. juste
  10. justo

Suppresses

  1. ertino
  2. .firebaseapp
  3. _locator
  4. uable
  5. Copenhagen
  6. chooser
  7. bdb
  8. STONE
  9. 踏
  10. unu