Neuron Explorer

Qwen3-0.6B

'the' right after 'On' in 'On the other hand'

A neuron in layer 0 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron reacts to the word 'the' when it comes straight after 'On', as in 'On the other hand' or 'On the contrary'. Turning it up made the model get stuck repeating words like 'the number of', which does not match the trigger.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    MR file formats does not make for very exciting⏎reading. On the other hand many NMR spectroscopists have experienced the⏎frustration

  2. #2 peak

    olds plants every four to six weeks. On the contrary, you can also use organic gardeners to work in plenty of compost at

  3. #3 peak

    transformed these unlikely men, most of them elitist, militaristic, and fiercely nationalistic, into martyrs to a universal ideal?⏎The resisters in On the Road to the Wolf’s Lair are not the singular souls doomed to failure by the

  4. #4 peak

    default on a loan or not. For this, you have a target variable i.e. ‘defaulting on loan’, which is a supervised learning problem. On the other hand, customer segmentation in a market has no target variable which makes it an

  5. #5 peak

    success I have enjoyed as a man,” Peterson said in a statement.⏎Among those coming to Peterson’s defense was NBA Hall of Famer Charles Barkley. On the CBS pregame show The NFL Today, Barkley recalled childhood beatings. “

  6. #6 peak

    On the other side, they⏎should write one sentence about Abraham Lincoln's life. After

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: I have been thinking about what is the main thing for the next project. I have been thinking about the project I am thinking about. I have been thinking about the project. I have been thinking about the project. I have been thinking about

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    5 eroding from a bank at approximately⏎25 cm below the current terrain⏎surface (see in-situ photo below).⏎Its front surface,⏎face down in the photo, is carved

  2. #2 peak

    and perhaps as quickly as 30 days - an incredible accomplishment for what was thought to be a loosely organized society consisting of small, widely scattered bands of foragers.⏎"What's extraordinary about these findings is that it provides some of the first evidence

  3. #3 peak

    which migrate to the dermis and trigger the release of cytokines in particular the tumor necrosis factor-alpha which causes skin inflammation which is coupled by increased production

  4. #4 peak

    inside them…” (Inferno 8, line, 73). This is meant to warn the narrator that the city dwellers are hostile and inhuman to strangers. They even further refer

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

None: this is the first layer.

Feeds later layers

  1. L16:792 excites "the" inside a prepositional phrase
  2. L26:1941 weakly excites
  3. L9:24 weakly excites "the" before a named organisation or title
  4. L3:719 weakly excites digits inside numbers and statistics
  5. L26:1080 weakly excites
  6. L16:419 weakly excites
  7. L18:641 weakly excites
  8. L23:288 weakly suppresses
  9. L6:419 weakly excites
  10. L1:1566 weakly suppresses
  11. L18:2243 weakly suppresses
  12. L23:1406 weakly excites
  13. L13:477 weakly excites
  14. L22:1318 weakly suppresses
  15. L2:2838 weakly suppresses 'Head Start' and 'follow up'
  16. L27:6 weakly excites
  17. L2:766 weakly suppresses
  18. L21:614 weakly excites
  19. L14:1169 weakly excites
  20. L11:2201 weakly excites
  21. L23:2214 weakly suppresses
  22. L17:30 weakly excites
  23. L17:1652 weakly suppresses
  24. L20:1246 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

8 values between -0.63 and -0.5034 values between -0.50 and -0.3714 values between -0.37 and -0.24167 values between -0.24 and -0.112438 values between -0.11 and 0.031051 values between 0.03 and 0.1669 values between 0.16 and 0.2911 values between 0.29 and 0.427 values between 0.42 and 0.555 values between 0.55 and 0.682 values between 0.68 and 0.813 values between 0.81 and 0.944 values between 0.94 and 1.071 values between 1.07 and 1.204 values between 1.20 and 1.332 values between 1.33 and 1.463 values between 1.46 and 1.592 values between 1.59 and 1.722 values between 1.72 and 1.854 values between 1.98 and 2.112 values between 2.11 and 2.246 values between 2.24 and 2.375 values between 2.37 and 2.502 values between 2.50 and 2.6313 values between 2.63 and 2.764 values between 2.76 and 2.8911 values between 2.89 and 3.036 values between 3.03 and 3.163 values between 3.16 and 3.291 values between 3.29 and 3.421 values between 3.42 and 3.551 values between 3.55 and 3.685 values between 3.68 and 3.812 values between 3.81 and 3.942 values between 3.94 and 4.075 values between 4.07 and 4.207 values between 4.20 and 4.331 values between 4.46 and 4.59offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. above
  2. main
  3. opposite
  4. critical
  5. attached
  6. around
  7. amount
  8. company
  9. feet
  10. objective

Suppresses

  1. unnel
  2. üssen
  3. ossa
  4. utra
  5. 下来的
  6. 回事
  7. 不高
  8. 走过
  9. 素质教育
  10. villa