Neuron Explorer

Qwen3-0.6B

question mark after a rhetorical question

A neuron in layer 17 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron lights up on the question mark at the end of a question an essay asks itself, like 'But what exactly is mulch?'. Turning it up made the model's output wander into loose, unfocused text, with no clear topic.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    the practice isn’t effective we run the risk of making permanent misconceptions.⏎But what is “perfect” practice? Can “perfect” practice really exist? I do not think that “perfect”

  2. #2 peak

    other, because both incur charges of “Denier!” to those who dare to question the consensus. Yet how solid is the consensus on human-caused climate change? Consider some recent news:⏎Angkor Wat’s Collapse From Climate Change Has Lessons for

  3. #3 peak

    of Damascus,<|endoftext|>You’ve probably heard the term or maybe know someone who claims to be following such a food regimen: Clean Eating. What exactly does it mean? I read several articles, all with varying definitions and exceptions. I’ll do my

  4. #4 peak

    question is whether the evidence is substantial enough to claim a discovery. And if a discovery can be claimed, the final question is what, exactly, has been discovered? Scientists can have complete confidence in their results but remain uncertain about how to interpret them

  5. #5 peak

    doubled, to over 1.2 million between 2001 and 2011.⏎But how prevalent are highly diverse neighbourhoods across England? And should we expect their numbers to keep growing?⏎Multi-ethnic neighbourhoods in

  6. #6 peak

    not the only thing requiring amends, and Indigenous people still face a great deal of social issues in modern day Canada. So what is the extent of these issues? And most importantly, what is being done about it?⏎Whilst only constituting

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: I am now, now and now now now now now now now now now now now now now now now now now now now now now now now now now now now now now now now now now now now now now now now now now now

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    and building was sanctified" [POOLE].⏎the tower of Meah--This word is improperly considered, in our version, as the name of a tower; it is the Hebrew word for "a hundred," so that the meaning is:

  2. #2 peak

    “pumpkin pie” smoothie! Place the following in a blender:⏎• 3-4 tablespoons of canned organic pumpkin (just the pumpkin puree – because pumpkin pie filling has lots of added sugar)⏎• Two tablespoons of Greek yogurt

  3. #3 peak

    ron sputtering is widely used to deposit thin films on a range of substrates, including glass and ceramics. The technology can be easily scaled to larger dimensions; it offers a high deposition rate (allowing a high level of productivity) and

  4. #4 peak

    people.) For pints, use one tablespoon bottled lemon juice or ¼ teaspoon citric acid. Acid can be added directly to the jars before filling with product; in fact, this is recommended to be sure you get the acid in each and

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L9:103 excites "as" or "since" giving a reason
  2. L16:1112 suppresses
  3. L15:403 suppresses period inside an abbreviation
  4. L9:12 suppresses
  5. L9:7 excites
  6. L4:96 excites
  7. L1:441 weakly suppresses
  8. L10:33 weakly suppresses
  9. L14:35 weakly suppresses
  10. L14:1209 weakly excites
  11. L15:1861 weakly excites
  12. L10:612 weakly excites full stop ending boilerplate or a title
  13. L11:132 weakly excites period ending an opening topic sentence
  14. L15:1260 weakly excites
  15. L14:451 weakly excites
  16. L16:1081 weakly suppresses
  17. L9:1113 weakly suppresses
  18. L8:304 weakly suppresses
  19. L16:797 weakly excites
  20. L6:250 weakly excites
  21. L9:819 weakly suppresses
  22. L13:345 weakly excites
  23. L12:878 weakly suppresses
  24. L10:1459 weakly suppresses

Feeds later layers

  1. L25:1316 weakly suppresses
  2. L26:405 weakly suppresses
  3. L25:1902 weakly excites
  4. L19:2811 weakly excites
  5. L18:613 weakly excites
  6. L18:2262 weakly suppresses
  7. L27:528 weakly suppresses
  8. L20:1190 weakly excites
  9. L24:2610 weakly excites
  10. L19:2041 weakly suppresses
  11. L24:1630 weakly excites
  12. L25:553 weakly excites
  13. L19:43 weakly suppresses
  14. L19:2787 weakly suppresses
  15. L24:2581 weakly suppresses
  16. L26:825 weakly excites
  17. L18:2593 weakly excites
  18. L26:509 weakly excites
  19. L27:1244 weakly suppresses
  20. L22:2701 weakly suppresses
  21. L25:509 weakly excites
  22. L20:467 weakly excites
  23. L19:973 weakly excites
  24. L24:205 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -5.44 and -5.162 values between -4.88 and -4.602 values between -4.60 and -4.321 values between -4.32 and -4.041 values between -4.04 and -3.764 values between -3.76 and -3.473 values between -3.19 and -2.915 values between -2.91 and -2.636 values between -2.63 and -2.358 values between -2.35 and -2.0715 values between -2.07 and -1.7916 values between -1.79 and -1.5132 values between -1.51 and -1.2344 values between -1.23 and -0.9542 values between -0.95 and -0.66100 values between -0.66 and -0.38662 values between -0.38 and -0.102256 values between -0.10 and 0.18556 values between 0.18 and 0.4661 values between 0.46 and 0.7426 values between 0.74 and 1.0212 values between 1.02 and 1.3012 values between 1.30 and 1.5911 values between 1.59 and 1.875 values between 1.87 and 2.159 values between 2.15 and 2.438 values between 2.43 and 2.713 values between 2.71 and 2.991 values between 2.99 and 3.272 values between 3.55 and 3.831 values between 4.40 and 4.681 values between 5.52 and 5.80offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. ellers
  2. ryo
  3. propri
  4. Overs
  5. }`
  6. plete
  7. appers
  8. }\"
  9. ltr
  10. bers

Suppresses

  1. 这点
  2. 这也
  3. 这样
  4. thus
  5. así
  6. 这项
  7. this
  8. 这样一个
  9. hence
  10. 这么