Neuron Explorer

Qwen3-0.6B

unclear: word starts like Ag and Re

A neuron in layer 26 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron responds to the first piece of certain names and words, such as 'Ag' in Agatha or Agudat, and 'eg' in Aedes aegypti. Its strongest negative cases are the start of words like 'Reproduced'. The model's output under steering was broken, so the role is not clear.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    disagreements over religious observances and liturgy, a group of more traditional members left to establish a separate Orthodox service. In time, this group evolved into the congregation Agudat Achim.⏎During this same period, B’nai Israel was finding

  2. #2 peak

    as 850 meters or half a mile or so (see P. Reiter et al., "Short Report: Dispersal of Aedes Aegypti in an Urban Area After Blood Feeding as Demonstrated by Rub

  3. #3 peak

    smell what The Rock is cooking?" He used illeism deliberately to exaggerate his self-importance.⏎Think also of the character Hercule Poirot in Agatha Christie’s mysteries. Christie often portrayed the detective as referring to himself in the

  4. #4 peak

    mother of Geb and Nut.⏎Tefnut and her husband Shu were the children of Atum who created them by masturbating. When Atum became associated with Re, Re became Tefnut's father. According to one myth, Tef

  5. #5 peak

    let you off the hook, even if you got 98 out of 100 on an exam.⏎Back to top⏎The Role of Indirect Aggression⏎What goes on outside the home is also a big factor in the development

  6. #6 peak

    speed wind streams in solar and stellar coronal holes, and plasma heating in closed magnetic structures. Dr. Davila<|endoftext|>Life Cycle and Information on Aedes Aegypti Mosquito

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately:dd cde dde dde cde cde cde cde cde cde cde cde cde dde cde cde

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    .<|endoftext|>MLA style for documentation is widely used in the humanities, especially in writing on language and literature.⏎One standard citation format applies to every source type⏎Reproduced from https://style.mla.org/whats-new/⏎Author.

  2. #2 peak

    29 Gastrooesophageal reflux disease⏎Musculoskeletal system 32 Osteoporosis⏎Endocrine system 35 Diabetes mellitus⏎Reproductive system 37 Erectile dysfunction⏎

  3. #3 peak

    og, acid rain, carbon monoxide, fossil fuel exhausts, and tropospheric ozone have in common? They are all examples of air pollution.<|endoftext|>Revealing the art and architecture of Vijayanagara Empire, Vittala Temple

  4. #4 peak

    improved infrastructure and higher wages isn’t cheap for smaller companies like his. The result, he says, is “a glut of skilled workers on the streets now.”⏎Reactions by western garment industry leaders

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L23:1695 suppresses
  2. L21:162 excites
  3. L18:335 weakly suppresses
  4. L24:1232 weakly excites
  5. L22:1392 weakly excites
  6. L6:2195 weakly excites
  7. L7:2095 weakly suppresses
  8. L6:2341 weakly excites 'mean' after 'doesn't' in 'just because' sentences
  9. L1:2915 weakly excites
  10. L2:1745 weakly excites
  11. L23:1621 weakly excites
  12. L22:2003 weakly suppresses
  13. L17:389 weakly excites
  14. L16:83 weakly excites
  15. L14:1929 weakly excites
  16. L19:377 weakly suppresses
  17. L5:236 weakly excites
  18. L19:2996 weakly excites
  19. L6:413 weakly excites
  20. L17:1627 weakly excites
  21. L4:1197 weakly suppresses
  22. L10:269 weakly suppresses joining word in a list
  23. L10:2909 weakly excites
  24. L15:2634 weakly suppresses

Feeds later layers

  1. L27:552 strongly suppresses
  2. L27:310 suppresses
  3. L27:845 suppresses
  4. L27:1680 weakly suppresses
  5. L27:343 weakly excites
  6. L27:1683 weakly excites
  7. L27:305 weakly suppresses
  8. L27:1905 weakly excites
  9. L27:2496 weakly suppresses
  10. L27:2948 weakly suppresses
  11. L27:1579 weakly excites
  12. L27:1284 weakly excites
  13. L27:2686 weakly excites
  14. L27:2570 weakly suppresses 'con' starting a word piece
  15. L27:2915 weakly excites
  16. L27:557 weakly suppresses
  17. L27:2504 weakly excites
  18. L27:2585 weakly excites
  19. L27:1713 weakly suppresses
  20. L27:1522 weakly excites
  21. L27:833 weakly excites
  22. L27:2497 weakly excites
  23. L27:1346 weakly excites
  24. L27:837 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -26.80 and -25.611 values between -18.51 and -17.331 values between -13.77 and -12.594 values between -11.41 and -10.222 values between -10.22 and -9.045 values between -9.04 and -7.852 values between -7.85 and -6.673 values between -6.67 and -5.493 values between -5.49 and -4.308 values between -4.30 and -3.1212 values between -3.12 and -1.9372 values between -1.93 and -0.753397 values between -0.75 and 0.44357 values between 0.44 and 1.6215 values between 1.62 and 2.8010 values between 2.80 and 3.995 values between 3.99 and 5.176 values between 5.17 and 6.362 values between 6.36 and 7.541 values between 12.28 and 13.461 values between 19.38 and 20.56offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. 版权归原
  2. ưới
  3. acci
  4. ights
  5. 亭
  6. итель
  7. eger
  8. Nest
  9. NEL
  10. 簽

Suppresses

  1. d
  2. d
  3. *d
  4. .d
  5. >d
  6. "d
  7. [d
  8. д
  9. <d
  10. ,d