Neuron Explorer

Qwen3-0.6B

comma after 'if' clause in prose, braces in code

A neuron in layer 21 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

In ordinary writing, this neuron fires on the comma that ends an 'if ... ' clause, just before the 'then' part of the sentence. Its opposite side fires on programming punctuation like braces and brackets. Turning it down made the model output repeated curly braces, which matches that code side.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    heaven, he wept on that migration and hence every child of Adam (as), weeps when he opens his eyes in this world. If this is true, then this reason for wailing certainly supports our point of view that in the grief

  2. #2 peak

    acceptable.⏎The skeptic seemed to be saying that if a certain behavior is found in the Old Testament narratives, and that behavior is not specifically condemned in those same narratives, then the narratives are teaching that this behavior is morally acceptable.⏎Is that how we

  3. #3 peak

    rum are specific approaches for Agile software development.” - Sam Newman (Building Microservices)⏎If microservices is about doing SOA (Service orientated architecture) well, it is probably worth looking at the SOA tenets:⏎- Services are autonomous

  4. #4 peak

    00 or 1000 experiments, then it is high probability that the hypothesis has been refuted.⏎If the hypothesis failed in their experiments, repeatedly, the scientist can do one of two things:⏎- He

  5. #5 peak

    and cause what are referred to as “cosmetic” skin cancers, but no direct evidence that it creates the deadly malignant melanoma.⏎If this were the case, then everyone who lives in the tropics<|endoftext|>

  6. #6 peak

    most open-source packages use this format to zip their files. If you are new to Linux or recently encountered the problem of unzipping the .tgz file, then you don’t have to worry this guide will teach you ways of

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: { { { { { { { { { { { { { { { { { { { { { { { {

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    !⏎xs = [6, 9, 13, 42]⏎-- Without library⏎f :: Bool -> [Int]⏎f b = if b then xs else ⏎-- With library⏎g :: Bool -> [Int]⏎g

  2. #2 peak

    correcting the other code (too tired to check who it was that posted it, and I can't see just now anyway :P)⏎void genFactorial(int x, int t)⏎int total = t; // you probably wouldn't even need

  3. #3 peak

    - but look at the C++-tagged posts in this blog for examples of what the compiler thinks isn't a bad idea.)⏎if (x=0) init_subsystem();⏎So lots of books have been written about how to write code

  4. #4 peak

    as:⏎void * memchr ( const void *, int, size_t );⏎instead of the two overloaded versions provided in C++.⏎/* memchr example */⏎int main ()⏎char * pch;⏎char str = "Example string";⏎pch = (

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L19:1084 strongly suppresses "and" joining clauses after a condition
  2. L20:122 strongly excites
  3. L16:2066 excites
  4. L16:1174 excites
  5. L20:2280 excites
  6. L15:725 suppresses
  7. L17:580 suppresses
  8. L18:1470 suppresses comma after an introductory phrase
  9. L16:2782 excites
  10. L17:243 suppresses
  11. L20:206 excites
  12. L17:1048 suppresses
  13. L11:237 suppresses
  14. L19:1979 excites
  15. L16:1838 excites
  16. L18:2139 suppresses
  17. L14:2194 suppresses
  18. L16:768 excites
  19. L20:2429 excites
  20. L18:1639 excites
  21. L16:1365 excites
  22. L16:669 excites
  23. L20:2274 excites
  24. L15:2295 suppresses

Feeds later layers

  1. L24:880 strongly suppresses
  2. L24:405 strongly suppresses
  3. L25:386 strongly suppresses
  4. L23:881 strongly suppresses
  5. L24:1443 suppresses
  6. L23:292 suppresses
  7. L27:1779 suppresses
  8. L25:1425 suppresses
  9. L27:967 suppresses
  10. L27:2506 suppresses
  11. L26:461 suppresses 'Sch' in surnames
  12. L22:1755 suppresses
  13. L27:1324 suppresses
  14. L27:1006 suppresses
  15. L27:1964 suppresses
  16. L25:2175 suppresses
  17. L23:221 suppresses
  18. L25:465 excites
  19. L25:255 suppresses pieces of split scientific or place names
  20. L25:865 suppresses
  21. L22:2197 weakly suppresses
  22. L27:860 weakly suppresses
  23. L26:1734 weakly suppresses 'the/as' before 'following'
  24. L25:769 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -3.24 and -3.131 values between -2.77 and -2.662 values between -2.66 and -2.541 values between -2.07 and -1.952 values between -1.37 and -1.251 values between -1.25 and -1.131 values between -1.13 and -1.021 values between -0.90 and -0.781 values between -0.78 and -0.666 values between -0.66 and -0.554 values between -0.55 and -0.4323 values between -0.43 and -0.3154 values between -0.31 and -0.20151 values between -0.20 and -0.08792 values between -0.08 and 0.041079 values between 0.04 and 0.16681 values between 0.16 and 0.27421 values between 0.27 and 0.39256 values between 0.39 and 0.51174 values between 0.51 and 0.63116 values between 0.63 and 0.7464 values between 0.74 and 0.8635 values between 0.86 and 0.9826 values between 0.98 and 1.099 values between 1.09 and 1.215 values between 1.21 and 1.331 values between 1.33 and 1.45offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. abyrinth
  2. "};⏎⏎
  3. 辕
  4. },⏎⏎
  5. edium
  6. asion
  7. esters
  8. onta
  9. byter
  10. "};⏎

Suppresses

  1. {⏎
  2. ){⏎
  3. '){⏎
  4. }{⏎
  5. '){
  6. ){⏎
  7. {⏎
  8. { ⏎
  9. {⏎⏎
  10. "){