Neuron Explorer

Qwen3-0.6B

comma after month and day

A neuron in layer 21 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the comma that comes after a month and day in a news dateline, such as 'Dec. 7, 2005'. Turned down, the model drifted into talk about prime ministers and government. Turned up, the output was not clearly related.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    audio⏎OAK RIDGE, Tenn., Dec. 7, 2005 — Forest productivity may be significantly greater in an atmosphere enriched

  2. #2 peak

    when the family moved to the U.S.⏎The<|endoftext|>NASA asks future explorers to respect historic landing sites⏎By David Szondy⏎May 27, 2012⏎When the last American astronauts blasted off from the Moon

  3. #3 peak

    in the journal The Plant Cell, opens the door to the engineering of plant clock systems, with powerful applications to agriculture.⏎(PRWeb UK) March 17, 2010 -- Researchers at the RIKEN Plant Science Center have

  4. #4 peak

    Capital News – Dec. 3, 2017);⏎- “Icy road leads to crash” (

  5. #5 peak

    Mars Rover Curiosity: Mars Science Lab Coverage⏎- 1st Photos of Mars by Curiosity Rover (Gallery)⏎Copyright 2012 SPACE.com, a TechMediaNetwork company. All rights reserved. This material may not

  6. #6 peak

    rover Curiosity makes historic Mars landing, beams back photos⏎Irene Klotz Reuters⏎12:17 p.m. EDT, August 8, 2012⏎PASADENA, California (Reuters) –

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: the number of the prime number 1000, the number of the prime number 1000000, and the number of the prime number 10000000. The number of the

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    Nuclear Power Station in the wake of the natural disaster, leading to concerns of a potential nuclear catastrophe, according to the U.S. Nuclear Regulatory Commission.⏎The Department of Energy has sent two experts to Japan -- an emergency response representative and a nuclear engineer

  2. #2 peak

    crisis of 1973/74 that ended the "economic miracle" once and for all. By the time Herbert Grünewald succeeded Kurt Hansen as Management Board Chairman following the 1974 Annual Stockholders' Meeting,

  3. #3 peak

    own communities, and resolve once more to advance religious freedom in our time.⏎Melissa Rogers, a widely respected advocate for religious liberty who currently serves as special assistant to the president and executive director of the White House Office of Faith-based and Neighborhood Partners

  4. #4 peak

    the Civil Rights Act turning 50, the success of the struggle for equal rights for women and minorities<|endoftext|>The No Child Left Behind Act, signed into law by President Bush January 8, 2002 includes as one of its

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L20:2169 excites
  2. L3:933 suppresses
  3. L10:3006 weakly excites
  4. L8:1741 weakly suppresses
  5. L11:3056 weakly suppresses
  6. L20:1474 weakly suppresses
  7. L20:2605 weakly suppresses
  8. L20:253 weakly excites
  9. L3:2066 weakly excites
  10. L1:94 weakly suppresses
  11. L9:2295 weakly suppresses
  12. L8:2224 weakly suppresses
  13. L18:1762 weakly excites
  14. L20:525 weakly excites
  15. L6:2535 weakly suppresses
  16. L20:115 weakly suppresses
  17. L13:2682 weakly suppresses
  18. L4:1137 weakly suppresses
  19. L18:468 weakly excites
  20. L17:1857 weakly excites
  21. L6:2330 weakly suppresses
  22. L8:2939 weakly suppresses
  23. L20:520 weakly suppresses
  24. L17:1108 weakly excites

Feeds later layers

  1. L23:2987 weakly suppresses
  2. L22:1661 weakly suppresses
  3. L27:863 weakly suppresses
  4. L22:2201 weakly suppresses
  5. L23:2845 weakly suppresses
  6. L22:1577 weakly suppresses
  7. L27:2781 weakly suppresses
  8. L22:593 weakly suppresses
  9. L27:3039 weakly suppresses
  10. L23:2039 weakly suppresses
  11. L22:2988 weakly suppresses
  12. L22:921 weakly excites
  13. L22:2950 weakly suppresses
  14. L22:705 weakly suppresses
  15. L25:1536 weakly suppresses
  16. L23:748 weakly suppresses
  17. L25:2000 weakly suppresses
  18. L22:2129 weakly suppresses
  19. L23:1728 weakly excites
  20. L25:1204 weakly excites
  21. L25:2851 weakly suppresses
  22. L23:954 weakly suppresses
  23. L22:1030 weakly suppresses
  24. L22:133 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -36.34 and -35.111 values between -30.19 and -28.961 values between -28.96 and -27.732 values between -24.03 and -22.801 values between -21.57 and -20.342 values between -17.88 and -16.651 values between -16.65 and -15.421 values between -15.42 and -14.191 values between -14.19 and -12.951 values between -12.95 and -11.722 values between -10.49 and -9.267 values between -9.26 and -8.038 values between -8.03 and -6.8011 values between -6.80 and -5.5723 values between -5.57 and -4.3428 values between -4.34 and -3.1170 values between -3.11 and -1.87201 values between -1.87 and -0.643248 values between -0.64 and 0.59213 values between 0.59 and 1.8238 values between 1.82 and 3.0520 values between 3.05 and 4.2810 values between 4.28 and 5.518 values between 5.51 and 6.743 values between 6.74 and 7.973 values between 7.97 and 9.211 values between 10.44 and 11.672 values between 11.67 and 12.90offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. Bloody
  2. funnel
  3. 获利
  4. ampie
  5. ;break
  6. máu
  7. uffer
  8. getResource
  9. halo
  10. ран

Suppresses

  1. prime
  2. Prime
  3. Prime
  4. ministers
  5. Ministers
  6. Min
  7. Secretary
  8. [min
  9. prime
  10. 会长