Neuron Explorer

Qwen3-0.6B

the digit 2 in years like 20xx

A neuron in layer 18 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the digit 2 when it appears as the third digit of a year such as 2020, 2021 or 2003, mostly in dates on web pages. Turning it up made the model's writing drift into unrelated subjects, so the effect is hard to see in the text.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    . So, you could also argue the Internet (<|endoftext|>このトピックには0件の返信が含まれ、1人の参加者がいます。2020年7月6日 at 9:45 AMに Megan Smith

  2. #2 peak

    for acyclic graphs of pointers.<|endoftext|>The Death And Life Of The Great Lakes Pdf⏎- and pdf⏎- Tuesday, June 1, 2021 2:11:00 AM⏎- 1 comment⏎

  3. #3 peak

    , osteoporosis, meniscus, ligament injuries, muscle problems.⏎Günceleme: 07/01/2023 14:52<|endoftext|>Sustainability and Renewable Merino⏎W

  4. #4 peak

    of the general population. Women are generally more affected than men .⏎Page 1 of 2⏎Dating Advice For Men<|endoftext|>Feb 5, 2020⏎Dr. Levy talks about cold adaption in ancient and modern populations.

  5. #5 peak

    or use hand sanitiser with a minimum of 60% alcohol base.⏎9. Wash<|endoftext|>Date Updated: 12/17/2020⏎Strep throat is a bacterial infection that can make your throat feel sore

  6. #6 peak

    appearance of troops at Pine Ridge, he advocated for peace with the European Americans⏎Date de dernière mise à jour : 05/07/2021⏎Ajouter un commentaire<|endoftext|>By DANIEL SUDDEATH⏎NEW

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: it is not just the fact that the world, as it is, as it was, as it, when it was in the case of the only one, when it was only the only one. It is the **** only ****

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    2010|⏎Leaders and contributors⏎|John W. Eaton||Maintainer|⏎Resources and communication⏎|Developer||VCS Repository Webview||http://www.octave.org/hg/octave|⏎|Required to build||GNU

  2. #2 peak

    up a new Python file and follow along:⏎import numpy as np⏎As you have to follow a few steps, I would suggest you go through this: https://www.thepythoncode.com/article/hide-secret-data-in-images-using-stegan

  3. #3 peak

    the for loop,⏎> hence n + 1 and not n executions), which will consume T4( n + 1 )⏎> time." (from http://en.wikipedia.org/wiki/Analysis_of_algorithms)⏎> 1 get a positive

  4. #4 peak

    Control of Cell Cycle and Growth by Extracellular Cues, Fall 2012. (Massachusetts Institute of Technology: MIT OpenCourseWare), http://ocw.mit.edu (Accessed). License: Creative Commons BY-NC-SA

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L9:2813 weakly excites
  2. L17:840 weakly suppresses
  3. L17:1224 weakly suppresses
  4. L14:779 weakly excites 'than' in comparisons
  5. L11:2409 weakly suppresses
  6. L17:1476 weakly excites
  7. L3:88 weakly excites
  8. L5:2756 weakly excites
  9. L7:1685 weakly suppresses
  10. L9:1791 weakly suppresses
  11. L8:51 weakly suppresses
  12. L2:982 weakly suppresses
  13. L11:249 weakly excites
  14. L16:1334 weakly excites
  15. L12:1571 weakly excites
  16. L17:1077 weakly excites
  17. L14:351 weakly suppresses
  18. L1:3034 weakly suppresses
  19. L14:1219 weakly suppresses
  20. L10:2931 weakly excites
  21. L17:95 weakly suppresses
  22. L9:1236 weakly excites
  23. L17:2368 weakly excites
  24. L14:618 weakly excites

Feeds later layers

  1. L20:1123 weakly suppresses
  2. L20:1819 weakly suppresses
  3. L22:476 weakly excites
  4. L25:813 weakly suppresses
  5. L25:1963 weakly suppresses
  6. L22:2151 weakly suppresses
  7. L21:868 weakly suppresses
  8. L20:525 weakly suppresses
  9. L19:1515 weakly excites
  10. L23:2751 weakly excites
  11. L20:617 weakly suppresses
  12. L26:1431 weakly excites
  13. L25:2883 weakly excites
  14. L22:647 weakly suppresses
  15. L24:524 weakly suppresses
  16. L24:1634 weakly suppresses
  17. L24:2250 weakly excites
  18. L21:1287 weakly excites
  19. L22:1796 weakly suppresses
  20. L26:1578 weakly excites
  21. L20:2840 weakly suppresses
  22. L27:474 weakly excites
  23. L25:2827 weakly suppresses
  24. L19:2033 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -5.35 and -4.831 values between -4.31 and -3.791 values between -3.79 and -3.271 values between -3.27 and -2.751 values between -2.75 and -2.232 values between -2.23 and -1.728 values between -1.72 and -1.2014 values between -1.20 and -0.68296 values between -0.68 and -0.163168 values between -0.16 and 0.36406 values between 0.36 and 0.886 values between 0.88 and 1.401 values between 1.40 and 1.921 values between 2.96 and 3.481 values between 14.91 and 15.43offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. ayload
  2. かり
  3. rial
  4. 'https
  5. .allocate
  6. .Read
  7. uster
  8. Ι
  9. Stadium
  10. ί

Suppresses

  1. دس
  2. ��作
  3. ций
  4. 權
  5. 中心城市
  6. правля
  7. hammer
  8. век
  9. RAR
  10. msgid