unclear: mixed, varied web text
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 17 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on many unrelated bits of web text, such as citations, event names and sign-offs, with no clear shared theme. When it was turned up, the writing drifted toward conferences and competitions, but that link is weak.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
ak Dun v. Yukon, 2015 YKCA 18 (the “appeal decision”), the Yukon Court of Appeal
-
surveillance to monitor the trends in NCD prevalence, their risk factors, and treatments.⏎Copyright © 2020 The Royal Society for Public Health. Published by Elsevier Ltd. All rights reserved.<|endoftext|>We all grew up hearing the phrase
-
, more than 200 social scientists (including myself) who study games in the fields of psychology and communication among others, signed a statement urging the American Psychological Association to repeal the 2005 report. One
-
devices(2427) Terms.⏎The official website of the Tokyo 2020 - Summer Olympic Games - 3x3 event 2021 - FIBA.basketball
-
Wear (1999). The ecology of Parentucellia viscosa in dune wetlands. California Exotic Pest Plant Council Symposium '99. Sacramento, CA.⏎- Quinn, L., B. Davis, et al.
-
refine, and establish clinical uses for liquid biopsy tests.⏎Different liquid biopsy<|endoftext|>Biology 107 Lab Exam Review⏎Science B01 with Magor at University of Alberta⏎About this
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the 20th national conference of the world international olympiads (WOIOC) international olympiads world championships, the 14th world international olympiads (WOIOC) world championships, the 1
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
.-H. (2014, July). Effectiveness of a tiered intervention model in Chinese: A growth model of reading fluency. Paper presented at the Twenty-First Annual Meeting: Society for the Scientific Study of Reading, Santa
-
Garfinkel, K. Christopher, M. Rosenblum, Understanding Data Lifetime via Whole System Simulation, Proceedings of the 13th USENIX Security Symposium, 2004.⏎Garfinkel,
-
Greenpeace motion demanding that Statoil withdraw its investments.⏎Greenpeace is making the tar sands a key issue in Norway, Sweden and Denmark in the lead-up to Statoil's AGM on May
-
which are similar to that<|endoftext|>Our learning this week has been focused on health and wellbeing as part of Health Week.⏎Primary 6 put lots of effort into preparing for Sports Day and their hard work paid off. Well done to everyone for their
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L9:2804 suppresses
- L10:2642 suppresses
- L16:3049 excites
- L7:2376 excites
- L16:3051 suppresses
- L10:1277 suppresses
- L6:2783 suppresses
- L10:1828 excites
- L3:1047 suppresses
- L9:2239 excites
- L6:2384 excites
- L15:2983 excites
- L9:1067 weakly suppresses
- L10:2607 weakly excites
- L9:2434 weakly suppresses 'of' in department and division names
- L13:2515 weakly suppresses
- L9:2099 weakly excites
- L11:587 weakly suppresses
- L16:2798 weakly excites
- L13:756 weakly excites
- L10:2880 weakly excites
- L11:2341 weakly excites
- L6:2514 weakly suppresses
- L7:2536 weakly excites
Feeds later layers
- L18:140 suppresses
- L21:2240 suppresses
- L21:2328 suppresses
- L19:948 suppresses
- L20:1535 suppresses
- L19:2220 suppresses
- L23:2519 suppresses
- L25:2873 suppresses
- L21:1631 suppresses
- L24:775 suppresses
- L18:1368 suppresses
- L26:668 suppresses
- L18:1410 suppresses
- L22:1901 weakly suppresses
- L19:1160 weakly suppresses
- L19:817 weakly suppresses
- L26:971 weakly suppresses
- L20:1208 weakly excites
- L19:2227 weakly suppresses
- L21:2931 weakly excites
- L18:381 weakly suppresses
- L20:1029 weakly suppresses
- L21:855 weakly excites
- L23:2827 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 设计理念
- -rays
- mine
- zon
- slowed
- ジョン
- Triangles
- Coroutine
- modelName
- zman
Suppresses
- 大赛
- 比赛中
- 比赛
- 参加
- competitions
- compete
- 参赛
- contest
- competition
- contests