colon in clock times
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 25 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron responds to the colon in times of day, like 01:32 AM or 15:47, in forum posts and timestamps. Turning it down or up produced text that did not clearly relate to times, so the steering does not confirm the pattern.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
actorial.shtml I don't happen to think that the code there is easily understandable though...⏎January 10th, 2004 01:32 AM⏎Tim_axe, sorry to be pedantic, but if
-
C=0 and MAS[1:0]=10).⏎Article last edited on: 2008-09-09 15:47:35⏎Did you find this article helpful? Yes No⏎
-
of the Marquis de Armijo.<|endoftext|>Thread: FNG methods of attack question⏎05-06-2006, 05:45 PM #1⏎FNG methods of attack question⏎I read this
-
dream up the basic elements of the classroom of the future using design thinking. Great example of a school-business partnership.⏎- Design & Thinking Official Trailer (02:28)⏎Design & Thinking is a documentary released this year about design thinking.
-
2:51:40 EDT⏎- Martian rock arrangement not alien handiworkWed, 7 Jan 2009, 13:
-
Awareness of climate change] is<|endoftext|>- Created by: Luke Simons⏎- Created on: 06-04-12 19:17⏎1. Newton's model of the universe made four assumptions which were
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: what is the place of government in an environment in which government is supposed to do exactly what it is supposed to do? Well, in fact, government is supposed to do exactly what it is supposed to do. And yet, as government in
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
Jurisdiction permits the homeowner to do everything that a licensed electrician can do, but the work must be performed under permit and the work must be inspected by a building department inspector. The documents that you will need to
-
increases.⏎The mechanical behavior of fractured rocks has directly impact on the stability of slope, tunnel and dam. etc. The research on creep shear strength of fractured rocks can provide
-
and to display results in near real-time. For at least 15 minutes on one or more days of the count, simply tally the numbers and kinds of birds you see. You can count from any location
-
options contract has the following properties or attributes:⏎- Expiration Date⏎- Symbol or Underlying⏎- Strike Price⏎- Type: Call or Put⏎The contract has an
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L21:326 excites
- L23:660 suppresses
- L20:2736 suppresses
- L22:2408 suppresses
- L20:2316 excites
- L22:610 suppresses
- L18:1614 suppresses
- L24:800 weakly excites colon in clock times
- L23:1369 weakly excites the '0' in years like 2008
- L23:2791 weakly excites
- L23:231 weakly excites
- L14:631 weakly suppresses
- L19:920 weakly excites
- L19:2230 weakly excites
- L22:2254 weakly suppresses
- L9:804 weakly suppresses
- L11:1996 weakly excites
- L15:1815 weakly suppresses
- L23:2992 weakly suppresses unclear: first pieces of split words
- L23:585 weakly excites
- L7:1266 weakly excites
- L9:1719 weakly suppresses
- L0:672 weakly excites
- L12:408 weakly excites
Feeds later layers
- L27:496 suppresses
- L26:905 suppresses
- L27:763 suppresses
- L27:205 excites
- L27:572 suppresses
- L27:1087 suppresses
- L27:435 suppresses
- L27:1100 suppresses
- L27:132 excites
- L27:893 suppresses
- L26:233 weakly suppresses
- L27:628 weakly suppresses
- L27:1329 weakly suppresses
- L27:1232 weakly suppresses
- L26:294 weakly suppresses
- L27:391 weakly suppresses
- L26:976 weakly suppresses the '1' starting a century
- L26:580 weakly suppresses
- L27:773 weakly excites
- L27:1626 weakly suppresses
- L27:530 weakly suppresses
- L26:898 weakly suppresses
- L26:2380 weakly excites
- L26:1551 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- -bar
- Bars
- вая
- .hh
- ubble
- backup
- ilda
- entine
- 憩
- èles
Suppresses
- 8
- 6
- 7
- 8
- 6
- 七个
- 7
- eighty
- six
- eight