hyphen inside dates
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 12 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the dash inside a date written as year-month-day, like 'Last updated: 1998-02-10'. It stays quiet on the dashes that separate page numbers or verse ranges, where it is strongly switched off. Turning it up or down did not change the model's story in a way that relates to dates.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
finances⏎you will be able to commit to the aquarium and its inhabitants.<|endoftext|>Views:22 Author:Site Editor Publish Time: 2021-04-24 Origin:Site⏎Which 5 axis machining center is
-
For Easter itself, the observances properly start on the Friday before Easter (Good Friday). Historically, people ate<|endoftext|>Last modified: 2002-09-28 by rick wyatt⏎Keywords: arapaho
-
time of reception, determines your location. ["Global Positioning by Satellite"? Precison? Coverage? Web page?]⏎Last updated: 1998-02-10⏎Global Positioning System ♦ Global System for Mobile
-
quite do things,” he said.⏎For the rest of this article, click here: http://www.abc.net.au/news/rural/2017-05-23/the-future-of-automation-in-the-mining-ind
-
AM's successor was Eurisko. http://homepages.enterprise.net/hibou/aicourse/lenat.txt.⏎Last updated: 1999-04-19<|endoftext|>There is no fixed protagonist of the novel, and
-
Birthplace : Buttenheim, Bavaria, German Confederation⏎Nationality : German⏎Category : Famous Figures⏎Last modified : 2011-10-14⏎Credited as : manufacturer, blue jeans,
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have been told by my family and I have been told by my parents, but I have been told by my parents, but I have been told by my parents, but I have been told by my parents, but I have been told
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
Clifton Park, NY: Delmar, Cengage Learning.⏎Chapter 3, “Pharmacotherapy of Bipolar Disorder” (pp. 37–47)⏎Preston, J. D., O’Neal, J
-
in the two collaborating project laboratories. This work is<|endoftext|>“Holy Week: In Like a Lion, Out Like a Lamb” (Matthew 21:1-11; 27:11-66)⏎“In like a
-
. The age-related disc degeneration in the sand rat has been shown to be reliable and predictable, and has been well characterized in previous radiologic studies [1–9]. The present work extends the previous radiological studies in to develop an
-
Besides serving as postmaster, Fannie operated the store and overnight accommodations at Mora. A few of her diaries, written from 1914 to 1922, have been preserved and donated to Olympic National Park by
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L6:1868 strongly excites
- L8:991 suppresses
- L6:2170 excites
- L10:2724 excites
- L7:89 excites dash in year or number ranges
- L6:2837 suppresses
- L5:3009 excites 'to' after a verb or noun
- L6:1149 suppresses
- L7:2727 excites
- L5:2052 excites
- L3:135 suppresses
- L6:3050 suppresses
- L5:1671 weakly suppresses
- L4:543 weakly suppresses
- L7:1233 weakly excites
- L8:932 weakly suppresses
- L9:1797 weakly excites
- L3:807 weakly suppresses comma inside dates and years
- L11:1048 weakly excites
- L7:1452 weakly suppresses
- L7:929 weakly excites
- L6:1037 weakly suppresses
- L9:465 weakly suppresses
- L2:1676 weakly suppresses
Feeds later layers
- L16:623 suppresses
- L17:2385 suppresses
- L14:2202 suppresses
- L14:1751 suppresses
- L18:2161 suppresses
- L13:1297 suppresses
- L15:2350 suppresses
- L13:1346 suppresses
- L16:2602 suppresses
- L16:1027 suppresses
- L23:1643 suppresses
- L13:1715 weakly suppresses
- L17:3004 weakly suppresses
- L20:1916 weakly excites
- L16:1717 weakly excites
- L20:2341 weakly excites
- L17:2964 weakly suppresses
- L20:3036 weakly suppresses
- L15:2576 weakly suppresses
- L16:1876 weakly excites
- L17:1982 weakly suppresses
- L20:848 weakly suppresses
- L20:1907 weakly excites
- L14:2511 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- abit
- sets
- 或多
- opport
- imony
- ội
- ceptive
- fact
- 绌
- 倍
Suppresses
- 直到
- until
- obar
- 一直到
- Until
- 直至
- odb
- until
- 的答案
- hasta