comma after a conditional lead-in clause
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 14 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the comma that ends an "if" or "when" style opening phrase, such as "given enough time and sufficient access," or "once in place and properly utilized," just before the main point. Its negative side is the opposite: a comma after a "After treatment," or "After demolding," phrase. Turning it up did not produce clearly related writing.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
. This type of writing essays might not be popular with the crowd, as it is thought to be difficult to write persuasive essays, but if you are well prepared it could be one of the most enjoyable styles of writing for college.⏎You should write
-
the team will spend about 45 days in the Southern Ocean, most of which will be spent studying the ice. But, given enough time and sufficient access, they hope to catch a glimpse of the famous ship too. Only time will tell
-
ground with the clinker during manufacture. These cements produce concrete with improved resistance to freezing and thawing. When mixed with proper intensity and for an appropriate duration, such<|endoftext|>In this section⏎
-
for breathable oxygen. The mind will become burning off its capability to regulate breathing in, therefore. If heVersusshe has the ailment and presented suitable treatment, with the assistance of a health care provider, an be clinically determined. Treatment method
-
range in the late 1800s because of unregulated trapping. With a decline in the demand for beaver pelts, and with proper management, they became reestablished in much of their former range and are now common in
-
; I'd sell a million books -- plus, the headlines would read "Philplait to Destroy the Earth!" which is awesome). If it could hit us, it would have an impact yield of at least 35,000
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I still want to make sure I can get the system and the team still do something. I don't want to know if they are still there, just that I can get them. I don't want to do anything. I don't
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
in too little bonding performance of the slurry, and the slurry will not be able to adhere tightly to the foamed plastic net. After demolding, it will have no strength and will easily disassemble. Hang up even if it
-
oprazole or omeprazole are prescribed in various combinations.⏎Finishing all medicines prescribed by your doctor is very important for successfully eliminating infection.⏎After treatment, children may sometimes complain of discomfort in their stomach and this can take several months to
-
was at the DDD exchange recently where we had the likes of Udi Dahan, Eric Evans and Scott Wlaschin on the panel. In a post event Q&A session I asked the panel - “Is microservices SOA renamed?
-
, and has the default set of MySQL accounts and no user data.⏎On Unix, initialize the data directory. See Section 2.10, “Postinstallation Setup and Testing”.⏎On Windows
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L11:1569 suppresses
- L13:1569 weakly suppresses
- L4:2769 weakly suppresses
- L7:307 weakly suppresses
- L13:1173 weakly suppresses
- L11:1399 weakly suppresses
- L11:1225 weakly suppresses
- L7:747 weakly suppresses
- L3:2431 weakly excites
- L9:1192 weakly suppresses
- L12:2718 weakly excites
- L7:1964 weakly suppresses
- L1:3026 weakly suppresses
- L12:1872 weakly suppresses
- L12:238 weakly excites
- L12:1099 weakly suppresses
- L12:3000 weakly suppresses
- L13:1874 weakly excites
- L11:2112 weakly suppresses
- L12:534 weakly suppresses
- L12:2185 weakly suppresses
- L3:1167 weakly excites
- L12:179 weakly suppresses
- L2:2863 weakly suppresses
Feeds later layers
- L16:1470 suppresses
- L19:1863 excites
- L18:2592 weakly suppresses comma after an opening clause
- L16:2210 weakly suppresses
- L15:641 weakly suppresses
- L15:1345 weakly suppresses
- L16:1542 weakly suppresses
- L25:2323 weakly suppresses
- L27:1360 weakly suppresses
- L16:793 weakly excites
- L17:1322 weakly suppresses
- L20:332 weakly excites
- L17:963 weakly excites
- L16:2646 weakly excites
- L15:1603 weakly suppresses
- L16:1759 weakly excites
- L17:2897 weakly suppresses
- L27:269 weakly suppresses
- L17:1431 weakly suppresses
- L16:2304 weakly excites
- L19:2350 weakly suppresses
- L20:1238 weakly suppresses
- L16:2359 weakly excites
- L26:2595 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- gratis
- olen
- .CreateInstance
- /public
- 建党
- iten
- ∋
- RLF
- inen
- реализаци
Suppresses
- eus
- 余
- 留
- 地段
- ерь
- tał
- ick
- 遗留
- �试
- queryParams