comma before 'such as' examples
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 24 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the comma that comes right before a list of examples, such as 'other symptoms of appendicitis, such as pain'. Turning it up made the model repeat the word 'such' endlessly, showing it is tied to that kind of example phrasing.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
will be built.⏎The four basic techniques of ML are: supervised , unsupervised, semi-supervised ,and reinforcement learning. There are other Machine Learning techniques, so the below list is not exhaustive.⏎Supervised machine learning⏎This technique uses
-
be causing your symptoms.⏎Your doctor may also order other tests, including:⏎- Hysteroscopy. Using a viewing instrument inserted through the vagina
-
blood cells to fight the infection. The increase in white blood cells can lead to a fever. A fever may also be accompanied by other symptoms of appendicitis, such as pain, swelling, and loss of appetite.⏎Gas is another common symptom
-
(such as www.internetsociety.org) to Internet addresses that are used by computers to talk to each other.⏎DNS also provides other information about domain names, such as mail services.⏎Why is DNS important?⏎Domain names are fundamental to the
-
als or their derivatives, such as flour, starch, bread, pasta, biscuits and cakes, all contain gluten. Gluten may also be present in less obvious foods, such as sweets, puddings, preserved meats, stock cubes, etc.⏎What
-
made up of A, B, AB, or O blood types, and the Rh group is either positive or negative. You blood groups help doctors know many things, like what kind of blood you’ll need in a blood transfusion or an organ
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the importance of the larger human and global human and global human and human value and importance and importance and importance and importance as well as the importance of the importance of the importance of the importance of the importance of the importance... I like to like
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
solutions, questions and answers of programming and scripting languages:<|endoftext|>RALEIGH — New research has found that North Carolina’s shellfish industry provides over $27 million in economic impact and 532 jobs in the state. Until 2
-
specificity of 25% to 80%. Typically a fracture can be seen on ultrasonography as a disruption in the hyperechoic linear cortex of bone as well as surrounding hematoma. (See image
-
time from a packed agenda to read aloud Boylan's request. The council members, struck by Boylen's youthful enthusiasm, passed the hat and collected $10.00.⏎Flush with funds, Boylan and Cook experimented with various rocket
-
sustainable eating and Angelina Frankowska (University of Manchester), whose expertise lays in sustainable foods and food groups.⏎The event attracted an audience of 70, including the members of the general public as well as staff and students from the University
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L22:149 suppresses
- L19:2614 excites
- L20:2676 excites
- L17:2545 excites
- L19:226 excites
- L18:178 suppresses
- L15:2393 suppresses
- L19:1124 excites
- L13:1567 suppresses
- L20:728 excites
- L19:2918 weakly suppresses
- L23:1448 weakly suppresses
- L9:77 weakly excites commas in citations and name lists
- L19:158 weakly suppresses
- L14:704 weakly excites
- L23:1068 weakly suppresses
- L16:240 weakly excites comma after 'sometimes' or 'the truth'
- L13:2704 weakly excites
- L18:1438 weakly excites
- L20:593 weakly suppresses
- L20:2038 weakly suppresses
- L20:42 weakly excites
- L9:1165 weakly excites
- L22:974 weakly excites
Feeds later layers
- L27:694 strongly excites
- L25:1898 strongly excites
- L27:927 weakly suppresses
- L25:769 weakly excites
- L25:1909 weakly excites unclear: mid-word pieces of names
- L26:1777 weakly suppresses
- L26:2051 weakly excites
- L27:2895 weakly excites
- L27:1981 weakly excites
- L26:2767 weakly suppresses
- L25:1105 weakly suppresses
- L25:440 weakly suppresses
- L27:1953 weakly excites
- L27:759 weakly suppresses
- L25:2182 weakly suppresses
- L26:2486 weakly excites
- L25:95 weakly excites
- L25:780 weakly suppresses opening parenthesis before an acronym
- L26:1238 weakly excites
- L27:2785 weakly excites
- L25:1467 weakly excites
- L25:563 weakly suppresses
- L25:1804 weakly suppresses
- L25:2548 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- such
- such
- Such
- Such
- 这样的
- SUCH
- 這樣的
- 如此
- 此类
- 这样
Suppresses
- strup
- ertype
- ificance
- liği
- đen
- 看你
- amental
- ================================
- responseObject
- 臌