periods ending explanations
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 19 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
The neuron fires on the full stop that ends an explanatory sentence, the kind that wraps up a point before the next one begins, as in describing how a method works. Turning it up produced repeated filler like 'The Most Of The Most', so the steering does not clearly confirm the pattern.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
aspects of AI is its ability to learn and adapt. Machine learning algorithms can analyze vast amounts of data to identify patterns and make predictions, and they improve with experience. This capability has applications
-
the maximum possible mark. Once you’ve determined the maximum, you can also divide it by the total marks. This will give you the percentage of a given number. In addition to finding the actual value of a number, you should<|endoftext|>Early Men
-
x, or %. Then, multiply the result by 100 to get the percent. This method is also useful for finding the exact value of the number. Once you have the answer, you can move onto the next step in interpreting the
-
servlets constructed to invoke such libraries. In other words, a tag library defines a set of Java classes for the custom JSP actions that the tag library supports. Invoking the tag library imports custom processing and actions into the Java environment so a
-
9. These are the "stems". For each value in the dataset, we pair its right-most digit to the corresponding stem that matches it's left digit. For example, if we had a⏎76 in our dataset, we would
-
The calculator will do the rest, including converting the decimal to a percentage.⏎To find the percentage value of a mark, you’ll need to know its total mark. In order to find this, use basic arithmetic. Divide the mark by the highest
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately:. P.............................................
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
women are to the manufacturing sector and how companies are working towards inclusivity. As a woman myself, doing research on dissolving the gender gap is incredibly rewarding. Over the past few decades, the United States has made remarkable improvements in empowering women of
-
using a compass, just position the point at the center of the cross, and change the radius ever so slightly to arrive at the desired image ahead of time.⏎Now for the lines!⏎Second Step - Very Simple! Very Easy!⏎Our outline for
-
.⏎Still, despite the fact that buckwheat flour is highly popular, it’s important to make sure that its potential side effects aren’t being overlooked.⏎Out of all the healthy grains out there, buckwheat has the highest levels of amino
-
Be Used for Armor, More.")⏎The discovery may inspire performance engineers to create better and more robust vehicles—such as bicycles, boats, and race cars—in the not-so-distant future.⏎"It's about translating design principles found in limpets to
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L16:432 suppresses period after month or initial
- L11:132 excites period ending an opening topic sentence
- L5:168 suppresses
- L9:16 suppresses unclear: periods inside numbers and names
- L17:347 excites full stops ending informative sentences
- L15:403 suppresses period inside an abbreviation
- L6:2302 suppresses 'and' joining two parallel items
- L13:53 excites period ending a claim before elaboration
- L18:791 suppresses
- L4:7 excites
- L17:2414 weakly suppresses
- L3:259 weakly suppresses
- L10:612 weakly excites full stop ending boilerplate or a title
- L18:227 weakly suppresses
- L8:541 weakly excites
- L18:2434 weakly excites
- L5:155 weakly suppresses
- L16:489 weakly suppresses
- L2:156 weakly excites
- L14:155 weakly excites sentence-ending periods in prose
- L18:366 weakly suppresses comma inside numbers and dates
- L8:2262 weakly suppresses
- L17:1054 weakly suppresses
- L16:781 weakly excites
Feeds later layers
- L21:1086 excites end of sentence before a claim or statistic
- L23:179 excites
- L20:296 excites
- L25:217 excites
- L23:278 excites
- L27:451 excites
- L26:1200 excites
- L24:353 excites decimal point inside a number
- L26:448 excites
- L23:509 excites
- L25:198 excites
- L27:133 excites
- L23:561 excites
- L20:473 excites
- L20:343 excites
- L27:452 excites
- L21:201 excites
- L26:299 excites
- L24:421 excites
- L21:524 excites
- L27:854 excites
- L27:508 excites
- L27:640 excites 'of' inside fixed titles and names
- L26:517 excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 这对于
- 但这
- 这是
- 这是因为
- 这
- Here
- For
- These
- конечно
- 这里面
Suppresses
- -hearted
- -muted
- -way
- grave
- -price
- quisites
- /off
- quisite
- yte
- -dependent