period after 'Dr' abbreviation
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 16 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the full stop in 'Dr.' when it comes before a person's name, as in news articles about doctors. Its negative side appears inside programming identifiers, but steering it did not change the writing in an obvious way.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
, including the germs that cause cholera and other diarrheal illnesses.⏎Data now suggest that the locations where certain pathogens are found have changed, said Dr. Glenn Morris, the director of the Emerging Pathogens Institute at the University of Florida
-
13 Desktop News | Troubled youth in the custody of the Alabama Department of Youth Services have been given a second chance at success thanks to the work of Dr. Randy Salekin, a professor in the Department of Psychology
-
10 percent of those people surveyed - including physical therapists, speech and hearing therapists and social workers - were confident in their training in these issues. According to Dr. E. Virginia Laph
-
breathalyzer that can test people for COVID-19.⏎The test identifies the disease within 15 seconds. The standard PCR test can take days.⏎Dr. Pelagia-Irene (Perena) Gouma, professor
-
be increasingly common -- because evolution's "survival-of-the-fittest" theory should dictate that we'd lose such disabling traits.⏎But an analysis by Dr. Atul Butte and graduate student Erik Corona of Stanford University's School of Medicine
-
, the grants are designed to help institutions expand opportunities for student research projects.⏎"We're seeing a profound change in the way many college students learn science," said Dr. Joseph G. Perpich, the institute's vice president for grants and special
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: what is the value of $x^2 - x + 10^x - 10^x + 10^x = x^2 - x + 10^x = x^2 - x =
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
typedef void * model_3d_ref;⏎model_3d_ref load_model_from_disk(const char * absolute_file_path);⏎void draw_model(model_3d_ref the_model, float
-
where_x, float where_y, float where_z);⏎void deallocate_model(model_3d_ref kill_this);⏎The compiler doesn't read your code like this - the following
-
as an int, but the function performs a byte per byte search using the unsigned char conversion of this value.⏎- Number of bytes to be analyzed.⏎sizet is an unsigned integral type.⏎A pointer to the first occurrence of value in the
-
⏎But here thing is, save() method can return that primary key id value which is generated by hibernate and we can see it by⏎long s = session.save(k);⏎In this same case, persist() will never give
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L14:1715 strongly suppresses
- L12:1393 excites
- L14:1584 suppresses
- L14:2023 suppresses
- L12:2335 suppresses
- L15:574 suppresses
- L9:1678 suppresses
- L12:1662 suppresses
- L8:51 excites
- L9:214 excites
- L15:1885 suppresses
- L14:1636 excites
- L14:1796 suppresses
- L13:1979 excites
- L15:2985 excites
- L14:1229 excites
- L15:48 weakly excites
- L14:1474 weakly excites
- L12:2947 weakly excites
- L13:2311 weakly suppresses
- L8:1503 weakly excites
- L1:1365 weakly suppresses
- L4:1597 weakly excites
- L14:166 weakly excites
Feeds later layers
- L17:1158 strongly suppresses
- L17:1230 strongly excites
- L20:1028 suppresses
- L20:2317 suppresses
- L19:842 suppresses
- L21:1347 suppresses
- L18:1092 suppresses
- L19:1512 suppresses
- L19:1218 suppresses
- L17:2715 suppresses
- L18:2544 suppresses
- L22:918 suppresses
- L19:2241 suppresses
- L19:1640 suppresses
- L19:2038 suppresses
- L18:831 suppresses
- L20:3046 suppresses
- L22:1534 suppresses
- L17:1943 suppresses
- L21:2053 excites
- L21:1664 suppresses
- L18:2944 suppresses
- L18:1422 suppresses
- L18:754 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 不排除
- felt
- ussian
- 的脚步
- che
- ubuntu
- ple
- iti
- application
- usses
Suppresses
- temp
- current
- =result
- نع
- morning
- kald
- chase
- MOVED
- =temp
- aved