'of' after 'Department'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 25 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'of' when it follows 'Department', as in 'Department of Justice' or 'Department of Education'. Turning it down made the text drift into words like 'systems' and 'skills', and turning it up made it repeat words like 'few', so the steering does not show the same theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
0s, the downstream repercussions of regular marijuana use may indeed hamper longer term plans,” she says.⏎Additionally, Lo and colleagues within the OHSU Department of Urology, and at Harvard Medical School, Boston University and the University of
-
of success,” Rees says.⏎State officials also connect the recent decline in adult sturgeon numbers to sea lions. But Tony Nigro with Oregon’s Department of Fish and
-
to a doctor to get the treatment you need.⏎Does your urine have a sweet-smelling stench? As Amy Krambeck, a specialist at the Mayo Urinary<|endoftext|>O-ring X - La Pic
-
utility line work and maintenance. Seattle City Light also offers urban landscape tree certificates to residents to offset its tree removals and partners with the Department of Transportation on its neighborhood tree planting work.⏎Seattle City Light has been invested in the
-
put forth that would direct all the school districts in the state as to how they should address bullying," said Nancy Riestenberg, School Climate Specialist at the Department of Education.⏎Riestenberg joined members of the task force to speak with students from
-
also has AT team members to support building core teams in designing accommodations that best match learner accessibility needs. Contact us!⏎What is Assistive Technology?⏎The Iowa Department of Education through the Individuals with Disabilities Act (IDEA) defines assistive technology as
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: How can systems systems systems systems systems systems systems systems systems systems systems systems systems systems systems systems systems systems systems systems systems systems systems systems systems systems systems systems systems systems systems systems systems systems systems systems systems systems systems systems systems systems systems systems systems systems
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
promising prospect that will surely propel our race to creating radical, ground-breaking technologies."⏎Commenting on this in Pune, Dr Vijay Bhatkar, a supercomputer expert and former director
-
.⏎To gain a clearer view of the new technological⏎advancements shaping the future of solar energy, we looked to⏎Mouser Electronics, a leading global semiconductor and electronic⏎components distributor that works with design engineers and buyers.⏎Known for
-
, leading to concerns of a potential nuclear catastrophe, according to the U.S. Nuclear Regulatory Commission.⏎The Department of Energy has sent two experts to Japan -- an emergency response representative and a nuclear engineer who speaks Japanese -- to assist the department's other
-
normal⏎“This analysis confirms what we already know – that we are suffering an extreme weather event caused by climate change,” says Gareth Redmond-King, a climate change specialist at WWF. “
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L19:2419 suppresses
- L23:34 excites
- L20:2804 suppresses
- L24:2963 excites
- L18:2472 weakly excites
- L10:2154 weakly excites
- L18:2292 weakly suppresses
- L9:814 weakly suppresses
- L19:561 weakly suppresses
- L21:1075 weakly suppresses
- L18:1651 weakly excites
- L20:2381 weakly excites
- L18:2529 weakly excites
- L22:525 weakly excites
- L20:669 weakly suppresses
- L7:2278 weakly excites
- L9:325 weakly excites
- L11:1134 weakly suppresses
- L18:247 weakly excites
- L5:2082 weakly suppresses
- L7:2172 weakly excites
- L4:13 weakly excites
- L5:197 weakly excites
- L20:1249 weakly suppresses
Feeds later layers
- L27:227 suppresses
- L26:111 suppresses
- L27:60 excites
- L27:1405 suppresses
- L26:68 excites
- L27:1218 suppresses
- L27:1181 weakly suppresses
- L27:831 weakly suppresses
- L26:856 weakly suppresses
- L27:406 weakly suppresses
- L27:546 weakly suppresses
- L27:250 weakly suppresses
- L27:957 weakly suppresses
- L27:1200 weakly suppresses
- L27:693 weakly suppresses
- L27:829 weakly suppresses
- L27:1656 weakly suppresses
- L26:1017 weakly suppresses
- L27:1987 weakly suppresses
- L27:999 weakly suppresses
- L27:2805 weakly suppresses
- L26:944 weakly suppresses
- L27:480 weakly suppresses
- L27:2586 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- osterone
- 他们都
- profile
- każdym
- 他们会
- każde
- TAIL
- mężczy
- 他们在
- they
Suppresses
- materials
- services
- operations
- skills
- systems
- ities
- Systems
- materials
- Systems
- technologies