acronyms and 'case' in running text

What this neuron does

This neuron responds to a few scattered words: acronyms like 'OAS' and 'MDC', and the word 'case' in phrases like 'the case'. The examples do not share a clear theme, so it is hard to say what unifies them.

Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   0 students, and has been expanded to include Argentina and Brazil with the support of the Organisation of American States (OAS).⏎The Organic Gardens programme recommends the use of greenhouse-style protected gardens so that children

2. #2 peak

   a dog’s leg and break the ankle of a human, and the poison causes gangrene if untreated. They live along the banks of rivers and oasises.⏎They ambush creatures, hiding in the sand and snapping when a foot or

3. #3 peak

   debt to women in dictatorships.”⏎Now, the CIDH has brought the ESMA exhibit to the Organization of American States (OAS) Headquarters in Washington DC in an attempt to start a conversation about crimes against women

4. #4 peak

   and pancreatic cancer.⏎A family history of breast cancer, male or female, increases the man’s chance of inheriting the disease, though this isn’t always the case — but as with women, many men have no obvious

5. #5 peak

   they just talk past each other. An additional challenge for a mediator, on top of getting the parties to listen to one another, is that it’s often the case that a person

6. #6 peak

   have made sure that they left the mark on the city be designing different pieces of beautiful architecture that are itself an amazing piece of work.⏎Delhi will drive anyone crazy when get a views of its age old style and zealous past. It is

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   INO - ARMOUR - ARTWORK - BIOLOGY - BLACK BOX - COMPUTERS - ELECTRONICS - ENERGY - FRAME - HEAD - JAWS - JIMMY WATSON - KITS - LEGS - MECHANICS - MOTORS

2. #2 peak

   ?⏎- What are high fidelity prototypes?⏎- What are the three key points in a relationship framework?⏎- Why is it called LOFI?⏎- What does Lo Fi mean?⏎- What is a wireframe diagram?⏎- When should I use low

3. #3 peak

   , and more than one story is recorded of people succumbing to hunger and disease while still in the harbor.⏎The remarkable confluence of four men made the Jeanie Johnston a exception to this rule. In the New World, there was John M

4. #4 peak

   writing of the user⏎instructions. Completed CAD models are also used in the wider⏎organization, such as for marketing and packaging.⏎source : wikipedia⏎How lego used to do it⏎do you know?⏎How people do it themselves⏎L

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.