Neuron Explorer

Qwen3-0.6B

'in' after a size measurement

A neuron in layer 11 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the word 'in' when it comes right after a size or range, as in 'range in color', '4 inches in diameter' or '3 metres in height'. Those snippets are about how big or wide something is. Turning it up gave text that did not clearly follow this pattern, so the link to the snippets is only partly confirmed.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    from boulders extracted from riverbeds.⏎The cylindrical shaped jars have a lip rim to support a lid, and range from one to more than three metres in height, weighing up to 14 tons. Very few examples of stone lids

  2. #2 peak

    the sweetest taste. Thick slices work well for sandwiches or caprese. Some varieties can produce fruit weighing up to several pounds.⏎Oxheart tomatoes can range in from small to as big as beefsteaks, and are shaped like large heart

  3. #3 peak

    28% protein. They are also an excellent supply of vitamins A, B, C, and E.⏎Sea vegetables come in many varieties and can range in color from red, blue-green, brown, and green.⏎- Kombu

  4. #4 peak

    demospongiae, which live in fresh water.⏎A wide variety of sponges exist, ranging in size from 1 inch to 4 feet in diameter. Inside a sponge there is a system of openings and passages called a canal

  5. #5 peak

    panel is a formed sheet of molded concrete, usually 2 feet to 12 feet (0.61 m to 3.66 m) in width, and 8 feet to 12 feet (2.44

  6. #6 peak

    drooping, and on this part, the 9-12 twelve flowers are produced. Flowers are splendid and of large size, being nearly 4 inches in diameter when fully expanded. In color the flowers in

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: I need to get this problem in the book 10000000000012323000101117112411271127

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    case of a number, you can use the following formulas: 1350pc, x, or %. Then, multiply the result by 100 to get the percent. This method is also useful for finding the exact value of

  2. #2 peak

    blue and red on this chart denote republican and democratic rule respectively and form the background for some salient information on the US economy. The grey line displays the annual average unemployment rate which has been seasonally adjusted. The black line shows historical GDP percentage

  3. #3 peak

    | Volume 25, Issue 1⏎That was the end of the campaigning in 177

  4. #4 peak

    in 2 patients (5%). The mean age of patients was 29 years. 2 patients (5%) reported

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L9:2164 suppresses
  2. L6:1318 suppresses
  3. L8:2201 excites
  4. L5:1247 weakly excites
  5. L9:1317 weakly suppresses
  6. L1:2070 weakly suppresses
  7. L6:398 weakly excites
  8. L3:2106 weakly excites
  9. L0:2496 weakly excites
  10. L4:456 weakly suppresses
  11. L1:2153 weakly suppresses
  12. L10:1839 weakly excites
  13. L4:1954 weakly excites
  14. L10:299 weakly excites
  15. L6:2252 weakly excites
  16. L0:2367 weakly excites
  17. L7:2705 weakly suppresses
  18. L5:2446 weakly excites
  19. L5:2163 weakly suppresses
  20. L9:707 weakly suppresses
  21. L8:586 weakly excites
  22. L7:121 weakly excites
  23. L3:1458 weakly excites
  24. L10:1712 weakly suppresses

Feeds later layers

  1. L13:901 excites
  2. L17:1979 excites
  3. L17:305 excites
  4. L18:557 excites
  5. L12:1925 suppresses
  6. L13:1335 excites 'of' inside fixed noun phrases
  7. L18:1358 excites
  8. L12:1518 suppresses
  9. L19:1361 excites
  10. L19:1176 suppresses
  11. L16:940 excites
  12. L20:803 excites
  13. L20:712 excites
  14. L17:546 excites
  15. L20:1284 excites
  16. L12:1496 excites
  17. L14:1393 excites
  18. L18:56 suppresses
  19. L15:1310 excites
  20. L13:938 excites
  21. L14:1737 excites
  22. L13:843 excites
  23. L22:507 excites
  24. L20:904 excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -1.48 and -1.382 values between -1.27 and -1.162 values between -1.16 and -1.053 values between -0.94 and -0.833 values between -0.83 and -0.725 values between -0.72 and -0.6123 values between -0.61 and -0.5068 values between -0.50 and -0.39172 values between -0.39 and -0.28392 values between -0.28 and -0.17825 values between -0.17 and -0.061516 values between -0.06 and 0.05521 values between 0.05 and 0.16181 values between 0.16 and 0.2760 values between 0.27 and 0.3740 values between 0.37 and 0.4827 values between 0.48 and 0.5916 values between 0.59 and 0.708 values between 0.70 and 0.817 values between 0.81 and 0.929 values between 0.92 and 1.036 values between 1.03 and 1.144 values between 1.14 and 1.251 values between 1.25 and 1.367 values between 1.36 and 1.472 values between 1.47 and 1.581 values between 1.69 and 1.801 values between 1.80 and 1.911 values between 2.12 and 2.232 values between 2.23 and 2.341 values between 2.56 and 2.671 values between 2.78 and 2.89offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. volume
  2. grace
  3. height
  4. functionality
  5. width
  6. appearances
  7. size
  8. 容量
  9. direction
  10. 宽度

Suppresses

  1. ionale
  2. autiful
  3. miền
  4. swana
  5. 私立
  6. Paleo
  7. ivist
  8. chemes
  9. chooser
  10. enment