Started KVTop, a research blog on how to interpret AI models on lower layers.
some of my recent thoughts
AI is changing the shape of our civilization. I feel blessed and fortunate to be old enough to appreciate how rare a moment this is, and still young enough to take part in it.
I see the philosopher’s stone, Aladdin’s lamp, and Pandora’s box in AI models. Intelligence is power. I believe everyone should have a share in it. That is why AI must stay open source.
The point of igniting fire was to pass it on. The people who keep that fire alive deserve much wider support, and their work should be open to equally wide public scrutiny.
One question I wish we took more seriously is why a model did what it did. Which parts of the model produced a particular answer? Would changing them change the answer in the way we expect? We spend a great deal to build these systems. I’d like to see more people, time, and money go into understanding them.
How I try to live
Between birth and death, I want to try things and leave room for chance. Some of the possibilities worth exploring only come into view once you’ve begun. I try to do what I can, leave the outcome to fate, and meet it with an even temper and a clear conscience.
Part of what I find beautiful about life is its capacity to make a little local order in a universe tending toward heat death. For a while, a small part of that universe is ours to shape. The form we give it is a matter of taste.