Discussion about this post

User's avatar
Jon Burdick's avatar

As with so many AI longer pieces, this is almost impossible to read. I read at least four, maybe five formulations of the “it’s not X, it’s Y” that characterizes AI writing no matter how it’s trained (this is before the entire paragraph of “Not…, not…, not…) in a list.

The result of using AI is a ratio of words to ideas that creates emptiness and disengagement. It is most jarring because it aims so hard to soothe.

Please don’t do this again.

Mac Black's avatar

As in the apocryphal mathematical journal, “attention is all you need.” But we have trained contemporary LLMs on the wrong signals. Attention to benefits and harms, aimed particularly at the most vulnerable (who are most susceptible to political silence, whether through personal amotivation/nihilism or institutional design) is the key to building democratic systems that can scale to govern with both legitimacy and beneficence through accountability. Tang/Kami identify exactly the necessary primitives and the scale (as local as possible) with one exception: cryptographic identification and privacy that allows the aggregation of the information on such harms, which are by design the subject of frequent cultural taboo. By aggregating our individual experiences of harm or benefit, forming Kami (or Covenants, as I call them) to represent small polities, and then collectively acting to change institutions in response to empirically-grounded signals, we can build the datasets and AI listening infrastructure of democracy.

I also would argue that this vision is not radical enough. The Kami or covenant, powered by such an inclusive data structure, is an alternative to the capitalist extraction regime that typifies modern AI businesses and our economy at large. Our intimate conversations with chatbots, as with social media, are commodified by corporations with no fiduciary responsibility to anyone, and will increasingly be deployed to squeeze more engagement via perfection of the individual mechanisms for addictions to their machine charms (think personalized infotainment and sycophantic relational chatbots, if not frank gambling and pornography). Sin taxes and blue laws cannot govern this space; only institutions designed to offer alternative modes of human interaction and dignity through democratic Kami/Covenant. Humans are interesting enough! We have just forgotten how to stay in dense relation to one another, and need to harness the technology of our time to structurally shift our relationships toward such forms rather than letting them splinter under the weight of extractive corporate AI.

2 more comments...

No posts

Ready for more?