8 Comments
User's avatar
Michael Smith's avatar

This was really good and clear. I recently encountered Jay Azhang's article on reflexivity:

https://ethylacetate.substack.com/p/reflexivity

…and noticed that the concept finished letting something click into place about what I've been calling "subjective science":

https://morphenius.substack.com/p/subjective-science

Your description is incredibly clear. Really emphasizes what I think is the key practical element: you can't remove yourself from reflexive systems you're part of in order to understand them. That graphic is incredibly clear. (Did you make it?)

Minor nitpick: yes, "predictions" given within reflexive systems are usually either spells or ignorant. And politicians are professional spellcasters. But that doesn't mean they're trying to make WHAT THEY SAY come about. Often they're trying to create an effect based on THE FACT THAT THEY MADE SUCH A PREDICTION. Reflexivity isn't simple enough to be a battle of stated goals.

I'm reminded of how supposedly the CIA hyped up the impression of a government cover-up around aliens so that there'd be plenty of cover for military experiments. I don't know if that's true, but it's PLAUSIBLE, and it's the kind of reflexive spellcasting I'd expect to happen in advanced info warfare. "There are no aliens, these UFO nutjobs are just crazy" isn't trying to MAKE there be no alien abductions. It's much weirder than that. It's (maybe) actually trying to create an impression that they ARE happening and that there's some government cover-up. So you get something like two layers of illusion.

Likewise, when Elon says he expects SpaceX to be profitable or whatever, I don't think he's necessarily trying to make SpaceX profitable. He's trying to change how space travel works. Him guiding people to expect profits can maybe cause enough support to enact the change he actually wants to see. Even if it's never profitable.

Weirdly, the stuff about "Look at how bad Elon's prediction rate is" getting publicized can mess with his methods if it spreads enough. This is a case where people who aren't used to thinking reflexively can use objective methods to break reflexive things and then look around going "Aha! I just exposed that the emperor has no clothes!" Never mind that the emperor's new clothes WERE REAL, just not physical. In the story, the child broke the spell. Saying the clothes were never real begs the question: what then did the emperor think he was wearing? What did everyone else think he was wearing?

Expand full comment
Guy's avatar

Thanks Michael—means a lot!

And thank you for linking Jay's article, I'm glad more people are thinking among the same lines. Very undervalued concept/understanding ime.

That graph didn't exist before. I got Claude to make it for me. Please feel free encouraged to take it/improve it/remix it etc. at will.

Ad the nitpick — entirely correct, and agreed. I think there's loops and loops and levels and levels here (and that misunderstandings play a biiiig part). I never know how much detail to pile on (from a pedagogical perspective).

> Weirdly [...]

Yes. The 'naive skeptic', albeit well motivated, breaks valuable things he doesn't understand. You've just guessed what Part 2 is about, how an instance of that happened in TPOT and how it illustrates that wider pattern where more naive 'truth' or 'rationality' leads to net-negative results

> Never mind that the emperor's new clothes WERE REAL, just not physical.

Perfect.

Expand full comment
Nick Redmark's avatar

And of course we need ro remind ourselves - lest we become cynical - or worse use this knowledge instrumentally to the detriment of our soul - The Way is to wait, wait and seek that which already-is-always-has-been true, good and beautiful, and speak that into more being, creation by recapitulation

Expand full comment
Nick Redmark's avatar

Already is even if only in seed form

Expand full comment
Adam's avatar

🔥

Expand full comment
ramjet_oddity's avatar

I broadly agree—but now it's interesting then to consider how good his spellcasting is, and how to assess it. did a spell work only if it caused that exact thing to happen, or can we count various weaker effects

Expand full comment
tavis's avatar

Weak effects and "collateral damage" are still effects and can be used to do things. If your gun always shoots a little to the left you can hit the target by aiming to the right.

Expand full comment
Chris Lakin's avatar

Ohhhh by reflexivity you mean self-fulfilling prophecies and Newcomb's Problem and such

Expand full comment