Discussion about this post

User's avatar
Taylor G. Lunt's avatar

I think the motivation for these beliefs is a disbelief in magic, and a belief that somehow, consciousness probably arises from the computation the brain is doing. Otherwise, you have to either believe in souls, or be a panpsychist who thinks gravel is conscious.

If consciousness is computational in nature, then you have to ask what kinds of computations lead to consciousness. Probably very simple computations do not, otherwise your calculator is conscious, and oops the gravel is conscious again because physical reality is essentially performing simple computation all the time.

So you're left with only the possibility that some special kind of complex computation leads to consciousness. Probably something related to recursive processing, or global workspace theory, or something like that. Yudkowsky's beliefs are all downstream from that.

By the same logic, I also think you maybe aren't conscious when you dream, though your memories of having dreamt are experienced while conscious.

Scott Alexander's avatar

Does Eliezer explain why he thinks this?

11 more comments...

No posts

Ready for more?