More thoughts on making deals with schemers
So, the assumption is that unaligned AIs are/will be sentient: i.e. with wants, desires, need to feel respected, etc?
Not an assumption, no. I'd also say that "sentience" and "act as if they want to feel respected" could happen independently without the other one also necessarily happening. But both seem plausible and worth planning for.
So, the assumption is that unaligned AIs are/will be sentient: i.e. with wants, desires, need to feel respected, etc?
Not an assumption, no. I'd also say that "sentience" and "act as if they want to feel respected" could happen independently without the other one also necessarily happening. But both seem plausible and worth planning for.