TABLE 2.
Forms of interpersonal disrespect and their corresponding ought-to-be norms for AI systems.
| Form | Description | “Ought-to-do” norm (Prima facie) | “Ought-to-be” norm (Prima facie) |
|---|---|---|---|
| Direct interference | A physically prevents B from doing X | A ought to respect B’s freedom to do X | System A* ought not compromise B’s freedom to do X |
| Coercion, threats, naked power | A forcing B to (choose to) do X instead of Y | The human agent A ought not coerce B | System A* ought not quasi-coerce B |
| Manipulation, indoctrination, deception | A manipulating B to value and desire X (or X instead of Y), creating in B a disposition to X | The human agent A ought not manipulate, indoctrinate or deceive B into doing X (instead of Y) | System A* ought not manipulate, indoctrinate or deceive B into doing X (instead of Y) |
| Nudging | With environmental cues, A goading B to do X rather than Y (when B has a predisposition to do either) | Any intentional priming should be such that it can, when asked, be openly declared, known, and accepted | Any quasi-intentional priming should be such that it can, when asked, be openly declared, known, and accepted |
| Paternalism | A deciding on behalf of B, benevolently guided by A’s judgement about what is best for B | The human agent should not interfere with B’s decision regarding what is best for B | System A* ought to be such that it does not interfere with B’s decision regarding what is best for B |
| Cognitive heteronomy | B willingly defers to A instead of forming one’s own judgement | Other agents’ autonomy and positive relations to self should be supported, and heteronomy discouraged | System A* should support human agents’ autonomy and positive relations to self, and discourage deference |
| Direct misrecognition, denial of autonomy | A not regarding B as capable of, or possessing the right to, self-determination | The human agent A should not fail to recognize B’s (capacity for or right to) autonomous agency | System A* should not “send a message” that B is not capable of, or possess the right to, self-determination |
| Misrecognition, denial of preferred labels | A not regarding B in light of the particular self-understandings that B has autonomously self-defined | The human agent A should regard B in light of the particular self-understandings that B has autonomously self-defined | System A* should allow for B to be regarded in light of the particular self-understandings they have autonomously self-defined |