Current discussions about ethical use of artificial intelligence for cultural heritage focus on bias, privacy, and surveillance. This paper illustrates how ethics of heritage AI should expand beyond those themes into broader human and environmental exploitation AI causes that put it at odds with efforts toward decolonization. This paper suggests a holistic, interdisciplinary approach that examines the broader effects of AI used for heritage work and focuses on AI that is used for collections and exhibits. It focuses on AI use by heritage organizations such as libraries, museums, and archives, in addition to non-heritage groups participating in heritage work.