There is a growing concern about the ethical implications of AI, particularly regarding its potential to cause social disruption and existential threats if not managed responsibly. The development of large language models raises serious ethical questions due to biases and preferences embedded in the data and the teams that built them.