The problem is that all it takes is for the AI to confidently make one false statement and have no human check it for something to go terribly wrong. AI isn’t concerned with truth, just generating based on data.