Story how Boeing ignored their engineers to maximize share values and how it lead to several disasters are well known. I have a feeling that the same is happening with AI use nowadays at many companies.
Taking risks is fine. Without it we will not advance. But taking risks without even being aware of them or ignoring them and hoping for the best, can crash your plane in the end.