I follow you on the informed vs ignorance argument.
But, given that you list many of the ethical reasons against AI, there is little "informed use" that will also stand up to the ethical razor.
The Luddites were not ignorant. They were the technically able, who knew how to operate the machines, but fought against using them BECAUSE they understood them.
In my work I use deterministic scientific models, but I work with machine learning models as well. And all my colleagues (who are real experts in how neural networks work) are opposed to generative AI.