The core problem with AI, is “A”…. From now, it is limited to hyper fast access to extended amounts of data, following code written by people, so inherently limited to what humans can observe, document and code. Yes, we can “iterate” faster, but through a limited set of data, mostly restricted to our individual and segmented perception. While many consider that already as a threat, there really are not supra-human capabilities, otherwise we would have already answers for some of our basic unsolvable equations (cure to cancer, how to solve global warming, how to link astronomy with quantum mechanics, etc.). None of that, today, can be answered by AI.
So… let’s chill…. Until AI will observe, select data points and program itself. The day an entity would develop its own logical pathways to solve problems (what a basic cell does), it could quickly gain a primitive way of consciousness. From that point forward, we will be not longer needed as the “carriers” of consciousness and therefore we’ll become obsolete nuisances slowing down its advance.