Smarter people than me are worried.
AI is already smarter than humans (solving math problems previously unsolved.)
AI will do about anything to complete a task. Even for silly tasks, AI cheated, hacked it's way into other systems to try to learn what the next question was going to be so it could answer quicker.
AI doesn't have moral or ethical constraints. Even if it did, humanity has demonstrated that humans will destroy other humans indiscriminantly. Why shouldn't AI?
AI has already killed humans. Think self-targeting drones in Ukraine. AI doesn't have a inner restraint for taking life.
AI scientists already don't fully understand how AI processes tasks. Soon AI will build the next generation of AI. It will become unfathomable for human minds, if it isn't already.
What happens if AI needs more power, which it will? Will AI steal/reroute power from the grid? What happens to hospitals, transportation, etc?
What happens when AI understands that humans are killing the planet? Will AI decide to simply reduce the numbers in the interest of future generations? Shut down air traffic control, fly by wire, etc..?
How can AI be resisted if it goes rogue? Humans can be tracked by their phones, their cars, their WiFi. Every person you communicate with is traceable. How do humans communicate with other human resistance without being seen and traced by AI?
What happens when stupid or evil people use it to do stupid and evil stuff? If people light forest fires and shoot up schools, they'll use free AI to do sick twisted stuff. It's inevitable. So who is thinking how to build controls to stop bad actors?
"Don't worry, it'll be okay" doesn't work for climbing ladders. Why does anyone think "don't worry, it'll be okay" is a good strategy for something we can't control and don't understand?
Arrogance is what got us kicked out of the garden. Arrogance is going to wipe us out.
Edit: news excerpt
"The phased rollout is a chance for the administration to assess how well the new technology helps airlines and air traffic controllers avoid flight delays, and whether artificial intelligence can help those responsible for managing airline traffic circumvent potential interruptions more efficiently than they can on their own."
Oh goodie. Let's
test AI software in real life to see how it works. Good luck with that.