The New AI Agents Will Tackle Your To-Do List
Autonomous AI agents “see” your computer screen, then complete a task, from buying a concert ticket to organizing email. This opens up a world of possibilities.
To help you understand the trends surrounding AI and other new technologies and what we expect to happen in the future, our highly experienced Kiplinger Letter team will keep you abreast of the latest developments and forecasts. (Get a free issue of The Kiplinger Letter or subscribe.) You'll get all the latest news first by subscribing, but we will publish many (but not all) of the forecasts a few days afterward online. Here’s the latest…
The tech industry is buzzing about AI agents. Part of the excitement stems from the distinctive, and almost human, way some of them work: They “see” your screen.
Microsoft recently unveiled a way to build an AI agent that “follows a loop of seeing, thinking, and doing,” says Sangya Singh, VP of Power Platform Intelligent Automations at Microsoft. The process goes something like this: An agent uses AI vision to look at the screen, capturing screenshots and interpreting the pixels, so it can navigate a computer desktop or web browser, including buttons, forms and web pages, says Singh.
From just $107.88 $24.99 for Kiplinger Personal Finance
Become a smarter, better informed investor. Subscribe from just $107.88 $24.99, plus get up to 4 Special Issues
Sign up for Kiplinger’s Free Newsletters
Profit and prosper with the best of expert advice on investing, taxes, retirement, personal finance and more - straight to your e-mail.
Profit and prosper with the best of expert advice - straight to your e-mail.
It’s powered by large language models, the systems at the core of generative AI. Microsoft uses an OpenAI model, which the Microsoft-backed start-up says is “a universal interface for AI to interact with the digital world.”
The AI agent controls a virtual mouse and keyboard, using AI reasoning to navigate a computer just like a human would. “It acts, by clicking, typing, or scrolling, until the task is done,” says Singh.
How does it know exactly what to do? A human gives it instructions in plain English.
This new AI tech offers a promising way to automate any computer task, without needing preprogrammed software or special protocols between apps. Current popular automation methods need to be preprogrammed and work best on tasks with rote steps. In contrast, these AI agents don’t need such programming and can work through various hurdles, such as a screen that looks different than normal or an intrusive pop-up message.
Using vision, this type of AI can take on incredibly complex tasks and navigate any apps or websites that it comes across. For consumers, AI agents could book a hotel, rent a car or buy a product online. At work, uses include data entry, market research and invoice processing, to save time and reduce human error. These examples are just the start of a seemingly endless list of digital tasks, many of which are already emerging.
Microsoft says “irreversible” decisions and “high-risk actions,” such as large financial transactions, will have an alert for human approval. Privacy will be a big concern as AI tools use credit card data and other personal information. There’s also the chance that AI could make mistakes. These issues are well known and safeguards are being put in place.
Note that using this type of generative AI can sometimes be an inefficient way to automate tasks, as it uses a lot of computing power, though it will get more efficient over time. Look for an explosion of AI agents in the coming year or so, using vision to navigate digital chores.
This forecast first appeared in The Kiplinger Letter, which has been running since 1923 and is a collection of concise weekly forecasts on business and economic trends, as well as what to expect from Washington, to help you understand what’s coming up to make the most of your investments and your money. Subscribe to The Kiplinger Letter.
Related Content
- The AI Doctor Coming to Read Your Test Results
- How AI Will Impact Our Lives in 2025 and Beyond
- 7 Best Robotics and AI ETFs
- Can Stocks Picked by Artificial Intelligence Beat the Market?
-
Missed an RMD? How to Avoid That (and the Penalty) Next TimeIf you miss your RMDs, you could face a hefty fine. Here are four ways to stay on top of your payments — and on the right side of the IRS.
-
What Really Happens in the First 30 Days After Someone DiesThe administrative requirements following a death move quickly. This is how to ensure your loved ones won't be plunged into chaos during a time of distress.
-
AI-Powered Investing in 2026: How Algorithms Will Shape Your PortfolioAI is becoming a standard investing tool, as it helps cut through the noise, personalize portfolios and manage risk. That said, human oversight remains essential. Here's how it all works.
-
How AI Chatbots Can Secretly Give Biased AdviceThe Kiplinger Letter “Poisoned” artificial intelligence can give untrustworthy advice about finance, health and lots more. Here’s how to fend off the growing threat.
-
Farmers Brace for Another Rough YearThe Kiplinger Letter The agriculture sector has been plagued by low commodity prices and is facing an uncertain trade outlook.
-
AI Sparks Existential Crisis for Software StocksThe Kiplinger Letter Fears that SaaS subscription software could be rendered obsolete by artificial intelligence make investors jittery.
-
A Scary Emerging AI ThreatThe Kiplinger Letter An emerging public health issue caused by artificial intelligence poses a new national security threat. Expect AI-induced psychosis to gain far more attention.
-
An Inflection Point for the Entertainment IndustryThe Kiplinger Letter The entertainment industry is shifting as movie and TV companies face fierce competition, fight for attention and cope with artificial intelligence.
-
I Met With 100-Plus Advisers to Develop This Road Map for Adopting AIFor financial advisers eager to embrace AI but unsure where to start, this road map will help you integrate the right tools and safeguards into your work.
-
Humanoid Robots Are About to be Put to the TestThe Kiplinger Letter Robot makers are in a full-on sprint to take over factories, warehouses and homes, but lofty visions of rapid adoption are outpacing the technology’s reality.
-
Trump Reshapes Foreign PolicyThe Kiplinger Letter The President starts the new year by putting allies and adversaries on notice.
