The announcement of a new AI model or feature fills me with a mixture of anticipation and dread. I’m excited to see what “new thing” I might be able to do, but I also know that some of my existing processes and systems might break as a result.
Every AI tool comes with the disclaimer that it can make mistakes. You might set up a workflow that is perfectly fine one day and perfectly awful the next.
It’s an ongoing challenge. Unlike traditional software, once an AI system is up and running, it’s not set-it-and-forget-it. Even a system that seems to be working fine needs an occasional check-in or fine-tuning.
{“blockType”:”mv-promo-block”,”data”:{“imageDesktopUrl”:”https://images.fastcompany.com/image/upload/f_webp,q_auto,c_fit/wp-cms-2/2025/11/work-better-1.png”,”imageMobileUrl”:”https://images.fastcompany.com/image/upload/f_webp,q_auto,c_fit/wp-cms-2/2025/11/work-better-mobile-1.png”,”eyebrow”:””,”headline”:”u003Cstrongu003ESubscribe to Work Betteru003C/strongu003E”,”dek”:”Thoughts on the future of work, career pivots, and why work shouldnu0027t suck, by Anna Burgess Yang. To learn more, visit u003Ca href=u0022https://www.workbetter.media/u0022u003Eworkbetter.mediau003C/au003E.”,”subhed”:””,”description”:””,”ctaText”:”SIGN UP”,”ctaUrl”:”https://www.workbetter.media”,”theme”:{“bg”:”#f5f5f5″,”text”:”#000000″,”eyebrow”:”#9aa2aa”,”subhed”:”#ffffff”,”buttonBg”:”#000000″,”buttonHoverBg”:”#3b3f46″,”buttonText”:”#ffffff”},”imageDesktopId”:91457605,”imageMobileId”:91457608,”shareable”:false,”slug”:””,”wpCssClasses”:””}}
The predictable AI failures
AI can stop working in some very predictable ways. Maybe it’s connected to an external tool (like your email), and the connection expired. Some AI tools require your computer to be on/awake for tasks to run. You might get an error message, or the output never shows up.
These failures are easy to address because it’s often clear what went awry. You reconnect and try again.
I rely heavily on AI scheduled tasks and have a notification system built in. If something breaks, I get an email telling me to review the process. That way, I realize immediately that something went wrong and can fix it.
The unpredictable AI failures
The harder failure is when an AI process runs as expected, but the output gets worse. Models and functionality change almost daily. You may have a well-crafted prompt that gave you what you were looking for last month, but the results are noticeably different today.
People in the industry call this “drift.” Most setups have no way to catch it, since technically nothing broke.
I use Claude and struggled with Opus 5.0. For the way I use AI, the output was “off” in a way I couldn’t quite put my finger on. I found myself returning to Opus 4.6, which was the last model where I felt comfortable. (As an aside: the update to Opus 5.5 went much more smoothly.)
The most reliable way to catch drift is to consistently review AI output, no matter how long it has been working as expected. Give every review the same critical eye you gave it the first time you tested an AI process.
Drift is inconvenient, especially when the whole point of an automation is to save you time. But you can’t count on a model to behave the same way from one month to the next. I look at it this way: a 5-minute review is still faster than the 20-30 minutes it may have taken me to do the task manually.
Factor ‘AI maintenance’ into your routine
AI tools save me a lot of time. But keeping my prompts and processes working smoothly takes time, too. That time has to come from somewhere.
Some fixes can’t wait. When a notification tells me something failed, I often need to look at it right away. Depending on what broke, it can throw off my whole workflow until I fix it.
Other changes I have to set aside time to review thoroughly. When a new model is announced, I don’t switch over right away. A big change in output could derail an afternoon, so I take time to test it first.
Upkeep is part of the cost of any AI system you set up. And if a process takes more time to maintain than it saves you, it’s fair to ask whether it’s worth keeping.
{“blockType”:”mv-promo-block”,”data”:{“imageDesktopUrl”:”https://images.fastcompany.com/image/upload/f_webp,q_auto,c_fit/wp-cms-2/2025/11/work-better-1.png”,”imageMobileUrl”:”https://images.fastcompany.com/image/upload/f_webp,q_auto,c_fit/wp-cms-2/2025/11/work-better-mobile-1.png”,”eyebrow”:””,”headline”:”u003Cstrongu003ESubscribe to Work Betteru003C/strongu003E”,”dek”:”Thoughts on the future of work, career pivots, and why work shouldnu0027t suck, by Anna Burgess Yang. To learn more, visit u003Ca href=u0022https://www.workbetter.media/u0022u003Eworkbetter.mediau003C/au003E.”,”subhed”:””,”description”:””,”ctaText”:”SIGN UP”,”ctaUrl”:”https://www.workbetter.media”,”theme”:{“bg”:”#f5f5f5″,”text”:”#000000″,”eyebrow”:”#9aa2aa”,”subhed”:”#ffffff”,”buttonBg”:”#000000″,”buttonHoverBg”:”#3b3f46″,”buttonText”:”#ffffff”},”imageDesktopId”:91457605,”imageMobileId”:91457608,”shareable”:false,”slug”:””,”wpCssClasses”:””}}
Source link