I will not promote - Has anyone replaced an AI provider halfway through a project?

On paper, it sounds pretty simple - swap one API for another and update a few things. But I’m guessing it gets a lot messier since other parts of the product depend on how the original provider works. Has anyone gone through this? Was it actually as painful as it sounds, or did it turn out to be pretty manageable?