Using Patches With Flows in Managed Packages

The ISV guide says Flows cannot be included in patches. But since we cannot remove items from patches, and thus cannot remove the Flow, doesn't this mean that if you have a Flow in a Managed Package you can NEVER use patches for anything??

That stinks if so but I just tried doing a patch and it's giving me a Flow error, even though Flow wasn't part of patch.