You feel as though an oppressive weight opposes your actions. You have spent an additional action point to attempt this action.(2023-03-23 20:57:14).
Seems to just spend MP for no benefit, so (assuming I'm not just missing what a potential use is) I think it would be more player-friendly to not let you do it under those circumstances. A tooltip could explain why the button is grayed-out.
Alternatively, make MV immune to this effect, but that would be a buff rather than just QoL.
In my case it was being in an ally's stronghold, but yeah, I'm inclined to say any case where MV would be canceled out and do nothing for you but drain your MP. There are other cases where you don't notice and do some things you might otherwise have not, but at least then you're actually accomplishing something, just not as efficiently as you wanted.