You are right. It happend to me in hell dungeons (lvl 10 or so) after ~1 1/2 hours (i was alone in the game). (Also in other places, but that was not so timetaking) I realy tried to find a way to solve it... Only rejoin helped.
I could only say, that you should try to avoid using it / use it with careness in such situations.
If you find another solution, plz post it. gl