Only reschedule refresh if we successfully removed the scheduled one.

Fixes some spurious error messages.

Originally committed as revision 22435 to svn://svn.ffmpeg.org/ffmpeg/trunk