8svx: log an error message if output buffer is too small

Based on a patch by Stefano Sabatini.
git.videolan.org/ffmpeg.git
commit e280a4da