Also never early frame drop the first frame after a flush.

Signed-off-by: Marton Balint <cus@passwd.hu>