Change one more variable type from int to enum PixelFormat.

This one was missing from r27727.

Originally committed as revision 27728 to svn://svn.mplayerhq.hu/mplayer/trunk/libswscale