video: decouple internal pixel formats from FourCCs

mplayer's video chain traditionally used FourCCs for pixel formats. For
example, it used IMGFMT_YV12 for 4:2:0 YUV, which was defined to the
string 'YV12' interpreted as unsigned int. Additionally, it used to
encode information into the numeric values of some formats. The RGB
formats had their bit depth and endian encoded into the least
significant byte. Extended planar formats (420P10 etc.) had chroma
shift, endian, and component bit depth encoded. (This has been removed
in recent commits.)

Replace the FourCC mess with a simple enum. Remove all the redundant
formats like YV12/I420/IYUV. Replace some image format names by
something more intuitive, most importantly IMGFMT_YV12 -> IMGFMT_420P.

Add img_fourcc.h, which contains the old IDs for code that actually uses
FourCCs. Change the way demuxers, that output raw video, identify the
video format: they set either MP_FOURCC_RAWVIDEO or MP_FOURCC_IMGFMT to
request the rawvideo decoder, and sh_video->imgfmt specifies the pixel
format. Like the previous hack, this is supposed to avoid the need for
a complete codecs.cfg entry per format, or other lookup tables. (Note
that the RGB raw video FourCCs mostly rely on ffmpeg's mappings for NUT
raw video, but this is still considered better than adding a raw video
decoder - even if trivial, it would be full of annoying lookup tables.)

The TV code has not been tested.

Some corrective changes regarding endian and other image format flags
creep in.

1 files changed, 4 insertions, 8 deletions

diff --git a/video/out/vo_vdpau.c b/video/out/vo_vdpau.c
index 42c8bc6a24..1d5f0ed86c 100644
--- a/video/out/vo_vdpau.c
+++ b/video/out/vo_vdpau.c
@@ -756,15 +756,13 @@ static int initialize_vdpau_objects(struct vo *vo)
 
     vc->vdp_chroma_type = VDP_CHROMA_TYPE_420;
     switch (vc->image_format) {
-    case IMGFMT_YV12:
-    case IMGFMT_I420:
-    case IMGFMT_IYUV:
+    case IMGFMT_420P:
         vc->vdp_pixel_format = VDP_YCBCR_FORMAT_YV12;
         break;
     case IMGFMT_NV12:
         vc->vdp_pixel_format = VDP_YCBCR_FORMAT_NV12;
         break;
-    case IMGFMT_YUY2:
+    case IMGFMT_YUYV:
         vc->vdp_pixel_format = VDP_YCBCR_FORMAT_YUYV;
         vc->vdp_chroma_type  = VDP_CHROMA_TYPE_422;
         break;
@@ -1428,11 +1426,9 @@ static int query_format(struct vo *vo, uint32_t format)
     int default_flags = VFCAP_CSP_SUPPORTED | VFCAP_CSP_SUPPORTED_BY_HW
         | VFCAP_OSD | VFCAP_FLIP;
     switch (format) {
-    case IMGFMT_YV12:
-    case IMGFMT_I420:
-    case IMGFMT_IYUV:
+    case IMGFMT_420P:
     case IMGFMT_NV12:
-    case IMGFMT_YUY2:
+    case IMGFMT_YUYV:
     case IMGFMT_UYVY:
     case IMGFMT_VDPAU_MPEG1:
     case IMGFMT_VDPAU_MPEG2: