This will allow making AVFilterPad opaque for the calling apps, since
those are the only two fields that can be useful to the users.