build: Move -Wcast-qual to the extra_warnings

It amounts to about 1/2 of the warnings generated and does not help
spotting anything useful.