Don't look through primitive casts; they actually do change the underlying type!

Don't look through primitive casts; they actually do change the underlying type! #5572