Fix some casting required in mask/endian calculation