[YoutubeDL] format spec: add additional checks for invalid syntax