Further optimize intermediate row fetching by filtering scids first