Yes, this happens with S905X4 boxes, I have one too. Only MKV playback is the least problematic with the latest ng nightly, even as of today. DTDL and BDMV playback is worse, especially when you try to do a FF or RW.
But sadly, the ng builds are no longer getting any active development from the CE team, except for xbmc upstream updates.