Same problem with my N2+ with two different USB BT dongles. I gave up and just got a FLIRC and connected my Harmony hub via IR to the Flirc. It is working flawlessly for more than week.
All USB ports on Odroid N2 are USB3.0 and they are stacked so interference could be a big issue, especially these USB3.0 ports on SBC were never sheilded like they were on laptop/desktops
Did you try to remove all other USB3.0 devices, and wire the BT/remote receiver through a USB2.0 hub/extender cable to keep it away from the onboard USB3.0 ports? This could minimize the interference
A dirty workaround is to plug the receiver always on a USB2.0 hub/extender cable placed far way from the board (30cm should be safe enough)