Yes. I made the same experience. Roughly every hour there is a slowdown, it feels like the slow down ist not as slow as before but this could be just my feeling about it.
I will try your modified kernel tonight.
Edit: with modified kernel i can see the RX-LED of arduino is flickering now instead of steady light but ambilight ist running smooth. promising 