Hmm, turns out that in my case, it's an imported video file emulating a computer screen is causing the problem. If I delete this asset, the render works fine.
I also have this problem on project that is 767 frames long. Running 6.53 on windows 10. I can also upload the project if this will help.