What displays in your webserver log when this issue appears? A 500 error generally indicates an issue with the Web server
I'd have to catch one in the act to even know where to look in the logs. It's been my experience that any php failure will generate a 500 error. I'll enable debugging and see if we can catch the error.