Very fast for me too!
I would suspect that the tables at this point don't need to be optimized.
But rather something else is going on in the morning.
Could be a connection issue due to:
What hops your site takes to get to the backbone or in reverse your users back to the site. One of those hops could be having some issues.
Or your host has been doing some upgrade maintenance at that time.
