If you have a lot of unread posts and have full post tracking turned on where it displays the unread numbers in red, then this is probably contributing. If there are many of those then it really adds up in execution time.
What you can try do to see if that's part of the issue is Mark all Read while logged in and see how it goes then.