Ok, think I nailed the bug. Seems like the birthday icon shows up according to server time, disregarding the server time adjustment in the CP. So if you host your server in a different location than your core user group, the "birthday hours" will depend on where the server is located...