The Recent Visitors line displays usernames for a set variable of time (which can be updated through the Control Panel on the Recent Visitors tab under the General link) this time will allow you to adjust how long you wish users to show in recent visitors.
Just because a username is shown in the recent visitors doesn't mean they're online "now", it simply means they've been online within so many minutes (defined by the "Minutes to Track Users:" option).