To reiterate what Ruben said:
When you access your site and login a session file is created, it'll linger around until the server purges it at whatever interval PHP is configured to remove it.
These files won't immediately delete themselves, they're not meant to, they will be around for a while to house information about the session.
If you'd like to read about them I'd suggest looking at the
PHP Manual: Sessions