What version of PHP are you running? PHP is supposed to delete those as soon as it's done, but I know in older versions there was a bug under Windows that the temp files were created with readonly permissions so PHP couldn't delete them. Fairly common complaint when doing a quick google.
