It is over written by the new one if the same file format. If you upload a .gif then your next avatar is a .jpg then the .gif remains and is abandon by the software but remains in your upload directory.