Does swap only come into play once the system starts running out of RAM?

Currently server is running on: [Dual CPU] intel Xeon E5620 2.40GHz with 12GB RAM

Seems like a single E5-1620 v4 should at least handle the same load, especially as it'll be coming with 32GB RAM so plenty of memory to allocate to SQL.