I'm currently hosting the site on a server with different websites on it.
But I've got one 4GB RAM frontend server (quadcore) with I3D.net (35 euro per month) and I've got a overkill fileserver with Leaseweb.
In order to just start the site of, the quadcore server would suffice in the beginning. Afterwards, I'd recommend a server with more RAM/bandwidth.