My advice would be to take powerful server with lots of RAM and SSD drives (if you can put all content on SSD) with connection 1GBPS network...
For serving of the content use NGiNX + Varnish and it will FLY!!!
I can help you with the setup
www.awmzone.com/services