Quote:
Originally Posted by WarChild
Depending on the complexity of the scraping and warehousing requirments, I don't think it would take that long to do.
Personally I'd start with a third party component like Chilkat HTTP library which has built in proxing support and makes working with http uber simple.
You could easily house it on a webair $99 unmanaged windows server with 10mbit included bandwidth. SQL Server license is another $40 a month or something like that.
|
A lot of the data can be pulled from XML feeds and via a couple different APIs. I'm still researching my options for a while yet. I want to be sure I come at this from the right angle this first time. Windows is sounding like a good option. If it ever comes down to it, I could always run the software locally for my own use.