Best way to generate a sitemap for a large site?
 

I have 15,000+ pages on my site what is the best way to generate a sitemap for google? I have downloaded a few freebie sitemap generators but they only do 5000 pages...I was hoping for a free program anyone know of any?

do they run from a database or are they all static?

well they run from a database, but they have been assigned static .html urls

I am using prestashop if that helps? which comes with a sitemap module but I am on a shared account with hostgator which only allows so much time for any given process to finish otherwise it kills it.

http://code.google.com/p/sitemap-gen...emapGenerators

hope this helps

if it needs to keep up then you may have to rerun it every now and then, but you could script a direct feed from your back-end and build the file that way, if the site i small(ish) then you could have it update automatically, providing it doesn't time your server out

I would be happy to help you put one together like: http://foxydrop.com/sitemap.xml, this automatically pulls the info from the db, as it is mainly used by spiders I have not yet made it a standalone file that generates itself. You can extend your sitemap to include as much information as you want, but it would be the time to construct it that I think you're having a few issues with if I'm not mistaken.

Rob

thanks that was what i was looking for =)

I am running a crawler right now, i'll see how it goes...

how did the crawler go?

Have a look at xmlsitemaps.org

I use this one:
http://www.xml-sitemaps.com/

Don't use a sitemap. Google will find your pages.