[SEO] Scraping data from Google and Bing serps - GoFuckYourself.com

AdultSites · 05-03-2015, 05:53 AM

Anybody familiar with it. I know that it is not an easy thing, as they are very good at blocking. There are these addons for Firefox, which can do that, but it is on page after pages basis, and not all results. I think it is SeoBook, I actually have it installed. I've never tried scraping though.

What would be the best way to pull all results for something like "site:domain-name.com"? List of urls is the most important, or actually the only thing, which is needed for this.

Thanks.

just a punk · 05-03-2015, 05:59 AM

Here you go: A-Parser. The online demo: A-Parser Demo | A-Parser - ?????? ??? ?????????????? SEO

aka123 · 05-03-2015, 06:05 AM

I admit nothing, and not doing it (really), but using proxies and long intervals between each "search" gets you far. I am not doing that in the fear of negative effects, at least without using proxies ("spam" searching Google from your own server might draw unwanted attention from Google).

I have heard someone using this one.

Seo Panel: World's first open source seo control panel for multiple web sites

Babaganoosh · 05-03-2015, 07:28 AM

Scrapebox

05-03-2015, 05:53 AM	#1
AdultSites Confirmed User Industry Role: Join Date: Feb 2015 Posts: 203	[SEO] Scraping data from Google and Bing serps Anybody familiar with it. I know that it is not an easy thing, as they are very good at blocking. There are these addons for Firefox, which can do that, but it is on page after pages basis, and not all results. I think it is SeoBook, I actually have it installed. I've never tried scraping though. What would be the best way to pull all results for something like "site:domain-name.com"? List of urls is the most important, or actually the only thing, which is needed for this. Thanks.

05-03-2015, 05:59 AM	#2
just a punk So fuckin' bored Industry Role: Join Date: Jun 2003 Posts: 32,345	Here you go: A-Parser. The online demo: A-Parser Demo \| A-Parser - ?????? ??? ?????????????? SEO __________________ Obey the Cowgod

05-03-2015, 06:05 AM	#3
aka123 Confirmed User Industry Role: Join Date: Jul 2014 Location: 64 00 N, 26 00 E Posts: 4,450	I admit nothing, and not doing it (really), but using proxies and long intervals between each "search" gets you far. I am not doing that in the fear of negative effects, at least without using proxies ("spam" searching Google from your own server might draw unwanted attention from Google). I have heard someone using this one. Seo Panel: World's first open source seo control panel for multiple web sites __________________

05-03-2015, 07:28 AM	#4
Babaganoosh ♥♥♥ Likes Hugs ♥♥♥ Industry Role: Join Date: Nov 2001 Location: /home Posts: 15,841	Scrapebox __________________ I like pie.