Welcome to the GoFuckYourself.com - Adult Webmaster Forum forums. You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today! If you have any problems with the registration process or your account login, please contact us. |
|
Discuss what's fucking going on, and which programs are best and worst. One-time "program" announcements from "established" webmasters are allowed. |
|
Thread Tools |
05-03-2015, 05:53 AM | #1 |
Confirmed User
Industry Role:
Join Date: Feb 2015
Posts: 203
|
[SEO] Scraping data from Google and Bing serps
Anybody familiar with it. I know that it is not an easy thing, as they are very good at blocking. There are these addons for Firefox, which can do that, but it is on page after pages basis, and not all results. I think it is SeoBook, I actually have it installed. I've never tried scraping though.
What would be the best way to pull all results for something like "site:domain-name.com"? List of urls is the most important, or actually the only thing, which is needed for this. Thanks. |
05-03-2015, 05:59 AM | #2 |
So fuckin' bored
Industry Role:
Join Date: Jun 2003
Posts: 32,378
|
Here you go: A-Parser. The online demo: A-Parser Demo | A-Parser - ?????? ??? ?????????????? SEO
__________________
Obey the Cowgod |
05-03-2015, 06:05 AM | #3 |
Confirmed User
Industry Role:
Join Date: Jul 2014
Location: 64 00 N, 26 00 E
Posts: 4,450
|
I admit nothing, and not doing it (really), but using proxies and long intervals between each "search" gets you far. I am not doing that in the fear of negative effects, at least without using proxies ("spam" searching Google from your own server might draw unwanted attention from Google).
I have heard someone using this one. Seo Panel: World's first open source seo control panel for multiple web sites |
05-03-2015, 07:28 AM | #4 |
♥♥♥ Likes Hugs ♥♥♥
Industry Role:
Join Date: Nov 2001
Location: /home
Posts: 15,841
|
Scrapebox
__________________
I like pie. |