Quote:
Originally Posted by celandina
See my post above I have no clue how to tell what is boot and what is real
|
Here's a little PHP I have in my footer or copyright statement:
$date=date("YmdHis");
$Users_IP_address = $_SERVER["REMOTE_ADDR"];
$ref = $_SERVER['HTTP_REFERER'];
$qry = $_SERVER['QUERY_STRING'];
$ThisPage=$_SERVER['PHP_SELF'];
$usr = $_SERVER['HTTP_USER_AGENT']
$FWwritethis = $date.', '. $ThisPage.', '.$Users_IP_address.', '.$ref.', '.$qry.'^ '.$usr.PHP_EOL;
$fp = fopen('myfilename.txt', 'a');
fwrite($fp, $FWwritethis.PHP_EOL);
fclose($fp);
The $_SERVER[...] built-in feature is really great!
You can then "read" myfilename.txt from a webpage link you create, or your "files" or FTP directory. I create a new file when it reaches a pre-determined filesize. It is just text.
Most bots or spiders or crawlers, put their name in the $_SERVER['HTTP_USER_AGENT']. Some put where to get more info about the bot.
You can then add IPs to your .htaccess.
Deny from 5.9.85.245
Because I could read that it is a bot: 20170908000805, /DVD-Detail-DL.php, 5.9.85.245, , id=848^ Mozilla/5.0 (compatible; BLEXBot/1.0; +
BLEXBot) |
Snippet from that log file:
20170901005526, /DVD-Detail-DL.php, 207.46.13.146, , id=277^ Mozilla/5.0 (compatible; bingbot/2.0; +
http://www.bing.com/bingbot.htm) |
20170901005527, /DVD-Detail-DL.php, 157.55.39.152, , id=7^ Mozilla/5.0 (compatible; bingbot/2.0; +
http://www.bing.com/bingbot.htm) |
20170901005527, /DVD-Detail-DL.php, 157.55.39.152, , id=7^ Mozilla/5.0 (compatible; bingbot/2.0; +
http://www.bing.com/bingbot.htm) |
20170901011016, /DVD-Detail-TD.php, 77.75.78.165, , id=541^ Mozilla/5.0 (compatible; SeznamBot/3.2; +
Seznam.cz web search | Seznam Nápov?da) |
20170901011016, /DVD-Detail-TD.php, 77.75.78.165, , id=541^ Mozilla/5.0 (compatible; SeznamBot/3.2; +
Seznam.cz web search | Seznam Nápov?da) |
20170901011053, /index.php, 144.217.240.34, , ^ Mozilla/5.0 (Windows NT 5.1; rv:7.0.1) Gecko/20100101 Firefox/7.0.1 |
20170901011055, /index.php, 144.217.240.34,
http://gay-dvds-for-women-and-men.com/, ^ Mozilla/5.0 (Windows NT 5.1; rv:7.0.1) Gecko/20100101 Firefox/7.0.1 |
20170901011302, /DVD-Detail-DL.php, 207.46.13.146, , id=489^ Mozilla/5.0 (compatible; bingbot/2.0; +
http://www.bing.com/bingbot.htm) |
20170901011302, /DVD-Detail-DL.php, 207.46.13.146, , id=489^ Mozilla/5.0 (compatible; bingbot/2.0; +
http://www.bing.com/bingbot.htm) |
20170901012019, /titlesbyone.php, 157.55.39.152, , FindStar=Bruce^ Mozilla/5.0 (compatible; bingbot/2.0; +
http://www.bing.com/bingbot.htm) |
20170901012019, /titlesbyone.php, 157.55.39.152, , FindStar=Bruce^ Mozilla/5.0 (compatible; bingbot/2.0; +
http://www.bing.com/bingbot.htm) |
20170901013412, /indexAL.php/DVD-Detail-TD.php, 180.76.15.159, , id=1263^ Mozilla/5.0 (compatible; Baiduspider/2.0; +
http://www.baidu.com/search/spider.html) |
20170901014839, /indexAL.php/DVD-Detail-TD.php, 180.76.15.163, , id=589^ Mozilla/5.0 (compatible; Baiduspider/2.0; +
http://www.baidu.com/search/spider.html) |
20170901015022, /DVD-Detail-DL.php, 157.55.39.37, , id=1213^ Mozilla/5.0 (compatible; bingbot/2.0; +
http://www.bing.com/bingbot.htm) |
20170901015022, /DVD-Detail-DL.php, 157.55.39.37, , id=1213^ Mozilla/5.0 (compatible; bingbot/2.0; +
http://www.bing.com/bingbot.htm) |
20170901015522, /titlesbyone.php, 180.76.15.161, , FindStar=Ian^ Mozilla/5.0 (compatible; Baiduspider/2.0; +
http://www.baidu.com/search/spider.html) |
20170901015522, /titlesbyone.php, 180.76.15.161, , FindStar=Ian^ Mozilla/5.0 (compatible; Baiduspider/2.0; +
http://www.baidu.com/search/spider.html) |
20170901020312, /DVD-Detail-TD.php, 207.46.13.146, , id=1000^ Mozilla/5.0 (compatible; bingbot/2.0; +
http://www.bing.com/bingbot.htm) |
20170901020312, /DVD-Detail-TD.php, 207.46.13.146, , id=1000^ Mozilla/5.0 (compatible; bingbot/2.0; +
http://www.bing.com/bingbot.htm) |