Tuesday Night Technical Open
Charles Johnson
Tue Oct 9, 2007 at 6:43 pm PDT • Views: 220
Our tech-oriented readers may like to know about a discovery I made today: the Internet Archive crawler is now trying to follow links within external Javascript files. So if you have an Ajax-based script that calls a PHP program on the server, their web robot will try to open that page. Even if it’s not really a page. And this may lead to serious issues, if you haven’t accounted for this possibility. (I did.)
The robots are evolving.
I know that didn’t make sense to most of our readers, but an open thread’s an open thread…
Frank says: