Digg Hits Bottom, Digs

My God!

What does all this mean? Seriously, I'm not a techie

Bad bot, no doughnut.

The bigger question is why?

re: #3 Charlie Martel

What does all this mean? Seriously, I'm not a techie

It looks like the crawler is trying to make a snapshot of the entire site.

re: #3 Charlie Martel

What does all this mean? Seriously, I'm not a techie

Digg is downloading large chunks of LGF, sapping resources and slowing us down.

Don't trust the digg robot.

Ah, the intellectual fountain known as Digg.

Where stories against radical Islam, the excesses of the left, and even Scientology are buried by bury brigades.

I never liked it.

re: #6 Charles

Is this a weird sort of DOS attack or do they just want to grab the site and do something with it?

Big Digg is ripping LGF off!

re: #6 Charles

It looks like the crawler is trying to make a snapshot of the entire site.

Strange. I wonder why. I hate robots that don't follow the rules.

Sure you don't mean 10 minutes? (600 seconds = 10 minutes)

re: #6 Charles

why would they wanna do it?

re: #9 marwan's daughter

Ah, the intellectual fountain known as Digg.

Where stories against radical Islam, the excesses of the left, and even Scientology are buried by bury brigades.

I never liked it.

Well we do find out what is important to pale pasty residents of mama's basement.

BLAMMO !

re: #5 Bubbaman

Digg.com is infested with leftie kidz.

But, why?

Never trust a robot.

re: #10 joncelli

Is this a weird sort of DOS attack or do they just want to grab the site and do something with it?

No, it's not an attack. I don't know what they're doing, but it's going through every file it can find and requesting nonexistent files as well. Acting a lot like a spam scraper, in fact.

I never liked Digg

re: #14 winston06

why would they wanna do it?

Perhaps to cherry-pick at their leisure.

Theft is the sincerest form of flattery.

Robots can be nasty.

[Link: www.youtube.com...]

What if that robot collected all of the intelligence of the great minds at lgf? It could take over the world.
"I don't think you want to post that, Dave"

I have a copy of the entire internet downloaded on a 3.5 floppy disc.

I Diggbot

The Three Laws:

A robot may not injure a liberal cause or, through inaction, allow a liberal cause to come to harm.
A robot must not obey orders given to it by right-wing blogs, except where such orders would conflict with the First Law.
A robot must protect its own existence as long as such protection does not conflict with the First or Second Law.

Looked through the logs some more and I don't think there's anything nefarious going on.

I think it's out of control; it seems to be confused by the mod_rewrite trick I described a few days ago, and isn't properly using the BASE tag.

The crawler is using the PEAR HTTP_Request class, and it may have a bug.

Kick the bot in the nuts.

re: #29 Charles

Danger! Danger!

It's not a bug, it's a feature.

Sorry, shmuli - no phone numbers allowed. If you want to link to a whois lookup that's OK.

The internet is out of control! Run for your lives!

re: #26 Lawrence Schmerel

I have a copy of the entire internet downloaded on a 3.5 floppy disc.

You sure you got it all? It took me two floppies.

OT

Flying Pig Moment!Ex-Pink Floyd Bassist Roger Waters Unleashes School Bus-Sized Pro-Obama Inflated Pig at Coachella.

re: #36 Cartman

You sure you got it all? It took me two floppies.

Got to zip it

Charles --

Sorry. Will do it right next time.

Did not mean to make more work for you.

Shmuli

re: #38 Kragar (Proud to be Kafir)

Got to zip it

Sheesh. I knew I forgot something.

re: #27 MI DB

I Diggbot

DB - Diggbot?

Michigan Diggbot?

re: #36 Cartman

I haven't finished downloading littlegreenfootballs.com, yet.

re: #31 HelloDare

Kick the bot in the nuts.

Take him to Detroit!

[Link: www.youtube.com...]

re: #42 Lawrence Schmerel

I haven't finished downloading littlegreenfootballs.com, yet.

Does someone keep blocking your robot?

re: #37 jcm

OT

Flying Pig Moment!Ex-Pink Floyd Bassist Roger Waters Unleashes School Bus-Sized Pro-Obama Inflated Pig at Coachella.

Saw this report on it

the swine floated into the night sky. Waters said sadly and comically, "That's my pig."

Never to be seen again, hopefully BHO pulls the same act

re: #37 jcm

OT

Flying Pig Moment!Ex-Pink Floyd Bassist Roger Waters Unleashes School Bus-Sized Pro-Obama Inflated Pig at Coachella.

short bus?

re: #42 Lawrence Schmerel

I haven't finished downloading littlegreenfootballs.com, yet.

Bypass the Tag Storm, and it goes a lot quicker.

;)

re: #44 CyanSnowHawk

Do you know something that I don't?

re: #20 Charles

Acting a lot like a spam scraper, in fact.

That's what they get for buying their droids from Sand People.

}:)     [ ... so to speak ... ]

Most likely they want to put up a mirror site and lure lgf posters there
to get the e-mail address of posters here and do not nice things.

I, tfk say carefull of this.

re: #47 Cartman

Bypass the Tag Storm, and it goes a lot quicker.

;)

Plus, turn off any porn filters when you get to the throbbing memo

Charles,

re-direct these things to say the

NSA site.

re: #47 Cartman

You can get really stuck in that Tag Storm.

re: #28 OldLineTexan

The Three Laws:

A robot may not injure a liberal cause or, through inaction, allow a liberal cause to come to harm.
A robot must not obey orders given to it by right-wing blogs, except where such orders would conflict with the First Law.
A robot must protect its own existence as long as such protection does not conflict with the First or Second Law.

If only Asimov knew the horrible truth.

re: #51 Kragar (Proud to be Kafir)

Plus, turn off any porn filters when you get to the throbbing memo

True dat. The floppy drive doesn't like the throbbing memo.

Hey guys, can you please knock it off?

re: #55 Cartman

True dat. The floppy drive doesn't like the throbbing memo.

I almost feel compelled to make a 'hard disk' joke...

re: #29 Charles

Looked through the logs some more and I don't think there's anything nefarious going on.

I think it's out of control; it seems to be confused by the mod_rewrite trick I described a few days ago, and isn't properly using the BASE tag.

The crawler is using the PEAR HTTP_Request class, and it may have a bug.

So in other words, your custom code for the site has driven this poor Diggbot insane.
[insert evil laughter here]

re: #48 Lawrence Schmerel

Do you know something that I don't?

In a thread about a runaway robot trying to download all of LGF, and Charles blocking the IP of said robot, you make a joke about not being finished downloading LGF, and you miss that reference?

I'm glad I'm not the only one that does things like that.

Understand, lgf's is hurting a loon commie, one the msm and other power mad commies like Soros wants in the White House, its not
a game to these power hungry loons.

re: #19 bosforus

Never trust a robot.

Now, that is one weird sci-fi series. Never heard of it before.

re: #58 Da_Beerfreak

So in other words, your custom code for the site has driven this poor Diggbot insane.
[insert evil laughter here]

Considering the bot's source, it was probably 3/4 of the way there already.

IDF: Palestinian family killed by terrorist bomb

Wasn't Israel.

But the damage is already done.

re: #60 taxfreekiller

Understand, lgf's is hurting a loon commie, one the msm and other power mad commies like Soros wants in the White House, its not
a game to these power hungry loons.

I can't repeat and emphasize enough the fact that for this bunch:

POWER IS LIFE!

re: #59 CyanSnowHawk

I have no idea what you are talking about. I am going back to work. I'm going to copy this sucker if I have to do it one page at a time.

re: #61 Cygnus

Now, that is one weird sci-fi series. Never heard of it before.

I have an Angela Android

adult ears

Charles send to the address, this

[Link: www.youtube.com...]

re: #49 Kulhwch

That's what they get for buying their droids from Sand People.

Jawas, jawas, jawas, jawas!

Uh, did I just expose my inner-geek?

re: #63 Ben Hur

IDF: Palestinian family killed by terrorist bomb

Wasn't Israel.

But the damage is already done.

I told junior not to bring work home.

Well, time to take a spin on the new Harley. Better get it in while I can. It's supposed to snow here tomorrow. Global warming my ass. Hrrumph.

re: #68 Silhouette

Jawas, jawas, jawas, jawas!

Uh, did I just expose my inner-geek?

Nah, you'd be doing that if you asked if the Diggbot speaks Bocce.

/

re: #63 Ben Hur

IDF: Palestinian family killed by terrorist bomb

Wasn't Israel.

But the damage is already done.

It's amazing how fast YNET goes back and edits and changes Ali Waked's articles once the truth comes out.

This has happened more than just a few times.

He reports what his "souces" tell him, then it comes out that it was complete BS, and they quickly and quietly change the article online.

Is that normal?

Union Bots Never do more work than coded
Same with Union Workers
Charles
Unionize the bots and every 10 minutes they will need a 20 minute break
LOL

re: #26 Lawrence Schmerel

Are you an Al Gore Foolower?

re: #74 Cap'n DOC

You know, you have Al Gore to thank for the fact that you can use your computer to ask me that question.

See update above - nothing bad about the Diggbot, it has a bug. And it was ignoring robots.txt.

re: #76 Charles

You sure know how to ruin a good comment thread.

Interesting. I think Digg maintains a mirror site of the submitted links because if the article becomes popular, the traffic deluge often causes the original link's server to have a heart attack.
It sounds like the mirroring code may be buggy.
I did a search at Digg for "littlegreenfootballs" and it looks like almost every story on LGF has been dugg at least once, but the ones with the most diggs in the last 2 days only have 32 diggs. None of them made the front page.
I don't know how many diggs it takes before they mirror the story.

On a different note... I heard a coupla months back about a new rival to Digg, that did the same sorts of vote-for-a-site stuff that Digg does, but didn't have some of the flaws of Digg... but I couldn't remember the name of the place. So, I did a Google search for "digg rival" and it turns out there's more than one wanna-be Digg out there.

I think Mixx might have been the one I'd heard about, though, but there's also one called NewsPond, and another called Reddit, and it seems Netscape (now calling themselves Propeller) have come back as a Digg competeter, too. Even Yahoo! seem to be getting into the act with their My Web 2.0. And there's another thing called Drupal or Drigg or something of the sort, apparently.

Wow!

I suppose LGF should add at least one of these new guys to the set of buttons we can click on to call attention to specific articles like we do now with Digg and de.lic.ious and stuff. Problem is, where do you stop in adding these guys? (There are probably even more of them out there that I haven't found in that cursory search.)

Damn robots.. next they'll want the vote.

(It was breaking the robots.txt rule, though, as it thrashed around trying to find files that didn’t exist.)

Sounds like in MiB when the Edgar-Bug is thrashing around smashing display cases in the jewelry store looking for the galaxy: Where is it?!?!

Seems funny to me...

Charles, you should read Michael Crichton's Prey, if you haven't, yet.

We are building our own demise...

I've found Digg to be rife with robots: their users.

re: #83 Mathew1977

Hehe!

I hope it didn't scare the gerbils.

re: #84 NomadOfNorad

Glad you liked it.