LGF Technical Update - Infrastructure Improvements

Charles Johnsonfollow me on twitter
Sat Feb 24, 2007 at 6:37 pm PST • Views: 227

Just to keep things interesting, I’ve changed the way our Ajax news feeds are displayed when you load an LGF page. Previously, the default news feed was Yahoo’s ‘Top Stories’ feed. Since this gets stale pretty quickly, now the first news/blog feed that appears when you load a page is chosen at random from the list. So one page load you might see The Corner, and the next, the Daily Kos.

(LGF is not responsible for ideological whiplash injuries suffered from unsupervised reading of news feeds, of course.)

Also, when you pick a different feed from the drop-down menu, while the Ajax back-end system goes out and fetches it, the message “Loading…” is displayed. Just to keep things all nice and informative. I’m into feedback.

In the not-visible-but-important category, I made a couple of large changes in the LGF Blog Engine that, under normal operating conditions, will greatly improve the performance of the site for most lizards. The registration system was designed in the Jurassic Era of LGF, without thought for scaling to 3 million plus visitors a month, and it was making our server’s hard disk do waaaaay too much work. That disk thrashing has now been reduced by a factor of 20 or more, by our new session-based authentication code.

To further decrease server load, another bottleneck has been eliminated in our statistics display. The ‘visitors online’ count was previously generated during each page load; now it’s cached at one minute intervals by a cron job. Instead of thousands of directory reads every minute, it’s now down to one. (The ‘visitors online’ count works by counting the number of active PHP session files.)

If an LGF post hits the Digg front page, or the Drudge Report, or some other huge-traffic site, these improvements are like origami in a hurricane; in that case our single server just can’t give out connections fast enough, and we’ll still slow down and possibly crash. But as I said above, under normal conditions these improvements should make comment posting and overall site performance significantly better.

For longer-term performance issues, our second server isn’t online yet, but the infrastructure is being readied.

UPDATE at 2/24/07 6:50:38 pm:

Quite a few people have reported a problem where the ‘Digg’ link at bottom left of each post seems to lead to the wrong page at Digg.com.

Unfortunately, this isn’t something I can fix; that little Digg button area is created by code that comes from Digg, and I’ve verified that I’m passing it the proper parameters. Their code seems to have a caching problem in some browsers; I’ve never seen this happen in Safari.

Advertisement

182 comments

^ back to top ^

Name:

Pass:

Register Forgot Your Password? Re-send Confirmation (To log in, cookies must be enabled in your browser!)

Turn off ads by subscribing!
For about 33 cents a day, our subscription option turns off all advertisements at LGF!
Read more...


► LGF Headlines

  • Loading...

► Tweeted Articles

  • Loading...

► Tweeted Pages

  • Loading...

► Top 10 Comments

  • Loading...

► Bottom Comments

  • Loading...

► Recent Comments

  • Loading...

► Tools/Info

► Tag Cloud

► Contact

You must have Javascript enabled to use the contact form.
Your email:

Subject:

Message:


Messages may be published in our weblog, unless you request otherwise.
Tech Note:
Using the Contact Form

More Partners

Compare Electricity Prices in your area. Texas Electricity is deregulated; you have the right to choose Texas Electric Rates from among many Texas Electric Companies.

Democracy, whisky, sexy!

TwitterFacebook
LGF Pages
Recent Pages

Daniel Ballard
Video and Photos: SpaceX's Rendezvous With the Space Station
3 hours, 55 minutes ago
Views: 56 • Comments: 2
Tweets: 0 • Rating: 0

Michael McBacon
Kansas governor signs 'Shariah bill' to ban Islamic law
4 hours, 13 minutes ago
Views: 106 • Comments: 5
Tweets: 0 • Rating: 3

MikeySDCA
Glenn Beck in Exile: Don't cry for the former Fox star—he's building a 24/7 media empire in his loopy image.- the Atlantic
4 hours, 15 minutes ago
Views: 72 • Comments: 0
Tweets: 0 • Rating: 1

researchok
How Did Wisconsin Become the Most Politically Divisive Place in America?
15 hours, 9 minutes ago
Views: 180 • Comments: 1
Tweets: 0 • Rating: 2

Aigle
National Geographic Traveler Veers Off Track
1 day, 4 hours ago
Views: 363 • Comments: 3
Tweets: 0 • Rating: -6

MichaelJ
Apple TV Slated to Debut in December?
1 day, 5 hours ago
Views: 186 • Comments: 0
Tweets: 0 • Rating: 1

Ascher
Israeli Who Saved Turk on Everest: You Never Abandon a Friend - Israel News, Ynetnews
1 day, 6 hours ago
Views: 247 • Comments: 1
Tweets: 0 • Rating: 3

Haywood Jabloeme
The Harrassment of Patterico & Its Roots in Left-Wing Activism
1 day, 6 hours ago
Views: 457 • Comments: 2
Tweets: 0 • Rating: 4

Curt
Brian Banks: (Video) Falsely accused of rape speaks out
1 day, 9 hours ago
Views: 223 • Comments: 1
Tweets: 0 • Rating: 3

Mickey_being_mickey
Obama Administration begins to form plan to arm Syrian rebels
1 day, 22 hours ago
Views: 218 • Comments: 2
Tweets: 0 • Rating: 1

 Frank says:

Another day, another sausage...