I’m testing a script right now that, if all goes well, will add every post and every comment at LGF into our MySQL database; nearly 25,000 posts and over 3.6 million comments. The comments section is so huge and takes so long to convert (several hours, probably) that it kept timing out when I tried to do it in one pass. So I ended up programming a multi-stage script that keeps reloading and starting from further into the swamp each time.

This isn’t anywhere near the point of going live yet, but it will be interesting to see how well MySQL performs with that many records. (Chances are I’ll end up archiving much of the early stuff.)