This is a search-engine-friendly text mirror of the TalkBass Forums

VIEW FULL LIVE VERSION : Forums are up, searches are up.


paul
06-25-2005, 09:25 PM
Whew... Sorry about all the downtime today (Saturday). Indexing the database after the server migration took 27 hours! (The server scans every post - all 2,130,000 of them... - and indexes the words so that they become searchable. Our search index now contains 1.2 gigs of words). The amazing thing is I nailed the completion time - I estimated 9pm and it wrapped up at 9:05pm. I think I have a deep connection to this webserver... ;)

nonsqtr
06-26-2005, 03:39 AM
Nice job, Paul. :)

Hey, if I may ask, what are you running now?

Do you have a cluster or something?

I'm noticing the "hit time" when clicking links is a little longer, which makes me guess it's a Windows cluster of some sort, maybe multiple IIS's, something like that?

But I'm also noticing a level of robustness too, which is definitely a good thing.

Anyway, nice work man. I couldn't have done better if I was trying to predict the up-time on my Linux cluster. :D

paul
06-26-2005, 07:44 AM
No, I'd never run Windows :cool: The new setup is just two linux boxes. The backend, dedicated to mysql is very robust - Dual Opteron 244's, 4 gigs of RAM, 15k rpm drives in raid 1... So far I'm LOVING these Opteron chips - the benchmarks I've seen that put them way above Xeons for mysql performance seem to be spot on. Granted I've yet to see it handle Monday afternoon traffic... but from the looks of things we've got a lot of room to grow now.

The frontend Apache box is just a P4 3ghz, 2 gigs of RAM, 10k rpm drives in Raid 1. It's laboring more than the mysql box, but after I get the php script caching going it should speed up. Upgrading this box in the future is no problem - my main concern was database performance and it looks like we're doing well on that front, so far.

I suspect the hit time increase you're seeing is due to a geographical change - the datacenter I'm using is in Michigan now, instead of Colorado previously. It should be only a minor difference, I hope...

Shakey
06-26-2005, 09:09 AM
Nice job Paul!!!

If you're ever in Roanoke Va, I'll treat you to dinner.

I've done my share of website development (php mostly), re-builds, and moves....and your work on this is truley inspiring.

Keep up the good work.

nonsqtr
06-26-2005, 06:08 PM
Paul, you've got a dinner coming in Burbank here as well. :)

CamMcIntyre
06-28-2005, 01:36 AM
Here too-w/o this site i wouldn't be the player i am.

Eric Perry
06-28-2005, 09:13 AM
And he's got another dinner coming in Scranton, PA. This site has been in my favorites for QUITE some time, and is accessed several times a day.

Paul has definitely bettered me as a player! Thanks man!

nonsqtr
06-29-2005, 03:08 AM
Paul, you have some issues with "hit time" right now.

Not sure exactly what's up, you might want to investigate a different RAID configuration.

Unix is notoriously inefficient when it comes to hard drive access - mySql is pretty good, but it's nothing like an Avid (or, I hate to say it, an Oracle cluster).

Maybe you might want to look into some databse optimization - just a suggestion, and a heads-up. :)

paul
07-01-2005, 08:27 AM
Paul, you have some issues with "hit time" right now.

Not sure exactly what's up, you might want to investigate a different RAID configuration.

Unix is notoriously inefficient when it comes to hard drive access - mySql is pretty good, but it's nothing like an Avid (or, I hate to say it, an Oracle cluster).

Maybe you might want to look into some databse optimization - just a suggestion, and a heads-up. :)

Actually it's not the database server, it's the web frontend. I'm confident it's just an 'untweaked' apache config. Will get on that soon ;)

Schwinn
07-01-2005, 05:17 PM
Thank you Paul. Your hardwork and dedication does NOT go unappreciated!

Eric Perry
07-02-2005, 05:57 PM
Thank you Paul. Your hardwork and dedication does NOT go unappreciated!


+1~ !!! :hyper: