Forum may be slow while I index 5 million posts. - Completed!

[joebryant]

I'm glad to see that you're doing this, Rob. I've been having a problem with "Search"; when I typed in a word for a recent post, anything in 2010, I would only get results for 2007, 2008, and 2009.

 

[wildorchid053]

since you live in california where i used to live, i just know you would like some snow for christmas as a thank you for all the trouble you go to for us byc'ers.. here you go!!!!

 

[Nifty-Chicken]

Quote:
Best way to explain it: Imagine you need to create an index for the back of a chicken book. You need to find all instances of all the words to add to the index. Well, our BYC search works like the index in the back of a book, but instead of just 500 pages of text to index, we have 5 MILLION posts of text to index.

Usually the posts are indexed at the time they are submitted, but every once in a while we need to delete the entire index and rebuild it from scratch. Kinda like when you have to reboot your computer <cough> Windows <cough> from time to time.


Quote:
Easier, definitely!

But it would mean the forum would be down for a couple days, and based on the withdraws peeps go through when the forum is down for a few hours... I'd rather save everyone that pain.

 

[ranchhand]

Hey Nifty, is this a good time to remind folks that clicking on submit repeatedly doesn't make it go to post any faster? I've seen several duplicate posts today, is that what causes it?

Bless you on the streamlining, take 2 aspirin and call us in the morning!

 

[Nifty-Chicken]

Yup, it would be the slightly longer delay in the time it takes to write the posts to the database and peeps get impatient and refresh, hit submit again, etc.

So, if your post isn't going through... just wait for at least 60 seconds.

If you see duplicates, just click report on it and we can delete super easy peasy.

 

[RioLindoAz]

Quote:
Best way to explain it: Imagine you need to create an index for the back of a chicken book. You need to find all instances of all the words to add to the index. Well, our BYC search works like the index in the back of a book, but instead of just 500 pages of text to index, we have 5 MILLION posts of text to index.

*sigh* Just another brain fart due to my lack of deductive reasoning. Maybe I just over-thought this because the main forum page is called an "index?" I'll pretend that's true.
I hope this helped other idiots like me...?

Good luck Nifty. Make me proud.

 

[ibpboo]

A bit earlier it was being slow posting, and I thought it was my connection, but its you!! lol

 

[Nifty-Chicken]

71% complete!

 

[canada-goose]

Quote:

Yay!

 

[Nifty-Chicken]

80% done. Hopefully if everything goes smoothly (

) I can get this all finished by tomorrow morning.