I spent quite a bit of time last night and this morning improving the Usenet post-indexing system. Before, it wasn't always grouping posts into their correct thread, and instead was creating new threads. What a nightmare! All I can say is that the system of grouping posts into threads can be best described with the phrase "seat of your pants."
Anyway, the whole system is running pretty smoothly with just a few little last things I want to fix up.
Also, I need to stop constantly rebuilding the index from scratch. :O It looks like the server I'm connecting to has a retention rate of about 2 years--- just a few days ago, it supplied posts from Jan 2007 and I had 20,000+ posts in total. Today I have only 19,700 reaching to only Feb 2007. I have a backup of the old database, but I'm not sure if it's worth the hassle to merge those last few posts in. :-/
Anyway, the whole system is running pretty smoothly with just a few little last things I want to fix up.
Also, I need to stop constantly rebuilding the index from scratch. :O It looks like the server I'm connecting to has a retention rate of about 2 years--- just a few days ago, it supplied posts from Jan 2007 and I had 20,000+ posts in total. Today I have only 19,700 reaching to only Feb 2007. I have a backup of the old database, but I'm not sure if it's worth the hassle to merge those last few posts in. :-/