On Thu, Nov 09, 2006 at 01:21:16AM +0100, moe wrote:
>
> there's one thing that keeps nagging me and that seems to be
> getting worse: duplicate articles. for various sites i get duplicated
> articles almost every day. for other sites i never get them.
> on average i skip over circa 10-15 dupes every day on my
> rawdog page.
I have been using a plugin to strip ads out of many of my feeds.
It's got a ton of individual regular expressions right now; it
definitely could be cleaner.
Stripping ads seems to eliminate some (but not all) of the feed
variability.
I've made my current filter available at:
http://gweep.net/~aron/rawdog_strip_ads.py
Let me know if this helps your problem.
Aron
--
aron atkins is aron@???
_______________________________________________
rawdog-users mailing list
rawdog-users@???
http://lists.us-lot.org/mailman/listinfo/rawdog-users
