wut
@prologic@twtxt.net any idea why I’d be seeing four copies of the same post?
@abucci@anthony.buc.ci Do you see the same on the web? 🤔
@prologic@twtxt.net yes, it turns out I see 13 copies on the web.
I see 13 in Goryon too. I only noticed 4 yesterday, but now that I’m looking again I see 13.
I’ve noticed this behavior before with other feeds.
If you look at the awesome scala weekly twtxt feed, https://feeds.twtxt.net/awesome-scala-weekly/twtxt.txt , it’s wild. “Issue 356”, the recent one I’m referring to, is repeated 13 times. Everything looks fine back to 2022-11-03T21:42:00Z, when “Issue 337” is repeated 13 times. “Issue 336” is repeated 13 times. “Issue 335” is repeated 13 times. Finally, I got bored and stopped counting.
The only conclusion is that this feed is cursed.
@abucci@anthony.buc.ci Yeah this is a bit of a known issue. It’s caused by bad RSS feeds that repeat the same items. We track the last time stamp of the lat item we saw.
@prologic@twtxt.net hash the content?
Yeah I’m pretty sure. I’ve looked into this once before. Hashing the content would probably work as long as the content itself isn’t changing…
@prologic@twtxt.net But like @marado@twtxt.net said, the RSS feed is clean. And the fact that it’s always 13 repetitions and not an arbitrary number suggests a systematic bug.
@abucci@anthony.buc.ci I’ll look into it again 🤣