Hey folks, I stumbled upon a big issue with Lemmy and Kbin. You know how we used to search stuff on Google like ‘why feet smell site:reddit.com’? Well, turns out I can’t do that for Lemmy and Kbin… yet. Maybe the crawlers haven’t caught up yet but I have a feeling it’s due to the nature of the fediverse. I mean, I’m not even sure which domain to specify. What do you guys think about this?
It’s definitely a combo of the crawlers haven’t caught up yet and that a lot of these sites have anti-bot protocols enabled to handle all the extra traffic. Just give it some time and I’m sure Google or whatever will start to index this place.
Yeah, I just hope it just got better. Reddit was super useful and still is but I’m not going back there.
FYI there is a GitHub issue open to add a site map to Lemmy installs. I was going to try and take a stab at it but I don’t know enough Rust to be useful.
Me neither. Thanks for the info.