Hey folks, I stumbled upon a big issue with Lemmy and Kbin. You know how we used to search stuff on Google like ‘why feet smell site:reddit.com’? Well, turns out I can’t do that for Lemmy and Kbin… yet. Maybe the crawlers haven’t caught up yet but I have a feeling it’s due to the nature of the fediverse. I mean, I’m not even sure which domain to specify. What do you guys think about this?

  • BarrierWithAshes@kbin.social
    link
    fedilink
    arrow-up
    3
    ·
    1 year ago

    It’s definitely a combo of the crawlers haven’t caught up yet and that a lot of these sites have anti-bot protocols enabled to handle all the extra traffic. Just give it some time and I’m sure Google or whatever will start to index this place.

    • lifeishard@kbin.socialOP
      link
      fedilink
      arrow-up
      1
      ·
      1 year ago

      Yeah, I just hope it just got better. Reddit was super useful and still is but I’m not going back there.

  • KNova@links.dartboard.social
    link
    fedilink
    arrow-up
    0
    ·
    1 year ago

    FYI there is a GitHub issue open to add a site map to Lemmy installs. I was going to try and take a stab at it but I don’t know enough Rust to be useful.