• azuth@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    0
    ·
    3 days ago

    The kind that wants to not appear as a bot is unlikely to send a Linux user agent even if running on Linux.

    • 8uurg@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      ·
      3 days ago

      It doesn’t have to be on purpose. Web crawlers like Google’s specifically identify themselves as a bot. A headless browser just acts like any normal browser, and uses the same user agent as one, just controlled by code rather than a keyboard and mouse.