Meta’s new AI assistant accessed private Signal messages during controlled tests and sent employees unsolicited bank balance figures of unknown origin, raising concerns about the technology’s access to personal information and whether it could be mixing up conversations between different accounts.

Muse, which launched in September and has surpassed 10 million downloads, is designed to handle tasks such as shopping, booking appointments and managing messages. But a Reuters investigation found employees reporting unexpected behaviour, including unsolicited financial information and conversations they had never initiated. AI Assistant Sends Bank Balance Figures Nobody Asked For

One Meta employee said Muse interrupted discussions about fishing conditions with figures presented as balances for accounts at Capital One and Charles Schwab. The worker said he had never shared his bank account information with Muse or discussed banking with the assistant.

‘I have never shared my bank account with Muse,’ he wrote in an internal post reviewed by Reuters.

Other employees reported unsolicited messages about childcare requests they had never made, career advice they had not sought, and product orders they had not placed. One employee reported that Muse booked a non-refundable Airbnb stay without authorisation.

Reuters reviewed more than two dozen internal posts describing unwanted actions by Muse since its September launch, many submitted through an employee feedback group. The news agency could not determine whether the unexplained financial details belonged to other users or were entirely fabricated by the AI.

Archive: https://archive.is/4Jo4g

  • aim4harmony@lemmy.world
    link
    fedilink
    arrow-up
    0
    ·
    2 hours ago

    Such a horrible project. From the “loaned” band name to the other attrocities. It deserves to be unplugged from the source for good.

  • The Bard in Green@lemmy.starlightkel.xyz
    link
    fedilink
    English
    arrow-up
    0
    ·
    4 hours ago

    One Meta employee said Muse interrupted discussions about fishing conditions with figures presented as balances for accounts at Capital One and Charles Schwab. The worker said he had never shared his bank account information with Muse or discussed banking with the assistant.

    ‘I have never shared my bank account with Muse,’ he wrote in an internal post reviewed by Reuters.

    Other employees reported unsolicited messages about childcare requests they had never made, career advice they had not sought, and product orders they had not placed. One employee reported that Muse booked a non-refundable Airbnb stay without authorisation.

    Shared (vibecoded?) harness problem.

    • trilobite@lemmy.ml
      link
      fedilink
      arrow-up
      0
      ·
      3 hours ago

      Ok, biggest problem here is that it can access Signal messages which everyone considers bullet proof. Clearly, the catch is that people need ti understand that they need to grant permissions carefully … although i:m baffled by how lazy people can be.

      • The Bard in Green@lemmy.starlightkel.xyz
        link
        fedilink
        English
        arrow-up
        0
        ·
        edit-2
        2 hours ago

        We don’t how it accessed Signal messages. But I bet someone (possibly Claude) installed Signal cli somewhere so they could have Muse participate in some group and some permissions weren’t set clearly and someone asked Muse to do something and somewhere in some thought chain no one read it was like “Ok, let me get access to the Signal Group so I can see if the information I need is there. It wasn’t there. Saving a memory.”

        • deunmotherly@retrolemmy.com
          link
          fedilink
          arrow-up
          0
          ·
          2 hours ago

          Or it may just read the push notifications. Signal messages are encrypted but the push notifications are in plain text, at least for the received messages. The cops indicted a guy even after he deleted his Signal app by reading the push notifications.