Everyone is wearing a wire

Credit: Unsplash (John Barkiple)

We know from history that when data exists, governments will do everything they can to access it. —EFF

In the 1970s, Francis Ford Coppola (of The Godfather fame) also directed a spy thriller called The Conversation. The late Gene Hackman plays Harry Caul, a surveillance expert who records a frightening dialogue that leads to a nearly two-hour descent into madness. Coppola captures the fear of knowing and not knowing, paranoia, and justified anxiety about what is true — a wickedly toxic combination.

In the final scene, Harry is exhausted and sweating and ripping apart his entire apartment looking for “bugs.” Real or not, the power of surveillance wins.

Big tech seems to be inspired by The Conversation — not for fear or concern about human rights, but instead they’ve used films like this as a vision for the future. Devices that are always available, on, and listening.

Meta (Facebook) has AI Glasses: “for effortless connection.” Amazon has the Bee Frontier: to have “clarity from every conversation.” Google is bringing back Glass as Intelligent Eyewear: so you can “never miss a moment.” Apple is introducing "Audio Intelligence" for Apple Watch Series 12 and Watch Ultra 4: to “ambiently [take] notes on your conversations throughout your day...to jog your memory, so you can stay present in the moment.”

The marketing reads like the work of a crack team from McKinsey: we must all be walking around oblivious to our surroundings, lonely for lack of technology.

Nearly every big tech company is joining in on near-constant audio and video surveillance hardware. We suddenly all need always-on, wearable devices constantly recording and transcribing our every moment.

In the second year of my counseling psychology doctoral program, a client of mine walked in with their phone recording and said they wanted to record the session. They asserted they needed the recordings to ensure they remembered everything from our work. On one hand, I was sort of buoyed as an early trainee by the idea that something we talked about would be worth recording. At the same time, I was concerned, as privacy and confidentiality are of utmost importance to me and my profession — legally and ethically we work tirelessly to protect our clients as psychologists. Having recordings floating around seemed like a liability for the client, me, and the clinic.

Ultimately, informed by our clinic’s policies, I kindly asked the client to reconsider and proposed we work together to create some takeaways at the end of each session. But I still remember the tightness in my chest and sudden desire to self-censor for the listening device the client brought into our work. Even after our dialogue, I held a likely unfounded fear that the client would record our session surreptitiously.

Knowing you’re being surveilled and fearing you might be feel eerily similar, even if one is simply paranoia. Being or feeling watched inherently changes our behavior. A reality TV show may encourage participants to play up their characters, dramas, and hurts. It makes for good TV! In the real world, aiming a video camera on people and keeping it there is typically deeply uncomfortable. It can lead to a self-censorship and silence that is concerning to our humanity and broader connection.

It’s like staring a little… bit… too… long.

Many primary care providers, accountants, customer support representatives, and other professionals are hastily incorporating digital assistants into their work. I’ve been on about ten in-person or virtual appointments with these folks over the last year or so. These are video calls with empty, black boxes labeled “Notetaker” or a provider rushing into the appointment, late and saying they’re using their phone to help speed up note-taking. Permission is either assumed, not asked, or cursorily sought. Each time, I’ve begrudgingly allowed it, but something just doesn’t feel right. Not one person has actually walked through my rights or expectations for privacy.

Away from the appointments, my mind runs wild with questions:

  • What AI service/software are you using?
  • What training did you receive in implementing it?
  • Has your company signed a business associate agreement (BAA) with the vendor?
  • How is data encrypted (e.g., at-rest, end-to-end, in-transit)?
  • What data sharing agreement does the third-party have to this recording/transcription?
  • What rights do I have as a client, patient, or user?
  • May I request a copy of this transcription/recording?
  • How can I delete records?
  • How long do you retain records after creation?
  • How do you respond to government requests for information?
  • If I say no to AI use or note-taking assistants, how does this change our work?
  • Am I inconveniencing and impacting your workflow if I say no?

These questions are all directed at professional uses of technology for note-taking and recording, but what about all the inadvertent ways that it can happen in professional and personal settings as well? A medical professional could wear prescription Meta AI Glasses at the workplace. Now that Audio Intelligence will be available to the newest Apple Watches, will your nurse, doctor, or psychologist remember to turn off Siri Recap before our appointment begins (HOLY HIPAA!)? Will a friend carry an Amazon Bee, transcribing what we talk about?

Take Victoria Song of The Verge and her experience carrying the Bee into a therapy appointment:

I should’ve turned Bee off for this [therapy] session. But the truth is, I just forgot. Because the design of these devices is, in many ways, built for you to forget they’re listening.

I did not expect how awful it felt to see a traumatic event summarized so starkly in plain English. I hated having to swipe right to say, “Yes, this is true.” I didn’t expect the accompanying summary to be titled “Reclaiming Reality from Manipulative Power.” —Victoria Song, The Verge

For about 40 years, the East German government surveilled its citizenry using one of the most ruthless secret police (Stasi) and compelled people to spy on their neighbors. East Germans who fled to the West arrived at clinics with anxiety and depressive disorders after years of prolonged stress. Movies like The Lives of Others portrayed with gut-wrenching detail how lives would be destroyed by this intrusiveness, as people would retreat from the public world for private spaces — still questioning those people closest to them. It was a recipe for the squashing of ideas, creativity, and dissent.

Decades have passed since the secret police roamed “communist” East Germany, and now we’re rushing to create a capitalist version. The risks of government or individual abuse, inadvertent or purposeful leaks of Protected Health Information (PHI), questions of consent and rights, and our education/preparation to implement said technologies should all be reason for concern.

Law enforcement will eventually try to compel access to the data that these products create (either real-time audio or the summaries and transcripts they create). And while some products, like Apple’s Audio Intelligence, are engineered to make that difficult, not every product will be. —EFF

If the past is predictive of the future, our laws will likely lag the technology frontier. As consumers, we need to request our elected leaders work with these companies, healthcare regulators, and other stakeholders to protect us. As providers, we need to educate ourselves about the technology we’re implementing. Just because we might be experts in our areas of practice doesn’t mean we’re qualified to explain how audio and video surveillance are being used with those we serve. As friends and family, we should work to openly acknowledge when conversations are being recorded or resist the urge to digitally record/transcribe everyday human connection in the first place. And as always, we all need to get curious and ask questions.