More stories

  • in

    Facial Recognition Spreads as Tool to Fight Shoplifting

    Simon Mackenzie, a security officer at the discount retailer QD Stores outside London, was short of breath. He had just chased after three shoplifters who had taken off with several packages of laundry soap. Before the police arrived, he sat at a back-room desk to do something important: Capture the culprits’ faces.On an aging desktop computer, he pulled up security camera footage, pausing to zoom in and save a photo of each thief. He then logged in to a facial recognition program, Facewatch, which his store uses to identify shoplifters. The next time those people enter any shop within a few miles that uses Facewatch, store staff will receive an alert.“It’s like having somebody with you saying, ‘That person you bagged last week just came back in,’” Mr. Mackenzie said.Use of facial recognition technology by the police has been heavily scrutinized in recent years, but its application by private businesses has received less attention. Now, as the technology improves and its cost falls, the systems are reaching further into people’s lives. No longer just the purview of government agencies, facial recognition is increasingly being deployed to identify shoplifters, problematic customers and legal adversaries.Facewatch, a British company, is used by retailers across the country frustrated by petty crime. For as little as 250 pounds a month, or roughly $320, Facewatch offers access to a customized watchlist that stores near one another share. When Facewatch spots a flagged face, an alert is sent to a smartphone at the shop, where employees decide whether to keep a close eye on the person or ask the person to leave.Mr. Mackenzie adds one or two new faces every week, he said, mainly people who steal diapers, groceries, pet supplies and other low-cost goods. He said their economic hardship made him sympathetic, but that the number of thefts had gotten so out of hand that facial recognition was needed. Usually at least once a day, Facewatch alerts him that somebody on the watchlist has entered the store.Mr. Mackenzie adds one or two new faces a week to the Facewatch watch list that stores in the area share.Suzie Howell for The New York TimesA sign at a supermarket that uses Facewatch in Bristol, England. Suzie Howell for The New York TimesFacial recognition technology is proliferating as Western countries grapple with advances brought on by artificial intelligence. The European Union is drafting rules that would ban many of facial recognition’s uses, while Eric Adams, the mayor of New York City, has encouraged retailers to try the technology to fight crime. MSG Entertainment, the owner of Madison Square Garden and Radio City Music Hall, has used automated facial recognition to refuse entry to lawyers whose firms have sued the company.Among democratic nations, Britain is at the forefront of using live facial recognition, with courts and regulators signing off on its use. The police in London and Cardiff are experimenting with the technology to identify wanted criminals as they walk down the street. In May, it was used to scan the crowds at the coronation of King Charles III.But the use by retailers has drawn criticism as a disproportionate solution for minor crimes. Individuals have little way of knowing they are on the watchlist or how to appeal. In a legal complaint last year, Big Brother Watch, a civil society group, called it “Orwellian in the extreme.”Fraser Sampson, Britain’s biometrics and surveillance camera commissioner, who advises the government on policy, said there was “a nervousness and a hesitancy” around facial recognition technology because of privacy concerns and poorly performing algorithms in the past.“But I think in terms of speed, scale, accuracy and cost, facial recognition technology can in some areas, you know, literally be a game changer,” he said. “That means its arrival and deployment is probably inevitable. It’s just a case of when.”‘You can’t expect the police to come’Simon Gordon, the owner of Gordon’s Wine Bar in London, founded Facewatch in 2010. As a business owner, “you’ve got to help yourself,” he said. Suzie Howell for The New York TimesFacewatch was founded in 2010 by Simon Gordon, the owner of a popular 19th-century wine bar in central London known for its cellarlike interior and popularity among pickpockets.At the time, Mr. Gordon hired software developers to create an online tool to share security camera footage with the authorities, hoping it would save the police time filing incident reports and result in more arrests.There was limited interest, but Mr. Gordon’s fascination with security technology was piqued. He followed facial recognition developments and had the idea for a watchlist that retailers could share and contribute to. It was like the photos of shoplifters that stores keep next to the register, but supercharged into a collective database to identify bad guys in real time.By 2018, Mr. Gordon felt the technology was ready for commercial use.“You’ve got to help yourself,” he said in an interview. “You can’t expect the police to come.”Facewatch, which licenses facial recognition software made by Real Networks and Amazon, is now inside nearly 400 stores across Britain. Trained on millions of pictures and videos, the systems read the biometric information of a face as the person walks into a shop and check it against a database of flagged people.Facewatch’s watchlist is constantly growing as stores upload photos of shoplifters and problematic customers. Once added, a person remains there for a year before being deleted.‘Mistakes are rare but do happen’Every time Facewatch’s system identifies a shoplifter, a notification goes to a person who passed a test to be a “super recognizer” — someone with a special talent for remembering faces. Within seconds, the super recognizer must confirm the match against the Facewatch database before an alert is sent.Facewatch is used in about 400 British stores.Suzie Howell for The New York TimesBut while the company has created policies to prevent misidentification and other errors, mistakes happen.In October, a woman buying milk in a supermarket in Bristol, England, was confronted by an employee and ordered to leave. She was told that Facewatch had flagged her as a barred shoplifter.The woman, who asked that her name be withheld because of privacy concerns and whose story was corroborated by materials provided by her lawyer and Facewatch, said there must have been a mistake. When she contacted Facewatch a few days later, the company apologized, saying it was a case of mistaken identity.After the woman threatened legal action, Facewatch dug into its records. It found that the woman had been added to the watchlist because of an incident 10 months earlier involving £20 of merchandise, about $25. The system “worked perfectly,” Facewatch said.But while the technology had correctly identified the woman, it did not leave much room for human discretion. Neither Facewatch nor the store where the incident occurred contacted her to let her know that she was on the watchlist and to ask what had happened.The woman said she did not recall the incident and had never shoplifted. She said she may have walked out after not realizing that her debit card payment failed to go through at a self-checkout kiosk.Madeleine Stone, the legal and policy officer for Big Brother Watch, said Facewatch was “normalizing airport-style security checks for everyday activities like buying a pint of milk.”Mr. Gordon declined to comment on the incident in Bristol.In general, he said, “mistakes are rare but do happen.” He added, “If this occurs, we acknowledge our mistake, apologize, delete any relevant data to prevent reoccurrence and offer proportionate compensation.”Approved by the privacy officeA woman said Facewatch had misidentified her at the Bristol market. Facewatch said the system had ”worked perfectly.”Suzie Howell for The New York TimesCivil liberties groups have raised concerns about Facewatch and suggested that its deployment to prevent petty crime might be illegal under British privacy law, which requires that biometric technologies have a “substantial public interest.”The U.K. Information Commissioner’s Office, the privacy regulator, conducted a yearlong investigation into Facewatch. The office concluded in March that Facewatch’s system was permissible under the law, but only after the company made changes to how it operated.Stephen Bonner, the office’s deputy commissioner for regulatory supervision, said in an interview that an investigation had led Facewatch to change its policies: It would put more signage in stores, share among stores only information about serious and violent offenders and send out alerts only about repeat offenders. That means people will not be put on the watchlist after a single minor offense, as happened to the woman in Bristol.“That reduces the amount of personal data that’s held, reduces the chances of individuals being unfairly added to this kind of list and makes it more likely to be accurate,” Mr. Bonner said. The technology, he said, is “not dissimilar to having just very good security guards.”Liam Ardern, the operations manager for Lawrence Hunt, which owns 23 Spar convenience stores that use Facewatch, estimates the technology has saved the company more than £50,000 since 2020.He called the privacy risks of facial recognition overblown. The only example of misidentification that he recalled was when a man was confused for his identical twin, who had shoplifted. Critics overlook that stores like his operate on thin profit margins, he said.“It’s easy for them to say, ‘No, it’s against human rights,’” Mr. Ardern said. If shoplifting isn’t reduced, he said, his shops will have to raise prices or cut staff. More

  • in

    Work at Home or the Office? Either Way, There’s a Start-Up for That.

    As more Americans return to an office a few days a week, start-ups providing tools for hybrid work are trying to cash in.SAN FRANCISCO — Before the pandemic, Envoy, a start-up in San Francisco, sold visitor registration software for the office. Its system signed in guests and tracked who was coming into the building.When Covid-19 hit and forced people to work from home, Envoy adapted. It began tracking employees instead of just visitors, with a screening system that asked workers about potential Covid symptoms and exposures.Now as companies begin reopening offices and promoting more flexibility for employees, Envoy is changing its strategy again. Its newest product, Envoy Desks, lets employees book desks for when they go into their company’s workplace, in a bet that assigned cubicles and five days a week in the office are a thing of the past.Envoy is part of a wave of start-ups trying to capitalize on America’s shift toward hybrid work. Companies are selling more flexible office layouts, new video-calling software and tools for digital connectivity within teams — and trying to make the case that their offerings will bridge the gaps between an in-person and remote work force.The start-ups are jockeying for position as more companies announce plans for hybrid work, where employees are required to come in for only part of the week and can work at home the rest of the time. In May, a survey of 100 companies conducted by McKinsey found that nine out of 10 organizations planned to combine remote and on-site working even after it was safe to return to the office.Providing tools for remote work is potentially lucrative. Companies spent $317 billion last year on information technology for remote work, according to the research company Gartner. Gartner estimated that spending would increase to $333 billion this year.An Envoy employee demonstrating how to use the software to book a desk.Lauren Segal for The New York TimesHybrid and remote work have the potential to benefit workers for whom office environments were never a good fit, said Kate Lister, president of the consulting firm Global Workplace Analytics. This includes women, racial minorities, people with caregiving responsibilities and those with disabilities, along with introverts and people who simply prefer to work at odd hours or in solitude.But she and others also warned that the move to hybrid work could make remote workers “second-class citizens.” Workers who miss out on the camaraderie of in-person meetings or the spontaneity of hallway chats may end up being passed over for raises and promotions, they said.That, start-up founders argue, is where their products come in.Rajiv Ayyangar, the chief executive and co-founder of Tandem, leads one of several software start-ups that have created desktop apps that help teams better collaborate with one another and that recreate the feeling of being in an office. He said Tandem’s product was trying to help with “presence” — the ability to know what one’s teammates are doing in real time, even if the worker is not with their colleagues in the office.Tandem’s desktop program, which costs $10 a month for each user, shows what teammates are working on so colleagues know if they are available for a spontaneous video call within the app. The list of user statuses automatically updates to let people know if their co-workers are on a call, writing in Google Docs or doing some other task.Pragli and Tribe, two software start-ups that have been around since 2019, also offer similar products. People can use Pragli’s product to create standing audio or video calls that others can join. It is free, though the company plans to introduce a paid product. Tribe’s software uses busy and available statuses to facilitate in-platform video calls; it is currently only accessible with an invitation.Owl Labs, a start-up founded in 2017, is also trying to tackle “presence.” It makes a 360-degree video camera, microphone and speaker that sits in the middle of a conference table and automatically zooms in on the person who is speaking.Owl’s 360-degree camera, microphone and speaker system is intended to remote workers to attend meetings seamlessly.Owl LabsThe company, which said its customers quadrupled to more than 75,000 organizations over the pandemic, said the $999 camera was a way for remote workers to participate in office meetings by being able to see everyone who is speaking, rather than the limited view enabled by a single laptop camera.Other start-ups, such as Kumospace and Mmhmm, said they were working on improving video communications for hybrid work. Kumospace, a video-calling start-up, structures calls so that users enter a virtual room. They then navigate the room using arrow keys and can talk to people when they are close to them.The design is meant to replicate in-person socializing, where people can mill around and have multiple conversations in the same room. That contrasts with a service like Zoom, where everyone is by default in the same conversation as soon as they enter the video call.Mmhmm, which was created by the founder of the note-taking and productivity app Evernote, Phil Libin, offers a variety of interactive video backgrounds, tools for sharing slideshows and other features for live conversations and asynchronous presentations. It has a free version and a premium version, which costs $8.33 per employee a month.Some companies said their products can help businesses understand their space usage as fewer workers come in needing desks. Density, a start-up in San Francisco, makes a product that uses custom depth sensors to measure how many people are entering an area or use an open space. Companies can then analyze that data to understand how much of their office space they are actually using, and downsize as necessary.Density also plans to offer other tools for hybrid work. Last month, it acquired a software start-up that provides a system for desk and space reservation.Envoy said its new Desks product had attracted 400 companies, including the clothing retailer Patagonia and the film company Lionsgate.Larry Gadea, chief executive of Envoy, at the company’s headquarters.Lauren Segal for The New York Times“The companies that use us get much more accurate data that’s standardized across all their offices globally,” said Larry Gadea, Envoy’s chief executive. “And then it’s around using that data to inform space planning things. Do we need more floors? Do we need more meeting rooms? Do we need more desks? Do we need more desks for this one team?”Lionsgate said it had used Envoy’s products since before the pandemic. When the coronavirus arrived, it turned to Envoy’s employee-screening software to provide health checks to those entering the office.Now, as more employees return to in-person work, the company is using Envoy to manage where everyone sits, as well as to track who is coming in. Lionsgate said the information can help determine how often teams will need to be in the office.“We’ll be able to know really how much space we need,” said Heather Somaini, Lionsgate’s chief administrative officer. “So I think it’ll be really useful.” More