More stories

  • in

    Companies without direct A.I. link try to ride the Wall Street craze

    Artificial intelligence has been one of the major Wall Street stories so far in 2023.
    Tech players like Amazon, Meta, Nvidia and Intel are all benefiting from investor excitement.
    But some companies nowhere near the tech vertical also think AI will help with their future.

    A robot plays the piano at the Apsara Conference, a cloud computing and artificial intelligence conference, in China, on Oct. 19, 2021. While China revamps its rulebook for tech, the European Union is thrashing out its own regulatory framework to rein in AI but has yet to pass the finish line.
    Str | Afp | Getty Images

    The artificial intelligence craze has consumed Wall Street in 2023.
    The madness found its roots in November of last year, when OpenAI launched the now infamous large-language model (LLM) ChatGPT. The tool touts some impressive capabilities, and spurred an AI race with rival Google announcing it’s own chat box – Bard AI – only a few months later.

    But the enthusiasm went even further. Investors started flocking to stocks that could provide ample AI exposure, with names like C3.AI, chipmaker Nvidia, and even Tesla, posting impressive gains despite an overall tense macroeconomic environment.
    Just like “blockchain” and “dotcom” before it, A.I. has become the buzzword companies want to grab a piece of.
    Now some with little to no historical ties to artificial intelligence have touted the technology on conference calls to analysts and investors.
    Supermarket chain Kroger touted itself as having a “rich history as a technology leader,” and chief executive officer Rodney McMullen cited this as a reason for the company is poised to take advantage of the rise of artificial intelligence. McMullen specifically pointed to how AI could help streamline customer surveys and help Kroger take the data and implement it into stores at a more speedy clip.

    Stock chart icon

    Shares of the supermarket giant have ticked up just above 4% from the start of the year.

    “We also believe robust, accurate and diverse first-party data is critical to maximizing the impact of innovation and data science and AI,” McMullen told investors on the company’s June 15 earnings call. “As a result, Kroger is well-positioned to successfully adopt these innovations and deliver a better customer and associate experience.”

    Similarly, Tyson Foods, the second-largest global producer of chicken, beef and pork, thinks the company can benefit from the explosion of investment and excitement over artificial intelligence. However, chief executive Donnie King didn’t specify how AI would play into the company’s future, or what specific applications the technology would be applied to in the Tyson business.

    Stock chart icon

    Tyson Foods stock has declined more than 20% from January.

    “…And we continue to build our digital capabilities, operating at scale with digitally-enabled standard operating procedures and utilizing data, automation, and AI tech for decision-making,” King told investors on the company’s May 8 earnings call.
    For heating, ventilation, and air conditioning (HVAC) equipment producer Johnson Controls, artificial intelligence can help the company ride a choppy macroeconomic environment, it proposes. Chief executive officer George Oliver did not elaborate last month on how AI would play a role in the company’s future beyond mentioning AI as a potentially helpful tool when asked about a decline in orders.

    Stock chart icon

    Shares have gained 2.2% from January.

    “…AI is going to continue to allow us to be able to expand services no matter what the [economic] cycle is that we ultimately experience,” Oliver told investors on the company’s May 5 earnings call.
    The promise of artificial intelligence has kept stocks higher, as Wall Street heads into the second half of the year. The tech-heavy Nasdaq Composite, for comparison, has added roughly 16% from January.
    But while the potential of AI upends a plethora of industries and threatens to automate hundreds of millions of jobs, investors will ultimately decide over time who are the legitimate beneficiaries and who is just trying to ride the hype. More

  • in

    Burger King parent says U.S. turnaround is already improving profits for franchisees

    Burger King’s plan to revive its U.S. business is already showing signs of improved franchisee profitability, on top of stronger sales.
    “We’ve moved sales back in the right direction, but we’ve already started to move franchise profitability meaningfully higher,” Josh Kobza, CEO of parent company Restaurant Brands International, told CNBC.

    Restaurant Brands also owns Popeyes Louisiana Kitchen, Firehouse Subs and Canadian coffee chain Tim Hortons.
    The burger chain in September unveiled the $400 million turnaround plan it crafted with franchisees after several years of disappointing sales. In 2020, Burger King slid to the No. 3 burger chain in the U.S. in terms of sales, losing ground to Wendy’s after it launched breakfast nationwide. And the gulf between Burger King and its top rival McDonald’s has only widened.
    But Burger King is trying to launch a comeback, with its parent company pouring money into restaurant renovations and advertising. The chain is also taking steps to improve restaurant operations and menu offerings and doubling down on the Whopper, the longtime anchor of its menu.
    In the first quarter, Burger King’s U.S. same-store sales grew 8.7%, an early sign that the strategy might be working. A year earlier, its quarterly same-store sales were roughly flat.
    But the chain is also trying to make sure the turnaround is sustainable and doesn’t just boost sales for a few quarters before lagging again.

    One of the longer-term aims of the turnaround is to improve franchise profitability, an important indicator of the chain’s overall success. Higher profits for operators mean they have money to reinvest back into their existing restaurants or new locations, driving more sales for the franchisor.
    That’s good for the restaurant chain, too: Franchisees that struggle to stay afloat are a drag on the business and typically result in closures, in addition to lower system sales at their lagging restaurants.
    So far this year, two Burger King franchisees have filed for bankruptcy. The first franchisee to file for bankruptcy, Toms King Holdings, sold most of its locations at auction for $33 million in April. Burger King is trying to push the other operator, Meridian Restaurants, to sell its restaurants, according to a report from Restaurant Business Online. Meridian has already closed more than two dozen restaurants after filing for Chapter 11 bankruptcy.
    Restaurant Brands executives said in early May that they expect to close 300 to 400 underperforming locations this year, although that depends on how quickly the business can bounce back. Burger King typically closes several hundred U.S. locations every year.
    “This is the seminal moment in time for us to figure out which restaurants have long-term viability,” Burger King U.S. President Tom Curtis told CNBC. “There’s a few out there that don’t, and we need to take those off our owners’ backs so they don’t have to bear the losses and can put that money back into growing their asset base and their restaurants that they do own.”
    “It’s all part of the normal process,” he added. “And we’re going to be bigger, stronger and be able to grow faster in the future if we do that.”
    The chain also recently changed its expansion policy for franchisees, limiting most operators to footprints of under 50 restaurants and requiring local ownership.
    Investors seem relatively optimistic about the company’s future. Shares of Restaurant Brands have risen 16% this year, giving the company a market value of $23.5 billion. The S&P 500 is up 13% in the same time period.
    “I think that investors appreciate the fact that RBI is coming to the table to invest money into the brand to see its resurgence,” Curtis said. More

  • in

    Goldman Sachs faces big writedown on CEO David Solomon’s ill-fated GreenSky deal

    Goldman Sachs is likely to take a large writedown for its 2021 acquisition of fintech lender GreenSky after seeking to unload the business, CNBC has learned.
    KKR, Apollo Global Management, Sixth Street Partners, Warburg Pincus and Synchrony Bank were among the asset managers and lenders involved in the first round of bids, according to sources.
    “Everybody’s been coming in low, and the Goldman team keeps pushing back, pounding the table about the value of it,” said one of the bidders.

    Goldman Sachs CEO David Solomon speaks during the 2023 Forbes Iconoclast Summit at Pier 60 on June 12, 2023 in New York City. 
    Taylor Hill | Getty Images

    Goldman Sachs is likely to take a large writedown for its 2021 acquisition of fintech lender GreenSky after seeking to unload the business, CNBC has learned.
    Bids for the installment-loan business are coming in well below what Goldman had hoped for, according to people with knowledge of the sale process.

    Under CEO David Solomon, Goldman bought Atlanta-based GreenSky for $2.24 billion to help accelerate its push into consumer finance. But just 18 months after the bank’s September 2021 release announcing the deal, Solomon said he was selling the business after mounting losses and dysfunction in Goldman’s consumer division forced a strategic shift.
    KKR, Apollo Global Management, Sixth Street Partners, Warburg Pincus and Synchrony Bank were among the asset managers and lenders involved in the first round of bids, which began early June, according to the people, who declined to be identified speaking about the sale. The companies declined to comment.
    “Everybody’s been coming in low, and the Goldman team keeps pushing back, pounding the table about the value of it,” said one of the bidders.
    The bank is continuing negotiations with a smaller group of bidders this week with the hope of ratcheting up the ultimate price, according to the sources.

    Dual-track process

    Goldman has been pursuing offers for GreenSky’s loan origination business and its book of existing loans separately as well as offers for a single deal, according to the people familiar.

    One bidder said the origination platform is worth roughly $300 million, while another said it was worth closer to $500 million.
    If a deal closed at anywhere near that valuation, it would represent a steep discount to what Goldman paid for it, forcing the company to disclose a writedown hitting its bottom line in an upcoming quarter.
    While the all-stock acquisition was announced with a $2.24 billion valuation, it was worth closer to $1.7 billion by the time the transaction closed six months later, according to a person with knowledge of the matter.
    Goldman President John Waldron acknowledged the potential for “some noise” to the bank’s results as a result of the GreenSky sale. The transaction could wipe out $500 million in goodwill tied to buying the lender, and the sale of loans could trigger other one-time accounting hits, he told analysts at a June 1 conference.
    The turbulence marks the latest fallout from Solomon’s decision to exit most of the bank’s consumer efforts after pushing hard for his vision to transform Goldman into a fintech disruptor.
    “We’re pleased with the participation by bidders,” Goldman spokesman Tony Fratto said in a statement. “We’re in the middle of the process and we’ll learn more as we go forward.” More

  • in

    Stocks making the biggest moves before the bell: Starbucks, CarMax, Virgin Galactic and more

    Starbucks workers union advocates wears union shirts at the Senate Health, Education, Labor and Pensions Committee hearing on No Company is Above the Law: The Need to End Illegal Union Busting at Starbucks in the Dirksen Senate Office Building on Wednesday, March 29, 2023.
    Bill Clark | Cq-roll Call, Inc. | Getty Images

    Check out the companies making headlines in premarket trading.
    Starbucks — The coffee shop chain slid 1.1% after a union representing workers said some stores will strike beginning Friday following claims that the company has not allowed Pride month decor in its cafes. The union said workers at more than 150 stories have agreed to join the strikes taking place over the next week, with more working on authorizations.

    CarMax — The used car retailer gained 6.8% after beating Wall Street expectations on first-quarter revenue. CarMax reported $7.69 billion, ahead of the $7.49 billion expected by analysts polled by StreetAccount.
    Virgin Galactic — Shares tumbled 12.4% in premarket trading after the space tourism company said it raised $300 million through a common stock offer. Virgin Galactic said it wants to raise another $400 million as the company looks to expand and improve its spacecraft fleet.
    Under Armour — Shares shed nearly 3% in premarket trading following a downgrade by Wells Fargo to equal weight from overweight. The Wall Street bank said the athletic clothing company had overexposure to North America, excess inventory and a CEO at the helm for just six months. On Thursday, Under Armour cut 50 jobs at its Baltimore headquarters, The Baltimore Sun and Footwear News reported.
    Wayfair — Shares of the home furnishings retailer rose more than 1% after MoffettNathanson upgraded Wayfair to market perform from underperform. The investment firm said Wayfair appears to be benefitting from the bankruptcy of Bed Bath & Beyond.
    C3.AI — Shares shed 0.8% premarket after Deutsche Bank said the company did not differentiate itself from other artificial intelligence names at its investor day. The firm reiterated its sell rating.

    Accenture — The consulting company lost 1.5%, adding to its decline from the previous session, as investors continued to take profit following its earnings report. On Thursday, Accenture reported earnings per share and revenue that beat analyst expectations. Despite the post earnings losses, Accenture shares are up 15% year to date.
    — CNBC’s Jesse Pound and Michelle Fox contributed reporting More

  • in

    Starbucks union says workers at more than 150 stores will strike over Pride decor

    Some organized Starbucks stores will strike across the U.S. at more than 150 locations starting Friday in Seattle, after the union representing baristas claimed some cafes were not allowed to put up Pride decorations.
    The coffee giant said its policy on decorating has not changed and that it unwaveringly supports the LGBTQ+ community.
    Workers United has alleged instances in at least 22 states when workers have not been able to decorate. It says it filed an unfair labor practice charge over the alleged change in policy.

    Marchers with Starbucks pass through the landmark intersection of Hollywood and Highland during the annual Pride Parade in Los Angeles, June 12, 2022.
    David Mcnew | Getty Images

    Some organized Starbucks stores will strike across the U.S. starting Friday in Seattle after the coffee giant and the union representing baristas publicly clashed over claims that the company was not allowing Pride month decor in cafes.
    The union, Starbucks Workers United, said more than 150 stores representing nearly 3,500 workers have pledged to join the strikes, which will take place over the next week. More than two dozen additional stores are voting on strike authorizations and the count could rise to nearly 200 stores by the end of the week, the union said.

    Last week, the union alleged dozens of U.S. stores were not allowing employees to decorate for Pride month, accusations that suggested a wave of backlash against LGBTQ+ inclusion had reached a perceived liberal bastion in corporate America. Starbucks said it had not revised its guidelines for store decorations.
    “There has been no change to any policy on this matter and we continue to encourage our store leaders to celebrate with their communities including for U.S. Pride month in June,” the company said last week, adding that it unwaveringly supports the LGBTQ+ community. Local store leaders and employees can make their own decorating decisions within guidelines laid out in the company’s security and safety manuals.
    In response to the strike pledges, the company added, “Workers United continues to spread false information about our benefits, policies and negotiation efforts—a tactic used to seemingly divide our partners and deflect from their failure to respond to bargaining sessions for more than 200 stores.” 
    In a post on its website, Starbucks shared a June 14 letter from its VP of Partner Resources, May Jensen, to Workers United President Lynne Fox demanding the union “cease from knowingly misleading partners.”
    Workers United has alleged instances in at least 22 states when workers have not been able to decorate, pointing to social media accounts where workers have documented their claims. The union said it has filed an unfair labor practice charge against Starbucks over what it alleges is a change in policy. Some of the strikes in the coming days are tied to that claim.

    Not all of the stores that will strike had issues related to Pride decor.
    Parker Davis, a 21-year-old barista in San Antonio, Texas, works at a store that has not had a dispute around Pride decor but will be a part of the strikes.
    “There’s a large percentage of partners at my store who are part of the LGBTQ community, and who feel that Starbucks’ continued actions with trying to limit or take down pride decorations just doesn’t make sense with what the company has done in the past,” Davis said.
    Davis told CNBC he expects several picketers, but said it was unclear if the store would be able to open during the strike.
    The public back-and-forth over decorations to celebrate Pride month comes as major brands including Target and Bud Light have been targeted for supporting the LGBTQ+ community. In both of those cases, the companies faced opposition from conservative consumers to partnerships with or merchandise for transgender people — and then saw backlash from more liberal customers for perceived deference to the critics.
    In Oklahoma, workers were told restrictions on decorating were out of a concern for safety after recent attacks at Target stores, the union said.
    The Starbucks workers are also striking over claims that Starbucks is dragging its feet on negotiating contracts. 
    “Good faith bargaining looks like both sides providing proposals and trying to meet in the middle — Starbucks is not willing to do that,” Workers United said in a statement. “Despite having our non-economic proposals for over 8 months and our economic proposals for over a month now, Starbucks has failed to tentatively agree to a single line of a single proposal or provide a single counter proposal. What Starbucks is doing is not bargaining, it’s stalling.”
    The strike “is important to me because it sends the message that we are not going to stand idly by while Starbucks continues to delay contract negotiations and continues to participate in union busting,” Davis said.
    For its part, Starbucks maintains Workers United has responded to only a quarter of the more than 450 bargaining sessions Starbucks has proposed for individual stores nationally, to date, and said it is committed to progressing negotiations toward a first contract.
    The roastery where the strikes will start Friday has not had any disputes over Pride decorations, but is also striking in solidarity.
    “The roastery wants to show solidarity with all workers that have been discriminated against in the company,” Mari Cosgrove, a 28-year-old barista at the Seattle location, told CNBC.
    “Frankly, it feels like an attack when these flags are taken down,” Cosgrove said. “The partners in these stores really appreciate being able to be seen and feel like this is a community space for them. Starbucks has really prided itself on being a third place, including for its workers.”
    More than 300 company-owned stores have voted to unionize since the first filing took place in August of 2021, but Starbucks and Workers United have yet to agree to a contract.
    Starbucks has more than 9,000 company-owned locations in the U.S.
    — CNBC’s Amelia Lucas contributed to this report. More

  • in

    Check out this $110 million tech campus being built in Lithuania — the largest in Europe

    Built by Tech Zity, an infrastructure project in Lithuania, the campus will span 55,000 square meters and house 5,000 digital workers.
    That would make it larger than Paris’ Station F, currently the largest startup campus in all of Europe.
    Vilnius, the second-largest city in the Baltic states, is home to a burgeoning tech industry, including major unicorns such as used clothing retailer Vinted and cybersecurity firm Nord. 

    The development, from Lithuanian infrastructure firm Tech Zity, is inspired by British renovation projects like the Battersea Power Station and Tate Modern art gallery.

    Lithuania is building a huge tech campus — Europe’s largest — in the capital of Vilnius, as it looks to become the new tech capital of the Baltics.
    Built by Tech Zity, an infrastructure project in Lithuania, the campus is a 100 million euro ($109.6 million) development that will span 55,000 square meters and house 5,000 digital workers, the firm said Friday.

    That would make it larger than Paris’ Station F, currently the largest startup campus in all of Europe.
    The development is inspired by British renovation projects such as the Battersea Power Station and Tate Modern art gallery.
    Tech Zity developers will renovate a number of sewing factories in a disused industrial space in Vilnius’ New Town, maintaining factory-like office floors with ceiling heights of at least 7 meters.

    The campus is aimed at encouraging Vilnius’ tech workers to come back to the office post-pandemic.

    The project aims to encourage Vilnius’ tech workers to return to the office after the pandemic. Tech companies have increasingly been pushing for their employees to go back to the office, in a reversal from the pandemic-era trend of working from home.

    Lithuania’s growing tech scene

    Lithuania’s tech ecosystem has grown dramatically over the past decade, Darius Zakaitis, Tech Zity’s founder, told CNBC.

    “When I started 30 years ago, there were 200 people in the Lithuanian tech ecosystem,” Zakaitis said. “Now it’s 18,000 people.”

    The development project is a restoration of old disused industrial space in Vilnius’ New Town, which is known as the hipster part of town.

    “It’s a result of 10 years of active young people building new companies every day. Some of them are very successful,” he said.
    “Lithuanians are very productive, very results-oriented, highly-skilled guys, very aggressively building their own companies,” he added.
    Vilnius, the second-largest city in the Baltic states, is home to a burgeoning tech industry, including major unicorns such as used clothing retailer Vinted and cybersecurity firm Nord. 
    Nord has its own 300-square-meter campus in Vilnius about 300 meters away from Tech Zity’s, while Vinted’s headquarters is roughly 200 meters away.
    Tech Zity’s new campus will include co-living spaces, restaurants and bars, and cultural and educational facilities.

    Tech Zity wants the campus to foster a buzzing night life as well as other socializing opportunities, incorporating co-living spaces, restaurants, and bars.

    “Vilnius is maintaining a firm position within the European tech scene thanks to rapid innovations and visionary businesses such as Tech Zity,” Valdas Benkunskas, the mayor of Vilnius, said in a statement Friday. 
    “Bursting with innovative entrepreneurs, multinational talents, and ambitious investors, the capital has grown to a modern tech hub that evokes bold ideas, successful collaborations, and  people-focused solutions.”
    Lithuanian tech companies make roughly 99% of their revenues abroad, he said. He added that the country’s tech scene models itself after Israel’s, which has produced numerous global tech successes, including self-driving tech firm Mobileye and the mapping app Waze.
    Tech Zity manages three tech campuses in Vilnius, including Tech Park, Tech Loft, and Tech Spa, which are home to companies like Google, Bored Panda and Kilo Health.

    The project is a huge undertaking — at 55,000 square meters, it is expected to be the largest tech startup campus in all of Europe.

    U.S. streaming platform Netflix has used Tech Zity locations for filming, including the docu-series “The Playlist” which focuses  on Spotify founder Daniel Ek.
    Currently occupying 20,000 square meters, Tech Zity plans to reach 80,000 square meters over time, considering new campuses, existing locations, and other projects.

    Long way to go

    Despite its recent successes, Lithuania is far from becoming a major tech hub that rivals the likes of the U.K., France or Germany.
    The country attracted 222 million euros of venture capital funding in 2022, paling in comparison to its Western European peers. By contrast, U.K. tech startups raised $30 billion, while their French counterparts raised 13.5 billion euros.
    But the country has been drawing more interest from venture capitalists, according to local founders.
    “All the top VC firms are now coming to Lithuania and talking with startups, angel investors, and anyone else,” Tom, CEO and co-founder of Nord Security, told CNBC on the sidelines of the Web Summit tech conference in Lisbon, Portugal, last November.
    “The last raise for a Lithuanian startup called Kevin was from Accel, Vineted has Insight Parnters, EQT, Accel, and many others.”
    WATCH: Russia sanctions must go further, Lithuania’s president says More

  • in

    A.I. has a discrimination problem. In banking, the consequences can be severe

    When it comes to banking and financial services, the problem of artificial intelligence amplifying existing human biases can be severe.
    Deloitte notes that AI systems are ultimately only as good as the data they’re given: Incomplete or unrepresentative datasets could limit AI’s objectivity, while biases in development teams that train such systems could perpetuate that cycle of bias.
    Lending is a prime example of where the risk of an AI system being biased against marginalized communities can rear its head, according to former Twitter executive Rumman Chowdhury.

    Artificial intelligence algorithms are increasingly being used in financial services — but they come with some serious risks around discrimination.
    Sadik Demiroz | Photodisc | Getty Images

    AMSTERDAM — Artificial intelligence has a racial bias problem.
    From biometric identification systems that disproportionately misidentify the faces of Black people and minorities, to applications of voice recognition software that fail to distinguish voices with distinct regional accents, AI has a lot to work on when it comes to discrimination.

    And the problem of amplifying existing biases can be even more severe when it comes to banking and financial services.
    Deloitte notes that AI systems are ultimately only as good as the data they’re given: Incomplete or unrepresentative datasets could limit AI’s objectivity, while biases in development teams that train such systems could perpetuate that cycle of bias.

    A.I. can be dumb

    Nabil Manji, head of crypto and Web3 at Worldpay by FIS, said a key thing to understand about AI products is that the strength of the technology depends a lot on the source material used to train it.
    “The thing about how good an AI product is, there’s kind of two variables,” Manji told CNBC in an interview. “One is the data it has access to, and second is how good the large language model is. That’s why the data side, you see companies like Reddit and others, they’ve come out publicly and said we’re not going to allow companies to scrape our data, you’re going to have to pay us for that.”
    As for financial services, Manji said a lot of the backend data systems are fragmented in different languages and formats.

    “None of it is consolidated or harmonized,” he added. “That is going to cause AI-driven products to be a lot less effective in financial services than it might be in other verticals or other companies where they have uniformity and more modern systems or access to data.”

    Manji suggested that blockchain, or distributed ledger technology, could serve as a way to get a clearer view of the disparate data tucked away in the cluttered systems of traditional banks.
    However, he added that banks — being the heavily regulated, slow-moving institutions that they are — are unlikely to move with the same speed as their more nimble tech counterparts in adopting new AI tools.
    “You’ve got Microsoft and Google, who like over the last decade or two have been seen as driving innovation. They can’t keep up with that speed. And then you think about financial services. Banks are not known for being fast,” Manji said.

    Banking’s A.I. problem

    Rumman Chowdhury, Twitter’s former head of machine learning ethics, transparency and accountability, said that lending is a prime example of how an AI system’s bias against marginalized communities can rear its head.
    “Algorithmic discrimination is actually very tangible in lending,” Chowdhury said on a panel at Money20/20 in Amsterdam. “Chicago had a history of literally denying those [loans] to primarily Black neighborhoods.”
    In the 1930s, Chicago was known for the discriminatory practice of “redlining,” in which the creditworthiness of properties was heavily determined by the racial demographics of a given neighborhood.
    “There would be a giant map on the wall of all the districts in Chicago, and they would draw red lines through all of the districts that were primarily African American, and not give them loans,” she added.
    “Fast forward a few decades later, and you are developing algorithms to determine the riskiness of different districts and individuals. And while you may not include the data point of someone’s race, it is implicitly picked up.”
    Indeed, Angle Bush, founder of Black Women in Artificial Intelligence, an organization aiming to empower Black women in the AI sector, tells CNBC that when AI systems are specifically used for loan approval decisions, she has found that there is a risk of replicating existing biases present in historical data used to train the algorithms.
    “This can result in automatic loan denials for individuals from marginalized communities, reinforcing racial or gender disparities,” Bush added.
    “It is crucial for banks to acknowledge that implementing AI as a solution may inadvertently perpetuate discrimination,” she said.
    Frost Li, a developer who has been working in AI and machine learning for over a decade, told CNBC that the “personalization” dimension of AI integration can also be problematic.
    “What’s interesting in AI is how we select the ‘core features’ for training,” said Li, who founded and runs Loup, a company that helps online retailers integrate AI into their platforms. “Sometimes, we select features unrelated to the results we want to predict.”
    When AI is applied to banking, Li says, it’s harder to identify the “culprit” in biases when everything is convoluted in the calculation.
    “A good example is how many fintech startups are especially for foreigners, because a Tokyo University graduate won’t be able to get any credit cards even if he works at Google; yet a person can easily get one from community college credit union because bankers know the local schools better,” Li added.
    Generative AI is not usually used for creating credit scores or in the risk-scoring of consumers.
    “That is not what the tool was built for,” said Niklas Guske, chief operating officer at Taktile, a startup that helps fintechs automate decision-making.
    Instead, Guske said the most powerful applications are in pre-processing unstructured data such as text files — like classifying transactions.
    “Those signals can then be fed into a more traditional underwriting model,” said Guske. “Therefore, Generative AI will improve the underlying data quality for such decisions rather than replace common scoring processes.”

    But it’s also difficult to prove. Apple and Goldman Sachs, for example, were accused of giving women lower limits for the Apple Card. But these claims were dismissed by the New York Department of Financial Services after the regulator found no evidence of discrimination based on sex. 
    The problem, according to Kim Smouter, director of anti-racism group European Network Against Racism, is that it can be challenging to substantiate whether AI-based discrimination has actually taken place.
    “One of the difficulties in the mass deployment of AI,” he said, “is the opacity in how these decisions come about and what redress mechanisms exist were a racialized individual to even notice that there is discrimination.”
    “Individuals have little knowledge of how AI systems work and that their individual case may, in fact, be the tip of a systems-wide iceberg. Accordingly, it’s also difficult to detect specific instances where things have gone wrong,” he added.
    Smouter cited the example of the Dutch child welfare scandal, in which thousands of benefit claims were wrongfully accused of being fraudulent. The Dutch government was forced to resign after a 2020 report found that victims were “treated with an institutional bias.”
    This, Smouter said, “demonstrates how quickly such disfunctions can spread and how difficult it is to prove them and get redress once they are discovered and in the meantime significant, often irreversible damage is done.”

    Policing A.I.’s biases

    Chowdhury says there is a need for a global regulatory body, like the United Nations, to address some of the risks surrounding AI.
    Though AI has proven to be an innovative tool, some technologists and ethicists have expressed doubts about the technology’s moral and ethical soundness. Among the top worries industry insiders expressed are misinformation; racial and gender bias embedded in AI algorithms; and “hallucinations” generated by ChatGPT-like tools.
    “I worry quite a bit that, due to generative AI, we are entering this post-truth world where nothing we see online is trustworthy — not any of the text, not any of the video, not any of the audio, but then how do we get our information? And how do we ensure that information has a high amount of integrity?” Chowdhury said.
    Now is the time for meaningful regulation of AI to come into force — but knowing the amount of time it will take regulatory proposals like the European Union’s AI Act to take effect, some are concerned this won’t happen fast enough.
    “We call upon more transparency and accountability of algorithms and how they operate and a layman’s declaration that allows individuals who are not AI experts to judge for themselves, proof of testing and publication of results, independent complaints process, periodic audits and reporting, involvement of racialized communities when tech is being designed and considered for deployment,” Smouter said.
    The AI Act, the first regulatory framework of its kind, has incorporated a fundamental rights approach and concepts like redress, according to Smouter, adding that the regulation will be enforced in approximately two years.
    “It would be great if this period can be shortened to make sure transparency and accountability are in the core of innovation,” he said. More

  • in

    Norfolk Southern engineer’s safety warning was unheeded before Ohio derailment, NTSB says

    Norfolk Southern supervisors didn’t address an engineer’s safety concerns about a train that ended up derailing in February in East Palestine, Ohio, according to preliminary findings released by the NTSB.
    The derailment, which happened in early February, spilled toxic chemicals, triggering health and environmental concerns among residents and officials.

    Cleanup efforts continue on portions of a Norfolk Southern freight train that derailed in East Palestine, Ohio, Feb. 9, 2023.
    Gene J. Puskar | AP

    Norfolk Southern supervisors didn’t address an engineer’s safety concerns before a train loaded with toxic chemicals derailed in East Palestine, Ohio in February, according to preliminary findings released Thursday from a National Transportation Safety Board investigation.
    The day before the train derailed, an engineer in Decatur, Illinois, had voiced his concern about the size of the train to the yardmaster, according to the NTSB. But the engineer told the agency that he was told, “Well, this is what they want,” the findings showed.

    “If you talk to the manager, they said this train was 100% rule compliant. To me, in my opinion, you know, you got 32% of the weight on the headend. Twenty percent in the middle and 40% weight on the rearend. So, to me, that’s why we reported that to the yardmaster and like I said this is what they want,” the Decatur engineer said.
    Norfolk Southern responded by saying that the Federal Railroad Administration has not set out regulatory requirements on train configuration, and that the train met its internal policies regarding train configuration at the time of the East Palestine derailment. 
    “Every accident is an opportunity to learn. We are collaborating with labor leadership and our craft employees to enhance safety, we’ve brought in an outside safety consultant, and we are committed to leading the industry,” Norfolk Southern spokesman Connor Spielmaker told CNBC in an email.
    The NTSB released its findings before it began a two-day hearing on the derailment Thursday. The hearing is intended to address preparedness during the initial emergency response, the decision-making process regarding venting and burning the vinyl chloride tank cars, and the examination of freight car bearing failure modes and wayside detection systems.
    On Feb. 3, a Norfolk Southern freight train carrying hazardous chemicals derailed, releasing toxic chemicals into the environment near Ohio’s border with Pennsylvania. Norfolk Southern CEO Alan Shaw has pledged support for residents of East Palestine, Ohio, although critics have said he hasn’t gone far enough.

    A duration of three minutes to three minutes and 45 seconds is adequate for maintenance personnel to inspect a train car, the Transportation Communications Union told NTSB in a separate statement. But the union said that Norfolk Southern has decreased the average inspection time to around one minute following the company’s new train scheduling strategies, which TCU believes is insufficient for a comprehensive inspection of each train.
    The company responded that it doesn’t have a policy limiting time for car inspections.
    Norfolk Southern took further exception with the union’s allegation, saying that the current average car inspection time is approximately two minutes. The company said that is one minute longer than the average that was set by professional craft railroaders performing the same inspection and offered as a guide to crews.
    “It is not accurate to say NS has ‘reduced’ the standard amount of time for a car inspection since the implementation of PSR. What we have done is documented and standardized what a proper inspection looks like, and the time it should take a qualified railroader to complete that inspection,” Spielmaker said. More