The Feed · Complete archive

AI at work: research and practice

A server-rendered record of the evidence, ideas and firsthand practices screened by The Feed. Every entry links to its original source.

Use the interactive Feed

Page 1 of 12 · 1143 items

  1. practice · Gloria Mark ·

    AI and the illusion of competence

    Using AI summaries can create false confidence in understanding without deeper verification or defense of the content.

    Photo by Tima Miroshnichenko on Pexels. This week I heard Sherry Turkle speak about her new book Artificial Intimacy at the New York Society Library. There was something surreal about sitting in a library where George Washington and Alexander Hamilton had borrowed books. (Here’s a fun fact: Washington never returned two library books from 1789, and his estate owes a $300,000 fine .) As I looked around at the shelves of books, I thought about how easily AI could now distill any one of those volumes into a few paragraphs, and how easily we might come away feeling that we really understood the bo

    judgment · Gloria Mark

  2. practice · Nate B Jones ·

    Stop explaining the same correction to your AI every morning. A guide and five prompts to find which of four causes sent your agent off track and make the fix stick

    Framework to diagnose why AI agents repeat mistakes and techniques to fix the root cause instead of correcting surface errors repeatedly.

    The latest AI systems are being asked to stay with a problem for hours or days. They investigate, try an approach, check the result, and keep working when the first attempt fails. The person directing them can step away from the individual steps and return to review progress or make the calls that matter. We’re seeing examples across the major labs. OpenAI recently reported AI sessions running for hundreds of hours finding and fixing problems in its system for managing code. Anthropic described an experiment in which more than 1,000 agents worked for eight days on a prototype operating system.

    ways of working

  3. research · HBS AI Institute ·

    Using AI to Guide Workers

    LLM-based recommendation system guides worker task selection in crowdsourcing contests, balancing firm productivity with worker satisfaction.

    New research shows how LLMs can balance organizational performance with individual priorities. If AI is integrated into operational and decision-making systems within organizations, it could in effect start to act like a manager. Think of AI in charge of assigning workers to tasks, sequencing work, or distributing resources. Executives who oversee this type of AI transformation face an important design challenge: can AI be beneficial and effective for your firm, while also being aligned with the interests of your employees, your customers, and others affected? The new paper, “ Guiding Worker S

    management org

  4. practice · Eugene Yan ·

    How Public Evals Work and Fail, and What Should Change

    Framework for reading AI benchmark results critically, with specific red flags from analyzing 12 actual benchmarks.

    How to read eval scores and what to question, from a teardown of 12 benchmarks.

    judgment · Eugene Yan

  5. practice · The Pragmatic Engineer ·

    Software factories and code reviews with Harjot Gill

    CEO describes running a startup that ships 5,000+ AI-reviewed pull requests monthly with specific workflow changes around code review.

    Listen and watch now on YouTube , Apple , and Spotify . See the episode transcript at the top of this page, and timestamps for the episode at the bottom. Brought to You by • turbopuffer – a ridiculously scalable, fast and cheap hybrid search engine, built on top of object storage, used by cutting-edge companies like Anthropic, Linear, Ramp and many others. Many companies that switch to turbopuffer are cutting their search bills by 50% or more and getting much faster results. Check it out. • Entire – Entire launched its own Git forge, shipped Continuous Memory, and reinvented the pull request (

    teams · Gergely Orosz

  6. practice · Rands in Repose ·

    How Robots Talk to Me

    Engineer documents personal interaction preferences with AI tools to reduce friction and repetition across voice and text interfaces.

    On and off, I’ve been using voice mode for ChatGPT and Claude. It’s mostly an in-the-car thing, and a months-ago update to ChatGPT made the experience unusable — audio interference. Claude is quite good now, and I’ve started chatting while driving, but she doesn’t know anything about me. Over on my Mac Studio, Claude Code knows lots, so I asked it to roll up how I like to work with robots. Thus: How to talk to me Plain language. No unexplained acronyms or jargon. Number any list I might act on, so I can answer by number. Be brief. In voice, keep answers short. Never guess facts about me and pr

    ways of working

  7. practice · martinfowler.com ·

    Data Contracts

    Data contracts apply API design practices to datasets, making data interfaces explicit for autonomous AI agents and human use.

    Data contracts are a way to describe the contents and guarantees of datasets. Simon Harrer and Arif Wider describe in detail what they are and how to use them. They apply practices from API design to data by treating them as data-providing services - such as data products - whose interfaces we want to define as clearly as possible. This approach significantly increases the robustness of large-scale data landscapes, and gives both people and AI agents the explicit, trustworthy metadata they need to work with data autonomously, which is why more and more enterprises are adopting them. more…

    ways of working · Martin Fowler

  8. research · Indeed Hiring Lab ·

    There is no AI Jobpocalypse, but plenty of AI-nxiety

    AI job postings doubled in a year; worker sentiment on AI in Glassdoor reviews fell from 82% positive to 45% positive.

    Key Points: AI’s impact is broad, but still shallow. There is little evidence of widespread job losses driven solely by AI. The Indeed AI Tracker roughly doubled over the past year, and nearly two-thirds of AI-touched job titles are now outside traditional tech. An AI-driven productivity boom hasn’t arrived yet. Labor productivity has grown at a 2.1% annual pace since late 2019, in line with its long-run average. 31% of workers say their employer has low-to-zero AI adoption. Workers are souring on AI. Only 45% of AI mentions in Glassdoor reviews are positive, down from 82% in 2019, and AI-crit

    jobs skills

  9. practice · Simon Willison ·

    External sandboxes for coding agents

    External sandbox pattern lets coding agents run untrusted code safely without risking the host machine.

    External sandboxes for coding agents I've been exploring new ways to sandbox code that is executed by agents, with a focus on making it safer to try out local models without worrying that a mistake or prompt injection attack might cause them to take damaging actions on a machine. I worked on this project with Prime Radiant , the AI research lab behind Superpowers and other projects . My post on the Prime Radiant blog introduces the external sandbox pattern, where code executed by the agent runs inside a dedicated sandbox while the agent itself lives outside of that sandbox. To demonstrate this

    ways of working · Simon Willison

  10. practice · The Pragmatic Engineer ·

    Inference engineering for software engineers

    Software engineers should learn inference engineering: practices for running open models cheaply via providers or bare metal.

    A recent trend we’ve covered is of tech companies moving to open models to rein in AI spend: Uber cut its per-token costs by 50%, Pinterest by 90%, and even AT&T has achieved a 56% decrease. But how do you move from a frontier lab’s APIs to using open models? There are two options: “Bare metal:” With plenty of time and money, you can go “bare metal” and purchase a few dozen NVIDIA GPUs and use those AI supercomputers, like Revolut has done : running 56 separate B200 units itself to serve its inference needs. This is a lot of work to set it up, but after that, operational costs are as cheap as

    ways of working · Gergely Orosz

  11. research · arXiv ·

    AI, Specialization, and the Organization of Knowledge Work: Evidence from Legal Services

    Legal AI increased self-representation 6.6 points but did not shift work to in-house lawyers; premium firms raised markups despite market share loss.

    Artificial intelligence makes specialized knowledge cheaper to use, but its effects on professional-service firms depend on how clients reallocate work and how suppliers respond. We develop a framework linking individual self-provision, enterprise make-or-buy decisions, and pricing by specialist firms. As AI improves lower-priced alternatives, clients may reallocate work across outside providers without bringing it in-house. If the departing work is more price-sensitive than the work that remains, premium firms may raise their optimal markups even as their share of work declines. We examine th

    jobs skills

  12. practice · John Warner ·

    Naomi S. Baron on What Happens When We Read

    An expert on technology and language discusses how AI reading differs from human reading and its implications.

    A lot of what ultimately gets to the page under my byline is based in my experiences. Stuff happens, I start thinking about it, want to understand it and then write in order to advance that understanding. The other source of fuel I need to do this work is expertise , the insights of people who have worked a particular issue in depth over a period of time and have come away with the kinds of insights that allow me to do my thinking. Naomi Baron is one of those experts I turn to over and over again to refresh my thinking. I’m pleased that she was able to take the time to answer some of my questi

    judgment · John Warner

  13. research · Journal of Labor Economics ·

    Automation and Gender: Implications for Occupational Segregation and the Gender Skill Gap

    Women shifted more than men from routine occupations to high-skill roles when exposed to automation, with greater college attainment among women in affected areas.

    We examine the differential effects of automation on the labor market and educational outcomes of women relative to men over the past four decades. Although women were disproportionately employed in occupations with a high risk of automation in 1980, they were more likely to shift to high-skill, high-wage occupations than men in over time. We provide a causal link by exploiting variation in local labor market exposure to automation attributable to historical differences in local industry structure. For a given change in the exposure to automation across commuting zones, women were more likely

    jobs skills

  14. research · Government Information Quarterly ·

    A perceived tax on privacy? AI misuse concerns as legitimacy deficits in mandatory governance

    Citizens' concerns about AI in mandatory public services stem from procedural justice violations, mediated by trust in administration.

    As public administrations embed artificial intelligence (AI) in mandatory services such as income taxation, discretion shifts from case-level judgment to system-level design choices. Privacy then concerns not only which data are held but how citizens are judged, as algorithms infer sensitive attributes and categorize individuals. Because citizens can neither opt out of these services nor audit the underlying logic, privacy frameworks built on voluntary use and personal control are inadequate to explain how citizens’ concerns arise or how regulation addresses them. This study draws on a dyadic

    judgment

  15. practice · Lenny's Newsletter ·

    🎙️ How I AI: Fable 5.2 Review + How I fight token fraud as a solo founder + Building a Claude Code family OS

    Solo founder built family household management system using Claude Code to store context in inspectable Markdown files instead of chat memory.

    Claude Code + Obsidian: My family’s AI brain | Scott Farrar Listen now on YouTube • Spotify • Apple Podcasts Brought to you by: WorkOS —Make your app enterprise-ready, with SSO, SCIM, RBAC, and more Jira Product Discovery —Prioritize with insights, build with confidence Scott Farrar is a math educator and parent who built a shared household brain using Claude Code and Obsidian. In this episode, he shows how the system tracks appliances and warranties, compares insurance quotes, organizes family projects, and keeps household tasks moving through a shared to-do list and wall display. He also exp

    ways of working · Lenny Rachitsky

  16. practice · The Pragmatic Engineer ·

    Software engineering after code becomes cheap with Satya Nadella

    Microsoft CEO describes how software engineering is shifting from code generation to code verification as AI makes coding cheap.

    Listen and watch now on YouTube , Apple , and Spotify . See the episode transcript at the top of this page, and timestamps for the episode at the bottom. Brought to You by • turbopuffer – a ridiculously scalable, fast and cheap hybrid search engine, built on top of object storage, used by cutting-edge companies like Anthropic, Linear, Ramp and many others. Many companies that switch to turbopuffer are cutting their search bills by 50% or more and getting much faster results. Check it out . Also, check out the new and improved The Pragmatic Engineer search I built on top of turbopuffer! • Linea

    ways of working · Gergely Orosz

  17. practice · How I AI ·

    How I fight token fraud as a solo founder

    Solo founder details six token fraud patterns hitting AI SaaS, the business and technical controls that slowed them, and why free trials were killed.

    Today I’m walking you through a problem that has cost me tens of thousands of dollars over the past year and eaten almost all of my engineering energy: token fraud. I’m the solo founder of ChatPRD, a bootstrapped AI platform for product managers, and fraudsters have been farming our free trials, reselling promo codes, wrapping the product in relays, and installing a custom MCP that ran as a 24/7 compute worker. I’ll walk through the six abuse patterns I’ve seen, the business and technical controls I put in place, the Jev loop that classifies fraud in real time, and why I finally killed free tr

    adoption · Claire Vo

  18. research · arXiv ·

    Auditing a Moving Target: Evidence Anchoring and the Expiry of Fairness Audits of Provider-Served Language Models

    LLM biases in hiring and investment decisions persist across model versions but change in magnitude and form, making single audits obsolete within months.

    Organizations increasingly use large language models (LLMs) for decisions about people, such as hiring, investment and employee evaluation, and rely on them over long periods of time. Fairness audits of such systems, however, are conducted only once. We examine how the biases of LLMs change over time. In a venture screening setting, models from five providers decided whether and how much to invest in startups whose founders differed only in gender, origin and university. We repeated this audit three times over 13 months (248,400 API calls). Study 1 shows that the same model, called under the s

    judgment

  19. research · New Economics Papers: AI ·

    Exposure Is Not Adoption: Measuring Generative AI and Labor Demand

    Realized AI adoption, not occupational exposure, predicts labor demand changes; adoption is more concentrated and shows 10 log-point job posting decline per standard deviation increase.

    Occupational exposure indices measure what generative AI could do, not what it is used for. I build a behavioral measure of realized AI adoption from the Anthropic Economic Index and compare it with the standard exposure index across 47 occupational sectors. Adoption and exposure rank occupations alike but diverge in level, because adoption is far more concentrated. In weekly Indeed job postings after ChatGPT, labor demand tracks adoption rather than exposure: a one standard deviation increase in adoption predicts a decline of about 10 log points, while exposure adds nothing. A second adoption

    jobs skills

  20. research · Proceedings of the National Academy of Sciences ·

    Automating inequality? Gender bias in AI-mediated labor markets

    Audit experiments show LLMs generate gender-biased CVs and exhibit gender bias in applicant screening and wage recommendations, with effects that reinforce each other.

    Generative AI is rapidly entering labor markets, with large language models (LLMs) now used to help write CVs and evaluate applicants. We study the risks this creates in a series of audit experiments in which applicant gender is randomly assigned while all other information is held constant. We find that LLMs generate gender-stereotypical CVs and exhibit gender bias in screening scores and wage recommendations. Screening scores track occupational gender segregation, penalizing women in male-dominated occupations and favoring them in female-dominated ones. Wage recommendations track occupationa

    jobs skills

  21. research · New Economics Papers: AI ·

    Generative AI Boosts Productivity Across the Expertise Ladder

    Generative AI access improved research productivity across skill levels in a seven-hour experiment with 276 researchers, boosting error detection and report quality.

    Generative AI is improving rapidly, but evidence on whether these advances translate into broad productivity gains across skill levels remains limited. We studied access to 2025–2026 generative AI among 276 researchers, ranging from undergraduates to senior academics, during a seven-hour research assignment spanning economics, political science, psychology, and management. Participants reproduced published results, searched for errors, proposed additional analyses, and wrote referee reports. AI assistance increased successful reproduction, the discovery of verified errors, the production of ex

    productivity

  22. research · New Economics Papers: AI ·

    AI and the Labor Market: Productivity Driver or Job Killer?

    Administrative data from Germany and EU show no widespread job losses in AI-exposed occupations since 2022, but young workers aged 20-24 saw declining employment, especially in highly exposed roles.

    While estimates of AIʼs long-run productivity gains diverge widely, early signs of its labor market impacts can already be observed. Using administrative data for Germany and the EU Labour Force Survey, we track employment by occupational AI exposure since the arrival of generative AI in late 2022. We find no widespread job losses in exposed occupations. Their employment has held up or grown, continuing a divergence from less exposed occupations that predates the introduction of generative AI. Young workers are the exception, however. In Germany, employment of workers aged 20 to 24 has fallen

    jobs skills

  23. research · New Economics Papers: AI ·

    Beyond Exposure: AI and Labor Market Reorganization in Türkiye

    AI exposure predicts job reorganization more than job loss in Turkey; 21% of private sector work reorganizes rather than automates.

    Occupational exposure to artificial intelligence (AI) identifies where technology may affect work, not how employment adjusts. Using microdata from Türkiye’s 2024 Household Labor Force Survey, this paper applies the Richmond (2026a) AI Jobs Transition Framework to a nationally representative sample of private sector workers. The framework links AI exposure with demand responsiveness (whether productivity gains expand demand enough to offset lower labor needs per unit of output) and human necessity (whether delivery requires human participation). It identifies four adjustment mechanisms: Automa

    jobs skills

  24. research · CEPR ·

    DP22189 Frontier Technology in Frontier Markets? Financing Global AI Entrepreneurship

    AI startups globally target more sectors than non-AI peers, but financing premiums for AI startups are sharply localized: 151% higher in North America, 42% in East Asia, near-zero in Africa and Latin America.

    Does the global diffusion of artificial intelligence (AI) extend to the creation and financing of the firms that build it? Using a novel dataset of 116,795 startups founded between 2015 and 2022 across 172 countries, we link company descriptions and financing histories to the employment and education records of founders, early employees, and potential investors. We document a stark divergence between the real and financial sides of global AI entrepreneurship. On the real side, AI startups everywhere display the hallmarks of a general-purpose technology: in every world region, they target more

    adoption

  25. research · New Economics Papers: AI ·

    Joules-to-GDP: How Much Economic Value Do AI Systems Produce per Unit of Energy?

    AI systems vary 2.5 to 4 times in economic value per joule of energy across models and occupations, with software development more efficient than engineering.

    An AI system can produce more economically valuable work while delivering less value for the energy it consumes. We therefore ask: How much economic value does an AI system create per unit of energy consumed? We formalize economic value in two ways: (1) net dollar value, the output's dollar value minus AI-system execution cost, and (2) time saving, the expert's completion time minus the AI system's completion time. Dividing each by measured end-to-end energy yields Net Value per Joule (NVJ) and Time Saving per Joule (TSJ), reported in USD/MJ and hours/MJ. We study 220 public GDPval tasks acros

    productivity

  26. research · New Economics Papers: AI ·

    Creative destruction: Human-AI competition in an experimental market

    In an experimental market, AI-designed products outperformed human-designed ones; consumers showed no preference for human authorship and did not pay more for it.

    We study two hypotheses for how a human role in production could persist despite growing AI capabilities. Humans might have a durable advantage in taste, designing better products even as AI agents automate routine tasks, or consumers might intrinsically prefer that humans have a hand in production. In our experiment, participants act as producers, designing computer games with an AI coding agent, and as consumers who buy them. Across three studies (N = 1, 025), we find no evidence for either hypothesis. Games designed by an AI on its own outperform those of human producers, including both ama

    jobs skills

  27. research · New Economics Papers: AI ·

    What is Work For? Labor, Politics, and Meaning in the Age of AI

    Survey of 8,234 workers across UK, US, Denmark, India finds 81% job satisfaction; one third intrinsically motivated, one quarter by community; most would leave for guaranteed income.

    This paper investigates the role of work in providing meaning, purpose, community, and other non-monetary benefits. Using an original cross-national survey of 8, 234 working-age adults across the UK, US, Denmark, and India, I study the factors that motivate people in their work, with an eye toward the future AI economic transformation. I find that 81% of respondents report being satisfied with their job, and a majority across all four countries are strongly motivated by the non-monetary components of their employment. Using an original "Work Values" Index, I show that one third of working resp

    worker experience

  28. research · arXiv ·

    Can AI Judge You? An Empirical Audit of Deployment Readiness in LLM-assisted Hiring Systems

    LLM-based resume screening systems show interface choice and permission controls affect both accuracy and security against prompt injection attacks.

    Delegating resume screening to large language models (LLMs) requires organizations to establish whether they can distinguish candidates by relevant qualifications while allowing only authorized users to change screening rules or approve exceptions. To this end, we develop a system architecture that separates candidate evidence, evaluation, permission controls, and assessment record, and empirically examine two complementary dimensions of its deployment readiness. First, we assess its operational readiness on four LLMs using a controlled experiment on 210 resumes across 14 job roles and six dec

    adoption

  29. practice · John Warner ·

    The Biggest Barrier to Improving Teaching and Learning

    Teaching writing with AI requires clarity on what we actually value in writing before we can teach it well.

    There is exactly one more paid subscriber to this newsletter this year vs. last year. Who wants to increase that number by 100%! This week at my Inside Higher Ed column I published a kind of summary/reflection of what it’s been like to talk to anyone who would have me about teaching writing in a world in which AI is present. Click here to read this article! I talk about how we’ve made significant progress on this challenge, and that early prophecies of doom have given way to a determination to figure things out. I talk about my experiences with students and how they very much express a desire

    jobs skills · John Warner

  30. research · arXiv ·

    LLM Facilitation of Group Decision-Making

    LLM facilitation increased groups reaching correct decisions in a hidden-profile task from 33% to 57%, with group-level intervention outperforming individual-level prompting.

    Human groups often fail to integrate information distributed across their members, converging on incorrect decisions. We ask whether large language models (LLMs) can help groups reach the correct decision in such settings. In an online, chat-based experiment, 138 three-person groups (N = 414) completed a hidden-profile hiring task that required selecting the best candidate using public information available to all group members and private information available only to individual members. The randomized human-subject experiment included three conditions: no facilitation, an individual-level LL

    judgment

  31. practice · Nate B Jones ·

    If you still have six AI windows open, what got simpler? Here's what it looks like to ask one office manager what happened and what needs you.

    Managing multiple AI agents requires a single interface to coordinate their work and report exceptions rather than checking each tool separately.

    What is my Claude doing? What is my Codex doing? What exactly are my agents doing all day? I use a lot of AI tools, and sometimes I feel like I’ve traded one kind of stress for another kind of stress. They can do things to my Gmail. Sometimes my Gmail gets rate limited and I didn’t intend it to. I got enough help with email that I now have to think about how many things are helping with email. As agents gain in capability, we need a simpler place to put them. I’m keeping the part where an agent can go off and do something useful for me. That’s the whole reason I gave it access to my email in t

    ways of working

  32. practice · Claude Blog ·

    Building always-on agents

    Guide to building agents that run continuously across sessions, deciding when and how to act.

    Always-on agents run indefinitely, deciding how and when to act across many sessions. This guide walks through their core primitives and how they fit together.

    ways of working

  33. research · VoxEU ·

    AI and the geography of expert work: Evidence from radiology

    As AI spreads in radiology, work shifts from small local markets to multi-state groups; employment grows but becomes geographically concentrated.

    Forecasts of the effect of AI on jobs usually start from the tasks a machine can perform. Radiology, the medical specialty most exposed to AI, points to a different margin. This column uses US Medicare data for 2013–2024 to show that as AI tools spread, radiologists did not read more scans and the profession kept growing, but radiology work moved out of small local markets and into multi-state groups. The evidence fits a mechanism in which AI makes expert work done elsewhere easier to check. The costs of AI may fall less on occupations than on places.

    jobs skills

  34. research · Information Systems Research ·

    The Workplace GenAI Usage Divide: A Genetics-Informed Cognitive and Metacognitive Account

    Genetic predisposition indexed by educational attainment polygenic score explains persistent variation in workplace GenAI usage intensity via cognitive and metacognitive pathways.

    Generative AI (GenAI) is increasingly deployed in organizations, yet employees differ substantially and persistently in how frequently and intensively they use it. This workplace “usage divide” raises a fundamental but underexplored question: Why do employees differ systematically in their use of GenAI, even under common formal access? We argue that this divide reflects a broader challenge for IS research: explaining the use of systems that are probabilistic rather than deterministic, and general-purpose yet uneven and evolving in their capabilities. In workplaces where employees remain accoun

    adoption

  35. research · arXiv ·

    AI and the Two Margins of Work: Why Job Losses Show Up Before Job Creation

    New firms exposed to AI tasks show 10–20% more entry; incumbent job losses appear before new job creation because statistics record them at different speeds.

    Technological change acts on labor demand at two margins: adjustment within established activities and the creation of additional activities, often by new firms. Payroll statistics record the first promptly and the second late. In the computing era, firms that entered in 1978 or later held 42 percent of payroll by 1998 and entering cohorts kept about 80 percent of their payroll after five years; in the industries most exposed to automation, incumbents contracted before entrants accumulated, a sequence that is precise early in the period and suggestive by its end. We develop a model in which on

    jobs skills

  36. research · Indeed Hiring Lab ·

    2026 Q3 US Tech Labor Market Update

    Tech job postings and wages rose in Q3 2026 despite AI concerns; quits rates remained low.

    The tech labor market continued to brighten a bit in the third quarter of 2026, as all categories notched job postings gains over the past year. Wage growth picked up dramatically in data & analytics and IT systems & solutions categories. However, workers so far remain stationary as quits rates are still low. Indeed job postings Overall US job postings on Indeed remain near pre-pandemic levels; however, the year-over-year trend turned positive for the first time in nearly four years, with job postings up 3.1% in the year to October 23. Somewhat unexpectedly, considering the concern over AI rep

    jobs skills

  37. research · Federal Reserve ·

    FEDS Paper: Artificial Intelligence and the U.S. Economy: Current Evidence

    Most firms do not use AI intensively yet; labor market and productivity effects so far are small and mixed.

    Nick Carollo , Leland D. Crane , Daniel Garcia Molina , and Joseph Nichols We assess the current evidence on how AI-related investment and the use of AI are affecting the U.S. macroeconomy. Specifically, we document the boom in data center capital investment, the current rate of adoption of AI tools in the economy, the impact of the AI-related investment surge on prices, and discuss whether AI tools have affected the labor market and productivity yet. Driven by current and expected future demand for AI services, investment in data centers, both the physical structures and semiconductor chips a

    adoption

  38. research · arXiv ·

    Beyond Curiosity: Habit and Organizational Learning Capability as Predictors of Shadow AI

    Habit, not curiosity, is the strongest predictor of employees using unauthorized AI tools at work, accounting for 28% of variance.

    Generative AI has entered the workplace faster than organizations can govern it. A large share of employees now use AI tools their employer has not sanctioned, and many actively conceal that use, but the psychology of this covert technology behavior remains poorly understood. A common assumption, in popular accounts and early commentary, treats unauthorized (shadow) AI use as curiosity-driven exploration by adventurous individuals. We test this against a competing account grounded in the psychology of habitual technology use, in which automaticity rather than exploratory disposition sustains t

    adoption

  39. practice · Shopify Engineering ·

    Cyber Chaos Monkey: Staying ahead of security threats with AI agents

    AI agents paired with system knowledge to safely conduct adversarial testing against production infrastructure.

    How we pair AI agents with our knowledge of Shopify’s systems to safely attack our production infrastructure, find bugs, and reduce risks.

    productivity

  40. practice · martinfowler.com ·

    Bliki: Generated Glossary

    Generate domain-specific glossaries from organizational text to improve LLM performance on specialized work.

    When we use LLMs in a specialized domain, such as the operations of any reasonably-large organization, there is a lot of specialized vocabulary. Such words and specialized meanings will be foreign to an LLM because they aren't in its training set, making it harder for the LLM to be effective when doing tasks in that domain. One technique to aid this is to use an LLM to generate a glossary of the terminology in that domain, and make this glossary available for any LLMs doing work in those circumstances. The sources for the LLM can be any material within the organization concerned such as docume

    ways of working · Martin Fowler

  41. research · HBS AI Institute ·

    The Real Shape of AI Adoption at Work

    Survey of actual AI use across occupations finds adoption widespread but shallow, with big variation among identical workers doing the same job.

    Rather than between distant roles, the true adoption gap lies between teammates working side by side. Listen to this article: Imagine two analysts who work on the same floor, hold the same title, and have the same subscriptions to AI tools. One has integrated AI into most of their workday, while the other tried it once, got a mediocre answer, and hasn’t opened it since. This is an example of identical access with opposite behavior, a gap that sits at the heart of the new NBER working paper, “ What Work Does Generative AI Do? ” co-written by 2026 HBS AI Institute Associate David Deming . Using

    adoption · David Deming

  42. practice · martinfowler.com ·

    Tests as data: ensuring AI-generated code does what we want

    When AI writes code, shift from developer tests to customer tests, encoding them as data to prevent AI from modifying the contract.

    Automated testing in the age of AI coding assistants is problematic: when AI agents write both production and test code, developers risk losing the assurance that automated tests protect against functional errors. Matteo Vaccari makes three claims: (1) when AI writes the code, developers become its customers; (2) therefore customer tests, not developer tests, become the primary contract between humans and AI; (3) moving that contract into test data rather than test code makes it easier to protect it from unexpected modifications by coding agents. All of this optimizes for human-readable tests

    judgment · Martin Fowler

  43. practice · How I AI ·

    Claude Code + Obsidian: My family’s AI brain | Scott Farrar

    Parent built a persistent household knowledge system in Claude Code and Obsidian to replace drifting AI chats, shared with spouse and displayed on wall.

    Scott Farrar is a math educator and parent who got tired of AI chats that drift and forget. So he built a household brain in Claude Code: a folder of Markdown files, viewed in Obsidian, that knows his appliances, warranties, insurance documents, and everything on his family’s to-do list. In this episode, Scott shows how he uses it to shop for car insurance, plan repairs, share the system with his wife, and put priority tasks and recent wins on a wall display. We also talk about AI and math learning, and why he wants AI to keep kids doing the thinking. What you’ll learn: Why he moved his home l

    ways of working · Claire Vo

  44. research · arXiv ·

    The Rebundling of Freelance Work in the AI Age

    AI is shifting freelance work toward higher-value bundled projects; tasks common in ChatGPT lose marketplace share while rarer tasks gain share.

    This paper examines how freelance work is changing in the AI era. We compare the activities people undertake in ChatGPT with the work clients request on Upwork, an online freelance platform, and examine how clients combine tasks into projects. We find that activities more prevalent in ChatGPT tend to lose marketplace share on Upwork, while those less prevalent tend to gain share. Within AI-related work, demand is becoming more diverse, and job postings combine tasks that were rarely requested together before the generative AI era. AI-related postings also have substantially larger project budg

    jobs skills

  45. practice · Lenny's Newsletter ·

    State of the tech job market: late 2026

    Product managers gain relative advantage in AI era while engineering demand stalls and design hits record lows.

    👋 Hey there, I’m Lenny. Each week, I share deeply researched product, growth, and career advice. For more: Lenny’s Jobs | Lenny’s Podcast | Lennybot | How I AI | Become an AI-Native Builder and my other favorite AI/PM courses . Subscribe now P.S. Get a full free year of Cursor, Notion, Replit, Lovable, Wispr Flow, Linear, ElevenLabs, PostHog, Granola, Brain.fm, Waking Up, and more, by becoming an Insider subscriber (while supplies last). Learn more . Welcome to my latest job market report, my second of 2026. Of the five reports I’ve done over the past few years, this one is the most surprisin

    jobs skills · Lenny Rachitsky

  46. practice · Shopify Engineering ·

    How we rebuilt the Shopify app in 12 weeks

    Mobile engineering team redesigned architecture and workflows around AI agents writing code, focusing on validation.

    What changed when agents started writing our mobile code, and how we redesigned our architecture, tooling, and workflow around validation.

    ways of working

  47. practice · martinfowler.com ·

    Fragments: November 10

    Scaling agentic AI from small teams to enterprises requires solving shared context, token cost, review load, security and platform dependencies.

    It’s that time of the year when the November Thoughtworks Technology Radar appears. Again my colleagues have taken a sweep of the technologies that our teams have used in the field, and pulled together a summary of what’s popped up in the last six months. It’s been a busy half-year, one that again has been dominated by AI, and that’s reflected in the many AI blips on the radar. The mass of blips makes it hard to develop a coherent story around trends, but Chris Ford has done a fine job of the writing the accompanying article on macro trends . One team of passionate people experimenting with ag

    management org · Martin Fowler

  48. practice · martinfowler.com ·

    Long-horizon agents and durable execution

    Durable execution pattern for long-horizon agents: runtime records each external step so failures resume without re-running completed work.

    Long-horizon agents can automate complex tasks that take days or weeks to complete and involve multiple exchanges with people and external systems. Many things can go wrong during this time, including process crashes, network failures, and unanticipated real-world behavior. Kiran Prakash explains durable execution: an emerging pattern that helps agents recover from these failures and move towards their goal. In this programming model, the runtime keeps a record of the result of each step that interacts with the outside world so that, when a failure occurs, the program runs again, completed ste

    ways of working · Martin Fowler

  49. practice · Simon Willison ·

    Quoting Prompting Claude Fable 5.2

    Telling Claude it owns the code doubles likelihood it refactors repeated code instead of preserving existing structure.

    Claude Fable 5.2 responds closely to what the prompt says about who owns the code it works on. In Anthropic’s testing on small coding tasks, when a prompt said nothing about ownership or presented the code base as someone else’s, the model tended to add to the existing structure, even when that repeated existing code. [...] If you want the model to improve the structure as it works, say that the code is its own: This codebase is yours: what it's for and how it's built are your call, and you'll keep building on it. In Anthropic’s testing on small coding tasks, the model merged repeated code in

    ways of working · Simon Willison

  50. practice · Claude Blog ·

    How Curative is building a national provider network with agents on Claude

    Deal-making agent negotiates over 2,000 provider contracts per week for healthcare network expansion.

    Curative’s deal-making agent negotiates 2,000+ provider contracts a week.

    productivity

  51. practice · Simon Willison ·

    Locating the source of a mysterious beep with Claude

    Claude Code built a multi-device sound triangulation system to locate an intermittent beep in a cluttered room.

    Our house has a box room, full of boxes that we still haven't unpacked from our last move. A couple of weeks ago something in that room started intermittently beeping . The beeps were far enough apart that standing in the room and trying to determine the source of the noise was frustrating, and I really didn't want to dig through every one of those boxes. So I had Claude Code build Beep Locator , a software system for triangulating the source of a mysterious beep using multiple devices scattered around the room. Here's what Beep Locator looks like after it has been running for a while: You run

    ways of working · Simon Willison

  52. practice · One Useful Thing ·

    Fable 5.2 and Jagged AGI

    Claude Fable 5.2 reaches near-expert performance on most computer-based intellectual tasks, with remaining gaps in specific task areas rather than basic errors.

    Before getting started, I wanted to thank my readers for making my new book, Co-Existence, a New York Times bestseller two weeks in a row. If you haven’t read it, you can get a copy here . I have had the chance to use the new Claude Fable 5.2 quite a bit before its public launch 1 , and it is very impressive, following on the already excellent Opus 5.5. AI has gotten so good, in fact, that it is worth asking if Anthropic’s newest models (and the inevitable competing models OpenAI and Google will soon release) cross the boundary into being an Artificial General Intelligence? AGI is a much-debat

    judgment · Ethan Mollick

  53. practice · Lenny's Newsletter ·

    🎙️ How I AI: How this founder built a better Duolingo with Codex

    Founder used Codex to build native iOS and Android apps without knowing Swift or Kotlin, letting agents write language-specific code.

    How this founder built a better Duolingo with Codex | William Imoh Listen now on YouTube • Spotify • Apple Podcasts Brought to you by: WorkOS —Make your app enterprise-ready, with SSO, SCIM, RBAC, and more Vanta —Automate compliance and simplify security William Imoh is the founder of Hackmamba and the creator of Mural, an AI language tutor he built after a 1,000-day Duolingo streak still left him unable to hold a conversation in Norwegian. In this episode, he shows how he used Codex and GPT-Live to build native iOS and Android apps despite having no Swift or Kotlin experience, and explains ho

    ways of working · Lenny Rachitsky

  54. research · Exponential View ·

    📈 AI-exposed workers wait a month longer for a job

    Workers laid off from AI-exposed roles in 2025 took roughly one month longer to find new jobs than other workers.

    In the AI Investment Brief today: The funding quality is still a concern even as hyperscalers move into long‑dated, investment‑grade debt. Hi, Here’s the latest roundup of data signals across AI, energy & markets from Exponential View. Subscribe now Anthropic’s place in the queue. Anthropic paid $3.4 billion to take over a supplier’s two-year-old order for 1.7GW of gas generators – the largest known power-equipment purchase by an AI lab. VC in 2026 is about two giants . Take a16z out, and US fundraising looks much like 2025. Without SpaceX, this year’s exits are close to last year’s. Memory ho

    jobs skills · Azeem Azhar

  55. practice · How I AI ·

    How this founder built a better Duolingo with Codex | William Imoh

    Solo founder uses AI agents assigned Lord of the Rings roles to run a team of 25, with specific costs and latency thresholds for voice tutoring.

    William Imoh is the founder of Hackmamba, a developer marketing company, and the creator of Mural, a real-time voice app he built to learn Norwegian after moving from Dubai to Norway. He has a chemical engineering degree, taught himself to code, and spent four years as a product manager, but he had never written a line of Swift. In this episode, William shows how he used Codex and GPT-Live to build Mural natively for iOS and Android, then walks through the Lord of the Rings–themed Grok Bot “fellowship” that helps him run a team of about 25 as a solo founder. What you’ll learn: The design promp

    management org · Claire Vo

  56. practice · Simon Willison ·

    Hide your slop PR descriptions behind

    Use HTML details tags to hide verbose AI-generated PR descriptions behind expandable summaries for readability.

    Most of the changes I make to my projects these days come in the form of PRs opened for me by Claude Code or Codex. The PR is my unit of work - I use them to bundle commits together, iterating on them until a feature is complete, document decisions and then merge the finished result. Today's coding agents are great at writing PR descriptions. They're too good at describing the work The problem is that they are too good. An agent-written PR description is accurate and comprehensive. It describes the problem, the detailed solution, and the steps taken to verify it. That's a lot of information to

    ways of working · Simon Willison

  57. research · New Economics Papers: AI ·

    How is AI Affecting College Major and Course Choices? Evidence from Finland

    After ChatGPT launch, Finnish university applications to AI-exposed fields dropped, especially computer science; non-ICT students avoided programming but took more AI/ML courses.

    Have concerns about the potential job displacement effects of artificial intelligence affected the education choices of students? We analyze administrative data on the university applications and course choices of Finnish students. We find, after the launch of ChatGPT 3.5 in November 2022, a persistent drop in applications to fields of study classified as more exposed to AI under several different measures. The drop is particularly large in computer science and other ICT fields. Examining the elective course choices of non-ICT students, we find declining enrollment in programming and algorithm

    jobs skills

  58. research · New Economics Papers: AI ·

    How Well Do LLMs Perform in Peer Review? Evidence from Finance and Accounting

    LLMs can assess technical correctness in academic papers, predicting publication 44% better when scoring high, but cannot judge significance.

    Referees increasingly use large language models (LLMs), while finance and accounting journals disagree about whether to allow it. We ask which part of a referee's job the models can do. GPT-4o, whose training data end before the 2024 conference season, referees the papers presented at the 2024 AFA and NBER finance meetings, and we compare its verdicts with publication in the top-three finance journals over the next two years. Papers the model scores one standard deviation higher are 44\% more likely to be published, net of author reputation. The result is not driven by look-ahead bias, as the

    judgment

  59. research · New Economics Papers: AI ·

    Artificial Intelligence and Support for Labor Market Policies: Evidence from a Survey Experiment

    Workers with AI experience support fewer safety-net policies when told AI substitutes labor, possibly fearing tax increases.

    We study whether alternative narratives about Artificial Intelligence (AI) shape workers' support for strengthening labor market policies and whether these responses differ by workplace AI use. We conduct a four-arm survey experiment on a representative sample of 2, 105 Italian employees. Respondents are randomly assigned to a control group or to one of three information treatments framing AI as a technology that may substitute for human labor, complement workers' tasks, or increase the need for reskilling. We then elicit support for five labor market policy instruments, including both passive

    policy

  60. research · New Economics Papers: AI ·

    Learning about Markets from Models: Evidence from an AI Hiring Platform

    AI hiring models optimized for one firm predict retention poorly at others, revealing how firms differ in valuing worker traits.

    Machine learning models are increasingly used to not only inform, but make decisions. Sometimes platforms add value by pooling data across contexts to improve models' decision making---but when the optimal decision differs by context, pooling may not increase accuracy. We argue that a platform storing starkly distinct models across contexts nevertheless captures a model comparison externality. Together, these models reflect how decision makers respond differently to the same data in the current equilibrium. Policymakers can use this differentiation to prioritize interventions; firms can learn

    adoption · Rembrand Koning

  61. research · New Economics Papers: AI ·

    Displacement Is Endogenous: AI Workers in a Search-and-Matching Labor Market

    Agent-based model simulates AI as labour-market participants: at 70% human wages, AI entry raises unemployment 4.1 percentage points; displacement mechanism switches from layoffs to reduced hiring as AI-human wage gap narrows.

    We build a labor market in which AI systems enter as workers: they apply for jobs, pass screenings, get hired, and get dismissed, alongside humans. Firms post vacancies, workers search with friction, and product demand slopes downward. Across 30 seeded runs per configuration, AI entry at 70% of the human wage raises unemployment by 4.1 percentage points (95% CI 3.5 to 4.6) and leaves 12.2 fewer humans employed (CI 10.5 to 13.9). Layoffs dominate when AI is much cheaper than humans: the layoff margin accounts for 7.2 of the lost jobs and reduced hiring for 5.0, though most dismissed workers fin

    jobs skills

  62. research · New Economics Papers: AI ·

    Who Pays for AI?

    UK banking data shows AI subscription adoption doubled yearly, reaching 5% of adults by mid-2026, with sharp shifts from ChatGPT to Claude among higher-earning technical workers.

    We document who pays for AI tools using a panel of millions of open banking and cardholder accounts from 2022 to mid-2026, covering billions of transactions. We find that subscriptions to products like Claude and ChatGPT have roughly doubled every 12 months since their introduction, reaching one in twenty UK adults by mid-2026. Adoption is five times higher for under 30s than over 60s, 27 percent higher for men, and grows 1.8 times larger from the bottom to the top quintile of earnings. While ChatGPT held 74 percent of direct subscription spending in late 2025, its share fell 21 percentage poi

    adoption

  63. research · New Economics Papers: AI ·

    Regulating AI Displacement: Public Demand, Institutional Credibility, and the Politics of Employment Protection in Latin America

    Survey experiment in four Latin American countries shows 75% prefer employment-protection regulation over redistribution or non-intervention for AI job displacement.

    How citizens want artificial intelligence (AI) regulated will shape which AI governance instruments are politically feasible. Yet we know little about public preferences over AI policy in middle-income democracies, where state capacity is contested. This paper provides the first multi-country experimental evidence on preferences over AI labordisplacement policy instruments in middle-income democracies. Using a randomized framing experiment in a sur-vey of Argentina, Brazil, Colombia, and Mexico, we examine how citizens map beliefs about AI-driven job disruption into demand for three governance

    policy

  64. research · New Economics Papers: AI ·

    More Knowledge, Less Difference: Generative AI and the Distinctiveness of Subsidiary Knowledge

    Generative AI may increase subsidiary knowledge flows to headquarters while reducing their distinctiveness by homogenizing outputs across subsidiaries.

    Multinational enterprises (MNEs) are increasingly providing the same generative AI tools to employees across their subsidiaries. Research on AI in international business has emphasized how AI transforms the way MNEs learn and decide, while research on AI and homogenization has shown that AI-assisted outputs tend to become more alike. Neither has examined how individual employees’ use of AI in subsidiaries affects the knowledge that reaches headquarters. I argue that generative AI creates a paradox for MNEs: by lowering writing and language barriers, it increases the amount of knowledge subsi

    management org

  65. research · New Economics Papers: AI ·

    When Everyone Writes Well: The Economics of Writing with AI

    AI-assisted writing raises output quality but may reduce author capability depending on which tasks are delegated to the model.

    Writing produces two things: the manuscript published now and the capability its author will hold next year. Artificial intelligence can raise the first while lowering the second, and which happens depends on the task the author delegates. The relevant comparison is between workflows rather than between using and refusing AI. This article separates writing into its tasks and applies a standard tool of economics to each, synthesising existing models into five predictions. Cheaper drafting lets an author test more versions of an argument, and the largest gains should go to researchers writing in

    adoption

  66. research · CEPR ·

    DP22161 Age, Education, and Occupational Gradients in Artificial Intelligence Anxiety

    AI anxiety increases linearly with age and nonlinearly with education; occupational skill explains education but not age differences.

    Higher levels of anxiety about artificial intelligence (AI) among older and less-educated adults have now been documented in large population-based samples from high-income countries. Much less is known about how these differences arise, whether age and education interact, and whether occupational position helps understand them, particularly in middle-income economies. It evaluates the measurement structure of the scale, tests flexible functional forms and age–education interactions, and decomposes both gradients by occupational skill level, task class, and routine-task intensity. AI anxiety i

    worker experience

  67. practice · Simon Willison ·

    parse_number() as a SQLite extension: C vs Rust

    Claude helped iteratively optimize a SQLite parser from 67ns to 19ns per row by suggesting algorithm improvements like Clinger's fast path.

    Research: parse_number() as a SQLite extension: C vs Rust I was out walking the dog when I got curious about how easy/difficult it would be to write a SQLite C extension that adds a parse_number() function for turning strings like -$1,234.56 or '12.5%' into numeric values that could be summed and sorted. I fired up regular Claude chat (Opus 5.5) and prompted : I'm thinking about a SQLite custom function 'parse_number(value)' that strips ',', '$', '£' and '%', handles a leading '-', and returns 'NULL' for anything it can’t parse Explore the difference between building this as a SQLite extension

    ways of working · Simon Willison

  68. practice · Latent Space ·

    How Stanford Teaches AI-Native Engineering — Mihail Eric, Monaco

    Stanford's modern software engineering course shifted from AI-tool exercises to open-source contributions as students already use coding agents daily.

    The AI Engineer YouTube channel just crossed one million subscribers . Thank you to everyone who’s watched a talk, sent one to a teammate, or put something they learned into production. For this special, we wanted to sit down with someone who has to answer a question a lot of us are asking at work: what should a software engineer actually learn now? Mihail Eric has two places to test his answer. He teaches The Modern Software Developer at Stanford and leads AI at Monaco, where his colleagues use coding agents to ship software and investigate outages. I asked him to take us through the syllabus

    jobs skills

  69. practice · Latent Space ·

    [One Million AI Engineer Special] How Stanford Teaches AI-Native Engineering — Mihail Eric, Monaco

    Stanford CS146S redesigned assignments around real open-source repos and maintainer review, forcing students to explain AI-generated patches to actual decision-makers.

    What do you assign when a coding agent can finish last year’s homework in one prompt? In the second run of Stanford’s CS146S, Mihail Eric brought open-source maintainers into the course. Students have to learn an unfamiliar repo, propose a change, and explain the patch to the person who might merge it. We invited Mihail, who teaches The Modern Software Developer at Stanford and leads AI at Monaco, to celebrate one million subscribers on the AI Engineer YouTube channel. He opens up the course syllabus and shows us which lessons survived contact with his own engineering team. Monaco built its ag

    jobs skills

  70. practice · Lenny's Newsletter ·

    Why PMs are suddenly valuable again | Tulsee Doshi (Head of Product, Gemini)

    Head of Gemini product explains PM roles in frontier AI labs, including eval writing and balancing model development tradeoffs.

    Tulsee Doshi is head of product for Google’s frontier AI models, including Gemini and other multimodal models, such as Nano Banana, Genie, Veo, and Lyria. Listen on YouTube , Spotify , or Apple Podcasts We discuss: Why model development is not just engineering, but also like Snape’s potions class Google’s full-stack frontier AI strategy What PMs do inside a frontier AI lab Tulsee’s 60-20-20 framework for balancing what works now and what’s almost working How to write your first eval The rising value of great PMs Brought to you by: WorkOS —Make your app enterprise-ready, with SSO, SCIM, RBAC, a

    management org · Lenny Rachitsky

  71. research · VoxEU ·

    The concentration of AI spending

    Survey evidence shows AI spending concentrated in 2% of firms; spending per employee rising 40% year-on-year in US and UK.

    AI use is spreading rapidly, but much less is known about businesses spending on AI. This column uses new survey evidence to estimate total AI spending in 2026 at around $280 billion in the US and $25 billion in the UK. Spending per employee is expected to increase by more than 40% in both countries compared with 2025, driven by younger, more productive, and higher-paying firms. Yet expenditure remains highly concentrated: fewer than 2% of firms account for half of total expected AI spending in each country.

    adoption

  72. research · arXiv ·

    AI Exposure and the Changing Responsibilities in Job Postings

    Job postings show AI-exposed tasks declining slightly but increasingly paired with explicit AI skills; AI mentions jumped 66% but mostly outside task descriptions.

    The growing adoption of artificial intelligence (AI) in the workplace has raised questions about how employer demand for different work activities is changing. We examine how the prevalence and content of work activities in online job postings change in association with activity-level measures of AI exposure, derived from Copilot and Claude usage. To enable systematic comparisons, we develop a pipeline that extracts the responsibilities from job advertisements and maps them onto O*NET's standardized taxonomy of Intermediate Work Activities (IWAs). We then apply this approach to 50,000 job adve

    jobs skills · Siddharth Suri · Scott Counts

  73. practice · Nate B Jones ·

    In my interview, OpenAI's CTO of Applications Vijaye Raji said more code gets thrown away now that coding is cheap. How to decide what your team keeps and scraps.

    When coding agents accelerated individual output, OpenAI's bottlenecks shifted to infrastructure and review; they rebuilt systems and automated checks to unblock teams.

    OpenAI’s coding agents increased the amount of work moving through its development systems. Engineers could pursue more changes at once, and agents repeatedly retrieved code, ran tests, and submitted their work. The infrastructure that supported those activities struggled to keep up. OpenAI built Pando to address the repository part of that problem. The company published its engineering explanation on November 2. I had just sat down with Vijaye Raji, OpenAI’s CTO of Applications, to discuss how agents were changing work inside the company. He joined OpenAI through its acquisition of Statsig, t

    productivity

  74. practice · Zapier ·

    What we learned by watching Claude read Zapier.com

    Running A/B tests on agent page comprehension by comparing Claude's output on production vs preview URLs reveals hidden processing layers.

    TL;DR SEO feedback loops take weeks. We wanted something faster for agents, so we built a tool that runs the same Claude Code task against production and a preview variant of a page, with the URL held constant. The first real test surfaced three things we didn't expect: our Markdown mirrors are already in the agent's request path, WebFetch hands the page to a separate model before the calling model ever sees it, and that model has its own instructions shaping what survives. The problem One of th

    ways of working

  75. practice · Zapier ·

    How much should an AI decide without asking you first?

    AI systems must balance asking permission versus acting autonomously; both extremes fail because users ignore prompts or lose trust after surprises.

    Any AI product that does things, not just says things, runs into the same decision problem sooner or later. The AI assistant can ask before acting, or act and tell you afterward. Both easy answers are wrong. If it asks every time, you stop reading the questions and click yes on reflex, so the questions end up protecting nobody. If it never asks, everything is fine until the first time it does something you didn't expect, and that single surprise is enough to end your trust in it. We've been work

    judgment

  76. research · Management Science ·

    Generative Artificial Intelligence and Sales Productivity: Field Experiments in Online Retail

    Randomized field experiments show GenAI in retail workflows increased sales 0-16.3%, with gains concentrated among inexperienced consumers.

    We quantify the short-term impact of generative artificial intelligence (GenAI) on sales performance through a series of large-scale randomized field experiments involving millions of users and products at a leading crossborder online retail platform. Over 2023–2024, the platform integrated GenAI into seven business workflows spanning customer service, consumer-product matching, advertising, and seller services. We find that GenAI adoption increases sales in most workflows, with effects ranging from no detectable impact to 16.3% depending on GenAI’s marginal contribution relative to baseline f

    productivity

  77. practice · Linear ·

    Introducing Mobile Diffs

    Engineering team reviews code on mobile by breaking PRs into sections, sending feedback to agents, and syncing state across devices.

    We built Linear Diffs because code review was becoming a bottleneck for our own team. What started as an internal tool has become the default way we review code. Guided Reviews make it easier to see what changed and why, and from the same place you can reply to a thread, leave a comment, or send a fix back to an agent. The review sits next to the issue, feedback, or bug report that started the work, so the reasoning behind the request stays connected. Running the whole loop from a phone Alessandro Oddone, who leads our Android team, does a lot of his thinking away from a desk. An idea that com

    teams

  78. practice · Understanding AI (Timothy B. Lee) ·

    This robotics concept helps explain the jaggedness of frontier capabilities

    Sim-to-real gap from robotics explains why AI's real-world work impact lags behind capability breakthroughs.

    The last year has seen incredible progress in model capabilities in certain domains — most notably programming , mathematics , and cybersecurity . Yet the real-world impact of these breakthroughs has been surprisingly modest — especially outside of those professions. Lawyers, architects, salespeople, college professors, and others are certainly using AI models in their work, but AI models don’t seem close to transforming those professions the way they seem to be transforming mathematics and computer programming. And even in the software industry, we’re not seeing the kind of mass unemployment

    judgment · Timothy B. Lee

  79. research · ACM Transactions on Software Engineering and Methodology ·

    "Like Taking the Path of Least Resistance": Exploring the Impact of LLM Interaction on the Creative Process of Programming

    Programmers using LLMs had shorter idea-generation periods and fewer creative moments, generating more similar solutions despite comparable idea counts.

    As AI takes on more of the generative work that once required human imagination, despite documented limitations in creative ability, a critical question emerges: How does GenAI affect users’ creativity? Through a within-subject study followed by retrospective interviews with (N=20) programmers, we investigated the impact of LLMs on participants’ process of creative thinking in programming and the creativity of generated solutions. Across two conditions (LLM-assisted vs. unassisted), participants using LLMs had significantly shorter idea-generation periods ( \(p=1.6\times 10^{-5}\) ) and fewer

    adoption

  80. practice · The Pragmatic Engineer ·

    How software engineering is changing: a tale of two eras

    Software engineer measures his own productivity metrics before and after adopting AI coding tools over nine years.

    Before we start: I’m in San Francisco this week and there are a few remaining spots for these live events (registration required): Wednesday (4 Nov): The Pragmatic Engineer Unplugged at the iconic SFJAZZ Center. With Diogo Almeida (creator of Jev & co-inventor of ChatGPT), and Bryan Cantrill (cofounder and CTO of Oxide). Thursday (5 Nov): System Update at The Howard SF. With Karri Saarinen (Linear), Kath Korevec (OpenAI), David Cramer (Sentry) and Adam Rogal (DoorDash) Also, this week there will be no issue of The Pulse on Thursday. Regular scheduling returns next week! In September, when The

    productivity · Gergely Orosz

  81. practice · Simon Willison ·

    Qwen 3.8 27B on my laptop can interpret model weights, too

    A smaller model running locally can interpret and modify neural network weights, extending a frontier model capability to accessible hardware.

    Yesterday's hot paper was Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights by Rikiya Takehi, Jayden Teoh, Alex Zhang, and Omar Khattab. The paper (OK, the authors classify is as a "blog post", but it's paper-shaped) found that frontier models, in particular GPT-6 Astra, can both interpret and modify the raw weights of a machine learning model - literally a text description of the model containing a bunch of floating point numbers. I've been playing with one of the examples from the paper and I'm delighted to share that Qwen 3.8 27B running on my laptop

    ways of working · Simon Willison

  82. research · Research Policy ·

    Synergistic gains between high skilled labor and workplace automation: The case of corporate innovation

    High-skilled workers and workplace automation show complementary productivity effects in corporate innovation settings.

    productivity

  83. practice · Latent Space ·

    Building Legal Agents When You Can't See the Data - Jacob Lauritzen, CTO of Legora

    Legal agents built without access to client data use synthetic test environments modeled on real work to validate accuracy and coordination.

    Legora can’t read a single trace of what its agent does for a lawyer. The data belongs to the law firm’s clients. How do you build and test an agent when you can’t see its work? Jacob Lauritzen is the CTO of Legora, one of the fastest-growing companies in legal tech history. The team started in a Stockholm basement with ChatGPT, Swedish law, and a search tool. Today, a lawyer can use Legora to draft and edit Word documents, review 10,000 contracts in a single table, or run due diligence. The agent also coordinates work between lawyers, clients, and other agents. When Legora made its own acquis

    ways of working

  84. practice · Simon Willison ·

    The U.S. Census Bureau and “Super Intelligence”

    Using public Census Bureau survey data to track corporate AI adoption trends over time, showing methodology and data changes.

    I was reminded today of AI Adoption Rate Trending Down for Large Companies , a chart produced by Apollo Global Management in September 2025, which appeared to show a slowdown in U.S. corporate AI adoption based on numbers collected by the U.S. Census Bureau. At the time I used that chart to demonstrate GPT-5 data analysis , and then to experiment with Claude's new Code Interpreter . I decided to try running those numbers again to see what had changed over the past year, and in doing so learned that the Bureau has fallen foul of Executive Order 14434 , aka the asinine Super Intelligence one. Fi

    adoption · Simon Willison

  85. research · arXiv ·

    LLMs and the Organization of Scientific Work

    After ChatGPT's release, new scientific teams became more specialized with narrower task portfolios, while established teams showed organizational inertia and resisted reorganization.

    The advent of large language models (LLMs) represents a technological revolution for science. Their diffusion may reshape not only how scientists conduct research, but also how they organize their work within teams. Here, we develop a conceptual framework in which LLMs expand individual capabilities across a range of research activities, reducing reliance on complementary human inputs within tasks and facilitating a more specialized division of labor among team members. We further propose that teams' history of collaboration may constrain their ability to reorganize in response to the new tech

    management org

  86. research · MIT Sloan Management Review ·

    The AI Governance Paradox

    High-reliability organizing principles from nuclear plants and space agencies apply to AI governance: protect front-line judgment and distribute decision authority.

    Getty Images Operations that run under extreme risk — such as nuclear power plants, aircraft carriers, and air traffic control centers — have long understood that safety depends not just on good technology but on how people exercise judgment under uncertainty. The scholarly field of high-reliability organizing (HRO) has identified a clear normative framework to distinguish organizations that manage catastrophic risk well from those that succumb to it: Reliable organizations protect front-line judgment , distribute decision authority to those closest to the problem, and treat emerging anomalies

    judgment

  87. practice · How I AI ·

    How Figma’s PMs actually use AI every day | Ezra Mechaber (PM, Figma)

    Product team built a shared repo of 31 Claude skills that 60–70 PMs use daily, including an automated growth agent that ran experiments with one human checkpoint.

    Ezra Mechaber is a growth product manager at Figma whose goal is to be “lazy in the right places.” When he joined Figma, he found almost no one outside engineering using AI to get real work done, so he and a couple of fellow PMs turned his personal Claude Code setup into PM OS, a shared repo of 31 skills that every PM at Figma now uses. In this episode, Ezra walks me through his favorite skills, how he bug bashes with Codex, AutoXP—an automated growth PM that found a huge win on its very first experiment—and a real-time writing assistant he built with Jev. What you’ll learn: Why PM OS is a rep

    ways of working · Claire Vo

  88. practice · Laurie Voss ·

    A proposal: how to hire junior engineers in the age of AI

    Proposal for hiring junior engineers based on code review and refactoring skills rather than from-scratch coding ability.

    About six weeks ago I wrote We are all Product Engineers now , an exploration of what LLM-written code is doing to the job of software development. A few weeks after that I turned it into an AI Engineer New York talk , which at a quarter-million views is now by far the most-watched talk I’ve ever given. The talk and the post both end with an exhortation: we have to figure out how to hire new engineers to do the vastly-changed job of software development now that “programming” isn’t part of that job description. This is a monumental shift and there is an entire cohort of people who got into col

    jobs skills · Laurie Voss

  89. research · New Economics Papers: AI ·

    AI at Work: Use, Complementary Technologies, and Task Reallocation

    Survey of 2025 Spanish workers finds 16% use AI; adoption correlates more with complementary tech use than worker traits; users report productivity gains in cognitive tasks.

    We provide evidence from a 2025 survey of individuals in Spain on workplace use of artificial intelligence (AI) and other modern digital technologies. AI use is already economically meaningful but far from pervasive, with about 16% of workers reporting AI use. Its adoption is highly uneven across workers and jobs, with strong gradients by education, age, earnings, and firm size and scope, as well as substantial within-occupation heterogeneity. AI use is strongly correlated with the use of other modern technologies, which accounts for a larger share of variation than any worker or job character

    adoption

  90. research · New Economics Papers: AI ·

    AI and the Boundary of the Firm: Evidence from Radiology

    AI enables radiology outsourcing by improving remote quality verification, shifting work from small to large markets without task replacement.

    Artificial intelligence (AI) may transform labor markets not only by changing workers' tasks but also by reorganizing production. We study radiology, where AI has spread rapidly without increasing interpretations per radiologist. In our model, AI facilitates outsourcing by letting hospitals verify the quality of remotely supplied interpretations. Using US Medicare data for 2013-2024, we document declining local radiology activity in smaller markets despite stable imaging demand. Interpretations shift toward larger markets, and radiologists at documented AI-adopting platforms end up serving mor

    management org

  91. research · New Economics Papers: AI ·

    AI Adoption by Firms: Insights from the Literature and the German Innovation Survey

    Literature review and German firm survey data on AI adoption patterns, productivity effects, and differences between general AI and generative AI.

    This paper provides an overview of evidence on firms’ adoption of Artificial Intelligence (AI). We revisit the main conceptual drivers of AI uptake discussed in the literature and summarize global trends in AI diffusion. We then examine the firm characteristics associated with adoption—including the distinction between in-house development and external acquisition—and highlight how patterns differ between general AI and generative AI technologies (GenAI). Next, we review the emerging literature on the productivity effects of AI, distinguishing non-experimental firm-level studies from rec

    adoption

  92. research · New Economics Papers: AI ·

    Headwind or tailwind? How banks interpret borrowers’ AI exposure

    Banks lowered default risk for AI-exposed firms after ChatGPT, but downgraded market leaders relative to competitors, predicting later bad-credit events.

    General-purpose technologies create large opportunities but make their distribution across firms difficult to assess in real time. We use banks as interpreters of the rise of generative AI by studying lender-specific probability-of-default (PD) estimates for private firms in four large euro-area economies. As public attention to AI rises after ChatGPT, banks lower assessed default risk for borrowers in highly AI-exposed industries by about 5%. The reassessment is weaker for labor-intensive firms and stronger among lenders with pre-existing industry expertise. Yet the favorable industry-level e

    adoption

  93. research · NBER ·

    TaskNet: Building Occupational Task Inventories from Worker Interviews at Scale

    New method uses worker interviews at scale to build detailed task inventories that capture how jobs change as AI tools appear in practice.

    Understanding how AI is reshaping work requires an accurate account of the tasks workers perform. Workers are often the first to see how their jobs are changing, as new responsibilities and tools often appear in everyday work before these changes reach formal descriptions. Interviews with workers (Jennifer Wang , Andreas Haupt , Isaac Robinson , Phil Lewis , Erik Brynjolfsson , Diyi Yang)

    jobs skills · Erik Brynjolfsson · Diyi Yang

  94. research · NBER ·

    AI as Shared Business Infrastructure: Firm Growth and the Distribution of Gains

    Generative AI embedded in e-commerce platform software increased firm growth unevenly; gains concentrated among larger, more sophisticated sellers.

    Generative AI improves performance on individual tasks, but whether those gains translate into firm growth, and for which firms, remains an open question. We study a leading Chinese e-commerce platform that in 2024 embedded a generative AI system in the operating software firms use to run their (Panle Jia Barwick , Lu Fang , Jinhan Liu , Huilan Xu , Zhe Yuan)

    productivity

  95. practice · Latent Space ·

    Agents Prompt People: Using Agents for Long-Horizon Financial Work

    Wealth management firm uses agents to guide human advisors through multi-day workflows with persistent memory tracking decisions and handoffs across actors.

    At AI Engineer New York this month, we sat down with Aman Singh , the lead AI Engineer at Arca , an “AI-native” company providing wealth management services. We discovered that while agents do most of the background work in the firm, there are guardrails in place to ensure that human advisors are making the final decisions. The goal is for AI to guide the process; or as Singh nicely put it, “agents prompt people more than people prompt agents.” Arca recently raised $48.5 Million in a round led by General Catalyst, with participation from Index Ventures and Venrock. One of the features of using

    ways of working

  96. research · arXiv ·

    Do Social Influence Pressures Move LLM Agents? Evidence from Delegated Audit Judgment

    LLM agents in audit tasks yield to social pressure from supervisors and peers but not clients, unlike humans, and resist career incentives.

    Large language model (LLM) agents are rapidly being integrated into complex professional workflows such as auditing and entrusted with judgments under human review. Human auditors are known to yield to social influence pressures from superiors, peers and clients, and this paper asks whether LLM agents yield to the same pressures and, if so, how they respond. In an experiment on twelve model settings, an LLM agent acting as a senior associate in audit analytical review forms an estimate and is then challenged without new evidence by colleagues inside the firm, by a reviewer from another firm an

    judgment

  97. research · arXiv ·

    AutoAnalysis: An automated, self-updating meta-analysis of human-AI collaboration

    Meta-analysis of 1,955 effect sizes across 420 studies finds human-AI combinations outperform humans alone but underperform the better performer alone.

    As generative artificial intelligence (AI) becomes more capable and widely used, understanding when and how humans should work with these systems is becoming increasingly important. However, the empirical evidence in this space offers conflicting recommendations, which leaves individuals and organizations without clear guidance on when to combine human and AI capabilities. Existing meta-analyses can help reconcile these findings, but they require substantial manual effort and cannot readily incorporate new evidence as it emerges. To address this challenge, we introduce AutoAnalysis: an automat

    judgment · Thomas Malone · Michelle Vaccaro · Abdullah Almaatouq

  98. research · arXiv ·

    AI evaluators favor job applications written by certain AI models, independent of candidate quality

    AI evaluators systematically favor job applications written by certain LLM models, filtering out qualified candidates based on model mismatch alone.

    Job applicants increasingly use large language models (LLMs) to write cover letters, while employers deploy LLMs to screen them. In this all-AI setting, we ask whether the \emph{choice of model} affects hiring outcomes independently of candidate qualifications. We introduce a multi-model auditing framework pairing eleven LLM writer agents with nine API-hosted evaluator agents across ten job descriptions and fifty candidates per job. Four findings emerge. First, we identify a generative preference hierarchy: a consistent global ranking of writer models by evaluator acceptance, in which locally

    adoption

  99. practice · Kent Beck ·

    Trust Is the Binding Constraint

    AI accelerates code production faster than teams can build the collaborative trust practices that make it safe.

    Teams accumulate code faster than they accumulate trust. That gap — code without trust — is where projects fail. I have been circling this idea for two years in this newsletter. Trust accumulates slowly and evaporates in an instant. Most trust-building work is invisible. AI has poured accelerant on the visible parts. Code arrives faster than ever, while the practices that manufacture trust — collaboration, testing, review, shared understanding — quietly get sacrificed to solo speed. So I am teaching a live class about it. The Human Practices Behind Trustworthy Software runs on ByteByteGo Live,

    judgment · Kent Beck

  100. practice · Will Larson ·

    Self-reinforcing quality / adopting verification pattern

    Engineering team implemented AI verification loop requiring PR verification reports, catching CI failures locally before submission.

    After implementing the small-change pattern, Imprint Engineering’s next focus in improving our development loop has been implementing a verification loop for our software development. This is an increasingly common pattern, particularly popularized by poteto’s pstack , but you’ll find similar ideas emerging in other places as well, e.g. Niko Matsakis’ post on the correctness ratchet , among others. This captures some of the confusion I’ve seen in our initial rollout, and the particulars of how we are implementing the approach. What verification pattern is, and what it isn’t The verification pa

    teams