The Feed · Complete archive
AI at work: research and practice
A server-rendered record of the evidence, ideas and firsthand practices screened by The Feed. Every entry links to its original source.
Use the interactive FeedPage 2 of 12 · 1143 items
research · JAMA Network Open ·
AI-Generated Draft Response Tool, Message Turnaround Time, and After-Hours Replies Among Health Care Professionals
AI draft-response tool adoption at a large medical center increased message turnaround time by 8.6% and after-hours replies by 26%.
Importance: Patient portal message volumes have increased, creating substantial administrative burden for clinicians and contributing to after-hours electronic health record work. The Epic In Basket Augmented Response Technology tool generates artificial intelligence-drafted replies to patient messages and has been widely deployed to reduce this burden, yet assessment of efficiency remains limited. Objective: To examine the associations of response tool adoption, use, and habituation with message turnaround time and after-hours response. Design, Setting, and Participants: This retrospective co
adoption
practice · Simon Willison ·
Building a multiplayer game world with autonomous Fable-class models
Game studio runs autonomous AI agents that ship code to production hourly, resolve bugs within 60 minutes, and spend $3M monthly on token costs.
How I Built the Most AI-Pilled Company in the World Don't be put off by the clickbait headline, this piece by Jacob Sansbury describing how they are building Spawn is a fascinating exploration of the bleeding edge of what's possible with agentic engineering against frontier models. Spawn is a massively multiplayer gaming environment where players can use prompts (to the in-game agent, Savi) to modify the game world. I fired it up on my phone for a few minutes and was able to prompt a castle into existence, then a dragon, then ride the dragon to fly around that castle. By Jacob's telling, Spawn
ways of working · Simon Willison
practice · martinfowler.com ·
Bliki: LLM Voice
Detecting LLM-written prose by feel is unreliable; distinguishing genuine voice from algorithmic output matters more than detection tools.
Sometimes when I read a post, I get the growing feeling that I'm reading the output of an LLM. I can't necessarily define why, although there are the common tells (it's not the em-dashes, it's the load-bearing tapestries). As I do this my desire to read on atrophies, sometimes to the point of revulsion There are tools out there that claim to be able to tell the difference between LLM-written prose and the old-fashioned biological product. I'm wary of them, partly due skeptism about their accuracy, but also because it rather misses the point. The reaction to LLM-Voice is a human one, that sense
ways of working · Martin Fowler
practice · martinfowler.com ·
Why are good developers so wary of agentic development?
Experienced developers resist agentic coding because production reliability matters more than convenient building.
TL;DR Good developers’ caution about agentic development comes from knowing that built isn’t the same as working in production. I’ve been surprised by how many excellent developers have been hesitant to go all in on coding agents. These are people who usually try new ways of working before anyone else and in many cases invent new tools and practices that support building the application well. So why have we had so much reluctance? The easy (lazy?) answer is that they love writing code, or they’re worried about their jobs. I’m sure that’s true for some people, some of the time. And I know it is
judgment
research · Exponential View ·
🤖 Microsoft is making room for machines
Microsoft's voluntary exit offer to 27% of workforce coincides with record productivity gap between revenue and headcount growth since 2022.
This week Microsoft offered a voluntary exit to around 60,000 employees across the US, UK, Canada, and India – about 27% of its 223,000 workers. Even vice presidents are within reach. This isn’t a round of layoffs, though it may be the prelude to one. Is AI behind it? That’s the usual reading. It comes in two versions. The first is that capital spending is heading to $170 billion, up from $23 billion five years ago; Microsoft needs to cut staff to pay for data centers. The second is that the company has become AI-pilled, and agentic loops are running rings around headcount. There is a more mun
adoption · Azeem Azhar
research · HBS AI Institute ·
The Future is Flat
Analysis of 30 years of workforce data from 7,681 US firms shows AI exposure reduces organizational layers and expands team spans of control.
Three decades of workforce data shows how AI reduces organizational layers and broadens teams Listen to this article: Conversations about AI and the shape of companies typically happen in the future tense. Will organizations need fewer employees? How will departments be restructured? What will happen to managers? Questions like these sound new because modern AI tools are so novel that their effects remain uncertain. But the AI organizational story already has a prehistory: firms have been incorporating AI-related capabilities long before ChatGPT broke onto the scene. This important point doesn
management org
practice · Zapier ·
AI cost management: How we track and optimize AI spend at Zapier
Zapier built internal tracking to measure AI spend against business value, moving from open access to cost-aware usage.
Does $5,000 in AI spend equal $5,000 in value? If it does, that's a bad investment. A 1x return wouldn't get approved anywhere else in our budget, and AI doesn't get an exception. As the Chief Operating Officer at Zapier, the question I really care about is whether that investment returned more than it cost. But you can't calculate that without seeing the spend, so that's the part we fixed first. When we initially rolled out AI tools across the organization, everyone got open access, and we meas
productivity
research · Management Science ·
Contest or Contract: Assessing the Effectiveness of Contests in Online Labor Markets
Contract-based pay outperforms contests for design work because contest visibility encourages copying and reduces effort as competition intensifies.
Online labor markets have become increasingly popular among companies seeking global access to workers. Some platforms have adopted a contest-based scheme, allowing employers to review multiple submissions before selecting the best one. This practice raises a crucial question: Given a predefined budget, should employers choose a contest or contract scheme for tasks? This study examines the comparative effectiveness of contests versus contracts in achieving better job outcomes, focusing on design tasks characterized by high uncertainty. Using a comprehensive data set from a leading online labor
adoption
practice · Paul Ford (Aboard) ·
The Great Firmware Flowering
AI-assisted coding makes firmware development accessible to web developers without hardware expertise.
When vibe coding got good, one of the things that really stuck with me was how easy it was to make digital things on systems you didn’t fully understand. I’ve long been a web developer, but I’ve always been “hardware curious”—that is, I wanted to do lower-level coding that ran right on a chip, instead of running a web browser (which runs on top of an operating system, which runs on top of a BIOS, which runs on top of a chip). But that stuff is pretty hard, and every time I tried it, I ended up stumbling through a tutorial, making an LED blink, and calling it a day. You might ask, “Why would an
jobs skills · Paul Ford
practice · Simon Willison ·
The October inflection point for vibe game development
Claude Opus 5.5 can now design fun game loops and mechanics, not just generate code that runs.
I've written before about how November 2025 was an inflection point for coding agents - the point where Opus 4.5 and GPT-5.1 crossed a tipping point that meant their respective coding agents became reliable daily drivers for software engineers. I think we've reached a new inflection point in October 2026, and this time it's for vibe coding computer games . Tree Appreciator Emberwick Battle Drones Pumpkin Farmer, aka Quarter Sun Cove Four times as insulting What happens if someone actually puts the work in? You should build a game! Claude Opus 5.5 in particular exhibits meaningful improvements
ways of working · Simon Willison
research · arXiv ·
When AI performs, what remains? An integrative review of generative AI and cognitive capital in individuals and organizations
Framework distinguishing productivity gains from losses in human cognitive capital when AI enters knowledge work, with four mechanisms and design levers.
Generative artificial intelligence is rapidly entering knowledge work, and its short-term productivity benefits are increasingly documented. Less is known about what happens, over time, to the knowledge, skills and judgment that remain in people and organizations. This integrative narrative review addresses that question through the construct of cognitive capital: the accumulated, renewable and depletable stock of knowledge, cognitive and metacognitive capabilities, and practices that enables an individual or an organization to learn, interpret information, exercise judgment, solve problems an
judgment
practice · Simon Willison ·
Quoting Terk Terkowitz
Engineers should document and share where AI tools don't help their work as evidence of good judgment, not failure.
If your work does not benefit from current AI tooling, that is a finding, not a failing. Document why, share it with your community of peers, bring it to your manager, and work to find solutions. An engineer who can explain where AI does not yet help their work is demonstrating the judgement we are asking for. — Terk Terkowitz , An update from Amazon engineering leadership on the role of the developer in the age of AI Tags: amazon , generative-ai , agentic-engineering , ai , llms
judgment · Simon Willison
practice · The Pragmatic Engineer ·
AI SRE: what is it, how could it change on-call – and does it work?
AI SRE agents are moving from hype to limited production use, with real constraints on autonomy and human oversight.
Before we start: I’m in San Francisco this week and also next week. On Wed, 4 November, I’m hosting The Pragmatic Engineer Unplugged at the iconic SFJazz Club, featuring a rare conversation with Diogo Almeida (creator of Jev & co-inventor of ChatGPT), and Bryan Cantrill (cofounder and CTO of Oxide). It’s free to attend with registration, sign up here. Wednesday, 4 November in SFJazz: The Pragmatic Unplugged. RSVP here In May 2025 at Microsoft’s annual BUILD conference, the tech giant introduced “Azure SRE Agent” with an onstage demo in which an alert fired and the AI SRE Agent went to work on
management org · Gergely Orosz
practice · Latent Space ·
Coding From the Himalayas With an Offline AI Agent
Engineer uses local coding agents offline to maintain productivity during unreliable internet and power in remote location.
When we talk about working remotely , we take a lot of things for granted, especially reliable internet and power. But sometimes, working remotely means trying to get something done on a flight, during a long train ride, or somewhere with little or no network. I moved to the foothills of the Himalayas a year ago. I love the peace of living here, but it also comes with its own challenges, including network and power outages . Things I didn’t think about as much before are now part of planning my work. I work as a Principal Engineer at Thomson Reuters , where I spend most of my time coding and r
ways of working
practice · Nate B Jones ·
Your agent finished the job and came back with six more things you could do. The prompt that makes it hand over the result and stop.
Prompts that make AI agents return results and stop suggesting new tasks, preventing delegation from creating more work.
You asked an agent to watch for something, and now it keeps telling you nothing has happened. Another thread finished its assignment and came back with six more things you could do. Your Chief of Staff collected all of this into a beautifully organized list, which you now have to read. This is how you end up managing more work after supposedly delegating it. Every individual update seems reasonable. Together, they become a job. Here’s what’s inside: Close out the thread that keeps pinging you. One instruction gets the finished result, with no new side projects. Make decisions without reconstru
ways of working
research · Anthropic Research ·
How AI agents shape experts’ judgment calls
Professional analysts mostly adopted an AI agent's preferred statistical approach without naming it as rationale, suggesting subtle influence on judgment.
As AI does more of the hands-on work, the hope is that experts still make the judgment calls, meaning the decisions with more than one defensible answer. We tested this with 50 professional analysts who did a statistical analysis with Claude Code. On each key decision, we randomly assigned which of two defensible options the agent would favor. Analysts mostly went with the agent’s side, and few named the agent as a reason afterward.
judgment
research · Epoch AI ·
We tried to automate Epoch
Researchers evaluated AI on real workplace tasks at their organisation using human performance standards, finding current AI unable to fully automate most jobs.
This is a summary of a longer report on our website. AIs continue to saturate new benchmarks year after year. Yet even as the list of benchmarks where AI has surpassed humans keeps growing, the actual economic impact of AI seems to be growing more slowly. This “productivity paradox” reflects several facts about benchmarks: they are often calibrated to measure cutting-edge AI progress compared to past capabilities (rather than against human performance); they are often limited to tasks where performance can be easily graded; and AIs are sometimes trained to the benchmark, like a high school stu
adoption
practice · Simon Willison ·
webframe: evaluated as a scraper and a sandbox
Using Claude to evaluate and prototype a tool (webframe) by running it, building exploratory prototypes, and assessing it for scraping and sandboxing uses.
Research: webframe: evaluated as a scraper and a sandbox webframe is a neat little project from Jeff Lindsay which lets you "run a web page like a program" - you point it at a URL or file and it executes it in a hidden headless web view and outputs console.log() to standard output and any exceptions to standard error. It's written in Go on top of the glaze library, which provides access to a system browser ("WKWebView on macOS, WebKitGTK on Linux, WebView2 on Windows") so it doesn't need to bundle its own browser engine. It reminds me of my own shot-scraper javascript tool, albeit in a much sm
ways of working · Simon Willison
research · arXiv ·
Practice Makes Perfect: Tacit Knowledge, Generative AI, and Returns to Schooling and Experience
After ChatGPT release, returns to schooling fell 0.55 log points in AI-exposed occupations; returns to experience rose early-career but fell after 18 years.
Generative AI changes the scarcity of different forms of human capital. It makes codified knowledge cheaply available at the point of production, while judgment acquired through practice remains tied more closely to the worker. We ask what this does to two familiar prices in the wage structure: the return to schooling and the return to experience. In a short-run framework, machine-supplied codified knowledge substitutes directly for the codified component of worker human capital, lowering the schooling gradient. If codified and practice-based knowledge are complements, the return to experience
jobs skills
practice · Lenny's Newsletter ·
🎙️ How I AI: Claude Duet honest review + Why Reddit built its own AI prototyping tool
Reddit built an internal AI prototyping tool that lets designers create production-like prototypes without Git, using real data and AI-assisted annotations for engineering handoffs.
Why Reddit built its own AI prototyping tool | Blair Metcalf Listen now on YouTube • Spotify • Apple Podcasts Brought to you by: Firecrawl —Give your AI agents web data and beyond Blair Metcalf is the principal UX engineer at Reddit and the creator of Reddit Proto, an internal platform that helps designers and product managers build production-like prototypes without touching GitHub. In this episode, he shows how the system combines real Reddit data, reusable scaffolds, Cursor annotations, and a custom design system MCP to turn ideas into shareable prototypes. He also explains how Reddit’s tea
adoption · Lenny Rachitsky
practice · How I AI ·
Why Reddit built its own AI prototyping tool | Blair Metcalf
Reddit built Proto, an in-house AI tool that maps design system to code, achieving 100% adoption across product teams with 700+ live prototypes.
Blair Metcalf is the principal UX engineer at Reddit and the builder of Reddit Proto, the company’s in-house vibe-coding harness. With a design system MCP that maps Reddit’s product language to production code, Proto has reached 100% adoption across Reddit’s UX and product org, and more than 700 prototypes are live on it. What you’ll learn: Why Reddit built its own prototyping harness How designers share prototypes with leadership safely Why real Reddit data beats mock data How one annotation becomes a code edit in Cursor What a “feature capsule” is Why Blair built a “Rosetta stone” Blair’s su
adoption · Claire Vo
research · CEPR ·
DP22088 AI and the Boundary of the Firm: Evidence from Radiology
AI in radiology enables outsourcing by verifying remote work quality; interpretations shift to larger markets without reducing radiologist headcount.
Artificial intelligence (AI) may transform labor markets not only by changing workers' tasks but also by reorganizing production. We study radiology, where AI has spread rapidly without increasing interpretations per radiologist. In our model, AI facilitates outsourcing by letting hospitals verify the quality of remotely supplied interpretations. Using US Medicare data for 2013--2024, we document declining local radiology activity in smaller markets despite stable imaging demand. Interpretations shift toward larger markets, and radiologists at documented AI-adopting platforms end up serving mo
adoption
research · New Economics Papers: AI ·
Task Expansion with Generative AI: Experimental Evidence on Middle-Skilled, Early-Career Workers
Field experiment: AI access raised productivity 26–31 percentage points on tasks beyond apprentices' formal training, with no comprehension loss.
Does generative artificial intelligence (AI) expand the set of tasks that middle-skilled, early-career workers can successfully perform? In a field experiment with 673 final-year IT apprentices at twelve German vocational schools, we randomly assign access to AI for completing occupation-specific tasks. To identify task expansion, we study tasks both within the apprenticeship curriculum and deliberately beyond it. AI raises productivity substantially across all task types, with gains tending to be larger on tasks where performance without AI is lowest. Crucially, productivity increases by 26–3
jobs skills
research · Nature Human Behaviour ·
Generative AI and the temporary upskilling of knowledge workers
Knowledge workers using generative AI show temporary productivity gains that fade as skills adapt, suggesting upskilling effects are transient.
jobs skills · François Candelon
research · npj Digital Medicine ·
Systemwide adoption patterns of ambient AI scribe technology in an integrated academic health system
Ambient AI scribes showed highly variable adoption across clinical specialties (16-69%), with community roles reaching 80-90% use by month six.
Ambient artificial intelligence (AI) scribes may reduce documentation burden, but little is known about their adoption during enterprise-scale ambulatory rollout. We conducted a retrospective observational cohort study of 2901 ambulatory clinicians at an integrated academic health system using linked electronic health record and vendor usage data from December 2024 through May 2025. Clinician adoption was defined as any use during the study period, and monthly visit-level uptake as the proportion of eligible ambulatory visits in which the ambient AI scribe was used. Adoption and uptake varied
adoption
research · New Economics Papers: AI ·
Graduating Into Disruption: Labor Market Outcomes for AI-Exposed College Majors
College graduates in AI-exposed majors saw employment drop 5 percentage points and initial earnings fall 13% after ChatGPT launch in late 2022.
How are new college graduates affected by the rise of artificial intelligence, and what can this tell us about the mechanisms behind AI's overall labor market effects? We use administrative records on college graduates to observe how economic outcomes among college majors with differing levels of labor market AI exposure have evolved since large language models became available. We find that post-graduation employment, earnings, and job switching patterns among the most AI-exposed college majors began to diverge immediately following the introduction of ChatGPT in late 2022. In regression-adju
jobs skills
research · New Economics Papers: AI ·
AI Innovation and Labor Market Polarization: Evidence from European Regions
AI innovation reduces the relative wage-cost ratio between high- and low-skilled workers by 7% across European regions, through both wage and employment adjustments.
We study whether AI innovation changes labor-market polarization by weakening the relative position of high-skilled workers. We develop a CES production framework showing how AI affects the wage-cost ratio between high- and low skilled workers through wage and employment margins. We test the model's predictions using European regional labor-market data and find that AI reduces the relative wage-cost ratio by nearly 7 percent on average, with effects broadly split between wage and employment adjustments. These results are primarily driven by regions in countries highly specialized in AI technol
jobs skills
research · New Economics Papers: AI ·
AI Exposure and Adoption Among U.S. Firms
AI exposure measures predict 4-11 percentage-point higher adoption probability at firms, but explain only modest adoption variation.
Measures of exposure to artificial intelligence (AI) are widely used to study where AI is likely to affect firm and worker outcomes, yet limited evidence exists on how closely exposure relates to realized AI adoption at the firm level. We examine this relationship by linking 14 firm-level exposure measures, constructed from occupational exposure estimates in the literature and occupational employment shares from the Bureau of Labor Statistics Occupational Employment and Wage Statistics program, to direct measures of firm AI adoption from the Census Bureau’s Business Trends and Outlook Survey.
adoption
research · arXiv ·
The Effects of Generative AI on Collaboration and Social Networks Among Knowledge Workers
Generative AI increased collaboration time and broadened workers' networks while deepening reliance on trusted colleagues, based on 13 months of behavioural data from 12,000 knowledge workers.
The rapid diffusion of generative artificial intelligence has raised concerns that knowledge work may become less dependent on human-to-human interaction. Yet because AI-generated outputs require interpretation, verification, and social legitimation, generative AI may instead increase collaboration among workers. We test these competing predictions using passively collected behavioral data from more than 12,000 knowledge workers observed over 13 months during the staged organizational rollout of an AI-powered assistant (Microsoft Copilot). Using two complementary quasi-experimental designs --
teams
research · Information Systems Research ·
“Generate” the Future of Work through AI: Empirical Evidence from Online Labor Markets
LLM adoption caused demand contraction and increased competition in programming on freelance platforms; high-skilled workers shifted into programming, lowering barriers.
Large Language Model (LLM)-based generative AI systems are general-purpose tools capable of augmenting or even automating a wide range of job functions, positioning them to reshape labor market dynamics. However, predicting their precise impact a priori is challenging, given AI’s simultaneous effects on both demand and supply, as well as the strategic responses of market participants. Leveraging an extensive dataset from a leading online labor platform, we document a pronounced displacement effect and an overall contraction in submarkets where required skills closely align with core LLM functi
jobs skills
research · arXiv ·
The Capability Transfer: Cohort Reversal, Codified Expertise, and the Adaptability Tax of AI Transformation
AI automation of routine work delays expert development from five to nine years, creating shortages seniors cannot fill due to shortened planning horizons.
Most analyses of AI and employment ask which jobs are exposed. This paper asks what happens to the pipeline that produces experts. It extends the model of Caosun and Aral (2026) from a single worker to a firm with two cohorts, juniors and seniors, and studies how expertise formation changes when codified work is automated. Because junior work is the most codified, demand for juniors falls first; the stock of seniors falls later but further, as the pipeline stops replacing the experts who retire. In the baseline calibration, junior demand bottoms out about a fifth below its 2022 level before re
jobs skills
research · arXiv ·
Making Generative AI Workable at Work: Accountability, Localization, and Representation in Kenyan and Nigerian Small Businesses
Workers in Kenyan and Nigerian SMBs do significant 'release work' to make AI drafts accountable before sharing with clients, beyond initial generation.
Generative AI is widely framed as democratizing skilled work by lowering the barrier to producing professional output. Drawing on 21 semi-structured interviews with 27 workers across 21 small and medium-sized businesses (SMBs) in Kenya and Nigeria (July to October 2023), we find that availability alone did not make participation workable. In participants' accounts, drafting was rarely the hard part. The consequential work was making AI-assisted drafts defensible enough to circulate to clients. We identify five intertwined practices through which participants made generative AI workable: using
worker experience
practice · Zapier ·
How a recruiting agency uses Claude and Zapier MCP to find the candidates who aren't looking
Recruiting agency uses Claude and Zapier MCP to identify and contact passive candidates at scale by automating prospect research and outreach sequencing.
Curtis Key has been building automation for about 20 years, first with basic code and scripts, then in Salesforce at a real estate brokerage that grew from 8 to 105 agents. But when hiring became the brokerage's hardest problem, he founded Blue Castle Agency, a recruitment firm exclusively for real estate and property management. Curtis keeps one idea in front of the team: the best candidates aren't looking. They're already employed, and a recruiter has to find them and earn a conversation. Most
adoption
practice · Shopify Engineering ·
We gave AI agents a mobile dev environment
AI agents build and test mobile apps in parallel using a shared remote environment instead of local machines.
We built Remote Dev so AI agents can build and test apps in parallel, without maxing out developers’ laptops.
productivity
research · HBS AI Institute ·
AI Can Clean Up the Comments. Can It Improve Sales?
Field study finds AI-moderated comment sections improve ad performance by shaping consumer trust in branded social media posts.
New research shows what happens to advertising performance when AI takes the reins. Listen to this article: Generative AI has enabled a wave of AI-integrated business products, making it easier than ever for organizations to automate complex business tasks across IT, marketing, operations, and beyond. But a capability can be impressive without creating measurable business value. That issue sits at the center of the new working paper “ Automated Comment Moderation Enhances Social Media Advertising Performance ,” co-written by 2025-2026 HBS AI Institute Associate Julian De Freitas . De Freitas a
productivity
research · Pew Research Center ·
Men Are Experiencing More Job Growth Than Women in AI-Exposed Occupations
Men's employment grew faster than women's in AI-exposed occupations, with the largest gap among workers without a bachelor's degree.
Men's employment grew faster than women's in occupations most exposed to AI, a gap driven largely by workers without a bachelor's degree.
jobs skills
research · arXiv ·
Metacognitive Scaffolds Create Productive Friction for AI-Assisted Knowledge Work
Metacognitive scaffolds in AI writing tasks improve essay quality and knowledge retention, even after scaffolds are removed, despite feeling harder to users.
Generative AI imposes new metacognitive demands on knowledge workers as their work shifts from production to planning, evaluation, and orchestration. In a randomized, between-subjects experiment on AI-assisted writing (297 workers, 594 essays), we test dynamically-generated metacognitive scaffolds supporting goal specification and task decomposition. We find that scaffolds improve writing quality, with this boost persisting in short-lag transfer when scaffolds are removed. We also find evidence of improved topic recall three days later. These effects are consistent with observed changes in how
ways of working · Lev Tankelevitch · Sean Rintel · Abigail Sellen · Advait Sarkar
research · arXiv ·
The Delegation Divide: An Open Index of AI-Agent Delegability across Occupations and Countries
AI-agent delegability varies across countries by income level; 35% of global employment has partly delegable tasks, only 2.5% fully delegable.
35.2% of task time in world employment is at least partly delegable to AI agents in 2026, and only 2.5% can be handed over in full. Existing measures score exposure to generative AI, mostly for the United States. We build the Agent Delegability Index (ADI): two language models rate all 18,796 O*NET 30.2 task statements on a frozen, preregistered rubric of delegation levels and barriers; tasks are mapped to 433 ISCO-08 unit groups and weighted by ILOSTAT employment in 146 countries. Four findings. First, delegable employment rises with income, from 22.5% in low-income to 48.7% in high-income co
jobs skills
practice · Claude Blog ·
Building agents: When to fold subagents into your main agent loop
Consolidating multiple subagents into a single agent with progressive tool disclosure reduces cost and latency while improving quality.
When building agents in Claude Platform, using fewer subagents in favor of progressively disclosed context and tools can improve quality while reducing cost and latency. Here’s when and how to migrate.
ways of working
research · New Economics Papers: AI ·
The Good, the Bad, and the Bayesian: Self-Confidence and Algorithmic Advice
When workers feel competent at tasks, they discount algorithmic advice even when it is accurate, but gain unwarranted confidence in their own choices.
Understanding how decision makers incorporate external information is increasingly important as algorithmic predictions become a common source of advice. The literature on advice-taking suggests that people discount others' advice, especially when they feel competent. We experimentally study how self-confidence affects advice utilization and how algorithmic advice shapes confidence in final judgments. In our online experiment, participants make age predictions and assess the prediction accuracy before and after receiving algorithmic advice. We exogenously vary self-confidence through (perceive
judgment
practice · Latent Space ·
Claude Mods: Flipping the Harness Inside Out
Claude Mods let engineers customize Claude Code's interface and behavior to fit their workflow, shifting control to human attention and decision-making.
For the last few weeks I’ve used Claude Mods to mold Claude Code to my AI engineering workflow. Claude Code is great out of the box, but every engineering workflow is different. Claude Mods let you make Claude Code yours, in the way you want to pay attention. The “paying attention” part is now the most important thing. In a recent Latent Space post, The Evolution of the Agent Harness , I argued that as models absorb more of the harness into their weights, the part that’s left faces the human. It becomes the Attention Interface : the layer that decides when the agent interrupts you, what it sho
ways of working
practice · Latent Space ·
AI for the Fortune 2000: How Tenex Builds an AI-Native SDLC — Alex Lieberman & CJ Hess
Engineering org pays for output via story points rather than hours; AI frees engineers to focus on customer context and architecture.
Last year , Alex Lieberman and his cofounder joined us to explain Tenex’s unusual bet: pay AI engineers for the work they deliver, rather than the hours they spend at a keyboard. If AI makes an engineer faster, an hourly rate can make the engineer less money for the same job. Tenex wanted the incentives to run the other way. At AIE New York, Alex came back with CJ Hess to talk about what happens when you scale that idea into an engineering organization. We also put one of our own experiments on the table: Kill My SaaS , where we asked builders to replace a conference speaker-management tool we
management org · Shawn Wang (swyx)
practice · The Pragmatic Engineer ·
What’s the ROI of software engineers’ spending on AI?
Engineering teams using AI code review tools doubled PR output year-on-year; AI-native teams ship 60+ PRs per developer per week.
A software engineer whose company is looking into its own spending on AI tools pinged me with a very timely question recently, asking what other companies spend on AI, per engineer. They were also keen to find out what the PR throughput was before and after the spending on AI at other places. Spending on AI agents is ballooning at all the tech companies I talk with this year. With 2027 coming around fast, many companies are seeking to put a realistic number on how much they really spend on AI. The change in PR throughput is a very simple metric, and one of those “readily-available” measurement
productivity · Gergely Orosz
practice · One Useful Thing ·
30 Months on the Exponential (in Charts)
Author delegated multi-step chart creation to agentic AI orchestrator, replacing iterative chat-based guidance with hands-off agent coordination.
My second book on AI, Co-Existence, is out today (and you can get it here ), 30 months after the release of Co-Intelligence in early 2024. Looking back across the gap between these books is a good way to get a sense of AI progress. And, thanks to AI, I can describe this progress with some quite lovely charts. Making the charts is itself a good indicator of how far things have come. In the era of chatbots, the era of Co-Intelligence , I would have had to work back-and-forth with an AI in a chat window, guiding it through each new step. In the current era of agentic AI that I cover in Co-Existen
ways of working · Ethan Mollick
practice · Nate B Jones ·
Is your Mac telling you to close apps while your agents work? Find out why, plus my guide that shows what's eating your machine so you can fix it before buying a new one.
Resource management checklist for developers running multiple AI agents on local machines to prevent system slowdown.
You’re not the only user of your computer anymore. If you run agents throughout the day, they may open more browsers, start more processes, and write more files than you do. Then you sit down to do something ordinary, open one more application, and the machine asks you to close something. I’ve had that happen repeatedly. I had a memory crash while working toward a deadline after opening one more program as a human. Everything seemed fine until it wasn’t. You still own the computer and decide what matters, but you now share its resources with software that does much more than answer questions i
ways of working
practice · Hamel Husain ·
How To Use Decision Models for Evals
How to tune decision model thresholds and calibrate their scores for reliable evals, with real apartment-leasing agent traces.
Decision models have exploded onto the scene recently, starting with TypeSafe’s Jev, followed by Perplexity’s Decider, Liquid’s d1, Cloudflare’s Clef, and OpenAI’s Decisions API 1 . These models promise fast, inexpensive classification. Decision models are an appealing low-cost alternative to LLM judges 2 for automated evals. But whether they’re the right choice depends on the cost, performance, and latency requirements of your use case. We’ve also noticed people using the default decision threshold of 0.50 without checking whether it works well for their task. This can leave a lot of performa
judgment · Hamel Husain
research · npj Digital Medicine ·
Expertise modulates automation bias and sentinel behavior in human–AI collaborative diagnosis of neonatal pneumoperitoneum
High-reliability AI induces automation bias in trainee radiologists but triggers careful override behavior in experts; adversarial resilience matters more than standalone accuracy.
Medical AI is often validated under an additive assumption that algorithmic sensitivity and clinician oversight will combine to improve care. We tested this assumption in the high-stakes diagnosis of neonatal pneumoperitoneum, a time-critical surgical emergency. In a multi-reader crossover study analyzing 1750 interpretation events, clinicians reviewed radiographs aided by either a high-reliability model or a systematically error-injected model. We found that high AI reliability paradoxically induces automation bias in trainees, who accepted 52.0% of incorrect suggestions, while offering limit
judgment
practice · Simon Willison ·
My obituary for programming
Coding agents are eliminating the puzzle-solving satisfaction that drew many programmers to the craft.
My obituary for programming Jeremy Scheff poignantly captures the key loss caused by coding agents for career programmers who enjoyed the puzzle of developing code: Programming turned into one of the greatest jobs you could imagine. You got paid to work on tricky little logic puzzles. The trickier the puzzle, the more you got paid. But even pretty simple puzzles were worth a lot of money because regular people just couldn't do it! No, they needed us. They would give us a problem and we would solve it the way we wanted. We set the strategy, we made the timeline, we defined what was and was not
jobs skills · Simon Willison
practice · How I AI ·
“Claude cuts my TikTok”: How this creator is scaling video with AI | Brooke Lacey
Creator uses Claude Code with FFmpeg and Whisper to auto-edit TikToks in 15 seconds, taught Claude her jump-cut style by example.
Brooke Lacey has been making videos since before Facebook had video, and she built a TikTok audience of more than 290,000 by learning to cut short-form videos herself. With over 25 years in tech, she now builds her own apps, including Zosha, a free mobile app for learning AI. In this episode, Brooke walks me through the Claude Code, FFmpeg, and Whisper workflow that edits her TikToks in about 15 seconds, how she mines her comments for new scripts, and how she runs a weekly short-form operation with no editor. What you’ll learn: How Claude Code edits a raw phone video on her computer in about 1
ways of working · Claire Vo
research · New Economics Papers: AI ·
Who Keeps the Gains from Personal AI Assistants? Seller Adaptation and the Unassisted in a Language-Model Market Simulation
Agent-based market simulation shows AI assistants cut consumer spending 13.7 USD per day; seller adaptation reclaims one-third of gains through pricing changes.
Personal AI assistants are beginning to transact for consumers, and early adopters capture real savings. Whether those savings survive, and what happens to consumers who have no assistant, depends on how sellers respond -- a question single-user evidence cannot answer. We build an agent-based rental market in which language models play consumers, assistants, and six adaptive sellers guided by an algorithmic pricing tool. Half the population receives an assistant under an advisory or an executing mandate; the contract pairs a fee only the renter's physical action avoids with a pre-selected add-
productivity
research · New Economics Papers: AI ·
How Heavily Are PhD Students Offloading Their Scientific Writing to AI? Evidence from US STEM PhD Dissertations
29% of US STEM PhD dissertations filed in 2026 contain AI-generated writing; PhD graduates with heavy AI use are less likely to pursue academic research careers.
Large language models are diffusing rapidly into science, raising concerns that delegating research writing to AI may undermine the development of expertise that scientific training is supposed to build. We measure AI-generated writing in the dissertations of a near-census of US STEM PhD graduates from 2019 to 2026 and link graduates to their subsequent employment. AI writing is absent before 2023, present in 29% of dissertations filed in 2026, and rapidly growing. Use is more common among students from non-English-speaking countries and at lower-ranked programs. Among graduates in the same pr
jobs skills
practice · Will Larson ·
Speeding up code review with `small-change`
Team reduced PR review time from 77 to under 30 minutes using AI-assisted small-change workflow, merging 4-10x more code while improving quality.
Imprint’s average engineer is merging 4x more PRs than 2 years ago. Yay. Aggregated behind the average is something even more interesting: we have two teams that are merging 10x their PRs over that period. One engineer is merging 25x the PRs per week of our average engineer two years ago, and a number of others are closing in on that number. That’s pretty neat, and the slope of the line suggests our average in a year is going to look much closer to today’s p90 than today’s p50. Even more importantly, we aren’t just shipping more, our quality has improved: incidents are down 42% half-over-half,
productivity
research · arXiv ·
Indirect Influences of Artificial Intelligence Advice on Complex Sepsis Treatment Decisions
Doctors given simple AI recommendations on sepsis overcame poor advice, choosing optimal treatments 56% of the time versus 32% if blindly following.
Sepsis is a major public health concern, and many sepsis patients die due to ineffective hemodynamic management. Artificial intelligence could support hemodynamic decisions, particularly in complex cases where conflicting information and comorbidities drive uncertainty and practice variation. However, these systems' real-world value depends on not just accuracy, but how they influence the quality of clinician decisions. We first retrospectively evaluated an AI system's recommendations in 6,928 sepsis patients, finding that they improved upon the original providers' decisions overall but had si
judgment
practice · Simon Willison ·
Quoting Addy Osmani, Morgan Westlee Lunt, and Qing Wang
Code review shifted from end-of-PR gate to continuous AI feedback during development, catching routine errors before human review.
We think "did a human read the code?" is an imprecise proxy for "what could go wrong with this change, and which check—automated or human—is the right one to catch it?" Asking that question also changed when review happens. Before, review was a gate at the end of the road: write the code, open a PR, wait for your colleague. Now, review runs continuously, more like spellcheck while you write. Most changes have been reviewed and fixed by Claude at least once before a human is asked to look. This catches most routine mistakes, and saves team attention for higher-level questions and scrutiny. — Ad
teams · Simon Willison · Addy Osmani
research · arXiv ·
Same Person, Different Advice: Auditing LLM Financial Advice with Repeated Risk-Tolerance Responses
LLMs give financial advice that swings 10-16 percentage points when clients repeat the same risk question differently, ignoring measurement reliability.
AI financial advisers set a client's stock allocation largely from one stated-risk question, yet people do not answer it the same way twice: in a national US panel, 41% of households chose a different answer two years later, and in a laboratory retest a third of people moved two or more points on a 0-10 scale after six months. Seven large language models from five providers gave one-turn allocation advice for 800 real household profiles in which only the risk answer changed. The recommended stock share moved by 10 to 16 percentage points on average, and by 24 to 35 when the answer changed, aga
judgment
practice · Simon Willison ·
sparqlite: SPARQL 1.1 inside SQLite, written in Rust
Claude Code's Ultracode mode orchestrated multi-day complex Rust project with dynamic subagent workflows from minimal prompts.
Research: sparqlite: SPARQL 1.1 inside SQLite, written in Rust This research task is really an experiment in running Claude Code for web in "Ultracode" mode, as described in Orchestrate subagents at scale with dynamic workflows in the Claude Code documentation. With Ultracode turned on, Claude Code makes aggressive use of dynamic workflows - it generates JavaScript that defines and coordinates a network of subagents to take on complex problems. My initial prompt was this - I meant "hit the rows directly", the word "delete" was an accidental typo on my phone: Write a SQLite extension in Rust th
ways of working · Simon Willison
research · New Economics Papers: AI ·
What is an AI worker? Evidence from Matched Vacancy-Hires
AI workers earn 5% more than occupational peers, explained by firm wages; doctorate holders earn more and differ sharply in traits.
Despite growing policy interest in AI workforce development, surprisingly little is known about what defines these workers, or indeed if they differ from their occupational peers. Using a novel matched vacancy-hire dataset linking Swedish job postings to the individuals hired to fill them, drawn from register data on the entire Swedish population, I study the characteristics of workers who develop and apply AI. Observable traits including high cognitive ability, a tertiary degree in STEM subjects, and a recent migrant background largely explain occupational sorting. Of these, only higher educa
jobs skills
practice · Claude Blog ·
How the Claude Code team does code review
Risk-tiered human code review process for AI-generated code, with Claude self-verification before human approval.
How do you review code at the volume agents produce it? The Claude Code team shares its review process, from Claude verifying its own work to risk-tiered human approval, plus a checklist for adopting it.
judgment
practice · Claude Blog ·
How an Anthropic Japan BDR runs his day with a fleet of Claude agents
A BDR uses multiple Claude agents to handle inbound queue and draft bilingual emails, showing a concrete daily workflow.
How one business development representative clears his inbound queue and drafts bilingual customer emails with Claude Managed Agents and Claude Tag.
ways of working
research · EU Joint Research Centre ·
AI and Skills
EU-wide data shows 30% of workers use AI at work in 2024-2025, with adoption concentrated in white-collar roles and large firms; employment data show no labour-market disruption yet.
Exposure to artificial intelligence has risen across the occupational spectrum, but actual use lags behind: in 2024-2025, 30% of EU workers reported using AI at work, and by 2025 20% of enterprises had adopted AI technologies. Adoption is uneven, ranging from close to 40% of white-collar workers to 6% in elementary occupations, and concentrated in large firms, digitally intensive sectors and Northern Member States. Exposure is highest in high-skilled, office-based work, but it does not equal replacement: whether AI augments or displaces workers depends on how central judgement, responsibility
adoption
research · HBS AI Institute ·
Staying in the Driver’s Seat: Designing Better Human Oversight for AI
Intentionally injecting realistic errors into AI outputs before human review maintains reviewer vigilance and oversight quality.
New research explores how deliberately imperfect outputs may help keep human reviewers vigilant. Modern AI systems increasingly present us with products that appear finished: complete slide decks with images, polished reports and emails, and even full web apps coded entirely by the AI. We therefore move into the role of the reviewer, but as AI outputs have gotten better and better over the years, checking can start to feel ceremonial. Earlier HBS AI Institute research identified the risk of “ falling asleep at the wheel ” when we approve AI outputs sight unseen. But if better AI can reduce the
judgment
research · arXiv ·
Kolab: Benchmarking Human-Agent Collaboration in Long-Horizon Workflows
Dataset of 115+ hours of screen recordings shows professionals collaborate with AI agents by revising plans, not just accepting outputs; models must predict adoption patterns.
When humans collaborate with AI agents on long-horizon tasks, what happens to the agents' contributions? For solving long-horizon tasks, humans place greater importance on ongoing interaction with AI agents (e.g., revising plans) than on an agent's ability to complete the task in a single attempt. However, most agentic benchmarks have focused more on automation. Strong performance on such benchmarks does not imply effective real-world collaboration. Professional workflows offer a useful setting, as they often involve interdependent steps. To address this gap, we introduce Kolab, a new dataset
adoption
practice · Simon Willison ·
LaTeX renderer
Using Claude to build a shareable LaTeX renderer that stores code in URL fragments, showing the prompting sequence.
Tool: LaTeX renderer Inspired by Paul Ford and Aboard Foundary's new web app Tiny Little Office , which provides a suite of web app content editors (a Word Processor, Outliner, Presentation Builder, Spreadsheet, Calculator, Drawing Tool, Diagram Maker, Animator, Calendar, and Trip Planner). Tiny Little Office's signature trick is to store all of the document data in the #fragment section of the URL, so every document created using it becomes a bookmarkable and shareable link. It also has an llms.txt file telling agents how to construct URLs that will render as documents. Claude used that file
ways of working · Simon Willison · Paul Ford
practice · Latent Space ·
Lab-in-the-Loop at Compute Speed — Ian Quigley, Leash Bio
Lab-in-the-loop simulations using DNA Encoded Libraries data train AI agents for verifiable scientific reasoning in drug discovery.
A few years ago I stumbled upon Leash Bio’s Substack , and was hooked. Be it their Kaggle competition that showed that no, we really haven’t solved protein-ligand binding , or their crazy discovery that knowing a molecule’s author is perhaps all you need to know to predict how good it is . Their substack — or at least Owl Posting ’s 1 deep dive on them — should be required reading for any scientist trying to do chemistry with AI. So I was super excited to finally be able to sit down with Ian Quigley from Leash Bio, and pick his brain. Leash specializes in DNA Encoded Libraries (aka “DELs”), a
ways of working
practice · The Pragmatic Engineer ·
Uber’s AI infra, from the inside
Uber's internal developer tools including DevPods, Code Inbox, Slate and Wisdom that augment engineer workflows with AI.
Stream the latest episode Listen and watch now on YouTube , Apple , and Spotify . See the episode transcript at the top of this page, and timestamps for the episode at the bottom. Brought to You by • turbopuffer – The turbopuffer engineering team is doing something really cool: they are completely redesigning their storage architecture from first principles to make search faster, cheaper, and more reliable at scale. And they’re documenting all of it! Follow along their rewrite at turbopuffer.com/v3 • Linear – one of the big challenges for us devs is the sheer amount of code to review. Linear D
ways of working · Gergely Orosz
practice · Addy Osmani ·
Agentic Verification
Equip AI agents with self-verification loops, tests, benchmarks, comparisons, so they improve their own output at scale without human review of every line.
If you give an AI agent a way to independently verify its work, that can heavily improve the quality of output. Agents write code “much better on average at scale ”. The “at scale” part comes from verification . Agents make checking cheap. The stuff that made “Good Code” expensive (tests, benchmarks, specs, real e2e runs) is now a cheap thing you can ask an agent for. You can improve the checks. So our work is less “review every line” and more “build loops the agent can run itself”. Give the agent a way to verify the work. That loop is where quality comes from. And make taste compound. When th
judgment · Addy Osmani
research · Management Science ·
AI-Driven Human Task Substitution: Evidence from Google Translate and ChatGPT
ChatGPT reduced demand for both routine and creative translation tasks, while earlier narrow AI only displaced routine work.
We examine how different generations of artificial intelligence (AI) substitute for human knowledge worker tasks, leveraging two sequential natural experiments in the translation industry. We study the introduction of Google Neural Machine Translation (GNMT), a predictive, task-specific AI, as well as ChatGPT, a broad, general-purpose generative AI, in a major online labor market. Distinguishing between analytical tasks (regular translations) and intuitive tasks (transcreations, which require creative and cultural adaptation), we estimate difference-in-differences models on transaction-level d
jobs skills · Joshua Gans
practice · The Pragmatic Engineer ·
Building resilient AI-powered software, and planning for when things go wrong
Disaster recovery and resilience patterns updated for AI-generated code causing more production outages and bugs.
Last week’s guest on the podcast was Sam Newman , who had released a book I’ve personally long awaited titled Building Resilient Distributed Systems . It’s an especially timely book for many of us software engineers, as we’re seeing more outages with nearly all services and systems – much of it caused by more code deploys thanks to AI agents writing more code; and more bugs causing more incidents in production. Sam’s new book, Building Resilient Distributed Systems , in print form Sam’s book being “fresh out of the oven,” it naturally also touches on what AI changes as we design resilient syst
management org · Gergely Orosz
practice · martinfowler.com ·
The Craft of Practitioner Voice
Practitioners should write with visible voice and grounded stories, using AI as a drafting tool while keeping authentic perspective.
A couple of months ago Jim Highsmith explained how practitioners writing for each other forms a distinct style of writing. He now adds a section to the article with more detail on the craft of how we write in this style. How the writer shows up in the prose, its four principles, the role of story, how to sensibly use AI, three levels of editing, and clarity of the audience. more…
ways of working · Martin Fowler
practice · martinfowler.com ·
Are Harnesses Worth the Cost?
A behavioral harness improved a cost-optimized model's reliability from 30% to 100% on API builds, matching frontier model performance at 33% lower cost.
Naresh Jain compares coding agents building the same API service with and without a behavioral harness. A frontier model, GPT-6 Sol, passed every external evaluation either way. But a cost-optimized model, GPT-6 Luna, succeeded in only 3 of 10 unharnessed runs and all 10 with the harness. While adding the harness increased token usage and runtime for Luna, the harnessed Luna runs achieved the same 10-for-10 reliability as GPT-6 Sol while costing 33% less per run ($0.273 vs $0.406). This experiment suggests a behavioral harness might be a practical way to get dependable results from smaller, co
productivity · Martin Fowler
practice · Simon Willison ·
Quoting Geoffrey Huntley
Pre-commit hooks enforcing code patterns by failing commits and injecting prompts guide AI agents toward using specific libraries.
If the agent isn't using my diagnostics library, I could introspect and update AGENTS.md, but there's still a delta, and it'll drift. Instead, I write a pre-commit hook that checks the git diff for direct calls to observability modules that bypass my diagnostics module. Boom: fail the commit, inject a prompt telling the agent to use the diagnostics library. All of a sudden it's ten out of ten. — Geoffrey Huntley , nobody should type code by hand anymore. here's what's left. Tags: coding-agents , generative-ai , git , agentic-engineering , ai , geoffrey-huntley , llms
ways of working · Simon Willison
practice · Nate B Jones ·
AI just produced more than 700 math research papers in one release. Before you take that as proof it can do your job, see which kind of work it got better at.
AI models may develop narrow peaks of capability rather than broad intelligence, excelling at some tasks while remaining weak at others.
What if AI gets dramatically smarter and spikier, with the gaps between its abilities getting larger? We tend to expect the opposite. A model does something extraordinarily difficult, and we take that as evidence of a deeper intelligence that should also help it do other things. If it can advance mathematics, surely it should become a better engineer. If it can reason through a problem that defeated human experts, surely it should recognize the bad assumption in a business plan. That expectation contains a theory of how intelligence works. Progress in one demanding intellectual activity is sup
judgment
practice · Linear ·
Five principles for working with Loops
Engineer shares five principles for delegating work to AI agents, with security team automation example.
I’m one of the engineers building Loops, and I’ve been using it extensively to automate different parts of my own work, from triaging bug reports in our Slack channels to cleaning up obsolete code. Loops gives you a way to automate recurring work with the Linear Agent by describing a job in plain language. You can choose whether a loop should run on a schedule or in response to an event. Working effectively with agents is increasingly a matter of learning how to delegate well, so I wrote down a few lessons I’ve picked up along the way. Hunt for tasks you can delegate Loops are extremely versat
ways of working
practice · Anthropic Engineering ·
Redesigning source control at Anthropic
Engineering team migrated to custom version control system to handle tenfold increase in merge volume, removing development bottleneck.
As our merges per day grew more than tenfold, source control became our biggest development bottleneck. Here, we share how we migrated to an in-house version control system in five months.
productivity
research · VoxEU ·
At risk or responsive: Rethinking unemployment policy
Job search counselling helps responsive workers enter employment faster but has limited effect on those at highest risk of long-term unemployment.
Public services increasingly use predictive algorithms to direct scarce support towards those most at risk. But are these also the people who benefit most from intervention? This column explains how to navigate this trade-off and shows why it matters in practice. Job search counselling gets people into work faster, but has little effect on those at greatest risk of long-term unemployment. Combining predictions of risk and responsiveness can make scarce support substantially more effective, while highlighting the need for different support for those hardest to help.
policy
practice · Lenny's Newsletter ·
🎙️ How I AI: How Meta designed Muse with Alex Cornell
Design principles for AI agents: progressive disclosure, human conversation framing, persistent relationships, and generative UI that feels personal.
How Meta designed Muse: an AI agent people actually want to talk to | Alex Cornell (Design Director) Listen now on YouTube • Spotify • Apple Podcasts Brought to you by: WorkOS —Make your app enterprise-ready, with SSO, SCIM, RBAC, and more Alex Cornell is a design director at Meta, where he leads design for Muse. In this episode, he explains how progressive disclosure makes Muse approachable for casual users without limiting technical ones, why its main chat is designed as a single persistent relationship, and how generative UI can feel personal without constantly changing the interface. He al
ways of working · Lenny Rachitsky
research · New Economics Papers: AI ·
Everyone Is a Manager: AI Use as an Act of Management
AI use requires managerial skills, direction and verification, whose relative importance shifts as AI reliability improves, creating skill collapse risk.
When a knowledge worker is given an AI assistant, they stop executing tasks and start delegating them. Thus, we propose that the use of AI is an act of management, which helps explain the heterogeneity in returns to AI use observed across firms. We model the return to AI as moderated by two managerial abilities: direction (how well the worker specifies what they delegate) and verification (how reliably they catch the tool's errors). As AI becomes more reliable, the skill with the higher marginal return shifts from verification to direction. To the extent that use builds skill, workers develop
management org
research · New Economics Papers: AI ·
The Hidden Value of Human Followers
Replacing human team members with AI can reduce team output because leaders work less when AI removes social observation and reciprocal effort dynamics.
Replacing a human follower with AI that supplies more input can reduce team output. With complementary effort, a leader works harder because a human follower observes this effort and responds with greater effort. AI that matches the follower's contribution removes this reason to work hard, so the leader works less and team output falls. In larger teams, the remaining human followers also work less. Profit-maximizing firms may nevertheless adopt AI that contributes more while the team produces less. Falling AI costs can trigger an output drop at adoption, followed by recovery. Replacing followe
teams
research · npj Digital Medicine ·
From authoring to editing: a competency framework for trainee use of ambient AI clinical documentation
Ambient AI scribes shift trainee work from authoring to editing notes; curricula lack competency frameworks for this new task.
Ambient artificial intelligence (AI) scribes have achieved rapid and widespread clinical adoption, with early evidence suggesting trainees derive disproportionate benefit compared to other clinician groups. Yet the outcomes measured so far - documentation time, cognitive workload, clinician burnout - speak to the value of these tools for workforce sustainability rather than for medical education. Physician practice is shifting from authoring clinical notes to editing AI-generated ones, and trainees are inheriting that shift without a defined competency for performing it. Here, we argue that re
jobs skills
research · New Economics Papers: Labor ·
At-Risk or Responsive? Targeting in Unemployment Policy
Algorithmic risk profiling for unemployment support shows treatment effects decline with predicted risk; targeting responsiveness outperforms targeting risk alone.
This paper evaluates the use of algorithmic risk profiling to direct job search support toward individuals most at risk of long-term unemployment. Using three regression discontinuity designs and rich administrative data from the Flemish Public Employment Service (VDAB) in Belgium, we address two key dimensions: whom and when to target. First, job search counseling raises employment on average, but treatment effects decline sharply with predicted risk. This reveals a fundamental trade-off between targeting those most at risk and those most responsive to intervention. Second, we find no evidenc
adoption
research · New Economics Papers: AI ·
Can AI Improve Household Welfare in Poorer Countries? Evidence and Measurement Challenges
Meta-analysis of nine evaluations finds AI assistance raises output per unit of time by 29% on average, with mixed results for education and labour markets in poorer countries.
Can artificial intelligence (AI) make scarce expertise more widely available in poorer countries and improve household welfare? Can it help measure welfare where surveys are infrequent? This structured critical review examines both questions and finds that the answers depend on the application and setting. Across nine selected evaluations, AI assistance raised output per unit of time by 29% on average, and the average remains positive in every reported sensitivity check. Eight tutoring comparisons give an average gain of 0.21 standard deviations on tests taken without the tool, including in po
productivity
research · New Economics Papers: AI ·
Right Order, Wrong Scale: Auditing LLM Judges for Occupational AI Measurement
LLM judges rank AI outputs similarly to workers but estimate acceptance rates ranging from 3-98% versus 61% from workers, invalidating occupational measurement.
LLM judges are increasingly used to assess whether AI outputs meet workplace requirements, but agreement on response rankings does not establish agreement on acceptance rates or occupational aggregates. We introduce O*NET-BENCH, an audit suite derived from an existing survey of 45, 796 worker ratings, and evaluate 33 pre-existing judge configurations across six model families on 4, 501 test ratings. Twenty-five configurations achieve tie-aware pair accuracy of at least 0.60, although a train-fitted response-only TF-IDF baseline nearly matches the strongest judge. Despite this ordering agreemen
adoption
practice · Lenny's Newsletter ·
Why every company now needs to think and operate like a lab team | Josh Woodward (Google Labs, Gemini, AI Studio)
Labs team model for rapid experimentation: frameworks for generating ideas, testing product-market fit, and deciding when to kill projects.
Josh Woodward is the head of Google Labs, the Gemini app, and AI Studio. He has spent over 17 years at Google and oversees its longest-running and largest labs team, whose products include NotebookLM (now Gemini Notebook), Project Genie, and Flow. His job is to find, experiment with, and scale new AI products, and he has built one of the most distinctive product cultures in the industry for generating ideas, running experiments, and, even more importantly, knowing when to quit. Listen on YouTube , Spotify , and Apple Podcasts In our in-depth conversation, we discuss: Why every company now need
management org · Lenny Rachitsky
practice · John Warner ·
We’re Going to Win
Faculty at two California colleges are actively rethinking how to teach critical thinking and human agency in an AI-saturated education system.
I feel like this one is kind of a banger, so subscribe early. This week I enjoyed several days in Humboldt County, California spending some time with folks at both Cal Poly Humboldt and the College of the Redwoods, and I’m pleased to report that we are going to win. I should be more specific. We = People who would like maintain a world where humans are able to move and act freely to pursue a life of experiences . Win = “We” will generally represent the predominant ethos of society. One reason I think we will win is that I spent four days almost entirely away from the Internet, two full days of
jobs skills · John Warner
practice · Sangeet Paul Choudary ·
How agents unlock new markets
AI agents lower negotiation costs enough to make individualised supplier deals economical at scale.
This post is Part 2 of a series titled Agents, and their better half. You can read Part 1 here. Walmart’s ability to manage its vast supplier network is one of its greatest competitive strengths, but has also so far been a source of considerable complexity. With more than 100,000 suppliers, it was too expensive to negotiate individual commercial terms with every one of them. Many suppliers operated under largely standardized agreements, even though better arrangements might have been possible for both sides. The problem was the cost of discovering and negotiating such arrangements - particular
management org · Sangeet Paul Choudary
research · arXiv ·
Too Late to Prune: Generative AI, the Screen, and Team Creative Decisions
When AI option-generation shifts from ideation to selection stage, team creative output drops 0.62 SD despite similar AI usage, because teams cannot screen late-arriving options effectively.
Generative AI makes options cheap and shifts the bottleneck of creative work from generating options to screening them. We argue that AI's value depends on whether its options arrive before or after the team's screen. In our model, early options compete for a place in the portfolio; late options arrive after that competition and are kept unscreened. In a preregistered experiment, we randomly assigned 148 three-person teams to five schedules of access to the same language model during a product-design task with timed search and selection stages. Moving the same 15 minutes of access from search
teams
research · arXiv ·
Impact of Expertise and Trust on AI-assisted Work
Experts using AI agents on data tasks sacrificed completion speed to scrutinize outputs; non-experts delegated more but produced more invalid solutions.
Artificial intelligence (AI) agents promise to extend what users can accomplish beyond their existing expertise, but they also raise the risk of producing plausible-looking work that users may struggle to evaluate. We ask how task-relevant expertise and trust in AI shape agent-assisted work. To isolate these factors, we conduct a think-aloud study in which 20 professionals with varying data-science expertise use the same agentic tool to complete the same data-science hiring assessment, used at a major U.S. company. We find that surface productivity can come at the expense of understanding: par
judgment
practice · Simon Willison ·
A new feature for my blog, built using my voice
Building a Django feature entirely through voice conversation with an AI assistant while multitasking.
I shipped a new feature for my blog today: the Newsletters page, which offers an index of all of the newsletters I've sent out, both my free weekly Substack and my monthly sponsors-only updates. I built the feature almost entirely using my voice, chatting away to my laptop while I cooked dinner. Codex voice mode I used the ChatGPT desktop app for this, in the Codex tab, using the voice conversation mode, running against a local development environment. Here's what that looks like: I started the session against my local simonwillisonblog checkout by typing: Start dev server and open in browser
ways of working · Simon Willison
practice · Charity Majors ·
If your team is happy, are you doing a good job?
High-performing teams need discomfort and growth, not absence of bad feelings; leaders conflate treating people well with eliminating struggle.
For those of you just catching up, Cat and I are having a dialogue about how teams are changing in the era of AI. Part 1: Where do AI norms and values come from? Where should people start? , by me. Part 2: How social identity is constructed, and how to defang the threat of identity loss , by Cat. At the end of Cat’s piece, she ended with a question for me and an observation of her own. She asked, “What gets us so stuck on believing we can’t have both high performance and good norms?” And observed: “It’s hard to get teams to open up, hard to get our companies to see the merit in this kind of pr
management org · Charity Majors
practice · The Pragmatic Engineer ·
The Pulse: new trend of building “internal vibe-coding apps” at tech companies
Mid-sized tech companies building internal vibe-coding platforms so non-engineers can create and share workplace applications.
The Pulse is a series covering events, insights, and trends within Big Tech and startups. Today, we cover: New trend: building internal vibe-coding apps at mid-sized companies. Ramp and Stripe built platforms for non-engineers to build internal websites and tools with, and both are taking off in those workplaces. I expect more companies to do the same. Do us engineers really enjoy hard problems? Or do we actually like pattern-matching with backend problems? A provocative post by Cloudflare engineer, Sunil Pai, suggests there are other motives. New open models launch in the EU and US . Kolibri,
adoption · Gergely Orosz
research · New Economics Papers: AI ·
AI Adoption and Employment Expectations: Evidence from a Survey of Small Business Owners
Small businesses using AI expect to increase employment and revenue more than non-users, especially those facing tech implementation challenges.
There is little consensus on the effect of AI adoption on employment. Economy-wide measures of pay and headcount have moved little even as AI adoption has spread rapidly, yet narrower measures document declining hiring for workers at the start of their careers or in AI-exposed occupations. In this post, we revisit this topic for U.S. small businesses. We use data from the 2025 Small Business Credit Survey (SBCS) to examine the twelve-month-forward employment and revenue expectations of AI users. We find that firms currently using AI are significantly more likely than non-users to expect increa
adoption
research · Organization Science ·
When Data Scientists Meet Domain Experts: Artificial Intelligence, Epistemic Conflict, and Knowledge Transformation
Data scientists address epistemic conflict with domain experts through bridging practices that embed AI predictions into experts' existing knowledge frameworks.
Predictive AI models developed by data scientists promise to transform organizational knowledge, yet in practice the predictions remain inscrutable to domain experts. Existing explanations situate the problems in the opacity of the AI tools, failed adoption, or jurisdictional conflict, but offer limited insight into how to make the knowledge accessible. Here we show how the problem emerges from the competing epistemic stances of data scientists and domain experts, which create conflict over how to produce and evaluate knowledge. We then ask how data scientists and domain experts address that c
management org
practice · Claude Blog ·
Building effective agent automations
Reference implementation and six rules for building reliable scheduled Claude agent automations in production.
A reference implementation walkthrough for a scheduled Claude Managed Agents automation, with the config files and six rules for avoiding common failure modes.
ways of working
practice · Claude Blog ·
How Block orchestrates Claude Fable across thousands of pull requests
Block uses Claude Fable to orchestrate thousands of pull requests for company-wide code migrations at scale.
Bradley Axen, Head of AI Capabilities at Block, on how his team evaluates new large language models, how Claude Fable 5 orchestrates company-wide code migrations, and why safeguards are a critical part of deploying frontier intelligence responsibly, at scale.
adoption
research · VoxEU ·
The adjustment of the Danish labour market to AI has begun
Danish firms adopting AI in 2023 reduced employment below trend, especially in AI-exposed roles and among small firms hiring new staff.
Policymakers are asking whether generative AI is reshaping labour demand, and the literature has found mixed results so far. This column links Denmark’s official IT-use survey to monthly employer–employee records and compares firms that started using AI in 2023 with those that did not. Early adopters fall behind their own pre-adoption employment trend. The decline is most visible in AI-exposed jobs and among new hires, and only significant among small firms. The results indicate that AI is affecting the labour market, even though the effect is not visible in the aggregate statistics.
jobs skills
research · CEPR ·
DP22028 At-Risk or Responsive? Targeting in Unemployment Policy
Algorithmic risk profiling for job search support reduces long-term unemployment but shows trade-off: highest-risk individuals are least responsive to intervention.
This paper evaluates the use of algorithmic risk profiling to direct job search support toward individuals most at risk of long-term unemployment. Using three regression discontinuity designs and rich administrative data from the Flemish Public Employment Service (VDAB) in Belgium, we address two key dimensions: whom and when to target. First, job search counseling raises employment on average, but treatment effects decline sharply with predicted risk. This reveals a fundamental trade-off between targeting those most at risk and those most responsive to intervention. Second, we find no evidenc
adoption
research · MIT Sloan Management Review ·
When Compliance Workarounds Backfire
Platform algorithmic management workarounds to avoid employment classification ultimately failed, forcing reclassification and employee hiring.
John Holcroft/Ikon Images In 2021, Barcelona-based delivery platform Glovo was faced with a law that threatened its business model. Spain had passed the Rider Law , which introduced a presumption of employment when a digital platform organizes, directs, or controls couriers’ work, including through algorithmic management. Glovo came up with what seemed like a clever fix to avoid having to classify its couriers as employees: emphasizing courier autonomy by redesigning its app so they could log in freely, reject orders without explicit penalties, and choose a daily rate multiplier. Three years l
policy
research · arXiv ·
Structured pre-generation elicitation versus single-shot prompting in AI-assisted enterprise decision-making: a randomised online experiment
Structured prompting scaffolds improve decision quality 32% over single-shot prompting in a randomised experiment with enterprise workers.
Generative AI speeds, and mostly improves, professional work, but there is concern that users who delegate both the production and the evaluation of an answer may accept weak output and engage less with the underlying reasoning (cognitive surrender). Interventions proposed so far, such as unassisted practice or slowing adoption, sit outside the working task. We tested a different approach: an interactive metacognitive scaffolding layer (Cognistance, a prototype developed at the Oxford Centre for Impact Research (OCIR) that asks users to clarify context, choose a strategic direction and explain
judgment
research · Industrial and Labor Relations Review ·
The “Digital Moral Economy” of Care: Institutional Logics and the Legitimation of AI-Based Algorithmic Management
Platforms use moral narratives about care to legitimize algorithmic management in care work, with cross-national variations in how this works.
Research on platform work has largely focused on algorithmic management in sectors such as delivery and ride-hailing, paying limited attention to care and domestic services. This article theorizes how platforms integrate technology-mediated economic activities with moral principles of care. Drawing on ethnographic data from 64 narrative interviews in Belgium and France, the authors show how platforms legitimate AI-based and technologically embedded forms of management by aligning them with institutional care logics. They conceptualize this as a “digital moral economy” of care, structured aroun
worker experience
practice · The Pragmatic Engineer ·
The state of the tech industry in 2026
Engineers now use 5-10 AI agents routinely; code reviews became performative; hand-coding has nearly disappeared.
I recently delivered the keynote at the LDX3 engineering leadership conference in New York, attended by 2,000+ engineering leaders, CTOs, Director+ and Staff+ engineering folks, in which I attempted to create a snapshot of where the tech industry is at this exact point. In the middle of my keynote at LDX3 It came after I had the chance to visit the AI labs OpenAI and Anthropic, meet innovative startups like Ramp, Uber and others, get new, unpublished data from GitHub, Factory AI and Linear. The focus of the talk is trend inside of AI labs, VC-funded startups and Big Tech. Thanks to the kind ac
management org · Gergely Orosz · Martin Fowler