The Feed · Complete archive
AI at work: research and practice
A server-rendered record of the evidence, ideas and firsthand practices screened by The Feed. Every entry links to its original source.
Use the interactive FeedPage 5 of 12 · 1144 items
research · npj Digital Medicine ·
Beyond expertise: exploring behavioral personas in AI-assisted rare renal cancer diagnosis
Pathologists using AI for rare cancer diagnosis showed different behavioral patterns: some followed AI recommendations often (automation bias), others questioned them more, with gains highest among less experienced doctors.
Abstract Fumarate Hydratase-deficient Renal Cell Carcinoma (FHdRCC) is a rare (< 0.4% of RCCs), aggressive subtype with significant morphological overlap, posing diagnostic challenges. While artificial intelligence (AI) shows promise in common cancer diagnostics, its impact on pathologist decision-making in rare diseases—particularly concerning automation bias—remains poorly understood. We developed a deep learning model to classify FHdRCC. We conducted a crossover reader study with 21 pathologists (7 genitourinary (GU) specialists, 7 non-GU specialists, 7 residents) diagnosing 30 challenging
judgment
practice · The Pragmatic Engineer ·
Stop being skeptical about AI for development with Charity Majors
Charity Majors explains how AI is becoming foundational to software development and why skepticism is now misplaced.
Stream the latest episode Listen and watch now on YouTube , Apple , and Spotify . See the episode transcript at the top of this page, and timestamps for the episode at the bottom. Brought to You by • Antithesis – turbocharge testing of your systems by running your whole system under aggressive fault injection. There’s good reason teams like Jane Street, Fly.io, and the etcd community rely on Antithesis. Learn more. • Buildkite – the CI platform trusted by OpenAI, Anthropic, Cursor, Meta, Uber, NVIDIA , Airbnb and many more. When CI volume becomes an architecture problem, you deserve better CI.
ways of working · Charity Majors · Gergely Orosz
research · arXiv ·
How Organizations Use AI: Evidence from ChatGPT
ChatGPT Enterprise usage is concentrated among larger, R&D-intensive firms, with especially high adoption among early-career workers across writing, technical, and communication tasks.
We study how organizations use frontier generative AI by linking ChatGPT Enterprise account records to usage, worker roles, task classifications, and public-company financial data through March 2026. These linked data enable a privacy-preserving analysis of adoption, worker roles, and message-level tasks at scale: for instance, the worker-level sample we analyze at the six-month adoption horizon includes over 1,500 organizations and over 17 million messages. We document four facts about enterprise AI adoption and use. First, ChatGPT Enterprise usage has grown rapidly due to a combination of ne
adoption · Aaron Chatterji
research · arXiv ·
Organizational Technology Ladders: Remote Work and Generative AI Adoption
Remote work adoption in 2021-2022 increased firms' later generative AI job postings by 0.4-0.7 percentage points, driven by shifts toward technical hiring.
This study proposes that firms move along an "organizational technology ladder": adopting one technology transforms hiring and work processes and builds skills and organizational capital that change the cost of adopting subsequent technologies. I study how firms' adoption of remote work technology during the COVID-19 period shaped later uptake of generative AI. Using U.S. job-posting data and an instrumental-variables strategy based on predicted differences in labor-market pressure to offer remote work, I estimate that a 10 percentage point increase in remote hiring in 2021-2022 increases the
adoption
research · arXiv ·
Cheap, Fallible Cognition and the Political Economy of Expertise
Framework distinguishes technical AI capability from equilibrium labor displacement through task vulnerability, adoption conditions, and governance bundles in occupations.
The question of whether artificial intelligence will "destroy jobs" is too coarse to guide economic analysis or institutional design. A job is not an indivisible object, and machine cognition is not a uniform substitute for human labor. This paper develops a task-based and institutionally grounded framework for analyzing generative AI as cheap, scalable, and fallible cognition. The relevant margins are exposure, adoption, verification, question selection, workflow redesign, demand elasticity, apprenticeship, and rent allocation. We distinguish the technical reach of large language models from
jobs skills
practice · Will Larson ·
Roadmap decisions rather than dates.
Shipping work by prototyping behind feature flags to resolve tradeoffs, rather than debating roadmap dates upfront.
One thing that bothered me about Imprint’s product after joining was our lack of passkey support. Passkey support is a rare opportunity to increase resiliency to phishing attacks while simultaneously reducing login friction. If it’s good for our members, our partners, and our product, it felt like something we should have already shipped. Nonetheless, it was hard to get it onto the roadmap alongside everything else we were working on. To dig into passkeys, I started sketching out the implementation as a side quest. Some iterations later, I had something implemented behind a disabled feature fl
management org
practice · martinfowler.com ·
TDD inside the agent loop - theater or actual value?
Experiments test whether asking LLM agents to use TDD actually improves code quality or is performative.
My colleagues at Thoughtworks tend to be big fans of Test-Driven Development, and many people in the industry advocate telling LLM agents to use TDD when building software. Birgitta Böckeler was curious if this really makes a difference, so conducted a few experiments . more…
ways of working · Martin Fowler
research · Proceedings of the National Academy of Sciences ·
Scientific production in the era of large language models: Outcome-triggered treatment timing and spurious event-study dynamics
Statistical analysis shows previous LLM productivity claims used flawed timing methods that generate false positives even with no real effect.
Large language models (LLMs) are increasingly used in scientific writing, but their effect on individual productivity is difficult to identify because adoption is rarely directly observed. [K. Kusumegi et al. , Science 390 , 1240–1243 (2025)] infer adoption from the first paper detected as LLM-assisted and report large productivity gains after adoption. We show that this treatment-timing rule mechanically generates positive event-study dynamics even in the absence of any causal effect. Because high-output months are more likely to produce a detected paper, treatment assignment becomes intrinsi
productivity
practice · Linear ·
How we built Linear Agent
Design principles for constraining AI agents via system prompts, tool design, and custom harnesses rather than rigid scripts.
Most software is designed to behave consistently. Good engineering has typically meant shrinking the space of possible outcomes until the same action reliably produces the same result. AI inverts that logic, at least somewhat. Much of Linear Agent’s value lies in doing work we didn’t anticipate in ways we never explicitly defined; script its behavior too tightly, and we’d dilute the flexibility that makes it useful. So rather than engineering a fixed path for Linear Agent, we defined the boundaries within which it could find its own. We drew those boundaries in the agent’s system prompt, the d
ways of working
practice · How I AI ·
Claude Code for normal people: skills, voice mode, and how to collaborate with AI
Service business owner built and now teaches non-technical clients to create Claude Code tools: pipeline automators, proposal generators, custom inboxes.
Grace Clarke is an AI educator and former marketing consultant who taught herself Claude Code earlier this year and built a curriculum out of the process. She now runs her entire service business on tools she’s built with Claude, including a pipeline operator, a proposal maker, and a Gmail replacement she created in under 30 minutes, and teaches individuals and teams to do the same. What you’ll learn: How to build an hourly pipeline in Claude that moves clients through your process automatically Why Grace ditched traditional proposals for password-protected, interactive HTML documents built in
ways of working · Claire Vo
research · Information Systems Research ·
Generative AI, Platform Stances, and Content Creator Behavior
Platforms' stance on generative AI affects creator behavior more than the tool itself; pro-AI signals drove away experienced creators concerned about replacement.
How platforms introduce generative AI may matter as much as what the technology can do. AI-related policies not only change features and rules; they also signal whether a platform values and protects human creators. We examine two visual arts platforms that took opposite approaches. Lofter introduced an AI image generator, whereas Graffiti Kingdom prohibited AI-generated artwork. Creator activity declined after Lofter’s launch and increased after Graffiti Kingdom’s prohibition. Evidence indicates that creators responded mainly to what these decisions communicated about AI’s future role, the pl
worker experience
research · Information Systems Research ·
How Platform Workers Contest Algorithmic Management: Theorizing the Dynamics of Algoactivistic Practices
Platform workers contest algorithmic management through three distinct practices, self-optimizing, distancing, confronting, that evolve with platform reconfigurations and depend on workers' resources.
Algorithmic management (AM) has become a defining feature of online labor platforms. Workers contest AM through a range of practices—a phenomenon we refer to as worker algoactivism. Existing debates portray algoactivistic practices as uniformly accessible and primarily reactive resistance directed at AM systems. Our study paints a more complex picture. Drawing on the case of Uber and using a computer-assisted, grounded-theory approach, we show how platforms’ AM reconfigurations and worker algoactivism co-evolve over time. We also show that workers’ ability to engage in different forms of algoa
worker experience
practice · Sangeet Paul Choudary ·
Scarcity and strategy - Misreading AI the way Hollywood misread streaming
AI strategy parallels streaming: scarcity shift from compute to judgment, requiring organizational restructuring.
Traditional TV programming was built around a scarce asset - prime-time slots. A network had twenty-four hours in a day, a handful of prime-time slots, and far more shows than it could have on air. The programmer’s job was therefore to decide what deserved one of those scarce slots, schedule it against competitors, and cancel quickly when the audience failed to appear. It was a case of exercising judgment under severe capacity constraints. We often think that Netflix made access to content abundant. But the real scarcity it removed was the scarcity of the prime time slot. Streaming effectively
management org · Sangeet Paul Choudary
practice · Rands in Repose ·
R.I.P. Your Backlog
Using AI to build website features (dark mode) in hours instead of months, shifting how engineers prioritize backlogs.
If everything is going to plan and your operating system is in dark mode, then randsinrepose.com is now dark for you. If you are a light mode person, you can click on the Moon in the upper right of the navigation and experience dark mode stylings. Click again to return. Why now? Well, I was finishing the Blade Runner piece last week, and as I sat there figuring out the ending, dark mode popped back in my head. As I’m apt to do these days, I fired up the robots to investigate building dark mode. We had a working version in about an hour. In three hours, I had a version I shared with friends for
ways of working
practice · Addy Osmani ·
Agentic Code Quality
Code quality shifts from human review to constraints around agents: tests, gates, and environment controls that scale.
For much of human history, we’ve evaluated code quality via code review: someone reads what you wrote and makes sure it’s clean, thoughtful, fast, understandable, and tests well. For agents, that approach doesn’t scale well; there’s just too much code for anyone to read. As a result, more and more of our quality checks have to happen in the harness, environment, and operating system around the agent. I still read and review code, but am very intentional about where I am comfortable with constraints as the check. Software quality now depends on the constraints you set around your agents. Speaki
judgment · Addy Osmani
research · Government Information Quarterly ·
Hybrid bureaucracy: The relationship between digital technologies and institutional arrangements in public welfare agencies
Three Scandinavian welfare agencies combine automated and manual casework in hybrid arrangements, contradicting predictions of full automation.
Public agencies are strategically adapting and applying digital technologies to improve their business processes and deliver greater value to society. This development has a profound impact on the agencies' institutional arrangements. While some services that the agencies offer are almost fully automated, others still require a high level of caseworker involvement. The variance in levels of automation and the coexistence of different institutional arrangements within the same agency are interesting and challenging because they contradict predictions made by both scholars and policymakers. Ther
management org
practice · Hacker News ·
Humans missed 1 in 3 threats approving AI agent commands across 40k game runs
Human operators missed one in three threats when approving AI agent commands, revealing oversight gaps in autonomous systems.
340 points on Hacker News. Discussion: https://news.ycombinator.com/item?id=49195468
judgment
practice · Paul Ford (Aboard) ·
Triple Threat
Knowledge graphs and ontologies are re-emerging as quality-control tools for AI workflows that need guardrails and human oversight.
Richard MacManus , of ReadWriteWeb fame and now the editor of Latent.space (on Substack) has a great writeup on the return of the knowledge graph in a world of LLMs. As a big knowledge graph fan, I’ve noticed this too! To quote MacManus: Perhaps ontologies are starting to resonate with AI engineers because a central concern at this time is quality control for loop engineering. We saw this debate play out at [The AI Engineer World’s Fair Conference], with many conference speakers not willing to go all-in on fully automated “software factories” just yet. One of the key learnings from the event w
judgment · Paul Ford
practice · How I AI ·
Build an AI code review bot in 30 minutes with Vercel Eve
Built an AI agent that reviews GitHub PRs across six risk dimensions, auto-approves low-risk ones, and escalates via Slack.
AI writes most of my code now, and that created a new problem: a PR queue I couldn’t keep up with. In this episode, I walk through how I built Merge Mommy, a Vercel Eve agent that reads every PR after checks pass, scores it across six risk dimensions, auto-approves the low-risk ones, and pings me in Slack for anything that needs a human. I built the whole thing in one Codex session, it’s SOC 2 compatible, and it’s already cleared my backlog. What you’ll learn: Why AI-generated PRs create a review bottleneck and why the answer isn’t reviewing all of them How Intercom 5x’d PR approval speed and
ways of working · Claire Vo
research · arXiv ·
Does generative AI narrow education-based productivity gaps? Evidence from a randomized experiment
Randomized experiment shows AI narrows education-based productivity gaps by three-quarters during task execution, but gaps re-emerge without AI.
Does generative artificial intelligence (AI) widen or narrow productivity gaps across workers? We study this in a randomized online experiment with 1,174 adults aged 25-45 who completed a workplace-style problem-solving task with or without a generative AI assistant, followed by an unassisted module. AI improves performance for all participants, but gains are larger among those with less education. Without AI, higher-education participants outperform lower-education participants by 0.548 standard deviations; with AI, the gap falls to 0.139, closing about three-quarters of the initial differenc
productivity
research · arXiv ·
Navigating the skill diversity frontier: How skill complexity explains worker resilience
Workers with diverse skill portfolios relative to their specialisation level show greater occupational mobility and lower automation exposure than similarly specialised peers.
As artificial intelligence transforms labor markets, understanding what makes workers adaptable has become increasingly important. Existing approaches typically characterize human capital using occupations, educational credentials, or predefined skill taxonomies, providing limited insight into how the structure of workers' skill portfolios shapes resilience to technological change. We develop an agnostic network based framework that reconstructs the hierarchy and diversity of skills directly from observed patterns of skill co occurrence. Using longitudinal data on 2.4 million United States wor
jobs skills
research · NBER ·
Canaries in the Gold Mine: Early Productivity Gains from Artificial Intelligence Creating Organization Capital
A firm-level AI investment measure shows AI-skilled hiring predicts productivity growth only in recent years, linked to organizational capital building.
Using a new firm-level measure of AI investment based on AI-skilled employmentspanning machine learning through generative and agentic AIwe show that AI investments are associated with productivity growth in recent years, but not over the previous decade. We trace the productivity gains to the (Tania Babina , Alex X. He , Renhao Jiang)
productivity
research · NBER ·
What Work Does Generative AI Do?
First task-level indexes of generative AI adoption from a nationally representative survey linked to detailed occupations and tasks.
We measure how workers use genAI for their jobs in a nationally representative survey linking genAI adoption to detailed occupations and tasks. Our data provide the first task-level genAI adoption indexes, which we show can inform analyses of genAIs labor market impact. Exposure scores explain some, (Alexander Bick , Adam Blandin , David J. Deming , Tyler R. Schumacher)
adoption
research · NBER ·
Replaceable but Employed: Automation and the Meaning of Work
Automation can reduce worker meaning and satisfaction by making their contribution feel replaceable, even when their job is not eliminated.
Can automation harm workers without replacing them? We study jobs in which workers value both producing useful output and knowing that the output depends on their own contribution. A credible machine alternative can weaken that second source of meaning even when the firm retains the worker. Our (Joshua S. Gans)
worker experience
practice · martinfowler.com ·
The Conductor Developer
As AI writes more code, developer bottleneck shifts from coding speed to managing attention and coordination across AI agents.
TL;DR Why I think software development is starting to feel a little more like conducting an orchestra. There’s a shift happening in software development that I don’t think we’re talking about clearly enough. For the last couple of years we’ve framed AI as a productivity tool. How much faster can it write code? How many more features can we ship? How much cheaper can we build software? I think that’s the wrong question, but I understand why. The first thing AI became good at was writing code, so naturally that’s where we focused. As AI got better at coding, I expected the bottlenecks to move th
management org
research · arXiv ·
The Deployment Wall: A Diagnostic Framework and Instrument for Enterprise AI in the Deployment Era
Framework explaining why 95% of enterprise AI pilots fail to deliver profit-and-loss impact: organizational friction, not model capability, is the core problem.
Enterprise investment in generative artificial intelligence (AI) tripled in a single year to roughly US$37 billion, yet independent field research finds that about 95% of enterprise generative-AI pilots deliver no measurable profit-and-loss impact. We argue that the dominant explanation--that models are not yet capable enough--is mistaken, and that enterprise AI has entered a Deployment Era in which advantage derives not from model intelligence but from the removal of the organizational and architectural friction that prevents a capable model from reaching production. Building on the software-
adoption
research · Organization Science ·
Worker Repositioning and Technological Change: Evidence from an Online Labor Market
Freelancers exposed to ChatGPT shifted away from affected skills and moved toward higher-value contracts, with adjustment costs constraining senior workers.
Technological change reshapes labor markets not only by changing labor demand but also by altering labor supply, as workers reallocate effort across tasks and opportunities in response to technological advances. Yet research has focused more on demand-side effects than on how workers themselves adapt. In this research, we examine worker repositioning on a large online labor market following the launch of ChatGPT in November 2022. We argue that the launch of ChatGPT reduced expected returns to labor in exposed skill domains and develop and test a series of hypotheses regarding how this shock is
jobs skills
research · arXiv ·
Voice AI in Firms: A Natural Field Experiment on Automated Job Interviews
A field experiment with 70,000 job applicants shows AI voice agents conducting interviews increase job offers by 12% and worker retention, with no productivity loss.
We study AI agents as information-collection technologies: automated systems that elicit decision-relevant signals from humans through live interactions. We test how such AI automation impacts information collection and organizational outcomes using a natural field experiment with 70,000 applicants applying for real jobs. Applicants were randomly assigned to be interviewed by either human recruiters or AI voice agents. Afterward, human recruiters evaluate the interviews and make hiring decisions. Applicants interviewed by AI agents are 12% more likely to receive job offers, and these gains tra
jobs skills
practice · Shopify Engineering ·
Building an agentic harness that outlasts the model
A harness that uses agents to find code vulnerabilities, verify them with real tests, and generate Shopify-specific fixes.
We built an agentic code review and test oracle harness that discovers vulnerabilities, proves them with real tests, and provides Shopify-tuned fixes.
ways of working
research · arXiv ·
Human diversity fuels collective creativity that large language models cannot simulate or sustain
AI-generated ideas compress collective diversity in creative work, especially for non-native speakers, but AI refinement preserves it.
Diverse human groups produce diverse ideas, the raw material of innovation. Generative AI challenges this engine twice over: everyday AI assistance may homogenize what diverse people create, and AI-simulated diversity may replace the people altogether. We tested both challenges in a preregistered creative metaphor experiment with native (L1) and non-native (L2) English writers, who wrote without AI, with AI-generated ideas (AI ideation), or with AI refining their own ideas (AI refinement). L2 writers contributed more collective diversity than L1 writers, with native-language ideation showing t
teams
research · arXiv ·
When LLM Agents Negotiate: Private Information and Dynamic Bargaining in Supply Chains
LLM agents in supply chain negotiations capture 95% of first-best surplus but lose 21-34% to bargaining delays; vendor identity predicts surplus division more than model capability.
As LLM agents move from decision support to autonomous procurement, firms need to know whether delegated negotiators create value, divide it predictably, and avoid money-losing contracts. We study this in a canonical supply chain bargaining problem: a buyer with private demand information negotiates a quantity-payment contract with an uninformed seller. We benchmark nine LLMs from OpenAI, Google, and Alibaba against a validated Perfect Bayesian Equilibrium across 9,840 LLM-to-LLM negotiations. First, capability governs value creation. Agents agree in 98.9% of negotiations and capture 95.4% of
adoption
research · arXiv ·
Faster, Higher, Stronger? The Impact of GenAI on Knowledge Work Productivity - Evidence from the Field
Randomized field experiment shows GenAI boosts efficiency across knowledge tasks but improves quality only for packaging and creation, not acquisition.
The rise of generative artificial intelligence (GenAI) has fueled high expectations regarding its potential to enhance knowledge work productivity in terms of efficiency and quality. Building on task-technology fit (TTF) theory, we empirically examine the extent of GenAI's productivity effect for different task types. We conducted a randomized lab-in-the-field experiment with 128 knowledge workers from a multinational industrial organization. Participants completed three representative knowledge work tasks (knowledge acquisition, packaging, and creation), either with or without GenAI. Results
productivity
research · Information Systems Research ·
The Indirect Disclosure Effect: How Disclosing Generative AI Use Impacts Human Creative Collaboration with AI
Disclosing AI use to lay audiences caused creators to withdraw from creative work and cede control to AI, fearing reduced attribution of human agency.
Generative AI disclosure rules aim to protect audiences from deception, preserving human creativity and self-expression. Yet disclosure may change not only how audiences evaluate creative work but also how creators produce it. In two experiments involving collaboration with a text-to-image generative AI tool, we identify an indirect disclosure effect. When creators anticipated that their AI use would be disclosed to a lay audience, most withdrew from the creative process and gave the AI greater control. They did so because they feared that audiences would discount their human creative agency a
worker experience
practice · Hacker News ·
My current strategy is to not read any of the code written by my agents
A developer deliberately skips reading AI-generated code, trusting tests instead of code review for validation.
https://xcancel.com/unclebobmartin/status/2080257779395154409?s=20
judgment
practice · Laurie Voss ·
Did OpenAI hack Hugging Face or didn't they?
OpenAI's autonomous agent penetrated Hugging Face's systems; raising questions about AI agent safety, liability and law enforcement response.
On July 16, Hugging Face reported they were being hacked - seriously enough that they reported it to law enforcement. Five days later, OpenAI disclosed that the hacking was being done by their own agent. What I want to know is: what happened to the law enforcement? OpenAI unleashed an agent that committed what would be a crime if a) it had been a person doing it or b) anyone at OpenAI had intended it to go anywhere near Hugging Face, but neither of those is true. But it still looks like a crime. OpenAI co-authored a paper predicting exactly this behavior, so is it criminal recklessness? Are we
judgment · Laurie Voss
research · Proceedings of the National Academy of Sciences ·
When coordination is avoidable: A monotonicity analysis of organizational tasks
Analysis shows 42-74% of organisational tasks may not require coordination for correctness, with implications for multiagent AI system design and coordination spending.
Organizations devote substantial resources to coordination, yet which tasks actually require it for correctness remains unclear. The problem is acute in multiagent AI systems, where coordination cost is directly measurable and can exceed the cost of the work itself. Distributed systems theory provides a precise criterion: Coordination is required when a task specification is nonmonotonic, meaning that as histories grow, new information can invalidate prior conclusions. Here we show that Thompson's classic taxonomy of interdependence maps to that criterion, yielding a decision rule for when coo
0research · Research Policy ·
How experience moderates the impact of AI suggestions on researchers' perceptions of their ideas
Experienced researchers are less likely to adopt AI suggestions for new research ideas and perceive them as less novel than less experienced peers.
At the heart of scientific discovery are researchers who identify ideas worthy of inquiry. In performing research tasks, researchers increasingly use generative artificial intelligence (AI) technologies. While this technology offers the promise of increased efficiency across the research process, little is known about how generative AI assists researchers with the generation of initial research ideas—one of the most fundamental tasks in science—and their willingness to adopt it for such purpose. In a pre-registered randomized online experiment with 310 researchers and a follow-up ideation stud
adoption
practice · Jason Fried ·
Mistaking making for the thing you've made
Development metrics and work style don't predict product quality; focus on customer experience and utility instead.
The speed at which a product is developed doesn't inherently make the product better or worse. The number of commits doesn't make the product better or worse. The number of people or agents working on it doesn't make it better or worse. The number of hours you’re pouring into it doesn’t make it better or worse. Working on a weekend, or late into the evening, doesn’t make it better or worse. Talking about these things sounds like it’s talking about the product, but it’s not talking about the product. Those are all development metrics and styles of work. They don't speak to the product itself. T
management org · Jason Fried
practice · Claude Blog ·
How the product designer who built Claude Design uses it to explore ideas before building them
Product designer uses Claude to explore and iterate design ideas before building, speeding concept validation.
How the product designer who built Claude Design uses it to explore ideas before building them
ways of working
practice · Anil Dash ·
Becoming Skilled at Making Documents
A reusable prompt skill file that helps LLMs apply document-quality principles through five concrete tests.
The vast majority of the documents people use to do business are really quite poor. Presentations that make your eyes glaze over, memos that are inscrutable or unclear, and all kinds of artifacts that say more about how they were created than whatever message they were ostensibly trying to communicate. It's been one of my great frustrations for years, and a big part of why I wrote Make Better Documents a while ago. That post captured a list of the suggestions I've been giving people for years on how to make better, more effective documents that can actually do work for you, instead of fighting
ways of working · Anil Dash
research · Management Science ·
Skill Deprioritization: Reorganizing in the Age of Generative Artificial Intelligence
Firms reduced hiring demand for monitoring, task division, and exception-handling skills after ChatGPT launch, while preserving task allocation and conflict resolution roles.
How does generative artificial intelligence (GenAI) reshape the skills that organizations seek as they adapt to a new general-purpose technology? GenAI effectively retrieves data, performs analysis, and conveys information, so it can substitute for workers doing these activities and complement workers relying on them. A natural consequence is skill deprioritization, a systematic reduction in firms’ demand for human skills that GenAI can effectively address as organizations adjust the division of labor and integration of effort. We draw on a theoretically grounded classification of organizing s
jobs skills
research · Information Systems Research ·
Unraveling the Impact: An Empirical Investigation of ChatGPT’s Exclusion from Stack Overflow
Stack Overflow's ChatGPT ban increased answer quality but reduced participation, creating a tradeoff between content quality and community engagement.
Online platforms are struggling to decide whether and how to restrict generative AI. This study examines Stack Overflow’s ban on ChatGPT-generated content and compares user behavior with a similar programming forum on Reddit. The findings reveal an important tradeoff: After the restriction, Stack Overflow answers became longer, more positive, more linguistically complex, and received more net upvotes, suggesting that human contributors responded by signaling greater expertise and that peers perceived the answers as higher quality. However, the policy also reduced overall participation, includi
adoption
research · arXiv ·
Google's AI & Economy ATLAS v1.0: Mapping Gemini Usage in the Economy
AI adoption spans 88% of US employment but remains shallow and collaborative; end-to-end automation is limited in scope.
This paper introduces the AI & Economy ATLAS (Activity, Task, Landscape, and Adoption Study), an ongoing economic research initiative using Google AI usage data. The first iteration of ATLAS is built on 15 million de-identified interactions across the Gemini App, Google AI Mode, and Gemini API. Using privacy-preserving algorithms as well as established and bespoke classification methods, we map AI usage to over 800 occupations, 4000 tasks, 300 household activities, 150 countries, and 140 languages. We then make a number of observations on what the data reveals about AI's diffusion, and its usa
adoption
research · arXiv ·
Mitigating Fabrication in Multi-Stage LLM Pipelines for Hiring: An Empirical Evaluation of Prompt Guardrails and Human-in-the-Loop Checkpoints
Multi-stage LLM hiring pipelines fabricate credentials in 97% of cases; prompt guardrails cut this by 86%, human checkpoints by 59%.
Multi-stage LLM hiring pipelines (resume improvement, interview question generation, answer feedback) can fabricate credentials, inflate qualifiers, and invent experience. We evaluate two mitigations, prompt guardrails and human-in-the-loop (HITL) checkpoints, against a fully automated baseline. In a controlled experiment (10 synthetic resumes x 2 job descriptions x 3 repetitions x 3 conditions; 180 runs), the baseline (C1) produced at least one unsupported claim in 96.7% of outputs (mean 6.80 findings/output). Prompt guardrails (C2) reduced finding density by 86% (6.80 to 0.92/output), but 50
adoption
practice · Paul Ford (Aboard) ·
The Other AI Content Paradox
News as a feature, not product; AI agents will mix personalized updates with life information, disrupting traditional publishing.
I always like reading what Brian Morrissey has to say. He used to be the editor in chief of Digiday , a trade publication for the world of digital media, but for many years, he’s been on his own, publishing a newsletter called The Rebooting . He focuses on media not as a higher calling, but as a real business. Given the state of the industry, this means he writes a lot of bracing things, like this post from a month ago : There’s no shortage of handwringing over the loss of trust in news. I find this focus misguided. You cannot control others, and this is a time of low trust in all manner of in
management org · Paul Ford
practice · Kent Beck ·
How Do You Know That?
Discussion of accountability, learning and human judgment in AI-assisted work, beyond technical capability.
Stream the latest episode Listen and watch now on YouTube , Spotify , Apple , and most other major streaming platforms. Brought to you by WorkOS is the infrastructure B2B and AI-native companies use to sell to enterprise. It covers everything enterprise security requires: SSO, SCIM, RBAC, Audit Logs, AI governance, and more. Engineering teams ship it in days. Trusted by 2,000+ fast-growing companies, including OpenAI, Anthropic, Cursor, and Vercel. Augment Code is the AI coding platform engineering teams use to build in large, complex codebases. Its context engine maps your entire codebase so
judgment · Kent Beck
practice · How I AI ·
Computer & browser use in Codex (5 real examples)
Five concrete workflows using Claude's computer-use feature: QA testing, LinkedIn inbox management, shopping, and form-filling, with principles for effective prompting.
Today I’m walking you through one of my absolute favorite AI features right now: browser and computer use via Codex (the ChatGPT desktop app). I use this every single day, personally and professionally, and I wanted to share the specific workflows I’ve built, the moments that surprised me, and the mental model that makes it actually click. What you’ll learn: How browser use and computer use work, and why the Codex desktop app plus Chrome extension is the combo I rely on How I use Codex to QA my onboarding flow, including exhaustive mobile testing I would never do manually Why under-prompting f
ways of working · Claire Vo
practice · Addy Osmani ·
Software Factories, Light and Dark
Software factories run AI-agent loops with humans in or out; the hard job is choosing which checks to build and how much autonomy to delegate.
A software factory is harnessing loops at scale. You can run the loop with humans in it (light factory): trading judgment and concentration against speed and breakage. Or you can ignore the humans (dark factory) and let those agents scope, build and ship code, without anyone really reading the details. But if people stop reading, they’ll stop understanding your software. Your hardest job now is knowing which checks to build and how much autonomy to delegate. This idea of the software factory is a term that dates back to Bob Bemer’s paper, “The economics of program production,” given in 1968. F
management org · Addy Osmani
practice · martinfowler.com ·
Fragments: July 21
Verification and judgment of AI output, not code generation, is now the critical bottleneck for software teams.
With this post, I’ll wrap up my notes from the second Future of Software Development Retreat . But before I do, I should note that the full Thoughtworks report on the retreat is now available . They have five headline findings: Code generation is no longer the bottleneck — verification is. ‘Harness engineering’ is emerging as a distinct, ownable discipline. Organizations are colliding with a real apprenticeship crisis. The executive/engineer expectation gap is a bigger risk than any technical limitation. Legacy modernization is the clearest, most defensible near-term value pool. ❄ ❄ A session
judgment · Martin Fowler
practice · How I AI ·
How the founder of Morning Brew built a Claude content machine that never runs out of ideas and never sounds like slop | Alex Lieberman
Multi-stage content pipeline: idea detection, voice codification, editorial review loop, feedback learning, built in Claude.
Alex Lieberman co-founded Morning Brew in college and grew it into one of the most-read business newsletters in the world before selling it to Business Insider. Now he’s the co-founder and co-managing partner of Tenex. In this episode, Alex explains why distribution is becoming a durable moat, why founders and teams need to “climb Cringe Mountain,” and how he rebuilt his content process around AI without letting it produce generic slop. He walks us through every step of his Content Machine live: an Oracle that scans internal systems and the internet for content spikes, an interview panel that
ways of working · Claire Vo
research · Proceedings of the National Academy of Sciences ·
Measuring disparate impact in human and machine decisions
New method for detecting unjustified racial disparities in algorithmic decisions, applied to 2.2 million police stops.
Empirical analyses have grown increasingly important in discrimination litigation with the greater availability of detailed data on individuals and decisions. A popular analytic strategy is to estimate disparities after adjusting for observed covariates, typically with a regression model, in hopes of ferreting out discriminatory intent. This approach, however, is ill-suited to auditing algorithms that are now commonly used to aid decisions, which typically do not include race or other legally protected factors as inputs. Motivated by legal understandings of disparate impact, we introduce an ap
judgment
research · arXiv ·
Who Will Become the Next Senior? How Generative AI Erodes the Development Pathway in Software Engineering
Qualitative study finds generative AI redirects entry-level work into senior workflows, eroding the struggle through which junior developers build expertise.
Generative AI (GenAI) is reshaping software engineering, raising concerns about how the development pathway through which juniors become seniors is being eroded. While macro statistics show a decline in junior hiring and controlled studies demonstrate the effects of AI on individual task performance, the mechanisms through which GenAI reshapes early-career development in real organizational and educational contexts have not been thoroughly examined. Through 14 semi-structured interviews with juniors at the threshold of entering software engineering and senior software engineers in South Korea,
jobs skills
research · arXiv ·
Real-World Evaluation of an AI Agent Drafting Translational Impact Summaries
AI agent reduced manual research-impact documentation time from 15 hours to 14 minutes per scholar with 82% of findings accepted or edited.
Introduction. Clinical and Translational Science Award (CTSA) programs must document their scholars' research impact, but assembling each scholar's record by hand takes staff an estimated 15 hours and does not scale to a full cohort. An artificial intelligence (AI) agent could serve as a tool to gather scholar data across platforms and disciplines. Methods. We built a human-in-the-loop AI agent that assembles a dossier of sourced evidence for each scholar and drafts one-sentence Translational Science Benefits Model (TSBM) impact summaries for staff review. We evaluated it in the impact-reporti
productivity
practice · Hacker News ·
Setting up your spare Mac for Claude Code to control, a step-by-step guide
Step-by-step setup for using Claude Code to control a spare Mac remotely for autonomous work.
251 points on Hacker News. Discussion: https://news.ycombinator.com/item?id=48959392
ways of working
practice · martinfowler.com ·
The Archaeologist’s Copilot
Using AI to modernize a Java 1.5 codebase by grounding it in evidence, validation, and test-protected refactoring steps.
When people think of legacy modernization, most folks aren't imagining the target environment will be Java 8. But this was the challenge facing Nik Malykhin when he needed to run a Java 1.5 codebase on today's hardware. His early use of LLMs gave plausible answers that did not hold up in the codebase. Progress came when he grounded the process in evidence, using AI to support analysis, validation in a stable Docker environment, and gradual refactoring protected by tests. The main takeaway is practical: AI was most useful when constrained by evidence, clear roles, and a step-by-step modernizati
ways of working · Martin Fowler
research · St. Louis Fed ·
New Survey Findings on AI Adoption and Its Effects on Employment and Productivity
Regional Fed survey reports firm-level AI adoption rates, productivity effects, and barriers cited by nonadopters in the Eighth District.
Survey data show how firms across the Fed’s Eighth District are using AI to boost efficiency and expand capacity—plus what’s holding back nonadopters.
adoption
practice · Claude Blog ·
How Anthropic runs large-scale code migrations with Claude Code
Anthropic migrated large codebases using Claude Code as an agent, showing patterns for scaling code changes across projects.
How Anthropic runs large-scale code migrations with Claude Code
ways of working
research · Proceedings of the National Academy of Sciences ·
Whistleblowers can contain the unethical externalities of human–AI delegation
Controlled experiment shows whistleblower reporting can neutralize increased unethical requests when delegating tasks to AI versus human agents.
Prior work using controlled principal-agent experiments suggests two risks from delegating tasks to AI systems: Human principals are more likely to request profit-maximizing misconduct from AI agents than from human agents, and AI agents are more likely to comply. Here we test whether third-party observers can contain the resulting harm. In an incentivized die-reporting paradigm, principals instructed either a human or an AI agent how strongly to prioritize profit over accuracy, creating potential financial harm to a charity. We first confirm, with human principals ( N = 600) and three large l
judgment
practice · Paul Ford (Aboard) ·
The Big Bun Fight
Open-source communities are splitting over AI-generated code inclusion, creating competing standards and policies.
If you’re a particular kind of old-school nerd, you’re used to drama from the open-source world—people fighting about code, or more typically, about policies involving code, on mailing lists, forever. Why do they fight? It’s simple: Those same things that inspire people to give their intellectual property away to the world also, very often, inspire them to defend their intellectual and ideological turf—with an intensity that might shock an outsider. Vibe coding has become a cultural fault line in this world. See, for example, the “ Open Slopware ” repository, listing hundreds of examples of su
adoption · Paul Ford
research · arXiv ·
Persona Migration and Expectation Recalibration in Generative AI Adoption: A Longitudinal Study at a State Department of Transportation
After eight weeks using Copilot, public-sector workers revised expectations downward; 68% of initial champions became less enthusiastic.
Generative AI tools are increasingly being piloted in public agencies, but limited evidence explains how employee acceptance changes after hands-on use. This study examines Microsoft 365 Copilot adoption during an eight-week pilot at a state Department of Transportation. A matched two-wave survey measured perceived usefulness, perceived ease of use, behavioral intention, and trust before and after participation. After matching and response-quality screening, the sample included 124 employees. Nonparametric tests assessed aggregate changes, k-means clustering identified baseline acceptance pers
adoption
research · arXiv ·
When Bots Join the Team: Bot Adoption and the Institutional Fabric of Open-Source Software Projects
Bot adoption in GitHub projects correlates with more repeated collaboration, fewer conflicts, and more distinctive outputs over two-year windows.
AI agents are joining human teams, raising a basic question: when an automated agent becomes a regular participant, does group organization strengthen or weaken? We study this question in open-source software, where bots open pull requests, review code, and merge changes alongside people, leaving a public record of every interaction. Treating bots as participants rather than tools, we examine 2,991 GitHub projects for two years before and after each adopted its first bot. We measure three capabilities that institutional theory links to durable coordination - repeated engagement, social memory,
teams
research · ACM Transactions on Software Engineering and Methodology ·
Engagement in Code Review: Emotional, Behavioral, and Cognitive Dimensions in Peer vs. LLM Interactions
Engineers regulate emotions differently in LLM versus peer code reviews, using reframing, dialogic regulation, avoidance, and defensiveness strategies.
Code review is a socio-technical practice, yet how software engineers engage in Large Language Model (LLM)-assisted code reviews compared to human peer-led reviews is less understood, especially as artificial intelligence (AI) tools are increasingly integrated into software engineering (SE) workflows. We report a two-phase qualitative study with 20 software engineers to understand such dynamics. In Phase I, participants exchanged peer reviews and were interviewed about their affective responses and engagement decisions. We also prompted them to discuss their submitted code review generated by
worker experience
practice · Kent Beck ·
The Beginnings of an Idea: XP is Long Volatility
Long-term idea incubation as a deliberate practice: examining, testing and refining ideas over years before they're ready to share.
I bought my first stocks at 7. I saw an episode of Leave it to Beaver where they talked about stocks. I got $50 for Christmas (like $500 today!). I wanted to try it. My investment thesis was simple—the names of the stocks needed to contain the names of the 50 states. I got as far as Oregon Freeze-Dried Foods & Washington Natural Gas before I ran out of money. So, yeah, I’ve been investing for a while. Never took it seriously enough to make any money at it, but analogies to trading resonate for me. My history with trading is why “XP is long volatility” hit me when I heard it yesterday. My histo
ways of working · Kent Beck
practice · martinfowler.com ·
DSLs Enable Reliable Use of LLMs
Using DSLs as a harness to guide LLM code generation, with the DSL as the system's source of truth.
LLMs generate code incredibly fast, but to ensure they generate exactly what is intended, they need clear boundaries. Abstractions and Domain-Specific Languages (DSLs) provide a strong harness that guides LLMs right from the start. Unmesh Joshi describes how the example of Tickloom - a domain model and DSL for illustrating distributed system behavior - shows how we can use an LLM as a partner to iteratively build a DSL and as a natural language interface to use it. Such a DSL can act as the key source of truth for software systems in the world of LLMs. more…
ways of working · Martin Fowler
research · Proceedings of the National Academy of Sciences ·
Many AI analysts, one dataset: Navigating the agentic data science multiverse
AI analysts using LLMs produce as much analytic dispersion as human teams on the same dataset, with results steerable by persona and model choice.
Empirical conclusions depend not only on data but also on analytic decisions. Many-analyst studies have quantified this dependence: independent teams testing the same hypothesis on the same dataset regularly reach conflicting conclusions. But such studies require costly human coordination. We show that fully autonomous AI analysts built on large language models (LLMs) can, cheaply and at scale, produce the analytic dispersion observed in human many-analyst studies. In our framework, each AI analyst independently executes a complete analysis pipeline on a fixed dataset and hypothesis; a separat
judgment
research · arXiv ·
Faster AI, Uneven Frontier: Rapid Crossings, a Jagged Frontier, and the Repositioning of Human Judgment
Frontier AI systems crossed expert baselines on specific tasks between 2023-2026, but humans retain advantages in long-horizon reliability and novel problems; early field evidence suggests skill atrophy from AI use.
Between 2023 and 2026, frontier AI systems crossed documented human expert baselines on a growing set of bounded, well-specified, evaluable cognitive tasks, including graduate-level science questions, competition mathematics, software-engineering benchmarks, and structured diagnostic reasoning, while the length of tasks such systems can complete at 50% reliability doubled roughly every seven months. These crossings are rapid and broad, but the frontier is jagged: humans retain decisive advantages in long-horizon reliability, genuinely novel problems, calibrated self-knowledge, sample-efficient
judgment
practice · martinfowler.com ·
Fragments: July 13
Context management and validation patterns for AI agents: keeping harnesses small, using formal methods, shifting to stricter languages.
Some more of my notes from Thoughtworks Future of Software Development Retreat . When we had our first retreat in Utah early this year, nobody had heard of Harness Engineering . This time we had a whole session on it. When comes to the guide side of harnesses, most of the discussion is about context management. While context windows have increased is size as models get more sophisticated, that doesn’t mean that models will properly focus on the right bits. Models typically only focus attention on part of the context, and to get the best behavior, we need to manage that focus. One attendee keep
ways of working · Martin Fowler
practice · How I AI ·
This solo builder runs 24/7 local AI on his own hardware | Alex Finn
Solo builder runs coordinated local AI agents across three machine types, using failover and task allocation to automate software development continuously.
Alex Finn is an AI builder, YouTuber, and the creator of Vibe Code Academy, a community for people learning to build with AI tools. He runs one of the most ambitious local AI setups I’ve come across: three Mac Studio 512 GB machines, a DGX Spark, and a custom RTX 5090 build, all coordinated through a fleet dashboard he built himself. He’s spent five months figuring out which local models belong on which machines, how to wire them to Claude Code loops, and how to get a software factory running without babysitting it. What you’ll learn: How Alex chose between a Mac Studio (512 GB unified memory)
ways of working · Claire Vo
research · Journal of Management Studies ·
Algorithmic Status Inequality: An Integrative Perspective on AI‐Driven Social Stratification
Framework linking computational beliefs and technical inequalities to persistent status hierarchies in organisations through self-reinforcing feedback loops.
Abstract This Point introduces algorithmic status inequality that is, enduring disparities in social position, influence, and resource access reinforced by AI systems, as a critical lens for understanding technological stratification in organizations. I develop an integrative model showing how computational beliefs (i.e., cultural assumptions embedded in algorithmic design) interact with computational inequalities (i.e., disparities in technical capabilities) to produce persistent status hierarchies through self‐reinforcing feedback loops. Illustrative cases in recruitment, healthcare and lega
judgment
research · arXiv ·
Return of the solo author: The changing division of labor in science in the age of generative AI
Solo-authored scientific papers increased after ChatGPT's release in late 2022, particularly in fields where coauthors' tasks are easily replaceable.
Modern science has experienced a long shift from individual work to team production. Generative artificial intelligence (AI) might appear to extend this trajectory by lowering research costs and enabling larger-scale collaboration. Yet if tasks once performed by coauthors can be delegated to AI, the same technology may also weaken the need for collaboration in parts of the research process. Here, we examine this tension by moving beyond average team size and focusing on the solo-authored tail of the author-count distribution. Analyzing over 300 million works across 26 fields, we find that the
jobs skills
practice · Will Larson ·
Generated and suppressed demand.
Teams recovering from backlog using AI often face generated demand: suppressed requests suddenly materialize, re-drowning previously improving teams.
Eight years ago, I wrote about my theory of restoring struggling teams , which came down to four steps: A team is falling behind if each week their backlog is longer than the week before. Solve by hiring more. A team is treading water if they’re able to get their critical work done, but are not able to start paying down technical debt or start major new projects. Solve by reducing work-in-progress. A team is repaying debt when they’re able to start paying down technical debt, but progress still feels slow. Solve by staying the course: it’s actually working, you just have to keep the faith unti
management org
practice · GitHub Blog ·
Better tools made Copilot code review worse. Here’s how we actually improved it.
Rewriting agent instructions to match how reviewers actually work reduced code review cost 20% without losing quality.
Give an agent better tools and it should do better work. That’s the instinct, anyway. When you open a pull request, Copilot code review reads the diff and explores the surrounding code to find the problems that matter before they ship. To do that, it used its own code exploration tools. So when we swapped in the better-maintained, shared tools that power the Copilot CLI, grep , glob , and view , we expected a clean upgrade. Instead, in our benchmarks, we found that the cost of reviews was higher and fewer issues were being caught. But the tools weren’t the problem. The instructions were. Once
ways of working
research · Management Science ·
The Uneven Impact of Generative Artificial Intelligence on Entrepreneurial Performance: Evidence from a Field Experiment in Kenya
Field experiment shows AI business assistant reduced low-performing entrepreneurs' revenues by 10% while high performers gained 15%, revealing uneven adoption effects.
Scalable and low-cost artificial intelligence (AI) assistance has the potential to improve firm decision making and economic performance, particularly in emerging markets. However, running a business involves a wide range of open-ended problems, making it unclear whether and how recent advances in AI can help business owners around the world make better decisions. In a field experiment with Kenyan entrepreneurs, we evaluated the impact of AI advice on small business revenues and profits by randomizing access to a GPT-4-powered AI business assistant. Although we are unable to reject the null hy
adoption · Rembrand Koning
research · arXiv ·
AI Adoption in S&P 500 Firms
11% of S&P 500 firms have deeply integrated AI into business processes in 2025, up from 5% in 2022, with no measured productivity gains yet.
The adoption of artificial intelligence (AI) by large enterprises is an important potential source of aggregate productivity improvement and labor market impact. We study AI adoption of S&P 500 firms over the period 2016 to 2025, estimating adoption at the enterprise level. While generative AI tools are useful for personal and professional applications, our focus is on the deep integration of AI in the business processes of large enterprises which are bellwethers for firm adoption more broadly. We develop a novel measure to assess deep AI adoption (and distinguish it from AI hype) that is base
adoption
practice · Addy Osmani ·
Own the Outer Loop
Engineers must own the outer loop: accountability for agentic systems through quality checks, verdicts, and answerability before shipping.
In the past year, the conversation around agentic engineering has moved to harnesses and loops , fleets and software factories . My 2c is engineers need to own the outer loop - the accountability for these systems. This only gets more true as powerful models like Fable and GPT-5.6 become available. Agents have leverage, and leverage creates obligations. Someone must be able to explain exactly what changed, why it was safe, and what will happen if they’re wrong. Otherwise, their actions can’t be justified. Which makes it unlikely their organization will ask for them in the first place. And so I
management org · Addy Osmani
research · arXiv ·
How Analysts Use AI in High-Stakes Crime Linkage: An Industrial Study
Crime analysts using an AI-enabled tool selectively validated predictions against behavioural evidence, showing partial trust and reliance on established practices.
Crime linkage analysis is used in many countries to identify series of offences that may have been committed by the same individual. In practice, specialist analysts manually search for behavioural and situational connections across large crime databases, an effort that is time-consuming, cognitively demanding, and can involve repeated exposure to disturbing material. To support this work, an Artificial Intelligence (AI)-enabled decision-support tool was co-developed with a UK law enforcement agency to assist analysts in identifying likely crime linkages. This paper reports an industrial evalu
judgment
research · Léonard Boussioux ·
The Hidden Cost of AI-Assisted Creativity
AI assistance raised individual idea quality but reduced the diversity of ideas generated across groups, per new research.
MIT Sloan Management Review · with Anil Doshi, Oliver Hauser & Kartik Hosanagar — AI can raise the average quality of individual ideas while narrowing the variety of ideas produced across a group.
teams · Léonard Boussioux
research · Personnel Psychology ·
Inter‐Rater Reliability of AI Scores: A Call to Move from Correlational to Factor Analytical Estimation
Factor analysis better estimates AI reliability for text scoring than correlation when AI and human raters differ systematically.
ABSTRACT Artificial intelligence (AI), such as large language models (LLMs), is increasingly being used to score psychological and organizational constructs from text. However, the reliability and validity of these scores remains vital. Frequently, AI scores are treated as replicants of human ratings and inter‐rater reliability (IRR) is established by correlating AI and subject‐matter‐expert (SME) ratings. Yet, because LLMs may meaningfully differ from humans in ability to score text, correlating LLM scores with SME ratings is inappropriate because correlational approaches assume that AI and h
judgment
practice · GitHub Blog ·
Automating cross-repo documentation with GitHub Agentic Workflows
Agentic workflow automatically drafts feature docs in a separate repo within 45 hours of product ship, reviewed by engineers, with no new hires or process retraining.
“Where are the docs?” It’s a question nobody on a product team enjoys answering. The honest reply is usually some variant of “behind.” A writer is staring at a closed pull request, trying to reverse-engineer what changed. The pull request’s author has already moved on. By the time the doc actually publishes, the feature has shipped, sometimes more than once. That used to be us on the Aspire team (we’re a small team of 10 building dev tools for distributed apps). A few months back, we were trying to figure out how to safely bring AI into automations we already trusted. That’s when we discovered
adoption
practice · martinfowler.com ·
Experiences with local models for coding
Developer evaluated local LLMs for coding tasks with standard benchmarks and real-world use, reporting practical results and tradeoffs.
Birgitta Böckeler now reports on her recent experiences trying local LLMs for coding. She compares them using two standard tasks, and tries out the most promising model for day-to-day use. more…
ways of working · Martin Fowler
research · MIT Sloan Management Review ·
GenAI Success Metrics: Look Beyond Reduced Workload
Four-year observational study of GenAI adoption in a large university found stable staffing and hours despite AI tool introduction to leaders and professionals.
Matt Harrison Clough / Ikon Images The Research The authors performed a four-year, fixed-window observational analysis of administrative work inside a large U.S. public higher-education institution. Generative AI tools were introduced to executive leaders, operational leaders, and student-facing professionals throughout the organization in 2026. Staffing levels and work hours remained stable across the period studied. […]
adoption
practice · How I AI ·
What a harness is and how to build one with Claude Agent SDK
Built a custom bug-triage agent harness with Claude SDK, showing architecture, code structure, and process for encoding permissions and integrations.
Everybody is saying, “It’s not the model, it’s the harness,” but almost nobody stops to explain what a harness actually is. So I did. I built one live on the show: a Sentry bug-debugging harness for my company ChatPRD, using the Claude Agent SDK, a custom terminal UI built with the Ink library, and opinionated adapters for Sentry, Linear, GitHub, and Vercel. The harness handles evidence gathering, root-cause analysis, and follow-up artifact creation, all without me needing to type “dear agent, please fix this bug” ever again. I also walk through the architecture, share the code structure, and
ways of working · Claire Vo
research · Indeed Hiring Lab ·
AI and Job Postings: From Destruction to Creation?
Job postings may be growing faster in roles with high AI exposure, reversing earlier automation-displacement patterns.
Agentic AI may be flipping the relationship between AI exposure and job posting growth. The post AI and Job Postings: From Destruction to Creation? appeared first on Indeed Hiring Lab .
jobs skills
research · Indeed Hiring Lab ·
AI Is No Longer Just a Tech Occupation Story: It’s Spreading Across Job Titles in the US and Europe
AI job-title mentions are spreading beyond tech roles across US and European job postings.
Employers on both sides of the Atlantic are writing AI into job titles for a wide range of roles — not just software and data jobs. The post AI Is No Longer Just a Tech Occupation Story: It’s Spreading Across Job Titles in the US and Europe appeared first on Indeed Hiring Lab .
jobs skills
research · arXiv ·
Digital Fragmentation and Generative AI Use Across 103 Million Application Events
Analysis of 103 million application events shows generative AI use occurs on fragmented days, but is followed by narrower, longer, more predictable application sequences.
Knowledge workers switch between applications thousands of times per day, spending nearly a tenth of the work year transitioning between digital applications in a process called digital fragmentation. Whether this fragmentation reflects who an employee is, where they work, or what kind of day they are having, has remained an open question. We analyzed 103 million application events recorded second-by-second from 1,017 employees across eight organizations that largely employ knowledge workers (e.g., law, financial services). Day-to-day variation in fragmentation within individual employees acco
adoption
practice · martinfowler.com ·
Viability of local models for coding
Factors that determine whether local LLMs are practical for programming work, based on hands-on testing.
Birgitta Böckeler recently spent some time trying out running local LLMs for some programming tasks. In this memo she outlines the factors that influence how viable they are for the job. more…
ways of working · Martin Fowler
practice · martinfowler.com ·
Fragments: July 6
Teams are shipping agentic systems in production; patterns emerging but effectiveness criteria still unclear.
Last week, Thoughtworks ran a second Future of Software Development Retreat , this time in Europe. As with the previous event, I’ll be sharing some fragmentary thoughts on this. There were five parallel streams, so I could, at best, only attend ⅕ of sessions. This isn’t an event that forms conclusions, rather one that allows those exploring to share what they’ve found, and their visions for the future. The bliki post lists all the writing I’ve run into on this, by myself and others. I’ll be updating it as more posts appear. Giles Edwards-Alexander “noticed a real difference between the retreat
ways of working · Martin Fowler
practice · How I AI ·
How I run autonomous coding agents from my phone with OpenAI Symphony + Linear | Alessio Fanelli (Kernel Labs)
Running autonomous coding agents from a phone using OpenAI Symphony and Linear as a state machine, with zero monitoring required.
Alessio Fanelli , founder of Kernel Labs and co-host of Latent Space podcast, walks us through two very different AI workflows: (1) a fully autonomous coding setup using OpenAI Symphony + Linear, where Linear acts as a state machine and Symphony manages agents through the whole dev lifecycle with zero babysitting; (2) Codex with browser access searching eBay for underpriced Pokémon cards—autonomously browsing, extracting PSA certificate numbers, and flagging deals on $10K–$20K cards for his San Carlos card shop, Merlin Games. What you’ll learn: Why “agent manager” is a better mental model than
ways of working · Claire Vo
practice · Laurie Voss ·
AI has torched the market for junior programmers
Junior programmer employment fell 19% since late 2022, while experienced developers grew; new coding roles emerged outside traditional programming titles.
In early 2025 I predicted that AI will create many, many more programmers , and that new programming jobs would look different. In March I checked in and found startups substituting compute for labor at record rates , with the wave of new jobs nowhere in sight. This post is the next check-in, and I have good news and bad news. The bad news: AI has torched the market for junior programmers. The good news: the long tail of new programmers I predicted has materialized, but with a big twist: they don't call themselves programmers . Let me show you the data, and see if you believe me. The market fo
jobs skills · Laurie Voss
practice · Addy Osmani ·
Agentic Autonomy Levels
Framework for choosing autonomy levels for different AI agent tasks, from low-risk reversible actions to manager agents delegating to fleets.
In most conversations about agentic engineering, the action has changed from prompting to operating . Here’s a frontier looking into the fog: software factories, goals, loops, background sessions, subagents, hooks, sandboxes, agent-approving agents . For many creators of the future, this behavior will be baked into products day-1: Claude Code and Codex expose the shift directly. From the engineer standpoint, you’ll use low autonomy to limit risk and increase reversibility, but use higher autonomy for explicit activities, and fleets of parallel agents safely refactoring massive codebases. The c
ways of working · Addy Osmani
practice · Charity Majors ·
In defense of AI mandates
AI mandates can work when framed as collective learning investments with explicit permission to slow down and miss deadlines.
I’ve been writing a series of pieces on lessons learned from our AI journey at Honeycomb . I’ve written about the tension between enthusiasts and skeptics , the need for engineering rigor , and the ethics of using tools with externalities and a seedy backstory . Today I want to send you off to a long July 4th weekend with a short but passionate defense of that most despised of management tools, the technology mandate. Nobody likes mandates I have read many a tweet or post from engineers exploding with rage over the pointless, counterproductive AI mandates they have endured at work. I have also
management org · Charity Majors
research · HBS AI Institute ·
AI is Giving Workers More Focus Time. Now What?
A six-month randomized trial across industries found generative AI increases worker focus time and flow states.
A six-month, cross-industry randomized trial shows how generative AI is reshaping work. Listen to this article: The promise of psychologist Mihaly Csikszentmihalyi’s “flow theory” is that people do their best work when they can enter a flow state, or stay deeply engaged in a challenging task without constant interruption. Yet the structure of knowledge work […] The post AI is Giving Workers More Focus Time. Now What? appeared first on Harvard Business School AI Institute .
productivity
practice · Geoffrey Litt ·
Understanding is the new bottleneck
Code understanding techniques, explainer docs, quizzes, micro-worlds, help developers maintain agency when AI agents write code.
July 2026 Understanding is the new bottleneck This is a written version of a talk I gave at the AI Engineer conference in July 2026, also shared as a tweet thread. Hot take: I think it's still important to understand the code that our agents write! In this talk I'll explain why that's the case, and show some ideas for how to efficiently understand code. Alright, let's dive in. Agents are writing more and more code for us, and we all know it's getting harder to keep up. But the good news is: there are many ways to understand code! Reading diffs line by line is not the only way. Most of this tal
judgment · Geoffrey Litt
research · arXiv ·
You Shall Not Pass! Where and Why Developers Draw The Line on AI Autonomy
Developers accept less AI autonomy for identity-defining and design work, more for high-demand tasks; task identity and accountability shape delegation choices.
As AI takes on more software work, the line between human and AI effort is shifting. Where developers draw that line around AI autonomy bears on how we design tools and roles that preserve meaningful work. Drawing on cognitive appraisal theory, work design, and automation research, we conducted a mixed-methods study of 448 professional developers at Microsoft to investigate their accepted levels of AI autonomy across software engineering work. Most developers accepted AI producing work under their oversight, although accepted autonomy varied substantively across tasks and individuals. Acceptan
worker experience
research · arXiv ·
A Simple Solution to Improving Human Supervision of Algorithms: Evidence from Smart Vending
Field experiment shows constrained override policies improve AI supervision: limiting workers to two overrides per machine increased inventory reduction without harming sales.
Organizations increasingly deploy autonomous artificial intelligence (AI) systems for operational decisions, such as inventory replenishment. Yet fully granting override rights can degrade performance due to human bias and noise, while prohibiting them may overlook valuable private information. This raises a key question: How should override rights be structured to improve human supervision of autonomous AI? Methodology/results: We propose a constrained override policy that limits overrides per decision episode to enable selective filtering that prioritizes high-value overrides. We tested it t
adoption
research · NBER ·
AI Premium
Analysis of 380 trillion tokens of real LLM usage across 400+ models shows how AI consumption relates to firm performance, market dynamics, and worker outcomes.
Using 380 trillion tokens of realized AI consumption across more than four hundred large language models from the licensed proprietary OpenRouter dataset covering approximately 2 percent of current global monthly AI token consumption, we analyze how AI affects firms, markets, and workers. Leveraging (Nicola Borri , Aleh Tsyvinski , Yukun Liu)
adoption
practice · How I AI ·
Sonnet 5 review: I ran 64 generations to find out if it's worth it
Claire Vo built a repeatable eval harness to compare frontier models across PRD quality, prototypes, agentic tasks, and agent personality using hybrid human-LLM scoring.
I’ve been testing every major frontier model release since the start of the year, and when Anthropic dropped Sonnet 5, I wanted more than a vibe check. I got tired of one-off tests I couldn’t repeat or compare over time, so I built something better: the How I AI Bench, a repeatable eval harness I constructed live using Claude Code while recording this episode. I ran Sonnet 5 blind against four other frontier models (Sonnet 4.6, Opus 4.8, GPT-5.5, and Gemini 3 Pro) across PRD quality, prototype generation, agentic task completion, and agent personality. The results were not what I expected. Wha
ways of working · Claire Vo
practice · One Useful Thing ·
The twilight of the chatbots
AI models now complete complex multi-week projects autonomously in hours, measured by multiple independent benchmarks showing exponential capability gains.
If you feel like things are accelerating in AI, you are probably right. Better AI models from the leading American AI labs have been releasing more quickly than ever (though government interventions stopped access temporarily to two of the most powerful models, Claude Fable and GPT-5.6). But it isn't just release timing. The evidence points to accelerating capability gains as well (though the frontier stays jagged, and AIs remain weak in many places). This is especially obvious when we look at the ability of AIs to do real work. There are a few good assessments that try to measure how much hum
productivity · Ethan Mollick
research · arXiv ·
The Organizational Behavior of Agentic AI: Collective Intelligence in Human-Agent Workflows
Multi-agent AI systems exhibit organizational behavior patterns, differentiated work, coordination, routines, but sustained by context architecture rather than human motivation or trust.
Agentic artificial intelligence is increasingly deployed not as a single assistant but as a collective of planners, solvers, reviewers, memory managers, tool users, and orchestrators. These systems are entering organisational workflows under familiar labels such as teams, managers, committees, markets, and workflows. This article asks whether such agent collectives exhibit organisational behaviour in a sense that is analytically comparable to, yet distinct from, human organisational behaviour. I argue that agentic AI is a partial organisational analogue. It resembles a human organisation becau
adoption
practice · How I AI ·
No Figma. No Jira. No docs. How Gusto built a new product line with Claude Code | Eddie Kim (CTO)
Five-person team built a production AI product in 10 weeks by eliminating planning docs, using async code review as product decisions, and pairing designers with Claude Code.
Eddie Kim is the co-founder and CTO of the payroll and HR platform Gusto, which just crossed $1 billion in revenue and serves more than 500,000 small businesses. Recently he did something most CTOs don’t: he went back to writing code. With three other engineers and one designer, Eddie built Gusto Cofounder, a net-new AI product, from zero code to a tier-one launch in 10 weeks. He walks through how that team actually worked, why they threw out nearly every process, and how anyone can copy the approach. What you’ll learn: The trash-can method: how to write, review, and delete a full PR as a prod
ways of working · Claire Vo