We lead MIT’s FutureTech program on the economics of AI: Don’t ask if AI can do the job, ask how much it costs

We lead MIT’s FutureTech program on the economics of AI: Don’t ask if AI can do the job, ask how much it costs

Every week seems to bring a major new advance in AI’s ability to do heretofore human-only work, heightening concerns of large-scale and rapid job loss for knowledge workers. Our research at MIT FutureTech suggests the reality is likely to be much more nuanced, with cost, not just capabilities, playing a major role. Our study of computer vision made this case first. Most research on “AI exposure” measures which tasks AI could potentially perform, focusing on where the technology might develop. That’s a far cry from what we studied: whether firms would actually choose to automate those tasks once they had to pay to build, deploy and maintain the AI system. Across about 1,000 vision tasks in roughly 800 U.S. occupations, only 23% of the wages paid for those tasks were worth automating at the costs of the time. The reason is fixed cost. A system costs about the same to build whether it replaces an hour of one worker’s day or the shifts of a hundred workers. Consider a bakery that wants to use computer vision to check for ingredient spoilage. If you are the Wonder Bread factory, producing 70+ million loaves of bread per year, it might make sense to automate this task. If you are a corner bakery, any reasonable amount of upfront fixed costs will quickly eclipse your labor savings. So the factory automates and the bakery keeps its bakers. Generative AI, the AI powering large language models, is different. A general-purpose model sold by the token is far cheaper to start using than a custom vision system, so the fixed-cost barrier is lower. Our newer research asks how good that work is. Experienced workers graded AI output on more than 6,000 text-based tasks from the Labor Department’s occupational database, over 60,000 evaluations in all. The most capable models produced work usable as-is about two-thirds of the time. That is impressive, but a two-thirds success rate can hide two different realities: AI may handle some tasks well every time and others poorly, or succeed at a given task only some of the time. Either way, firms must work out where AI can be trusted, and pay people to review its work or do the rest. That is part of the real cost of AI. Moving from “usually right” to “reliably right” is often the most expensive step. For most tasks, AI is a collaborator rather than a replacement. It is also improving like a rising tide, steadily and across most tasks at once, not in sudden waves that sweep away one occupation overnight. Of course, even gradual automation changes what work is worth. But here again the impact is nuanced, because the wage effect depends on which part of a job is automated. For example, when GPS became readily accessible on simple mobile devices, the expertise required of taxi drivers fell, and so did their wages. Conversely, when software took over routine checking from proofreaders, the remaining work demanded more expertise, and wages rose. The same technology can raise pay in one occupation and lower it in another. The lesson for all is to look past AI exposure. Capabilities matter, but business leaders in particular should judge AI by its full cost per task, including review and correction, not by demos. Policymakers should track AI’s cost and reliability, not just its capabilities. And workers and employers should ask which part of a job AI takes, because that decides whether the remaining work is worth more or less. Firms will hand work to AI when it is cheaper than a person, not when a demo says it can do the job. That point will arrive task by task and firm by firm, and which tasks go first will decide whose pay rises and whose falls. So the question to ask is not whether AI can do the job. It is what it costs. The opinions expressed in Fortune.com commentary pieces are solely the views of their authors and do not necessarily reflect the opinions and beliefs of Fortune.

Original Source

Read the full article at Fortune →

KhanList aggregates and links to publicly available news content. We do not host full articles from third-party sources. Always verify important information with original sources.