BARBRI Research (August 6): Firms Grade Their Own AI Rollouts a C — No Firm Has Built the Competency Framework Its Pipeline Needs; Billable Hour Is the Structural Barrier

BARBRI Professional Education published "Driving Change and ROI: Uniting Three Teams to Lead Law Firms into the Future" on August 6 — the most operationally specific research on AI rollout failure published this year. Based on in-depth interviews with ten leaders across nine firms (Am Law 100 partnerships to a tech-enabled firm outside the traditional model), the findings are consistent with the broader pattern: firms know who has activated AI tools, but almost none knows who has actually changed the way they work; no firm has built the AI competency framework its associate pipeline needs; collaboration between Innovation and L&D teams is improving but still fragile; firms grade their own rollouts a C. The structural diagnosis is direct: the billable hour is the most stubborn barrier to AI adoption, and training alone cannot fix it. When productivity gains don't produce corresponding revenue recognition, the incentive structure pushes against behavioural change. The Innovation, L&D, and KM teams needed to drive adoption are "elbowing for the same territory, or nobody owns it at all." As one former L&D director told the researchers: "The problem is that the AI arrived before the infrastructure and backup was ready. Firms bought Harvey seats and CoCounsel licences at speed, then discovered that measuring behaviour change requires someone whose actual job is to measure it." For legal engineers and innovation directors: the BARBRI data confirm what inside-the-firm observation has been accumulating: AI deployment is a software procurement problem that has been mostly solved; AI adoption is an organisational design problem that has barely been started. The firms that will win the next phase are those that can connect AI output to measurable outcomes — matter economics, client value delivered, capability development — and build the management layer to sustain that connection.