What one Big Law firm is doing to eliminate 'AI pilot fatigue'

In the fast-paced world of legal services, firms are inundated with proposals from tech startups that promise enhancements in research efficiency, drafting speed, and overall profitability. However, for law firm leaders, the task has evolved beyond just identifying beneficial tools; it now includes managing the overwhelming influx of AI software demonstrations and trials that often lead to wasted resources. Andrew Woolfe, the Chief Strategy and Innovation Officer at Cozen O'Connor, a prominent law firm with over 1,000 attorneys and approximately $800 million in annual revenue, has coined the term "pilot fatigue" to describe the challenge organizations face when employees are tasked with evaluating too many new products simultaneously. In his discussion with Business Insider, Woolfe highlighted the reality of pilot fatigue and how it can detract from productive work. Cozen O'Connor has altered its approach to technology testing, moving away from indiscriminate piloting and instead focusing on prioritizing tools that demonstrate real potential. Woolfe noted that the firm now emphasizes the importance of defining success criteria before initiating any pilot program. High usage rates can justify broader implementation, but the firm also considers qualitative factors, such as whether an AI tool integrates into existing workflows, improves client outcomes, or enhances job satisfaction for lawyers. Feedback from attorneys plays a crucial role in determining which technologies are ultimately adopted. The firm is deliberate in selecting participants for pilot programs and in managing the demands placed on them. Cozen O'Connor tends to favor tools that have the potential for widespread adoption among its lawyers, particularly those that could yield insights applicable across various practice areas. However, specialized software is also on the table if a smaller group can convincingly demonstrate its value. Each pilot, regardless of its outcome, contributes to the firm's overall capacity to assess new technologies, train its lawyers, and adapt to change. Woolfe emphasized the importance of asking, "What will help us build our institutional capability around AI?" So far, Cozen O'Connor has tested various AI solutions, including Laurel for time tracking, DeepJudge for customized search engine creation, and Harvey for broader law firm applications. Despite the continuous stream of technology evaluation requests from both software developers and internal lawyers, Woolfe acknowledged the constraints of time and budget. He stated that the firm must strategically invest in a few key areas to ensure meaningful benefits for both attorneys and clients.