This is the first in a 3-part blog post, it first appeared on The Sente Playbook.  The other 2 posts are co-authored by Toby Brown and Greg Lambert and will follow later this week. Apologies for the length of this post, but I was channeling my inner Casey Flaherty.
The Big Idea:  The data that Goldman used is insufficient to make the claims about Generative AI’s effect on legal that their report did.
Key Take-Aways:
  • Reporting about this report is sloppy
  • Reporting within this report is sloppy
  • The underlying data doesn’t tell us much meaningful
  • 3 Geeks attempts to find meaningful data
On March 26th, 2023 Goldman Sachs sent shockwaves through the legal industry by publishing a report claiming that 44% of “something” in the Legal Industry was going to be replaced by Generative AI.  I didn’t question that stat at the time, because it sounded about right to me.  I suspect that was true for most people who know the legal industry.  As I’ve heard this stat repeated by multiple AI purveyors actively scaring lawyers into buying their products or services, I eventually started to question its validity.
I started by looking into the press coverage of that 44% number and was immediately confused.  (All emphasis below added by me.)

Law.com  – March 29, 2023
Generative AI Could Automate Almost Half of All Legal Tasks, Goldman Sachs Estimates
“Goldman Sachs estimated that generative AI could automate 44% of legal tasks in the U.S. “

Observer – March 30, 2023
Two-Thirds of Jobs Are at Risk: Goldman Sachs A.I. Study
“The investment bank’s economists estimate that 46% of administrative positions, 44% of legal positions, and 37% of engineering jobs could be replaced by artificial intelligence.

NY Times – April 10, 2023
A.I. Is Coming for Lawyers, Again
“Another research report, by economists at Goldman Sachs, estimated that 44 percent of legal work could be automated.”

Okay, so which is it?  Generative AI is going to replace 44% of legal tasks, positions, or work?
Because those are 3 very different things; each of which would have extremely different impacts on the industry if they came to pass.  Lest you think I cherry-picked three outlying articles, go ahead and Google “AI Replace 44% Legal Goldman Sachs” and see what you get.  Those 3 articles are in my top 5 results.
My top result as of this writing is a news article from IBL News, writing last Tuesday that Goldman says,  “AI could automate 46% of tasks in administrative jobs, 44% of legal jobs, and 37% of architecture and engineering professions.”
We should probably just go back to what the Goldman Sachs report actually said and then we can chalk this up to lazy tech journalism.  Well, not so fast.  Because while the Goldman researchers clearly say “current work tasks” (see below) even that begins to fall apart once you dig into the underlying data.

What Goldman Sachs actually said in the report

Continue Reading 44% of Investment Bankers Think They Can Make Lots of Money Off of Attorney Insecurity (AI)

This week on The Geek in Review, Marlene Gebauer and Greg Lambert talk with Curt Meltzer, principal of Meltzer Consulting, LLC. Meltzer has over 40 years of experience in the legal and legal tech industry. He discusses his interest in pro bono and community outreach programs in law firms and legal tech companies. He notes that while 95% of AmLaw 200 law firms highlight pro bono work on their websites, many legal tech companies do not prioritize these efforts.

Meltzer emphasizes that pro bono and community work is good for business. It enhances company culture, helps with recruiting and retaining top talent, and strengthens customer relationships. He argues that legal tech companies should consider emulating their law firm clients’ community programs. This could include donating software or services, allowing employees paid time off for volunteer work, or collaborating directly with organizations that law firm clients support.

Meltzer highlights LexisNexis and Thomson Reuters as leaders in the legal tech industry for their work promoting access to justice and the rule of law around the world. However, he notes that companies of any size can contribute, whether through recognizing employees who volunteer or donating resources. He published a list of 41 legal tech companies that do highlight community outreach on their websites to raise awareness, though he found 39 companies with no mention of such efforts.

Meltzer sees both opportunities and challenges ahead. Private equity investment in legal tech companies may prioritize short-term profits over community programs. However, companies that do not respond to customer interest in their pro bono and corporate social responsibility initiatives risk losing business to competitors. Overall, Meltzer aims to foster conversations about strengthening the relationship between the legal tech community and the broader community. Corporations that embrace ESG programs and give back to the communities they serve will thrive.

Listen on mobile platforms:  Apple Podcasts |  Spotify

Links:

Contact Us:

Twitter: ⁠⁠⁠⁠@gebauerm⁠⁠⁠⁠, or ⁠⁠⁠⁠@glambert⁠⁠⁠⁠
Voicemail: 713-487-7821
Email: geekinreviewpodcast@gmail.com
Music: ⁠⁠⁠⁠Jerry David DeCicca⁠⁠⁠

⁠Transcript⁠


Continue Reading Curt Meltzer on Why Legal Tech Companies Should Give Back: The Business Case for Pro Bono, A2J, and Community Outreach (TGIR Ep. 207)

This week we bring in Christian Lang, the CEO and founder of LEGA, a company that provides a secure platform for law firms and legal departments to safely implement and govern the use of large language models (LLMs) like Open AI’s GPT-4, Google’s Bard, and Anthropic’s Claude. Christian talks with us about why he started LEGA, the value LEGA provides to law firms and legal departments, the challenges around security, confidentiality, and other issues as LLMs become more widely used, and how LEGA helps solve those problems.

Christian started LEGA after gaining experience working with law firms through his previous company, Reynen Court. He saw an opportunity to give law firms a way to quickly implement and test LLMs while maintaining control and governance over data and compliance. LEGA provides a sandbox environment for law firms to explore different LLMs and AI tools to find use cases. The platform handles user management, policy enforcement, and auditing to give firms visibility into how the technologies are being used.

Christian believes law firms want to use technologies like LLMs but struggle with how to do so securely and in a compliant way. LEGA allows them to get started right away without a huge investment in time or money. The platform is also flexible enough to work with any model a firm wants to use. As law firms get comfortable, LEGA will allow them to scale successful use cases across the organization.

On the challenges law firms face, Christian points to Shadow IT as people will find ways to use the technologies with or without the firm’s permission. Firms need to provide good options to users or risk losing control and oversight. He also discusses the difficulty in training new lawyers as LLMs make some tasks too easy, the coming market efficiencies in legal services, and the strategic curation of knowledge that will still require human judgment.

Some potential use cases for law firms include live chatbots, document summarization, contract review, legal research, and market intelligence gathering. As models allow for more tailored data inputs, the use cases will expand further. Overall, Christian is excited for how LLMs and AI can transform the legal industry but emphasizes that strong governance and oversight are key to implementing them successfully.

https://open.spotify.com/episode/4c2MXnFuGxZ7XczuvNJP68?si=fT0SYJdLSoOztJIVR–H1w

Listen on mobile platforms:  Apple Podcasts |  Spotify
Contact Us:

Twitter: ⁠⁠⁠⁠@gebauerm⁠⁠⁠⁠, or ⁠⁠⁠⁠@glambert⁠⁠⁠⁠
Voicemail: 713-487-7821
Email: geekinreviewpodcast@gmail.com
Music: ⁠⁠⁠⁠Jerry David DeCicca⁠⁠⁠

⁠Transcript⁠

Continue Reading Christian Lang on Governing the Rise of LLMs: How LEGA Provides a Safe Space for Law Firms to Use AI (TGIR Ep. 206)

In this 200th episode of The Geek in Review, talk with Toby Brown, CEO and founder of DV8 Legal Strategies, and Nita Sanger, Director of Digital Advisory Services at Cherry Bekaert. There are three rules for growth and success when it comes to large law firms. Strategy, strategy, and strategy.

Brown emphasizes the need for law firms to develop strategies that prioritize clients and build meaningful relationships. He argues that “firms should start thinking of clients as customers and using customer experience as a way to differentiate themselves.” Sanger shares this view, adding that law firms should “focus on value creation, continuous improvement, and customer experience” as they grow and evolve.

Both Brown and Sanger discuss how law firms can reframe their view of growth, moving away from a talent management perspective and toward a mergers and acquisitions approach. Brown highlights his experience at a prior law firm, where he transformed the lateral partner program into a strategic acquisition initiative. He explains, “this is straight up M&A. So I renamed the program the lateral partner acquisition and integration program. And we treated it much like Apple or Google or any of them would treat their acquisitions.”

Sanger and Brown also touch on the importance of integrating newly acquired practices or firms into the existing business. Sanger emphasizes the need for planning and a program management office to ensure a smooth transition, while Brown shares his success with where hist firm had one of the highest lateral retention rates in the market due to the strategic approach and focus on integration.

Looking into the future, Sanger envisions law firms as technology-enabled platforms, providing a wider range of services, while Brown expresses concerns about the reluctance of law departments and law firms to prioritize standardized business processes over the individual preferences of frontline lawyers. Despite their differing perspectives on the future, both agree that a focus on strategy, client experience, and growth through mergers and acquisitions will be crucial for the success of law firms moving forward.

Listen on mobile platforms:  Apple Podcasts LogoApple Podcasts |  Spotify LogoSpotify
Contact Us:

Twitter: ⁠⁠@gebauerm⁠⁠, or ⁠⁠@glambert⁠⁠
Voicemail: 713-487-7821
Email: geekinreviewpodcast@gmail.com
Music: ⁠⁠Jerry David DeCicca⁠

Transcript

Continue Reading Rethinking Law Firm Strategy: The Road to Growth and Success with Toby Brown and Nita Sanger (TGIR Ep. 200)

We give you the true “3 Geeks” experience on this week’s show as we are joined by an OG (original geek) Toby Brown. Toby, Marlene, and Greg talk with Litify’s President and COO, Ari Treuhaft, and Pam Wickersham, the VP of Product and Engineer there at Litify. One of the taglines at Litify is that they #BreakLegalSilos. Treuhaft and Wickersham explain what that means, and how they focus on providing an operating system, built on Salesforce, that creates transparency between Corporate Counsel and their law firms.

Both Ari and Pam got their start in Financial and Professional services, so they come at these business problems with a different approach. With Pam’s engineering background, and experiences at Google, she brings in a unique perspective on how to build the technology through the lens of the customer. Ari’s experiences with the Financial Services industry going to the cloud over a decade ago also positions him to better understand the naysayers in the legal industry who are still resistant to placing data in the cloud.

It’s a great conversation. We want to thank the great folks at City Acre Brewery in Houston, Texas for letting us record this episode there. And, for not laughing too hard as Greg destroyed his laptop by spilling an entire Maple Porter into his brand-new laptop. We hope this is a semi-regular event! (Recording at City Acre… not pouring a beer into laptops!!)

Listen on mobile platforms:  Apple Podcasts LogoApple Podcasts |  Spotify LogoSpotify
Crystal Ball Question

Toby Brown takes on our question this week by talking about the fact that attorneys are resistant to changing behaviors, not because they are unwilling to adapt to new technology, but because this is an industry that is very reputational based.

Links Mentioned:
Contact Us:

Twitter: @gebauerm@glambert, or @gnawledge
Voicemail: 713-487-7821
Email: geekinreviewpodcast@gmail.com
Music: Jerry David DeCicca

Transcript

Continue Reading Creating Actual Transparency Between Law Firms and Clients – Litify’s Ari Treuhaft and Pam Wickersham (TGIR Ep. 182)

For the first time, Law360 and Major, Lindsey, and Africa team up to survey BigLaw partners in their 2022 Partner Compensation Survey. We are joined by Craig Savitzky, Senior Data Analyst at Law360 and Jeffrey Lowe, Global Practice Leader of the Law Firm Practice at Major Lindsey and Africa. With this being the first survey of law firm partners since most firms have made some effort to return to the office, there were some surprises on how much remote work partners want to take versus how much their firms are offering. It may not be what you think.

Women and minority partners made some strong gains according to this survey in narrowing the pay gap. While the gap is still significant between women/minority partners and their white male colleagues, this was the smallest percentage in the history of the survey which began in 2010.

For the first time, the difference between average equity partner pay was more than $1 Million over average non-equity partner pay.

Savitzky and Lowe unpack a lot of data from the survey for us.

Listen on mobile platforms:  Apple Podcasts LogoApple Podcasts |  Spotify LogoSpotify

Links:

Crystal Ball Answers from LVNx

This week we talk with Properoware founder Keith Lipman, who recently merged into Litera, about the role that ALSP’s and others will play in filling the gap left by law firms when the economy begins its expected downturn.

Contact Us:

Twitter: @gebauerm or @glambert
Voicemail: 713-487-7821 (note the NEW NUMBER!)
Email: geekinreviewpodcast@gmail.com
Music: Jerry David DeCicca

Transcript

Continue Reading An Overview of the 2022 Partner Compensation Survey with Law360’s Craig Savitzky and MLA’s Jeffrey Lowe (TGIR Ep. 178)

Adam Curphey’s new book, The Legal Team of the Future: Law+ Skills guides the reader through the need for less silos in legal practice and much more reliance upon teams and collaborative efforts. The idea of a “Law+” model for the profession brings in the essential processes of adding people, business, change, and technology to the law and creating legal teams to solve legal problems.
Curphey’s experiences at law firms like White & Case LLP, Reed Smith LLP, and Mayer Brown LLP helped provide insights into what worked and didn’t work in legal innovation. His membership on the O-Shaped Lawyer Steering Board also provided the human-centric skills needed for the integration of teams into an industry filled with accomplished individuals used to going it alone. This expansion of the T-Shaped and the Delta Model Lawyers brings in more of that human interaction that is needed in today’s complex legal environment.
The Legal Team of the Future: Law+ Skills also lays out multiple case studies and examples of collaboration, teamwork, and professional progression. We talk about some of the case studies along with Adam Curphey’s view into his crystal ball on what is on the horizon for the legal industry in terms of legal innovation.

Listen on mobile platforms:  Apple Podcasts LogoApple Podcasts |  Spotify LogoSpotify
Links to Order The Legal Team of the Future: Law+ Skills
LVNx Crystal Ball Answer
This week, Purvi Sanghvi  from Paul Hastings, and a current Legal Value Network Executive Board Member, explains how the legal industry may approach a potential economic downturn in 2023, and how that must be different from the 2008 or the 2020 approaches on previous challenges to the profession.
Contact Us:
Twitter: @gebauerm or @glambert
Voicemail: 713-487-7821 (note the NEW NUMBER!)
Email: geekinreviewpodcast@gmail.com
Music: 
Jerry David DeCicca
Transcript

Continue Reading Preparing for the Legal Team of the Future – Adam Curphey (TGIR Ep. 176)

For the first time ever, we have a guest co-host this week while Marlene wears her fancy sneakers around ILTACon seeking answers to our Crystal Ball question.
Katie Brown, Associate Dean for Information Resources at Charleston School of Law is on a mission to increase the teaching of practical technology skills to law students. In her view, law professors “are required to educate people so that they can go out into the practice and successfully do that. And so beyond just, rule 1.1 with legal technology and having that competency, for us as law schools, I think we have an ethical obligation to be teaching legal technology.” This approach needs to be embedded into the Law School’s culture, because it costs money, time, and effort to do correctly.
In upcoming research collected with University of Connecticut Law’s Jessica de Perio Wittman, Brown and de Perio Wittman calculated that on average, law students have less than 4 classes during their entire time in law school that have some aspect of teaching them the technology skills in that topic. Brown wants to see that number rise.
AALL Crystal Ball Answer

While in Denver at the AALL Conference, Katie not only answered our Crystal Ball question, she also persuaded Abby Dos Santos, Reference Librarian at Caplin & Drysdale, to sit down with her and have a conversation about the pipeline of technology teaching from law school to law firms. We cover both of those answers and then Katie turns the mic on Greg to ask what law students need to understand about court dockets before landing in law firms.

Special thanks to Katie Brown for stepping in and co-hosting this week!!

Listen on mobile platforms:  Apple Podcasts LogoApple Podcasts |  Spotify LogoSpotify
Contact Us:
Twitter: @gebauerm or @glambert
Voicemail: 713-487-7821‬
Email: geekinreviewpodcast@gmail.com
Transcript

Continue Reading Teaching (and Pressuring) Law Professors to Teach Technology – Katie Brown (TGIR Ep. 171)

Five years ago, Dr. Heidi Gardner, Distinguished Fellow at Harvard Law School and co-founder, Gardner & Co, wrote the book, “Smart Collaboration” where she laid out the “why” behind smart collaboration efforts. In her upcoming sequel, “Smarter Collaboration: A New Approach to Breaking Down Barriers and Transforming Work,” Dr. Gardner explains the “who” and the “how” behind collaboration. The issues that law firms face today are incredibly complex and multifaceted. And in an industry famous for “going it alone,” that approach exposes firms to much greater risk than those who find ways of implementing “smarter collaboration” techniques. 
Smarter Collaboration helps increase revenues, profits, and efficiencies while reducing risks and improving client relationships and positive outcomes. While the idea of collaboration may sound like a “soft topic” for law firm leaders, Dr. Gardner points out that there is empirical data behind this and if firms are not engaging in smarter collaboration when doing the “real work” then they are either doing something that is pretty low value, or that falls into the realm of commodity work.  
In addition to data driven analysis, Smarter Collaboration also includes a number of examples of how companies and law firms thrive through the use of Smarter Collaboration. Plus, there is a test on determining behavioral tendencies when it comes to collaboration. This psychometric tool helps identify seven different dimensions which can lead to great collaboration within the organization, or may be barriers to collaboration. And, as strange as it may sound to those of us in the legal industry, law firms are not unique when it comes to collaborative behaviors. In fact, Dr. Gardner says law firms are more different from each other than they are from other professional services industries or large corporations.
Listen in for more details on the upcoming book, Smarter Collaboration.

Listen on mobile platforms:  Apple Podcasts LogoApple Podcasts |  Spotify LogoSpotify
AALL Crystal Ball Question
This week we have John Beatty from the University of Buffalo Law School answer our crystal ball question where he points out that the pipeline of traditional law librarians for law schools may be running dry.
Links Mentioned:
Contact Us:
Twitter: @gebauerm or @glambert
Voicemail: 713-487-7270
Email: geekinreviewpodcast@gmail.com
Transcript

Continue Reading Increased Revenue, Profits, and Efficiencies through “Smarter Collaboration” – Dr. Heidi Gardner (TGIR Ep. 169)