I am the co-founder and chief strategy officer at LexFusion, the go-to-market collective of legal innovation companies (tech and services). I am also the co-founder of Procertas (competency-based tech training). I was a BigLaw litigator and then in-house counsel who went into legal operations consulting before one of my BigLaw consulting clients hired me full-time to help them build the biggest and best legal project management team in world. A Lean Six Sigma black belt, I tend to think in terms of scalable systems that properly leverage people through process and technology. I am deeply experienced in legal operations, legal tech, strategic sourcing, process improvement, systems re-engineering, and value storytelling, in addition to spending over a decade in the legal trenches as a practitioner. I’ve long served  as a mesh point between law departments and law firms to promote structured dialogue that fosters deep supplier relationships (read about that here). I am a regular writer and speaker on practical legal innovation.
Continue Reading Casey Flaherty

This week, Greg Lambert sat down with Caroline Hill, Editor-in-Chief for Legal IT Insider to discuss the new partnership with NetLaw Media. Hill described the new partnership between Legal IT Insider and NetLaw Media as a mutually beneficial collaboration with significant synergy between the two organizations. She emphasized the complementarity of their focuses, with Legal IT Insider’s emphasis on impartial coverage and promotion of various conferences in the legal tech sector, and NetLaw Media’s focus on technology and IT security. Hill noted that both organizations share common sponsors and audiences, which enhances the partnership’s potential​​.

She also mentioned the importance of working with Frances Anderson, the chief executive of NetLaw Media. Hill pointed out that NetLaw Media has been running the British Legal Technology Forum for years, indicating a deep involvement in the legal tech community.

Greg and Caroline also discussed the dramatic change in Legal Tech in 2023, and the continued shift in the industry as demands increase on law firms and others to truly implement AI solutions in 2024.

Hill pointed out that many law firms lack the expertise to build AI solutions themselves and therefore rely heavily on their business partners (vendors) for these capabilities. She suggested that the solution might lie in leaning on these business partners, but noted the challenge of justifying the costs to law firm leadership. She further mentioned the challenge of capacity and waitlists for AI projects, indicating that this has become a source of competition among law firms. The ability to quickly understand and adapt to the requirements of working with AI and establish effective vendor relationships is crucial for law firms to stay competitive and relevant in the rapidly evolving legal tech landscape​​.

Listen on mobile platforms:  ⁠⁠⁠Apple Podcasts⁠⁠⁠ |  ⁠⁠⁠Spotify⁠⁠⁠ | ⁠⁠YouTube⁠⁠

⁠⁠⁠⁠⁠⁠⁠⁠

Contact Us: 

Twitter: ⁠⁠⁠⁠⁠@gebauerm⁠⁠⁠⁠⁠, or ⁠⁠⁠⁠⁠@glambert

⁠⁠⁠⁠⁠Threads: @glambertpod or @gebauerm66

Email: geekinreviewpodcast@gmail.com

Music: ⁠⁠⁠⁠⁠⁠⁠Jerry David DeCicca⁠⁠⁠⁠

⁠Transcript

Continue Reading Navigating the Future of Legal Tech with Caroline Hill (TGIR Ep. 233)

This is the first in a 3-part blog post, it first appeared on The Sente Playbook.  The other 2 posts are co-authored by Toby Brown and Greg Lambert and will follow later this week. Apologies for the length of this post, but I was channeling my inner Casey Flaherty.
The Big Idea:  The data that Goldman used is insufficient to make the claims about Generative AI’s effect on legal that their report did.
Key Take-Aways:
  • Reporting about this report is sloppy
  • Reporting within this report is sloppy
  • The underlying data doesn’t tell us much meaningful
  • 3 Geeks attempts to find meaningful data
On March 26th, 2023 Goldman Sachs sent shockwaves through the legal industry by publishing a report claiming that 44% of “something” in the Legal Industry was going to be replaced by Generative AI.  I didn’t question that stat at the time, because it sounded about right to me.  I suspect that was true for most people who know the legal industry.  As I’ve heard this stat repeated by multiple AI purveyors actively scaring lawyers into buying their products or services, I eventually started to question its validity.
I started by looking into the press coverage of that 44% number and was immediately confused.  (All emphasis below added by me.)

Law.com  – March 29, 2023
Generative AI Could Automate Almost Half of All Legal Tasks, Goldman Sachs Estimates
“Goldman Sachs estimated that generative AI could automate 44% of legal tasks in the U.S. “

Observer – March 30, 2023
Two-Thirds of Jobs Are at Risk: Goldman Sachs A.I. Study
“The investment bank’s economists estimate that 46% of administrative positions, 44% of legal positions, and 37% of engineering jobs could be replaced by artificial intelligence.

NY Times – April 10, 2023
A.I. Is Coming for Lawyers, Again
“Another research report, by economists at Goldman Sachs, estimated that 44 percent of legal work could be automated.”

Okay, so which is it?  Generative AI is going to replace 44% of legal tasks, positions, or work?
Because those are 3 very different things; each of which would have extremely different impacts on the industry if they came to pass.  Lest you think I cherry-picked three outlying articles, go ahead and Google “AI Replace 44% Legal Goldman Sachs” and see what you get.  Those 3 articles are in my top 5 results.
My top result as of this writing is a news article from IBL News, writing last Tuesday that Goldman says,  “AI could automate 46% of tasks in administrative jobs, 44% of legal jobs, and 37% of architecture and engineering professions.”
We should probably just go back to what the Goldman Sachs report actually said and then we can chalk this up to lazy tech journalism.  Well, not so fast.  Because while the Goldman researchers clearly say “current work tasks” (see below) even that begins to fall apart once you dig into the underlying data.

What Goldman Sachs actually said in the report

Continue Reading 44% of Investment Bankers Think They Can Make Lots of Money Off of Attorney Insecurity (AI)

This week we bring in Christian Lang, the CEO and founder of LEGA, a company that provides a secure platform for law firms and legal departments to safely implement and govern the use of large language models (LLMs) like Open AI’s GPT-4, Google’s Bard, and Anthropic’s Claude. Christian talks with us about why he started LEGA, the value LEGA provides to law firms and legal departments, the challenges around security, confidentiality, and other issues as LLMs become more widely used, and how LEGA helps solve those problems.

Christian started LEGA after gaining experience working with law firms through his previous company, Reynen Court. He saw an opportunity to give law firms a way to quickly implement and test LLMs while maintaining control and governance over data and compliance. LEGA provides a sandbox environment for law firms to explore different LLMs and AI tools to find use cases. The platform handles user management, policy enforcement, and auditing to give firms visibility into how the technologies are being used.

Christian believes law firms want to use technologies like LLMs but struggle with how to do so securely and in a compliant way. LEGA allows them to get started right away without a huge investment in time or money. The platform is also flexible enough to work with any model a firm wants to use. As law firms get comfortable, LEGA will allow them to scale successful use cases across the organization.

On the challenges law firms face, Christian points to Shadow IT as people will find ways to use the technologies with or without the firm’s permission. Firms need to provide good options to users or risk losing control and oversight. He also discusses the difficulty in training new lawyers as LLMs make some tasks too easy, the coming market efficiencies in legal services, and the strategic curation of knowledge that will still require human judgment.

Some potential use cases for law firms include live chatbots, document summarization, contract review, legal research, and market intelligence gathering. As models allow for more tailored data inputs, the use cases will expand further. Overall, Christian is excited for how LLMs and AI can transform the legal industry but emphasizes that strong governance and oversight are key to implementing them successfully.

Listen on mobile platforms:  Apple Podcasts |  Spotify

 

Contact Us:

Twitter: ⁠⁠⁠⁠@gebauerm⁠⁠⁠⁠, or ⁠⁠⁠⁠@glambert⁠⁠⁠⁠
Voicemail: 713-487-7821
Email: geekinreviewpodcast@gmail.com
Music: ⁠⁠⁠⁠Jerry David DeCicca⁠⁠⁠

⁠Transcript⁠

Continue Reading Christian Lang on Governing the Rise of LLMs: How LEGA Provides a Safe Space for Law Firms to Use AI (TGIR Ep. 206)

[Ed. Note – Please welcome back Jessica de Perio Wittman & Kathleen (Katie) Brown as guest bloggers. – GL]

In case you didn’t know, the National Conference of Bar Examiners (NCBE) will release a brand-new version of the bar exam in 2026.  The NCBE conducted a study in 2018 and asked practicing attorneys and non-licensed lawyers about basic technology tasks in their law practice.  Attorneys said they expect proficiency in word processing, research platforms, electronic communication, desktop publishing, and document storage, including the cloud.  This should not be a surprise because D. Casey Flaherty has been talking about minimum tech expectations in the practice of law since 2012.  His technology audit proved that many attorneys do not possess basic technology competency per Model Rule 1.1 and Comment 8. Over 10 years later, we are still talking about the importance of technology competency in the legal profession and highlighting ever-present shortcomings in basic technology skills.  Flaherty himself stated that “lawyers in general are woefully deficient in using the software tools at their disposal – e.g., Word, Acrobat, Excel.”

Joseph Lawson, Law Library Director at the Harris County Robert W. Hainsworth Law Library, identified that a lack of time and training opportunities prevent solo and small firm practitioners from accessing legal technology.  The 2019 American Bar Association Tech Report confirms Lawson’s hypothesis:  only 28 percent of solos report the availability of technology training, while more than 95 percent of attorneys at large firms reported access to training.

Some may argue that law firms should not spend their time and money on offering basic technology training because the training should be offered in law school.  We address how law schools provide technology training in our 2023 article, “Taking on the Ethical Obligation of Technology Competency in the Academy: An Empirical Analysis of Practice-Based Technology Training Today”.  In our longitudinal study, we found that 670 technology courses were offered in the technology space.  Now, 670 courses may sound like a large number, but this number includes every e-discovery, cybersecurity, law office management, and law practice and technology course in the country.  This results in an average of 3.38 technology courses at each of the ABA-accredited law schools.  This statistic also includes the University of North Texas, which is currently the only ABA-accredited law school that mandates the completion of a Practice-Related Technology requirement for all J.D. candidates.  To learn more about how law schools are attempting to address the disconnect in technology training, we encourage you to watch the recorded version of the University of St. Thomas Law Journal Fall 2022 Symposium, A Roadmap for Law School Modernity: Teaching Technology Competence (available at https://youtu.be/hILd5qJ1G4I).

Today, the “next big thing” in legal technology is ChatGPT and generative AI, and we recognize that, in contrast, it’s not sexy to talk about basic technology skills. Or the fact that many attorneys still do not possess them.  But we need to continue having these conversations about basic technology training and possessing the requisite skills for efficient legal practice.  All attorneys should know how to:

  • Download forms from databases
  • Use formatting styles
  • Create tables of authority
  • Use Quick Parts and Autotext
  • Save Word documents as efile-ready PDFs, and
  • Set up shortcut keys to insert a section symbol.

Some believe that our law students were exposed to these basic skills because they grew up surrounded by technology.   Iantha Haight disproves the assumption of native technology competency in her article “Digital Natives, Techno Transplants: Framing Minimum Technology Standards for Law School Graduates”.  She claims that the term digital natives “lulls educators into thinking students need no additional training in technology to be prepared for the workforce.”  Even though we have started to dispel the myth of the digital native in the legal classroom, we must now deal with a new generation of law students who went to “Google School”.

What does it mean to be a Google School student?  These students were handed a Chromebook or an iPad with some (or all) of Google G Suite for Education.   Today, some colleges and universities have been using Google Workspace for Education (previously called G Suite for Education) for at least a decade.  In 2017, Google reported that about 15 million primary- and secondary-school students in the United States use Google Classroom.  By this time, Chromebooks accounted for 58 percent of mobile devices shipped to primary and secondary schools in the United States.   In 2019, Google reported that all eight Ivy League schools use G Suite for Education as a productivity tool of choice for their faculty, staff, and students.  For a discussion on how Google Schools are impacting the law school classroom, you can listen to this podcast: https://www.geeklawblog.com/2022/08/teaching-and-pressuring-law-professors-to-teach-technology-katie-brown-tgir-ep-171.html.

Law schools have the challenge of minimizing the use of Google products in the classroom because most law firms don’t allow employees to use Google apps on their work devices. Microsoft and Adobe productivity tools currently have a large footprint on the legal academy and the legal profession. As a result, there is a disconnect in technology knowledge and skill when you compare what students were accustomed to prior to law school and what they’ll be expected to know when they head into practice.  If the next gen bar exam is intended to simulate scenarios in modern-day practice, then the NCBE must also award points to test takers for successfully completing basic technology tasks that they would be expected to use in practice.  The NCBE can ask test takers to:

  • Create documents with specific margins, page numbers, and styles, like the formats expected from local court rules
  • Create a table of authorities or a table of contents
  • Draft an email using mail merge skills
  • Convert a Word document into a PDF and
  • Remove any metadata damaging to their client

We recognize that this is not a complete list, but it provides examples for how the NCBE could test basic technology skills that are expected in modern-day law practice.  Only then, can bar examiners determine whether test takers have the requisite knowledge and skills for entry-level practice.

Author Bio:

Jessica de Perio Wittman (UConn) and Kathleen (Katie) Brown (Charleston) have been friends since their law school days at Seattle University.  Although the two have lived in different states for the past 13 years and now serve as Law Library directors at their respective schools, they still manage to hold Zoom marathon writing sessions on a weekly basis.

 

 

It is pretty apparent that we are in a super Hype Cycle when it comes to AI tools like ChatGPT, but for many of us in the legal profession, we’re not used to reaching this point of the cycle at the same time as the rest of the world. Because things are happening so fast, we wanted to bring in someone like Colin Lachance from Jurisage to talk about how they are integrating Generative AI tools into their products.
Greg was going down an AI rabbit hole on Twitter this week when Colin mentioned his own project he was launching. Jurisage’s tool, MyJr (pronounced “My Junior”) is part of a joint venture between Jurisage and AltaML, and is designed to change how researchers access information by allowing the AI tool to synthesis and read cases as the researchers search and analyze the information. Rather than opening up web browser tab after tab and scanning cited cases for relevant information, the idea behind MyJr is to have it quickly answer that information for you. If you need to know what the relevant arguments are from each side in Smith v. Jones, as MyJr to pass that along to you. Ask it a plain language question, get a quick and plain language answer.
Lachance is working to use the GPT 3.5 tool to pass along cases and create what he calls “guardrails” with the cases so that the prompt and the results limit themselves to the case itself. This protects the researcher from the AI “creating” the answer from all the non-relevant information it has collected in its large language model of machine learning. Lachance has additional goals for using AI within Jurisage’s data, but he’s focused tools like MyJr establishing trust with those using it for researching Canadian, and soon US caselaw.
The MyJr product works as a browser extension and identifies Canadian and US case law citations on any web page. It delivers a preview into key details about the cited case, and a link to a free full-text version, in a popup when the user hovers over the citation. Clicking through to a “more insights” dashboard reveals additional detail as well as access to the upcoming “Chat with a case” feature (Feb 20th for Canadian case, a month later for US). While the paid version of the dashboard won’t officially launch until late March, user can get unlimited pre-sale access today as well as secure a future 50% discount option for a one-time payment of $7.

Listen on mobile platforms:  Apple Podcasts LogoApple Podcasts |  Spotify LogoSpotify
More information on Jurisage and MyJr can be found here:
Contact Us:
Twitter: @gebauerm, or @glambert
Voicemail: 713-487-7821
Email: geekinreviewpodcast@gmail.com
Music: 
Jerry David DeCicca
Transcript

Continue Reading Colin Lachance on Jurisage’s MyJr and How He’s Looking at AI to Assist in the Synthesis and Reading of Legal Cases (TGIR Ep. 190)

At present, the most universal priority for law departments is “controlling outside counsel costs” per 85% of respondents to the most recent TR Legal Department Operations Index.

I understand. I also doubt the marginal utility of simply pressing harder on the traditional levers of cost control (discounts, panels, RFPs, outside counsel guidelines, AFAs). My sometimes solicited, alternative advice:

  • Package work. Identify opportunities to enter portfolio arrangements, including integrated law relationships with New Law offerings.
  • Move work. Right source, including greater use of legal marketplaces to find the right talent at the right price.
  • Re-examine costs on autopilot. Major advances in ediscovery, ADR, court reporting, staffing, etc. present substantial, immediate spend-optimization opportunities.
  • Don’t stop investing in compliance by design. Embedding legal knowledge in business processes is the only viable, long-term approach to meeting the evolving legal needs of business in an increasingly complex operating environment.

If you want to discuss, call me, maybe.

Herein, however, I am not focused on being better. Rather, we will continue our exploration of avoiding worse. The unpalatable message remains that even when something must be done, doing nothing is superior to doing the wrong thing. Running in the wrong direction cannot be course corrected solely by redoubling our efforts.

Continue Reading Trust Fall: the limits of discounts, panels, billing guidelines, etc.

I’m not really into the whole brevity thing. I already wrote a brief post (only 800 words) that concludes with succint advice to law departments on discounts, AFAs, panels, outside counsel guidelines, RFPs, and, in particular, a humbling recommendation they not ask law firms about the use of technology unless the answers will inform structured dialogue to improve business outcomes at scale and pace (because I’d previously written a book on this subject).

At the conclusion of this off-brand concision, I promised my tiny corps of hard core readers an extended universe of nerd content. Fair warning, this is not for everyone.

Continue Reading Scary Stories about our Wicked Problems (Legal Nerd Halloween)

I should be taking a victory lap. Instead, I am on an apology tour urging in-house departments not to listen to me—i.e., ignore my long-standing advice re asking law firms about their use of technology. I’ve concluded that the common application of my advice only adds unnecessary friction to an already friction-laden system—similar to the value-subtractive frictions introduced by ubiquitous, well-intentioned, and misguided approaches to discounts, panels, outside counsel guidelines, AFAs, etc.

I understand the motivations. I also understand the constraints. Everyone operating in our space should be able to connect the dots on these four statistics:

  • 75% of GCs recognize workloads will outpace budgets (problem)
  • 80% of in-house lawyers are burned out (consequence)
  • 70% of law departments are not investing in digital transformation (unavailable solution due to resource constraints)
  • 70% of law departments are asking law firms about technology usage (attempt to cope within resource constraints)

Continue Reading Legal Buy: We’re Asking the Wrong Questions (and it is my fault, kind of)

For the first time ever, we have a guest co-host this week while Marlene wears her fancy sneakers around ILTACon seeking answers to our Crystal Ball question.
Katie Brown, Associate Dean for Information Resources at Charleston School of Law is on a mission to increase the teaching of practical technology skills to law students. In her view, law professors “are required to educate people so that they can go out into the practice and successfully do that. And so beyond just, rule 1.1 with legal technology and having that competency, for us as law schools, I think we have an ethical obligation to be teaching legal technology.” This approach needs to be embedded into the Law School’s culture, because it costs money, time, and effort to do correctly.
In upcoming research collected with University of Connecticut Law’s Jessica de Perio Wittman, Brown and de Perio Wittman calculated that on average, law students have less than 4 classes during their entire time in law school that have some aspect of teaching them the technology skills in that topic. Brown wants to see that number rise.
AALL Crystal Ball Answer

While in Denver at the AALL Conference, Katie not only answered our Crystal Ball question, she also persuaded Abby Dos Santos, Reference Librarian at Caplin & Drysdale, to sit down with her and have a conversation about the pipeline of technology teaching from law school to law firms. We cover both of those answers and then Katie turns the mic on Greg to ask what law students need to understand about court dockets before landing in law firms.

Special thanks to Katie Brown for stepping in and co-hosting this week!!

Listen on mobile platforms:  Apple Podcasts LogoApple Podcasts |  Spotify LogoSpotify
Contact Us:
Twitter: @gebauerm or @glambert
Voicemail: 713-487-7821‬
Email: geekinreviewpodcast@gmail.com
Transcript

 

Continue Reading Teaching (and Pressuring) Law Professors to Teach Technology – Katie Brown (TGIR Ep. 171)

I had the good fortune to attend the first in-person CLOC Global Institute in three years. It was an extremely positive experience. Unfortunately, I came home to find I was different kind of positive (new reality; unsurprising after three weeks of travel). I was therefore not able to timely complete my final CGI Dispatch for Artificial Lawyer. Blogs, however, have no deadlines.

To recap:

Dispatch #1 discussed the rise of legal ops in the context of ever-increasing scale, organizational complicatedness, and legal complexity.

Dispatch #2 covered the stellar pre-conference Legal Ops 101 session, highlighting the importance of education when most legal ops roles are net new and, therefore, being filled by individuals with no prior experience.

Dispatch #3 reported on the first day of CGI, which was bookended by sessions on storytelling (one of my favorite topics).

Dispatch #4 was to be a reflection piece. While I could have done without the multiple days of fatigue and brain fog, I am glad I had the opportunity to truly reflect.

Let me set the scene.

LARGE CONFERENCE ROOM — BELLAGIO, LAS VEGAS — CLOC GLOBAL INSTITUTE — LEGAL OPS 101

The presenters are lined up on stage at the end of a three-hour session built around the CLOC Core 12. The Q&A session is commencing. I am part of a sold-out audience of 170+.

Question: At a company where legal ops is new, which of the Core 12 would you start with?

Presenter1: Well, I began by getting the DMS under control.

Me (mouthing silently): What? No?

Presenter2: Typically, ebilling and outside counsel rates get attacked first.

Me (shaking head and whispering): But…but…

Presenter3: Knowledge management.

Me (clutching table and muttering compulsively): No! No! You start with the business! The business!

Presenter4: Department budgeting.

Me (spontaneously combusts)

END SCENE

The above is not a literal transcript. But it is a fair recounting of the conclusion of the excellent Legal Ops 101. What was unfair was my reaction.

While I have been wrong many times before (here, here), I stand by my substantive point in this instance. I am a broken record (most recently, here) about the importance, and unfortunate absence, of centering business needs in law department planning.

But being right is different than being fair. Continue Reading CLOC Global Institute – Reflection (Delayed)