Tony Thai and Ashley Carlisle of HyperDraft, return to The Geek in Review podcast to provide an update on the state of generative AI in the legal industry. It has been 6 months since their last appearance, when the AI Hype Cycle was on the rise. We wanted to get them back on the show to see where we are on that hype cycle at the moment.

While hype around tools like ChatGPT has started to level off, Tony and Ashley note there is still a lot of misinformation and unrealistic expectations about what this technology can currently achieve. Over the past few months, HyperDraft has received an influx of requests from law firms and legal departments for education and consulting on how to practically apply AI like large language models. Many organizations feel pressure from management to “do something” with AI, but lack a clear understanding of the concrete problems they aim to solve. This results in a solution in search of a problem situation.

Tony and Ashley provide several key lessons learned regarding limitations of generative AI. It is not a magic bullet or panacea – you still have to put in the work to standardize processes before automating them. The technology excels at research, data extraction and summarization, but struggles to create final, high-quality legal work product. If the issue being addressed is about standardizing processes or topics, then having the ability to create 50 different ways to answer the issue doesn’t create standards, it creates chaos.

Current useful applications center on legal research, brainstorming, administrative tasks – not mission-critical legal analysis. The hype around generative AI could dampen innovation in process automation using robotic process automation and expert systems. Casetext’s acquisition by Thomson Reuters illustrates the present-day limitations of large language models trained primarily on case law.

Looking to the near future, Tony and Ashley predict the AI hype cycle will continue to fizzle out as focus shifts to education and literacy around all forms of AI. More legal tech products will likely combine specialized AI tools with large language models. And law firms may finally move towards flat rate billing models in order to meet client expectations around efficiency gains from AI.

Listen on mobile platforms:  Apple Podcasts |  Spotify

Contact Us:

Twitter: ⁠⁠⁠⁠@gebauerm⁠⁠⁠⁠, or ⁠⁠⁠⁠@glambert⁠⁠⁠⁠
Voicemail: 713-487-7821
Email: geekinreviewpodcast@gmail.com
Music: ⁠⁠⁠⁠Jerry David DeCicca⁠⁠⁠

⁠⁠TranscriptContinue Reading You Still Need to Put in the Work: Hyperdraft’s Ashley Carlisle and Tony Thai on the AI Hype Cycle (TGIR Ep. 213)

Last Thursday, a group of some 400 legal knowledge management professionals came together for the Strategic Knowledge & Innovation Legal Leaders Summit (SKILLS) conferenceOz Benamram asked me to pull together a 20 minute recap of all of the presentations that day, and share it with the 3 Geeks’ readers. So, here’s about a 20 minute recap of the 20 presentations for that day. Enjoy!!

Jason Barnwell – Keynote

There are two things that most of us know about Jason. First, he thinks there is always opportunities for improvement. Whether that is for himself, his team at Microsoft, and especially for law firms looking to better service their clients. His takeaway quote for me was when Kay Kim asked him what are law firms doing right and what are they doing wrong?

So the biggest challenge I see is, is structural, and as much as the business model works pretty well for about right now. But it doesn’t necessarily work great for where we’re going.

The other thing that we know about Jason is that if you are presenting on innovation in a law firm, he’s going to ask you specifically “is what you are doing benefitting the law firm only, or does it benefit the client?” So, expect to answer that question… at a minimum to yourself, even if Jason isn’t in the room.

Digital Transformation – Shark-TED-Talk-Tank (Part 1)

I loved all three sessions of our Shark-Ted-Talk-Tank presentations. We were just missing the three billionaires, and the large red carpet. But, the content was all there.
Continue Reading SKILLS 2022 – Recap