In the last two weeks, the MLB’s Toronto Blue Jays have made trades and acquisitions from all over the U.S.  The team is on fire, the Rogers Centre is selling to its 45,000 person capacity and there is a winning energy in the air.  But the Blue Jays,  their fans, and their latest string of new players are not the only ones who are noticing this great city.  Yesterday, Littler Mendleson, the Bay Area Headquartered AmLaw 100 Labour and Employment boutique opened its doors in Toronto and Canada.  Aside from the new spellings it will need to adopt, the opening signals what I have always held true.  Toronto is a world class city, with opportunity for the legal market that expands beyond the “6”.  I could be lamenting the consolidation of the industry and pain of the current exchange rate or the price of oil, but today, I am (possibly naively), buoyed by the energy of the announcement and the paradigm shift it represents for this legal market.  All eyes are on Toronto and thankfully this time, it’s not because of our drama generating former mayor but because of the vitality of the city and the country.  There is no doubt that the legal industry is changing, if you only ever read 3 Geeks, you’ll get a pretty good sense of the angst and possibility of the current climate, and moves like this one, remind me that not all change is bad and in fact change is the necessary evil that forces us to grow and evolve.  So, as the Canadian “Geek”, let me welcome you to Toronto.  May you enjoy the city and its energy as much as I do and Go Jays Go!

I’ve been labeled a Legal Rebel, an Innovator, and a “humorless moron.” The last one I understand. But the first two have always struck me as a slightly silly. I feel like what I am best known for—the suggestion that legal professionals should get slightly better at using the machines they’ve been staring at eight to eighteen hours a day for the last twenty years—borders on banal. I took a while to realize that the innovation was not in the call for increased proficiency but in the approach.

Instead of throwing work over the wall and then reactively complaining months later about inefficiency while reviewing information-poor invoices, I tore down the wall to proactively address root causes. I defined the problem. Measured it. Analyzed it. Then I sought to improve on the status quo and maintain control of the improvements. One would think some form of this methodology would had have been in use for the past 60 years, at least. Unfortunately, in the legal market, any disciplined approach to process improvement is somewhere between innovative and revolutionary.

What was once the Legal Tech Audit is now the Service Delivery Review (“SDR”) because (a) the word “audit” makes people uncomfortable, (b) the audit concept is too one-sided, and (c) a comprehensive vendor management program has become confused (my own fault) with its most well-known component, Basic Technology Benchmarking. While the lack of basic technology training garnered the headlines, it is only one out of ten categories in the SDR. The categories are:

  • Hardware/Software
  • Mobility
  • Training
  • Staffing
  • E-Signatures
  • Document Assembly
  • Process/Project Management
  • Knowledge Management
  • Data/Analytics
  • Billing Hygiene 

Each category is supplemented by an onsite review. I will discuss each category and the onsite review in subsequent posts.

The conceptual foundation of the SDR is this: with people and pricing in place, process offers the most levers to drive continuous improvement. When deployed correctly, the SDR serves as far more than just a finger-wagging exercise. 

The SDR is the initial step in an ongoing structured dialogue. As inside counsel, it was my responsibility to set priorities and communicate clear, achievable expectations for my outside counsel, rather than just complain in vague terms about inefficiency. It was also important for me to listen and understand how my internal team and I could assist outside counsel in achieving their objectives.

To take one example, my first SDR was of a firm that preceded my tenure in-house and, no matter what happened, was going to be there long after I left. They were the quintessential sacred cow. And for good reason. They turned out to be some of the finest lawyers (and people) I’ve ever had the pleasure to know. Not only were they true substantive experts in a rather niche area, but their institutional knowledge of our mutual client was also unparalleled. While I do not think incumbency should be unassailable, it does confer legitimate advantages, which this firm had earned.

But to say that they were the very best at what they did is not to say they were perfect (no one is, author included). To their eternal credit, this group of domain experts was genuinely interested in improving the more generic aspects of their legal service delivery. They greeted the SDR with open minds (despite being professional issue spotters). When the SDR was complete, the relationship partners and I had a frank dialogue about what the findings meant and the concrete steps that should be taken as a result. They committed to a number of process improvements, which they delivered. These included better associate training on basic technology. But that was only one aspect of the review and one area in which they measurably improved.

It is worth noting, however, that, beyond their substantive expertise, these long-time incumbents also had the best knowledge management practices I ever reviewed. While, like every other firm, they got dinged where they performed below expectations, the SDR also resulted in them earning substantial goodwill in the many areas where they excelled. Combined with their commitment to, and subsequent delivery of, process improvements, the end result of the SDR was a deeper, more collaborative relationship.

Collaboration runs both ways. I, for example, needed to get more disciplined about putting new matters into the system earlier (most matters were initiated with an email, and the matter management system was updated later) in order to facilitate better accrual practices and quicker turnaround of invoices. We also developed a secure file sharing protocol that meant they had ready access to the regular reports, rather than waiting for my paralegal or me to respond to an email request. This firm was a critical piece of our workflow and better integration benefited both parties.

In short, without yet knowing the term, I had adopted a strategic sourcing perspective on supplier relationships:

All this was a bit of a surprise to me. I moved in-house with the attitude that many of the problems with the legal market are result of inside counsel being too soft on outside counsel. I still think that is true to a certain extent. But, as I will detail in my next post, there are different approaches to taking a firm line with long-term suppliers. My initial impulse to rely solely on strong-arm tactics was misguided. I owe a debt of gratitude to the law firm partners who showed me a better way. Commitments to collaboration and coprosperity were important evolutions in my thinking about the relationship between inside and outside counsel.

++++++++++++++++++++++++++++
Casey Flaherty is the founder of Procertas. He is a lawyer, consultant, writer, and speaker focused on achieving the right legal outcomes with the right people doing the right work the right way at the right price. Casey created the Service Delivery Review (f.k.a., the Legal Tech Audit), a strategic-sourcing tool that drives deeper supplier relationships by facilitating structured dialogue between law firms and clients. There is more than enough slack in the legal market for clients to get higher quality work at lower cost while law firms increase profits via improved realizations.
The premise of the Service Delivery Review is that with people and pricing in place, rigorous collaboration on process offers the real levers to drive continuous improvement. Proper collaboration means involving nontraditional stakeholders. A prime example is addressing the need for more training on existing technology. One obstacle is that traditional technology training methods are terrible. Competence-based assessments paired with synchronous, active learning offer a better path forward. Following these principles, Casey created the Legal Technology Assessment platform to reduce total training time, enhance training effectiveness, and deliver benchmarked results.
Connect with Casey on LinkedIn or follow him Twitter (@DCaseyF).
Regardless of whether you love this concept, or hate it, the University of Michigan’s Medical School may have just laid out the future of the Librarian as “Informationist.”

In its announcement regarding the opening of the new A. Alfred Taubman Health Sciences Library (THSL), U-M Med School removed all of the books, and bookshelves, and created a 137,000 square foot “natural light-filled medical education hub that supports in-person, collaborative, active learning.”

Books are off-site and available via “rapid delivery upon request.”

The Library is staffed by “Informationists” that serve the University and general public to access the “stored knowledge of medical and health science.”

Space is for learning, training, teaching, connecting, simulation, and collaboration. Not simply for housing “stored knowledge.”

I, for one, like this concept. I like the idea of having Informationists. I like storing massive amounts of books off-site and focusing more on digital access, and quick retrieval of information from a stored location. I like the idea of using the space for hands-on training, collaboration, and interaction.

I know that there are some things that are missing. The happenstance of browsing the shelves and coming upon the one book that has the answer that you would have missed online. The ability to sit in the middle of a quiet area of the library and study without people having a disruptive discussion. The ability to find a spot deep in the shelves and hideaway from the rest of the world.

All of that has been replaced with digital catalogs, and study rooms (probably with big glass windows and lots of outdoor lighting.)

Despite this, and other things that may disappear with this style of library, I think this is the future. If we do not embrace this, or something similar that creates a more interactive space, then libraries will not evolve, they will shrink and disappear. Traditional Librarian roles will struggle to maintain, but Informationists or the next iteration of engaged and interactive Librarian will thrive and innovate their way into the future.

Watch the video of the ideals behind the new library design. As you are watching it, think about how the concepts apply to your library space and service strategy. Replace “medical” with “legal.” Replace “school” with “court” or “firm.” Think big and imagine what you could do beyond storing and retrieving knowledge in your own library.

When students come to the University of Michigan, they don’t just think about becoming a doctor, a medical scientist, or a health professional; they think about making the world a better place.

Now we’ve created a better place for them. A place to learn, to connect, and to grow.

Welcome to the new, vastly improved Taubman Health Sciences Library.

What was once a traditional library has been transformed into a light-filled, technology-driven, dynamic learning space. Our students envision a future where learning, technology, and passion combine to help patients, and enhance the public’s health. So we designed the renovation with those same ideals in mind.

Now students and their professors can connect and learn in dozens of classrooms, small group rooms, simulated patient care rooms, and an all-digital library environment. 

The building allows students from different health profession programs to come together in new ways. To learn how to care for patients as a team. To problem solve. And, to learn from one another, as well as faculty. 

For our medical students, the renovation means a quantum leap – as big as their innovative new curriculum. Here, they will learn the core principles of doctoring to prepare them to become members of outstanding patient care teams at the University’s nearby hospitals and clinics. The walls and tables will become canvases for their ideas and questions. They can even spend time in the new medical student lounge. 

Rows of bookshelves may have vanished from this library building, but the vast holdings of one of the nation’s best medical libraries are still available for rapid delivery upon request. 

The Library’s Informationists are still here to help the university community and the general public access and use the stored knowledge of medical and health science. For those who learn and those who teach it’s all about making the world a better place, one place at a time. [emphasis added]

Long-time reader. First-time poster.

Does the following resemble anyone you know? “Far too many people—and especially people with high knowledge in one area—are contemptuous of knowledge in other areas or believe that being ‘bright’ is a substitute for knowing.” Peter Drucker’s biting observation is likely familiar to anyone who has spent time working in the legal market. We have an abundance of well-credentialed domain experts with little interest in areas outside their comfort zone no matter how important those areas might be to their success or the success of their organization. Suggestions that legal professionals—lawyers, in particular—should concern themselves with pricing, marketing, technology, project management, etc. are often met with some blend of confusion and disgust.

And so begins another installment of lawyer bashing. But not this time. Or, at least, not yet. I want to thank the Geeks for providing me a platform. I hope to deliver more nuanced thoughts on the legal profession than may have previously been associated with me. When The American Lawyer introduces you to the world with the headline “Big Law Whipped for Poor Tech Training”, it is hard to break out of the mold of inside counsel berating outside counsel—especially when there is some truth to it and playing the big bad is so much fun. 

My first couple of posts will serve as an introduction to who I am but also highlight many of the ways in which I have been wrong–the ways in which I was the person described in the Drucker quote above.

I am former BigLaw lawyer turned corporate counsel turned consultant. The reason people might recognize my name is coverage of my tenure in-house where I subjected my outside counsel to what was then called the Legal Technology Audit (now called the Service Delivery Review because the word “audit” makes some people uncomfortable). I visited my law firms to examine how work was handled. The focal point of the review was how the law firms integrated process and technology into the delivery of legal services—rather than  substantive legal acumen, a threshold requirement the firms had already satisfied. I investigated hardware, software, project management, document automation, knowledge management, staffing, etc. But training on the basic technology is what got everyone’s attention (including Greg). The Washington Post, for example, was intrigued that (a) someone had the audacity to test legal professionals on their proficiency with common desktop software (e.g., Word, PDF, Excel) and (b) legal professionals fared so poorly. So I became the guy who bashed outside lawyers for not knowing Word, and I relished it.

At a recent meeting with a prominent law firm, one of the partners confessed at the end, “I expected you to have horns.” That’s great fun. But it is also a problem. The big bad persona obscures a more constructive approach to what it means to be sophisticated providers and consumers of legal service. As Connie Brenton of NetApp and I wrote in a recent column, “Law firms are easy targets. But law departments are the largest impediment to change in the legal marketplace. We set the incentives.” An antagonistic posture runs counter to my thoughts on the ways in which inside and outside counsel should collaborate, as well as my evolution on how that collaboration should occur and why it matters. More on that in my next couple of posts.

++++++++++++++++++++++++++++++++++++

Casey Flaherty is the founder of Procertas. He is a lawyer, consultant, writer, and speaker focused on achieving the right legal outcomes with the right people doing the right work the right way at the right price. Casey created the Service Delivery Review (f.k.a., the Legal Tech Audit), a strategic-sourcing tool that drives deeper supplier relationships by facilitating structured dialogue between law firms and clients. There is more than enough slack in the legal market for clients to get higher quality work at lower cost while law firms increase profits via improved realizations.
The premise of the Service Delivery Review is that with people and pricing in place, rigorous collaboration on process offers the real levers to drive continuous improvement. Proper collaboration means involving nontraditional stakeholders. A prime example is addressing the need for more training on existing technology. One obstacle is that traditional technology training methods are terrible. Competence-based assessments paired with synchronous, active learning offer a better path forward. Following these principles, Casey created the Legal Technology Assessment platform to reduce total training time, enhance training effectiveness, and deliver benchmarked results.
Connect with Casey on LinkedIn or follow him Twitter (@DCaseyF).

Some are saying that President Obama’s choice to fill Dr. James H. Billington’s position at the Library of Congress could very well define his legacy as President. If you’ve paid any attention to this discussion, the common theme is that, while Dr. Billington was a good leader, he lagged behind in positioning the Library of Congress for the 21st Century and the digital age. Now is the time to change the direction of the Library, and the American Association of Law Libraries is adding its voice to what Law Librarians would want in the 14th Librarian of Congress.

The letter below was sent to the President today recommending that he nominate a candidate who will provide strong leadership on issues affecting libraries in the digital age.

FOR IMMEDIATE RELEASE

Contact: Cara Schillinger
Director of Membership, Marketing, and Communications
312.205.8020
cschillinger@aall.org

AMERICAN ASSOCIATION OF LAW LIBRARIES
SENDS LETTER TO PRESIDENT ON QUALIFICATIONS
OF NEXT LIBRARIAN OF CONGRESS

CHICAGO, August 3, 2015 — The American Association of Law Libraries (AALL) today submitted a letter to U.S. President Barack Obama recommending he nominate a visionary leader with a deep commitment to preserving cultural memory as the new Librarian of Congress to replace Dr. James H. Billington, who is retiring from the position effective January 1, 2016.

The Librarian of Congress heads the Library of Congress, recognized as the United States’ de facto national library and the largest library in the world. The librarian also oversees the U.S. Copyright Office, Law Library of Congress, and several other service and support units. Dr. Billington, the 13th Librarian of Congress, has served in the role for 28 years, after being appointed to the position by former President Ronald Reagan in 1987.

AALL’s letter asks President Obama, during his search for the next Librarian of Congress, to consider qualified candidates, including law librarians, who will provide strong leadership on issues affecting libraries in the digital age — such as preservation of and permanent public access to born-digital and digitized materials.

AALL believes the next Librarian of Congress should have a transformative vision of a strong, responsive, and modern Library of Congress for the 21st century and beyond; possess a sophisticated understanding of how technology can improve library operations and promote access and reservation;
and display a commitment to transparency, public participation, and collaboration.

The full text of AALL’s letter to the president is available at bit.ly/AALLlocrec. For more information about AALL and its other advocacy efforts, please visit www.aallnet.org.

About AALL
The American Association of Law Libraries was founded in 1906 to promote law libraries’ value to the legal and public communities, foster the law librarianship profession, and provide leadership in the legal information field. With nearly 5,000 members, AALL represents law librarians and related professionals who are affiliated with law firms; law schools; corporate legal departments; courts; and local, state, and federal government agencies. For more information, visit www.aallnet.org.

# # #

In his post the “Great Google Debate“, Mark Gediman suggested I was wise to not touch the debate on Google, and while I am happy to take the compliment, it also makes me wonder if somewhere down the road we (and by we, I mean those industry insiders, you know who you are) can’t create a Google equivalent to support the Legal industry. Imagine a single source that allows researchers to bridge the chasm between the business of law and the practice of law.  Let me explain.

On that same panel at AALL, I was asked where CI should report, my reaction drew a chuckle and was rapidly tweeted and retweeted. It was something to the effect of “I am tired of having this debate”. And I am, for a variety of reasons.  Where any of the research types or “information and analysis brokers” – Library, CI, KM, Research etc. – report is in my opinion, irrelevant and but an administrative imperative. How and where we add value to the firm and most importantly its bottom line/top line is what matters. I tweeted yesterday that information, intelligence, analysis when used effectively and systemically by firms could be the next disruptive factor, akin to the AFA.  Research, and the information professionals who undertake these tasks are embracing technology and are “to be congratulated for navigating really difficult times in the industry” according to Aric Press.  Big Law Is Here to Stay, and if its information professionals are going to continue to step up their game in this rapidly changing industry, they need proper tools, a collaborative environment and a checking of the proverbial egos (and related reporting structures) at the doors. 

Throughout the day, information professionals on the business side of the equation, search Google, subscription databases (what’s your favourite??), social media feeds, securities filings, traditional and  new media outlets and should be doing some kind of primary research i.e. talking to people and working the network (that’s a blog post for another time). On the practice side of the equation, legal researchers search corporate precedents, case law, filings, treaties, judgments, dockets, summaries, briefs, memos and other subscription databases. Imagine if you could put it all together, search one platform – a Googlesque type platform minus the paid SEO and get whatever research you needed in one place. How much more efficient, smart and focused on client and legal service could we and our firms be with one magnificent tool at our finger tips. 

Its pie in the sky, but that’s where dreams live, right? Here’s a use case. A proposed change in legislation relating to construction zoning in a particular jurisdiction is announced.  You  – Research Warrior/Maven/Guru  access the details of the proposed changes, and are able to fire it off to the relevant attorneys for an opinion, a LinkedIn Post, or a Client Update, while at the same time researching the number of public (and private, it’s a dream database, right?) companies in the jurisdiction who will be affected. You can also access which of those companies are your clients, your competitor clients, or prospects, and you can analyze the text of the proposed change to determine what the percentage of prior proposals with similar language were accepted, or rejected. With this data in hand, you can do a historiographic or timeline analysis to determine the likelihood of the proposal becoming law and using the same magic portal you can determine which other jurisdictions may adopt similar changes based on a cursory review of relevant local media and social media reactions and commentary.  And let’s not stop there, with a few clicks, you can output all the data into neatly branded reports complete with charts and graphs – a data visualization panacea. At that point, who really cares where you report? You just saved lawyers time, developed new leads, created an opportunity to demonstrate the firm’s value and demonstrated the information professional’s propensity for serial innovation.  Not bad in a day’s work!

Yes, there will be those that suggest it can’t be done, or those who won’t trust the data in a single platform even if it is pulling from multiple (triangulated and vetted) sources.  And course there will be a myriad of UX considerations, search/browse convergence discussions, taxonomy whoas and other finicky things to figure out.   But it would stop the where should we report and should we use Google debates….

I just returned from the AALL annual meeting in Philadelphia and had an interesting discussion with a colleague about Google.  First, let me set the scene: I was on a panel with Zena Applebaum and we had just answered a question about our favorite CI resources.  A member of the audience then asked why neither of us had included Google in our lists. As I began to answer, Zena wisely tweeted:

There is a debate going on, both within our institutions and in the research community.  Is Google a tool or a resource?  I feel that Google is just a tool, an excellent one that allows us to access a universe of information.  Unfortunately, the quality of the information is always in doubt.  Information from a fake website or a misleading post could be included in the search results, maybe even at the top of the list. The same reasons you don’t rely on Wikipedia apply even more to Google.  Google has never laid claim to delivering only quality, vetted information.  In fact, they have taken great pains to do the opposite.  Look at the disclaimer at the bottom of the page here and listen to the conversation Richard Leiter and Company had with Google Scholar’s Chief Engineer here.

As a researcher, I know the importance of confirming anything I find on Google and noting if the information is suspect and cannot be verified.  In CI as in law, it is important to have a high degree of confidence in the information that your analysis and recommendations are based on.  Google alone does not instill that confidence. 

There is a reason we pay for services like Lexis Advance and WestlawNext.  These services ensure that their subscribers have access to current and vetted content, often with editorial review.  I’m not saying Google isn’t useful.  I am on Google several hours each day.  However, it is for these reasons I don’t conduct legal research on Google when I have these services and others like them at my fingertips.  Just like any tool, a thorough understanding of its limitations is necessary to get the most out of it.

We all know this coming of age story. A boy leaves home to study abroad, sows his wild oats, and returns home a grown man, wiser and ready to take on the world. Except this coming of age story has a bit of a twist. The boy is actually a computer. And that computer’s name is Watson.
ROSS Intelligence, which is making headlines for its novel application of the IBM Watson machine learning platform to legal research, has been hard at work training the system to understand law. The team originally worked with Canadian legal content and lawyers, teaching Watson what “good” results looked like. But yesterday, the ROSS team announced they are bringing Watson back to the States to tackle US case law. They also announced support and funding from a powerful investor: Silicon Valley’s Y Combinator. ROSS is starting small with bankruptcy and, in a similar fashion to their original work north of the border, has partnered with a number of pilot law firms. But make no mistake, this first small step is likely to create tremendous ripples in the legal profession as their program expands.
I sat down recently with two of the co-founders of ROSS Intelligence, Andrew Arruda (CEO) and Jimoh Ovbiagele (CTO), to learn a bit more about ROSS and their experience with Watson.
One of the first topics was whether ROSS complemented or replaced the likes of LexisNexis and Westlaw. Arruda’s perspective was that it complemented traditional legal research for now, but the goal is ultimately to replace them. In reality, it is a bit of an apples and oranges comparison. Traditional legal research vendors generally provide data and a search box, leaving much of the heavy lifting to lawyers. This approach was well-suited to the “leave no stone unturned” philosophy that guided legal research in the golden age of law. ROSS, on the other hand, serves up insights based on a more natural dialogue between the lawyer and its Watson-based system. This approach fits better in a post-recession world where clients are cost-conscious and expect efficiency in their law firms.
For now, ROSS is still relatively targeted in its scope and utility. LexisNexis and Westlaw have massive stores of content they either own or license, and they have spent decades gathering and curating this content. Matching their breadth and depth of content will be a daunting task, to say the least. But the big vendors would be foolhardy to ignore this threat. Anyone familiar with Clayton Christensen’s The Innovator’s Dilemma and the concept of disruptive innovation knows that incumbents are often unseated when entrants perfect their technology downstream then move to compete directly. As Arruda says, “Think of us like the Netflix of legal research; we are going to keep adding capabilities and original content until lawyers no longer have a reason to stay with their traditional providers and can cut the cord.”
ROSS’s pilot approach is consistent with this notion. They start by turning associates loose, using ROSS just as they would other research tools (yes, Google and Wikipedia, you’re included in that list). As ROSS returns results, associates can provide feedback on whether ROSS’ answer was helpful. If it is not, the result is dropped and the next most relevant one is shown. This user feedback loop helps ROSS understand what is relevant for a particular topic.
As ROSS gets a more sophisticated understanding of an area of law, the pilot then moves upstream to senior associates and, ultimately, counsel and partners. This incremental approach to learning is a recurring theme in the world of deep learning, where AI systems learn in much the same way as children. In this instance, the ROSS team took Watson to law school and is now guiding ROSS through its first years at a law firm.
I asked Arruda and Ovbiagele about some of the challenges they faced adapting Watson to the legal profession. I have some familiarity in this space, having built several AI systems for LexisNexis back in the early 2000’s. One of the key issues is the structure of the typical legal document. If you break it down, much of the text in a brief or agreement is not really that important. It’s filler text or scaffolding where the real meat of the argument is hung. Take the heading of a court filing, for instance. It may say “In the 2nd district court of appeals,” but really all that matters is 2nd and appeals. All that extra text, like “in the court of,” or the “by and between parties” in an agreement, really don’t mean much. But to a system trying to extract and make sense of concepts, the extra text is a real problem.
Arruda and Ovbiagele confirmed they experienced the same issue. Much of their work has been tailoring and building an infrastructure around Watson to make legal text understandable. While some may cry foul at this level of intervention, that is the reality of where we are with AI. There is currently no “silver bullet” general purpose AI that is fully automated. But that does not stop the creation of targeted, specific-purpose AI like ROSS. And as has been shown in many other domains, that level of targeted AI is usually sufficient to disrupt an industry.
We also discussed how Watson is designed for a very specific type of question/answer interaction. Developers are constrained to a very specific formula of content ingestion, topic extraction, and tuning of relevant answers to questions. There are many other machine learning techniques out there – clustering, classification, prediction – that Watson does not do. ROSS, like many other Watson applications, layers their own special sauce on top of Watson to make results even more relevant and meaningful. “ROSS is a composite of AI technologies with Watson at its center, but we have a dedication to using the best methods available for this grand challenge,” explained Ovbiagele.
So what’s next for ROSS? With their move to the largest legal market in the world, it is clear they are setting their sights on broader application, both in terms of practice areas and law firm customers. But much remains to be seen. How fast will this occur? What will the business model and cost ultimately look like? How will other legal research providers like LexisNexis and Westlaw and intelligence system providers like Kira Systems react? And perhaps most importantly, will lawyers embrace help from a computer as it becomes more human-like?
One thing is clear. Disruption is coming to legal, as it has to so many other industries, and this time there is a feeling of inevitability. Lawyers and firms will have a choice: adapt, or perish.

++++++++++++++++++++++++++

Matt Coatney is an AI expert, data scientist, software developer, technology executive, author, and speaker. His mission is to improve how we interact with smart machines by making software smarter and teaching people how to work (and cope) with advanced technology. Great things happen when smart people and smart machines work together toward a common goal.
Follow Matt on LinkedIn and on Twitter @mattdcoatney. Follow the conversation at #BridgingTheAIGap.

We constantly make fun of the lack of innovation in the legal field, but there are a number of highly talented people out there that battle the constant resistance to change, and make a difference for their own organizations and profession. For the past five years, Ed Walters, CEO of Fastcase, has recognized those whom he lists as innovators, visionaries, and leaders in the law through his Fastcase 50 Award Winners. I was honored to be a part of the inaugural Fastcase 50 back in 2011, and I’m even happier that my fellow Geek, Ryan McClead, received the award this year. (In fact, Ryan is so good, that when the list was initially displayed, he showed up twice!)

Here’s the write-up on Ryan:


Ryan McClead
Legal Technology Innovation Architect, Norton Rose Fulbright

Ryan McClead leads Norton Rose Fulbright’s Global Legal Technology Innovation initiative, solving information supply-chain problems in one of the world’s largest law firms. Ryan is a regular contributor to the popular 3 Geeks and a Law Blog (perhaps the most prolific contributor recently). According to Original Geek (OG) Greg Lambert: Ryan’s writing is “pure genius.” Lambert adds: “The Exponential Law Firm series, and The Myth of Disruptive Technology are instant classics and not only show Ryan’s ability to talk about current trends in legal technology, but also to peer into the future, all in a funny, imaginative, and thought-provoking way. Ryan’s projects at Norton Rose Fulbright also expose his creative side. Pushing out technologies directly to the firm’s clients and other consumers across the globe, Ryan is turning the concepts of what we think technology can do within a law firm on its head. We could all use a Ryan or two at our firms, to enable us to break out of our groupthink mentality and see things from a completely different perspective.”

Ryan is just one of those people that sees things in a different way, and finds ways of making things work, sound, and look better. Much of that comes from his creative background of working in the fine arts and applying his ability to tell a story in a way that makes us all sit up and say “ohh, I get it.”

Congratulations to Ryan and the other 49 recipients of the Fastcase 50 award.

[Ed. Note: Please welcome guest blogger Noah Waisberg, CEO of Kira Systems, and a good friend of the 3 Geeks. Noah was on an ILTA Panel with me last year, and will participate in the follow up to that panel this year called, Legal Technology Innovation: Bolstering AND Destroying Legal Work.  This post originally appeared on the Kira Inc. Blog. – RM]

[CC] Gengiskanhg

Watson is almost certainly the most significant technology ever to come to law, and it will give lawyers permission to think innovatively and open up the conversation about what is possible in a field that has been somewhat “stuck.” 

 –“10 predictions about how IBM’s Watson will impact the legal profession“, Paul Lippe and Daniel Martin Katz, ABA Journal

IBM’s Watson AI has received a lot of attention for how it might change law practice. Should it? Or should commentators expecting “Watson” to change the world instead refocus their attention on “artificial intelligence” or “machine learning”?

Recently, legal market observer Ron Friedmann wrote, in a post on potential business models for Watson in the legal space:

if we aim to improve the efficiency of the legal market, there is no lack of technology to choose from. Whether Watson is the best place to bet remains an open question.

  1. What is Watson currently good it, and is it even the best avenue for automating tasks where it is strongest?
  2. Is Watson strong in the most promising areas for legal automation?
  3. Will Watson grow to become leading machine learning or AI technology across the board, or will it remain high quality only for question answering?

Watson, Currently

From Wikipedia: “Watson is an artificially intelligent computer system capable of answering questions posed in natural language”. Today, it appears to be a leading machine learning offering for question answering of a very specific sort (as we will cover below). IBM looks to be attempting to build Watson out into leading general purpose artificial intelligence software, but there is no consensus that it is at or better than the state of the art in areas beyond question answering. Indeed, early reviews on released Watson APIs have been underwhelming. As Ron Friedmann points out, it is not even clear whether Watson is a better technological approach for legal question answering tasks than, say, Neota Logic.

Apparently, one vendor is currently using Watson to extract data from contracts. I have yet to see any data suggesting that identifying contract provisions is in Watson’s sweet spot (by data, I mean information such as, say, published provision extraction accuracy numbers for a system built using Watson; the vendor claims their “goal today is to deliver a 20% cost reduction for a law firm in a typical diligence exercise”, which would not stand out relative to claims from other contract review software vendors (e.g., our clients tell us they find from 20–45% time savings on page-by-page review using our contract review software, and 60–90% time savings when they rely on it more heavily)).

Is Current Watson Right for Legal Problems?

Watson is currently a leading technology for question answering tasks. Are most legal tasks that could be impacted by software question answering tasks?

“Question answering” could be very broad, and most or all legal tasks could be interpreted as giving answers to questions. However, today Watson only stands out for performance on a narrow definition of question answering.

Each of the following questions illustrates a type of legal problem technology could help solve:

  1. Is it illegal for individuals to have ferrets in the state of California? (Watson-type question answering)
  2. Which of these 1 million documents are relevant to determining if anti-competitive behavior occured in this specific case? (eDiscovery technology-assisted review)
  3. How long does it tend to take for cases to get to trial in front of Judge Vernon Broderick? (Lex Machina)
  4. Who will the Supreme Court decide for in King v. Burwell? (Katz/Bommarito/Blackman algorithm)
  5. Can you draft a brief for us to submit to the court for this case? (NarrativeScience, Automated Insights (neither appear to be currently targeting legal))
  6. Do any expense items on this legal bill seem inappropriate? (SimpleLegal)
  7. Which of these contracts have change of control or exclusivity clauses? (us (Kira) and others)
Despite how all of these legal automation areas were phrased as questions, current Watson seems to only have documented high quality performance on tasks similar to the first, legal researchey issue. Is there any data to support the idea that Watson could best other currently-existing technology solutions on the other questions?
Alternatively, is being great at legal research question answering sufficient to make Watson the leading legal technology? Are all the other areas insignificant compared with an ability to know the law? As an ex-corporate lawyer, not to me. I know there are large numbers of lawyers that hardly ever do legal research.*

Will Future Watson Be Better Than Alternatives?

A Watson proponent might say maybe Watson is only truly great at question answering right now, but it will grow into the accross the board leading AI technology. After all, Watson won Jeopardy!, and IBM is pouring tons of resources into bettering it. As Friedmann states, after listing off a number of companies—including us—who build contract review software:

But as Paul points out, Watson’s R&D investment is probably 100x all these companies combined, and so has the potential to ride a much steeper performance curve.

Since machine learning does not yet have one approach that is better than others across the board, it is hard to say how much value Watson’s extensive R&D investment matters in the contract review software space (or, for that matter, in most other areas of technology, legal or otherwise). The argument that Watson will dominate outside its core because of overall R&D investment is akin to arguing that Lance Armstrong, straight off winning seven consecutive Tour de Frances, would win the 2006 New York Marathon. After all, he had incredible aerobic capacity, slow twitch muscle training, toughness, and more spent on his training than others in the field. Plus, running is basically just putting one foot in front of the other. For what it’s worth, Armstrong finished in 856th place his first try, and 232nd the next year.
Winning Jeopardy! is great, but there have been many other very impressive machine learning feats, including self driving cars; translation, including of live speech; and writing decent enough quality news articles that human reviewers could not necessarily tell the difference. Even on question answering, was Ken Jennings easy competition at Jeopardy! relative to a different current AI system like Google DeepMind?
Moving past Jeopardy!, IBM may be putting significant resources into Watson, but other companies are doing the same. Some equally large companies to IBM, including Google, HP, Facebook, and Baidu, are also putting a lot of resources into machine learning. Why will IBM beat them? Why will IBM even beat out newer AI focused startups such as DeepMind (bought by Google in 2014 for $650 Million), MetaMind, or many others? IBM itself appears to recoginize that others are building valuable machine learning technology, acquiring deep learning focused AlchemyAPI in May. 
Lots of companies are building AI technology for specific verticals (like us with contract review). Current machine learning is quite problem-specific, and these companies are getting experience honing their technology for their particular use cases. Will Watson’s technology really be better for specific verticals than companies focused on those specific verticals? Would you use Watson for eDiscovery ahead of offerings from companies who have been focused on that challenge for years? Will Watson do machine learning fraud detection better than well-funded Sift Science? Or movie recommendation better than Netflix? Will Watson even be better on legal research than something Thomson Reuters builds? IBM may be a lot bigger than TR, but TR is not small and has to nail this, whereas IBM does not need to get legal research right.
There are a lot of different legal tasks ripe for automation. There are also a lot of different technological approaches to solving AI problems. I suspect we’re a long way out from saying any one vendor’s technology is going to transform law practice on the whole.
* There is one other way Watson could transform law practice that I did not discuss here. Perhaps question answering lies behind as-yet-undiscovered-but-transformative legal applications. No doubt, there is a lot of opportunity to improve law practice through technology.