Artificial Intelligence in Legal Practice
In recent discussions surrounding artificial intelligence (AI) in legal contexts, alarming reports have emerged about lawyers citing fabricated cases generated by AI, often referred to as ‘hallucinations.’ These occurrences serve as stark reminders that any work produced by AI must be thoroughly verified by legal professionals before being presented in court.
Courts have begun to mandate disclosures regarding the use of AI in legal submissions, emphasizing a growing concern over the reliability and authenticity of AI-generated content. A particularly notable case highlighting this issue involved a judge rejecting an expert’s report due to its reliance on three non-existent citations, all generated by AI.
Lessons from Kohls v. Ellison
The Kohls v. Ellison case provides a compelling illustration of the risks associated with incorporating AI in legal documentation. Here, an expert—whose report was intended to warn against the dangers of AI—submitted misleading information derived from unverified sources.
As described by the court, ‘a credentialed expert on the dangers of AI and misinformation has fallen victim to the siren call of relying too heavily on AI.’ This unfortunate incident not only undermined the expert’s credibility but also wasted valuable court resources and eroded public trust in the judicial system.
Expert Obligations and AI Disclosure
This case underscores the necessity for lawyers and their clients to ascertain whether AI has been utilized in expert reports. While explicit requirements for disclosing AI usage may not yet be established in all jurisdictions, professionals are expected to adhere to existing obligations regarding the accuracy and reliability of the methodologies employed in their assessments.
To mitigate risks, legal counsel are advised to include provisions in retainer agreements that mandate experts to disclose their use of AI, thus ensuring a transparent and accountable process.
AI Innovations in Cybersecurity
On a related front, the burgeoning intersection of AI and cybersecurity is exemplified by the recent unveiling of Hunted Labs, a startup focused on harnessing AI to detect and address vulnerabilities in software supply chains. Backed by $3 million in pre-seed funding, Hunted Labs aims to improve the security of open-source software used by organizations.
As former Booz Allen Hamilton executives leading the company explained, ‘organizations today are under constant threat from attackers who hunt for vulnerabilities in the software supply chain.’ With projected costs of supply chain attacks nearing $81 billion by 2026, proactive measures have become increasingly paramount.
Hunted Labs has received significant support, including contracts from the Air Force’s AFWERX innovation unit, to develop its automated threat management solutions, which aim to mitigate the risks posed by malicious actors targeting software infrastructure.
Conclusion
The expanding role of AI in both legal practice and cybersecurity emphasizes the importance of careful oversight and verification. Professionals in these fields must remain vigilant and adapt to technological advancements while upholding the integrity of their work. As AI continues to evolve, so too must the frameworks governing its application to protect against misinformation and security threats.
