The 14-page motion looked like any standard court filing in a civil lawsuit. Filed in April in San Diego Superior Court, attorneys defending a local company were making a routine request for a judge to authorize additional expert witnesses in a vehicle collision injury case.

But on the sixth page of the motion, the attorneys cited legal authority from a case that does not exist — it was hallucinated by artificial intelligence.

A San Diego judge wrote in October that she was “deeply troubled” by the conduct of the company’s civil defense attorneys. She found they had filed multiple documents containing AI hallucinations, including citations to non-existent cases, fake quotes from real cases and inaccurate citations to real but irrelevant legal authorities.

That is one of at least two known San Diego cases that are part of a troubling trend of attorneys abusing or misusing AI, especially generative AI, a powerful technology that can at times fabricate information with no basis in reality.

But even as legal watchdog groups have documented hundreds of AI hallucination cases in the U.S. and around the world, legal experts and attorneys say those cases are rare, arguing that AI is an important tool being put to good use throughout the legal profession, helping lawyers research case law, analyze evidence, draft contracts and complete any number of rote tasks.

“We can’t just ignore generative AI, we have to become experts in the use so that we can avoid issues … where hallucinated case law gets into final documents,” Bryan McWhorter, a patent attorney and partner at the firm Knobbe Martens, said in an interview. “But I think when leveraged correctly, generative AI is frankly a power tool. It’s going to allow me to produce higher-quality work product in less time and deliver that value to clients.”

McWhorter recently argued that AI cannot now and likely never will be able to replace human legal analysis. That’s a view shared by James Cooper, a professor at California Western School of Law in downtown San Diego and co-author of the book “A Short & Happy Guide to Artificial Intelligence for Lawyers.”

“It complements all our skill sets,” Cooper said. “(But) there still needs to be a human in the loop.”

Cooper said there will always be subtlety in fact-finding and questioning people “that robots don’t understand … AI tools can’t fully engage with the nuance of humankind.”

Even so, Cooper is concerned that the use of AI in the legal field may be advancing too rapidly, and he hopes attorneys and firms are implementing safeguards that lawmakers and regulators have not.

“We’re at a juncture now where the technology is far outpacing our ability to regulate it, both as a legal profession but also in the real world, in a non-legal context,” Cooper said. “… We don’t know yet where to put the guardrails.”

‘Risks are no different’

As the use of AI has exploded in recent years, legal organizations have grappled with what sort of guidelines and policies to put in place to ensure that attorneys who use the technology do so ethically and responsibly. That can look different for a patent lawyer such as McWhorter and attorneys who litigate criminal and civil cases before judges, though the basic principles are largely the same.

“Broadly speaking, (the) risks are no different than we’ve always had in the industry, which is we must produce work that is 100% accurate and maintains all of our ethical obligations regarding client confidentiality,” McWhorter said.

For courtroom litigators, a federal judge in New York helped set the standard for the use of the technology in June 2023 while presiding over a case in which attorneys filed documents containing AI hallucinations. He wrote that there is “nothing inherently improper about using a reliable artificial intelligence tool for assistance,” but also noted that existing rules required that attorneys ensure the accuracy of every filing.

That has been the theme of most court opinions and bar association guidelines issued since then.

“Simply stated, no brief, pleading, motion, or any other paper filed in any court should contain any citations — whether provided by generative AI or any other source — that the attorney responsible for submitting the pleading has not personally read and verified,” wrote a panel of judges from California’s Second Appellate District.

The judges said the September opinion was the first by a California court to address “the generation of fake legal authority by AI sources” and should double as a warning for all attorneys in the state.

The American Bar Association and California State Bar have issued similar guidelines that AI cannot replace the judgment of trained lawyers and that attorneys should not become overly reliant on the technology.

Cooper, McWhorter and organizations such as the ABA all agree that there is a long list of legitimate uses of AI technology in the law. Much of it is geared toward helping summarize and analyze large data sets, while other tools can help be a middle step in crafting writing.

“The best analogy is we are creating the bones of the strategy, generative AI is adding the first-pass flesh onto those bones and then we’re going back and sculpting it into the final creation,” McWhorter said. “It’s really an intermediary in the process; it’s neither a beginning nor an end.”

‘Erodes trust in the legal profession’

Thus far, the most obvious and visible risk that has emerged in the use of AI in legal work is that of hallucinations. Several watchdog groups have been tracking cases in which court filings have contained AI hallucinations.

While the databases show that many such instances involve pro se litigants, or non-attorneys representing themselves, hundreds of licensed attorneys have also been sanctioned, reprimanded or otherwise caught submitting filings containing AI hallucinations, according to one such database compiled by attorney and researcher Damien Charlotin. His database only tracks cases in which a court has explicitly found or implied that a party relied on hallucinated content.

Charlotin’s database includes three cases in which U.S. judges were found to have written orders or opinions containing AI hallucinations. Meanwhile, the New York Times recently reported that a district attorney in Northern California has been accused of filing briefs containing mistakes typical of AI, one of the first known cases involving suspicions of prosecutorial misuse of the technology.

So far in San Diego, there are two known cases involving court documents containing AI hallucinations.

On Oct. 2, a panel of judges from the California Court of Appeals’ 4th Appellate District sanctioned longtime San Diego criminal defense attorney George Siddell, finding that he violated the Rules of Professional Conduct. They ordered him to pay $1,500 as part of the sanction.

A member of the California State Bar since 1971, Siddell admitted to filing a motion in a client’s criminal appeal that contained a citation to a case that doesn’t exist, a fake quote from a real case and two citations to cases that did not address the issues for which they were cited, according to a published appellate opinion. Siddell declined to comment for this story.

The judges wrote that Siddell’s conduct, when compared to similar conduct by attorneys in civil matters, was “particularly disturbing because it involves the rights of a criminal defendant, who is entitled to due process … and representation by competent counsel.”

The next day, San Diego Superior Court Judge Carolyn Caietti ruled that two attorneys from Tyson & Mendes, a national firm headquartered in San Diego, had filed multiple documents containing AI hallucinations in the case defending the local company in the auto injury lawsuit.

A Tyson & Mendes partner wrote in a declaration prior to the ruling that he took responsibility for the mistakes, though he blamed the errors on a younger associate attorney who he said “neglected to confirm the accuracy of certain case citations.”

In her own declaration, the associate attorney took responsibility and wrote that she was fired from the firm “as a direct result of my actions and conduct in this case.”

In a statement provided by Tyson & Mendes, the firm said in part: “As the Court in this case noted, we accept responsibility for our obligation to present the highest quality work product to the Court. We affirm this responsibility, even and especially in the face of technological transformation.”

The firm also added a lengthy explanation about how it is endeavoring to be a leader in the use of AI in the legal industry.

“As the practice of law continues to evolve through new challenges, opportunities, and technologies, we must also continue to hold ourselves accountable through introspection and transparency,” the firm said in its statement. “Tyson & Mendes remains steadfast in our commitment to our clients, our industry, and our profession to leverage the transformative power of AI and new technologies with keen professional and ethical judgment, ongoing education, and agility.”

Caietti did not ultimately sanction either attorney, though her decision was based on procedural issues rather than their conduct.

“Notwithstanding the denial on procedural grounds, the Court is deeply troubled by the conduct of Defense counsel,” Caietti wrote. “… All of this conduct is contrary to the rules of professional responsibility and is the type of conduct that erodes trust in the legal profession … This is hopefully an experience that will never be repeated by the attorneys involved in this matter, let alone others in the profession.”

Client confidentiality

Since AI learns from the data fed to it by its users, attorneys must also take care that confidential client information is not used to train AI models and that it does not inadvertently become public.

For patent attorneys such as McWhorter, those risks revolve around business interests and market competition. Other areas of the law — Cooper mentioned due process and evidentiary issues, as examples — could implicate constitutional rights and protections.

Cooper said that unless and until there are stronger regulations, it will be up to each attorney and law firm to understand the AI technology they use and mitigate any potential risks and harms.

‘Effectively and ethically’

Newer attorneys especially run the risk of becoming over-reliant on AI tools without first building a foundational knowledge of how to practice the law, Cooper said.

At California Western School of Law, the use of AI is a balancing act. The faculty is navigating how best to ensure that students don’t abuse AI technology in their coursework while also teaching them how practicing attorneys are using it.

“We’re trying to make sure that we prepare our students to be able to enter the workforce, enter the profession, and use it effectively and ethically,” said Liam Vavasour, vice dean for academic affairs.

Vavasour said students are not allowed to use ChatGPT or other generative AI tools for writing assignments unless given explicit permission to do so, and even then the use is typically limited to idea-generation or editing and must be disclosed.

Vavasour said that from his understanding, practicing attorneys and judges are using AI in a variety of ways, “so we’re trying to make sure that our students know how to use it effectively and some of the pitfalls to avoid.”

McWhorter supervises younger associates at his firm and believes fears about them being over-reliant on AI are overblown.

“Because the value of generative AI is not in legal strategy, (young attorneys) will develop the ability to provide legal strategy the same as anyone else,” McWhorter said.

Source link


Attorneys and law firms can elevate their online presence with professionally written content from SEO Content Writing Services monthly plan. Our team of experienced writers specializes in crafting blog posts, articles, and written content that accurately reflect the expertise and knowledge of our clients in the legal field. With a keen eye for detail and a thorough understanding of legal terminology, we provide high-quality writing that helps our clients stand out from their competition and engage with their target audience. Trust SEO Content Writing Services for one time article writing or monthly written content to handle all of your written content needs and showcase your law firm's expertise.
If you need written content, blog posts, or articles professionally written for your website, we can help. Go HERE to find out more.
or email us here: myseowritingservices@gmail.com
To find out more about our article writing or blog post services, fill out the form, thank you.

Name *

First

Last

Business Name

Email *

What type of articles are you intertested in?

Submit

The post AI hallucinations discovered in 2 San Diego court cases appeared first on Attorney Legal Counsel.

The 14-page motion looked like any standard court filing in a civil lawsuit. Filed in April in San Diego Superior Court, attorneys defending a local company were making a routine request for a judge to authorize additional expert witnesses in a vehicle collision injury case.

But on the sixth page of the motion, the attorneys cited legal authority from a case that does not exist — it was hallucinated by artificial intelligence.

A San Diego judge wrote in October that she was “deeply troubled” by the conduct of the company’s civil defense attorneys. She found they had filed multiple documents containing AI hallucinations, including citations to non-existent cases, fake quotes from real cases and inaccurate citations to real but irrelevant legal authorities.

That is one of at least two known San Diego cases that are part of a troubling trend of attorneys abusing or misusing AI, especially generative AI, a powerful technology that can at times fabricate information with no basis in reality.

But even as legal watchdog groups have documented hundreds of AI hallucination cases in the U.S. and around the world, legal experts and attorneys say those cases are rare, arguing that AI is an important tool being put to good use throughout the legal profession, helping lawyers research case law, analyze evidence, draft contracts and complete any number of rote tasks.

“We can’t just ignore generative AI, we have to become experts in the use so that we can avoid issues … where hallucinated case law gets into final documents,” Bryan McWhorter, a patent attorney and partner at the firm Knobbe Martens, said in an interview. “But I think when leveraged correctly, generative AI is frankly a power tool. It’s going to allow me to produce higher-quality work product in less time and deliver that value to clients.”

McWhorter recently argued that AI cannot now and likely never will be able to replace human legal analysis. That’s a view shared by James Cooper, a professor at California Western School of Law in downtown San Diego and co-author of the book “A Short & Happy Guide to Artificial Intelligence for Lawyers.”

“It complements all our skill sets,” Cooper said. “(But) there still needs to be a human in the loop.”

Cooper said there will always be subtlety in fact-finding and questioning people “that robots don’t understand … AI tools can’t fully engage with the nuance of humankind.”

Even so, Cooper is concerned that the use of AI in the legal field may be advancing too rapidly, and he hopes attorneys and firms are implementing safeguards that lawmakers and regulators have not.

“We’re at a juncture now where the technology is far outpacing our ability to regulate it, both as a legal profession but also in the real world, in a non-legal context,” Cooper said. “… We don’t know yet where to put the guardrails.”

‘Risks are no different’

As the use of AI has exploded in recent years, legal organizations have grappled with what sort of guidelines and policies to put in place to ensure that attorneys who use the technology do so ethically and responsibly. That can look different for a patent lawyer such as McWhorter and attorneys who litigate criminal and civil cases before judges, though the basic principles are largely the same.

“Broadly speaking, (the) risks are no different than we’ve always had in the industry, which is we must produce work that is 100% accurate and maintains all of our ethical obligations regarding client confidentiality,” McWhorter said.

For courtroom litigators, a federal judge in New York helped set the standard for the use of the technology in June 2023 while presiding over a case in which attorneys filed documents containing AI hallucinations. He wrote that there is “nothing inherently improper about using a reliable artificial intelligence tool for assistance,” but also noted that existing rules required that attorneys ensure the accuracy of every filing.

That has been the theme of most court opinions and bar association guidelines issued since then.

“Simply stated, no brief, pleading, motion, or any other paper filed in any court should contain any citations — whether provided by generative AI or any other source — that the attorney responsible for submitting the pleading has not personally read and verified,” wrote a panel of judges from California’s Second Appellate District.

The judges said the September opinion was the first by a California court to address “the generation of fake legal authority by AI sources” and should double as a warning for all attorneys in the state.

The American Bar Association and California State Bar have issued similar guidelines that AI cannot replace the judgment of trained lawyers and that attorneys should not become overly reliant on the technology.

Cooper, McWhorter and organizations such as the ABA all agree that there is a long list of legitimate uses of AI technology in the law. Much of it is geared toward helping summarize and analyze large data sets, while other tools can help be a middle step in crafting writing.

“The best analogy is we are creating the bones of the strategy, generative AI is adding the first-pass flesh onto those bones and then we’re going back and sculpting it into the final creation,” McWhorter said. “It’s really an intermediary in the process; it’s neither a beginning nor an end.”

‘Erodes trust in the legal profession’

Thus far, the most obvious and visible risk that has emerged in the use of AI in legal work is that of hallucinations. Several watchdog groups have been tracking cases in which court filings have contained AI hallucinations.

While the databases show that many such instances involve pro se litigants, or non-attorneys representing themselves, hundreds of licensed attorneys have also been sanctioned, reprimanded or otherwise caught submitting filings containing AI hallucinations, according to one such database compiled by attorney and researcher Damien Charlotin. His database only tracks cases in which a court has explicitly found or implied that a party relied on hallucinated content.

Charlotin’s database includes three cases in which U.S. judges were found to have written orders or opinions containing AI hallucinations. Meanwhile, the New York Times recently reported that a district attorney in Northern California has been accused of filing briefs containing mistakes typical of AI, one of the first known cases involving suspicions of prosecutorial misuse of the technology.

So far in San Diego, there are two known cases involving court documents containing AI hallucinations.

On Oct. 2, a panel of judges from the California Court of Appeals’ 4th Appellate District sanctioned longtime San Diego criminal defense attorney George Siddell, finding that he violated the Rules of Professional Conduct. They ordered him to pay $1,500 as part of the sanction.

A member of the California State Bar since 1971, Siddell admitted to filing a motion in a client’s criminal appeal that contained a citation to a case that doesn’t exist, a fake quote from a real case and two citations to cases that did not address the issues for which they were cited, according to a published appellate opinion. Siddell declined to comment for this story.

The judges wrote that Siddell’s conduct, when compared to similar conduct by attorneys in civil matters, was “particularly disturbing because it involves the rights of a criminal defendant, who is entitled to due process … and representation by competent counsel.”

The next day, San Diego Superior Court Judge Carolyn Caietti ruled that two attorneys from Tyson & Mendes, a national firm headquartered in San Diego, had filed multiple documents containing AI hallucinations in the case defending the local company in the auto injury lawsuit.

A Tyson & Mendes partner wrote in a declaration prior to the ruling that he took responsibility for the mistakes, though he blamed the errors on a younger associate attorney who he said “neglected to confirm the accuracy of certain case citations.”

In her own declaration, the associate attorney took responsibility and wrote that she was fired from the firm “as a direct result of my actions and conduct in this case.”

In a statement provided by Tyson & Mendes, the firm said in part: “As the Court in this case noted, we accept responsibility for our obligation to present the highest quality work product to the Court. We affirm this responsibility, even and especially in the face of technological transformation.”

The firm also added a lengthy explanation about how it is endeavoring to be a leader in the use of AI in the legal industry.

“As the practice of law continues to evolve through new challenges, opportunities, and technologies, we must also continue to hold ourselves accountable through introspection and transparency,” the firm said in its statement. “Tyson & Mendes remains steadfast in our commitment to our clients, our industry, and our profession to leverage the transformative power of AI and new technologies with keen professional and ethical judgment, ongoing education, and agility.”

Caietti did not ultimately sanction either attorney, though her decision was based on procedural issues rather than their conduct.

“Notwithstanding the denial on procedural grounds, the Court is deeply troubled by the conduct of Defense counsel,” Caietti wrote. “… All of this conduct is contrary to the rules of professional responsibility and is the type of conduct that erodes trust in the legal profession … This is hopefully an experience that will never be repeated by the attorneys involved in this matter, let alone others in the profession.”

Client confidentiality

Since AI learns from the data fed to it by its users, attorneys must also take care that confidential client information is not used to train AI models and that it does not inadvertently become public.

For patent attorneys such as McWhorter, those risks revolve around business interests and market competition. Other areas of the law — Cooper mentioned due process and evidentiary issues, as examples — could implicate constitutional rights and protections.

Cooper said that unless and until there are stronger regulations, it will be up to each attorney and law firm to understand the AI technology they use and mitigate any potential risks and harms.

‘Effectively and ethically’

Newer attorneys especially run the risk of becoming over-reliant on AI tools without first building a foundational knowledge of how to practice the law, Cooper said.

At California Western School of Law, the use of AI is a balancing act. The faculty is navigating how best to ensure that students don’t abuse AI technology in their coursework while also teaching them how practicing attorneys are using it.

“We’re trying to make sure that we prepare our students to be able to enter the workforce, enter the profession, and use it effectively and ethically,” said Liam Vavasour, vice dean for academic affairs.

Vavasour said students are not allowed to use ChatGPT or other generative AI tools for writing assignments unless given explicit permission to do so, and even then the use is typically limited to idea-generation or editing and must be disclosed.

Vavasour said that from his understanding, practicing attorneys and judges are using AI in a variety of ways, “so we’re trying to make sure that our students know how to use it effectively and some of the pitfalls to avoid.”

McWhorter supervises younger associates at his firm and believes fears about them being over-reliant on AI are overblown.

“Because the value of generative AI is not in legal strategy, (young attorneys) will develop the ability to provide legal strategy the same as anyone else,” McWhorter said.

Source link


Attorneys and law firms can elevate their online presence with professionally written content from SEO Content Writing Services monthly plan. Our team of experienced writers specializes in crafting blog posts, articles, and written content that accurately reflect the expertise and knowledge of our clients in the legal field. With a keen eye for detail and a thorough understanding of legal terminology, we provide high-quality writing that helps our clients stand out from their competition and engage with their target audience. Trust SEO Content Writing Services for one time article writing or monthly written content to handle all of your written content needs and showcase your law firm's expertise.
If you need written content, blog posts, or articles professionally written for your website, we can help. Go HERE to find out more.
or email us here: myseowritingservices@gmail.com
To find out more about our article writing or blog post services, fill out the form, thank you.

Name *

First

Last

Business Name

Email *

What type of articles are you intertested in?

Submit

The post AI hallucinations discovered in 2 San Diego court cases appeared first on Attorney Legal Counsel.

The 14-page motion looked like any standard court filing in a civil lawsuit. Filed in April in San Diego Superior Court, attorneys defending a local company were making a routine request for a judge to authorize additional expert witnesses in a vehicle collision injury case.

But on the sixth page of the motion, the attorneys cited legal authority from a case that does not exist — it was hallucinated by artificial intelligence.

A San Diego judge wrote in October that she was “deeply troubled” by the conduct of the company’s civil defense attorneys. She found they had filed multiple documents containing AI hallucinations, including citations to non-existent cases, fake quotes from real cases and inaccurate citations to real but irrelevant legal authorities.

That is one of at least two known San Diego cases that are part of a troubling trend of attorneys abusing or misusing AI, especially generative AI, a powerful technology that can at times fabricate information with no basis in reality.

But even as legal watchdog groups have documented hundreds of AI hallucination cases in the U.S. and around the world, legal experts and attorneys say those cases are rare, arguing that AI is an important tool being put to good use throughout the legal profession, helping lawyers research case law, analyze evidence, draft contracts and complete any number of rote tasks.

“We can’t just ignore generative AI, we have to become experts in the use so that we can avoid issues … where hallucinated case law gets into final documents,” Bryan McWhorter, a patent attorney and partner at the firm Knobbe Martens, said in an interview. “But I think when leveraged correctly, generative AI is frankly a power tool. It’s going to allow me to produce higher-quality work product in less time and deliver that value to clients.”

McWhorter recently argued that AI cannot now and likely never will be able to replace human legal analysis. That’s a view shared by James Cooper, a professor at California Western School of Law in downtown San Diego and co-author of the book “A Short & Happy Guide to Artificial Intelligence for Lawyers.”

“It complements all our skill sets,” Cooper said. “(But) there still needs to be a human in the loop.”

Cooper said there will always be subtlety in fact-finding and questioning people “that robots don’t understand … AI tools can’t fully engage with the nuance of humankind.”

Even so, Cooper is concerned that the use of AI in the legal field may be advancing too rapidly, and he hopes attorneys and firms are implementing safeguards that lawmakers and regulators have not.

“We’re at a juncture now where the technology is far outpacing our ability to regulate it, both as a legal profession but also in the real world, in a non-legal context,” Cooper said. “… We don’t know yet where to put the guardrails.”

‘Risks are no different’

As the use of AI has exploded in recent years, legal organizations have grappled with what sort of guidelines and policies to put in place to ensure that attorneys who use the technology do so ethically and responsibly. That can look different for a patent lawyer such as McWhorter and attorneys who litigate criminal and civil cases before judges, though the basic principles are largely the same.

“Broadly speaking, (the) risks are no different than we’ve always had in the industry, which is we must produce work that is 100% accurate and maintains all of our ethical obligations regarding client confidentiality,” McWhorter said.

For courtroom litigators, a federal judge in New York helped set the standard for the use of the technology in June 2023 while presiding over a case in which attorneys filed documents containing AI hallucinations. He wrote that there is “nothing inherently improper about using a reliable artificial intelligence tool for assistance,” but also noted that existing rules required that attorneys ensure the accuracy of every filing.

That has been the theme of most court opinions and bar association guidelines issued since then.

“Simply stated, no brief, pleading, motion, or any other paper filed in any court should contain any citations — whether provided by generative AI or any other source — that the attorney responsible for submitting the pleading has not personally read and verified,” wrote a panel of judges from California’s Second Appellate District.

The judges said the September opinion was the first by a California court to address “the generation of fake legal authority by AI sources” and should double as a warning for all attorneys in the state.

The American Bar Association and California State Bar have issued similar guidelines that AI cannot replace the judgment of trained lawyers and that attorneys should not become overly reliant on the technology.

Cooper, McWhorter and organizations such as the ABA all agree that there is a long list of legitimate uses of AI technology in the law. Much of it is geared toward helping summarize and analyze large data sets, while other tools can help be a middle step in crafting writing.

“The best analogy is we are creating the bones of the strategy, generative AI is adding the first-pass flesh onto those bones and then we’re going back and sculpting it into the final creation,” McWhorter said. “It’s really an intermediary in the process; it’s neither a beginning nor an end.”

‘Erodes trust in the legal profession’

Thus far, the most obvious and visible risk that has emerged in the use of AI in legal work is that of hallucinations. Several watchdog groups have been tracking cases in which court filings have contained AI hallucinations.

While the databases show that many such instances involve pro se litigants, or non-attorneys representing themselves, hundreds of licensed attorneys have also been sanctioned, reprimanded or otherwise caught submitting filings containing AI hallucinations, according to one such database compiled by attorney and researcher Damien Charlotin. His database only tracks cases in which a court has explicitly found or implied that a party relied on hallucinated content.

Charlotin’s database includes three cases in which U.S. judges were found to have written orders or opinions containing AI hallucinations. Meanwhile, the New York Times recently reported that a district attorney in Northern California has been accused of filing briefs containing mistakes typical of AI, one of the first known cases involving suspicions of prosecutorial misuse of the technology.

So far in San Diego, there are two known cases involving court documents containing AI hallucinations.

On Oct. 2, a panel of judges from the California Court of Appeals’ 4th Appellate District sanctioned longtime San Diego criminal defense attorney George Siddell, finding that he violated the Rules of Professional Conduct. They ordered him to pay $1,500 as part of the sanction.

A member of the California State Bar since 1971, Siddell admitted to filing a motion in a client’s criminal appeal that contained a citation to a case that doesn’t exist, a fake quote from a real case and two citations to cases that did not address the issues for which they were cited, according to a published appellate opinion. Siddell declined to comment for this story.

The judges wrote that Siddell’s conduct, when compared to similar conduct by attorneys in civil matters, was “particularly disturbing because it involves the rights of a criminal defendant, who is entitled to due process … and representation by competent counsel.”

The next day, San Diego Superior Court Judge Carolyn Caietti ruled that two attorneys from Tyson & Mendes, a national firm headquartered in San Diego, had filed multiple documents containing AI hallucinations in the case defending the local company in the auto injury lawsuit.

A Tyson & Mendes partner wrote in a declaration prior to the ruling that he took responsibility for the mistakes, though he blamed the errors on a younger associate attorney who he said “neglected to confirm the accuracy of certain case citations.”

In her own declaration, the associate attorney took responsibility and wrote that she was fired from the firm “as a direct result of my actions and conduct in this case.”

In a statement provided by Tyson & Mendes, the firm said in part: “As the Court in this case noted, we accept responsibility for our obligation to present the highest quality work product to the Court. We affirm this responsibility, even and especially in the face of technological transformation.”

The firm also added a lengthy explanation about how it is endeavoring to be a leader in the use of AI in the legal industry.

“As the practice of law continues to evolve through new challenges, opportunities, and technologies, we must also continue to hold ourselves accountable through introspection and transparency,” the firm said in its statement. “Tyson & Mendes remains steadfast in our commitment to our clients, our industry, and our profession to leverage the transformative power of AI and new technologies with keen professional and ethical judgment, ongoing education, and agility.”

Caietti did not ultimately sanction either attorney, though her decision was based on procedural issues rather than their conduct.

“Notwithstanding the denial on procedural grounds, the Court is deeply troubled by the conduct of Defense counsel,” Caietti wrote. “… All of this conduct is contrary to the rules of professional responsibility and is the type of conduct that erodes trust in the legal profession … This is hopefully an experience that will never be repeated by the attorneys involved in this matter, let alone others in the profession.”

Client confidentiality

Since AI learns from the data fed to it by its users, attorneys must also take care that confidential client information is not used to train AI models and that it does not inadvertently become public.

For patent attorneys such as McWhorter, those risks revolve around business interests and market competition. Other areas of the law — Cooper mentioned due process and evidentiary issues, as examples — could implicate constitutional rights and protections.

Cooper said that unless and until there are stronger regulations, it will be up to each attorney and law firm to understand the AI technology they use and mitigate any potential risks and harms.

‘Effectively and ethically’

Newer attorneys especially run the risk of becoming over-reliant on AI tools without first building a foundational knowledge of how to practice the law, Cooper said.

At California Western School of Law, the use of AI is a balancing act. The faculty is navigating how best to ensure that students don’t abuse AI technology in their coursework while also teaching them how practicing attorneys are using it.

“We’re trying to make sure that we prepare our students to be able to enter the workforce, enter the profession, and use it effectively and ethically,” said Liam Vavasour, vice dean for academic affairs.

Vavasour said students are not allowed to use ChatGPT or other generative AI tools for writing assignments unless given explicit permission to do so, and even then the use is typically limited to idea-generation or editing and must be disclosed.

Vavasour said that from his understanding, practicing attorneys and judges are using AI in a variety of ways, “so we’re trying to make sure that our students know how to use it effectively and some of the pitfalls to avoid.”

McWhorter supervises younger associates at his firm and believes fears about them being over-reliant on AI are overblown.

“Because the value of generative AI is not in legal strategy, (young attorneys) will develop the ability to provide legal strategy the same as anyone else,” McWhorter said.

Source link


Attorneys and law firms can elevate their online presence with professionally written content from SEO Content Writing Services monthly plan. Our team of experienced writers specializes in crafting blog posts, articles, and written content that accurately reflect the expertise and knowledge of our clients in the legal field. With a keen eye for detail and a thorough understanding of legal terminology, we provide high-quality writing that helps our clients stand out from their competition and engage with their target audience. Trust SEO Content Writing Services for one time article writing or monthly written content to handle all of your written content needs and showcase your law firm's expertise.
If you need written content, blog posts, or articles professionally written for your website, we can help. Go HERE to find out more.
or email us here: myseowritingservices@gmail.com
To find out more about our article writing or blog post services, fill out the form, thank you.

Name *

First

Last

Business Name

Email *

What type of articles are you intertested in?

Submit

The post AI hallucinations discovered in 2 San Diego court cases appeared first on Attorney Legal Counsel.

The 14-page motion looked like any standard court filing in a civil lawsuit. Filed in April in San Diego Superior Court, attorneys defending a local company were making a routine request for a judge to authorize additional expert witnesses in a vehicle collision injury case.

But on the sixth page of the motion, the attorneys cited legal authority from a case that does not exist — it was hallucinated by artificial intelligence.

A San Diego judge wrote in October that she was “deeply troubled” by the conduct of the company’s civil defense attorneys. She found they had filed multiple documents containing AI hallucinations, including citations to non-existent cases, fake quotes from real cases and inaccurate citations to real but irrelevant legal authorities.

That is one of at least two known San Diego cases that are part of a troubling trend of attorneys abusing or misusing AI, especially generative AI, a powerful technology that can at times fabricate information with no basis in reality.

But even as legal watchdog groups have documented hundreds of AI hallucination cases in the U.S. and around the world, legal experts and attorneys say those cases are rare, arguing that AI is an important tool being put to good use throughout the legal profession, helping lawyers research case law, analyze evidence, draft contracts and complete any number of rote tasks.

“We can’t just ignore generative AI, we have to become experts in the use so that we can avoid issues … where hallucinated case law gets into final documents,” Bryan McWhorter, a patent attorney and partner at the firm Knobbe Martens, said in an interview. “But I think when leveraged correctly, generative AI is frankly a power tool. It’s going to allow me to produce higher-quality work product in less time and deliver that value to clients.”

McWhorter recently argued that AI cannot now and likely never will be able to replace human legal analysis. That’s a view shared by James Cooper, a professor at California Western School of Law in downtown San Diego and co-author of the book “A Short & Happy Guide to Artificial Intelligence for Lawyers.”

“It complements all our skill sets,” Cooper said. “(But) there still needs to be a human in the loop.”

Cooper said there will always be subtlety in fact-finding and questioning people “that robots don’t understand … AI tools can’t fully engage with the nuance of humankind.”

Even so, Cooper is concerned that the use of AI in the legal field may be advancing too rapidly, and he hopes attorneys and firms are implementing safeguards that lawmakers and regulators have not.

“We’re at a juncture now where the technology is far outpacing our ability to regulate it, both as a legal profession but also in the real world, in a non-legal context,” Cooper said. “… We don’t know yet where to put the guardrails.”

‘Risks are no different’

As the use of AI has exploded in recent years, legal organizations have grappled with what sort of guidelines and policies to put in place to ensure that attorneys who use the technology do so ethically and responsibly. That can look different for a patent lawyer such as McWhorter and attorneys who litigate criminal and civil cases before judges, though the basic principles are largely the same.

“Broadly speaking, (the) risks are no different than we’ve always had in the industry, which is we must produce work that is 100% accurate and maintains all of our ethical obligations regarding client confidentiality,” McWhorter said.

For courtroom litigators, a federal judge in New York helped set the standard for the use of the technology in June 2023 while presiding over a case in which attorneys filed documents containing AI hallucinations. He wrote that there is “nothing inherently improper about using a reliable artificial intelligence tool for assistance,” but also noted that existing rules required that attorneys ensure the accuracy of every filing.

That has been the theme of most court opinions and bar association guidelines issued since then.

“Simply stated, no brief, pleading, motion, or any other paper filed in any court should contain any citations — whether provided by generative AI or any other source — that the attorney responsible for submitting the pleading has not personally read and verified,” wrote a panel of judges from California’s Second Appellate District.

The judges said the September opinion was the first by a California court to address “the generation of fake legal authority by AI sources” and should double as a warning for all attorneys in the state.

The American Bar Association and California State Bar have issued similar guidelines that AI cannot replace the judgment of trained lawyers and that attorneys should not become overly reliant on the technology.

Cooper, McWhorter and organizations such as the ABA all agree that there is a long list of legitimate uses of AI technology in the law. Much of it is geared toward helping summarize and analyze large data sets, while other tools can help be a middle step in crafting writing.

“The best analogy is we are creating the bones of the strategy, generative AI is adding the first-pass flesh onto those bones and then we’re going back and sculpting it into the final creation,” McWhorter said. “It’s really an intermediary in the process; it’s neither a beginning nor an end.”

‘Erodes trust in the legal profession’

Thus far, the most obvious and visible risk that has emerged in the use of AI in legal work is that of hallucinations. Several watchdog groups have been tracking cases in which court filings have contained AI hallucinations.

While the databases show that many such instances involve pro se litigants, or non-attorneys representing themselves, hundreds of licensed attorneys have also been sanctioned, reprimanded or otherwise caught submitting filings containing AI hallucinations, according to one such database compiled by attorney and researcher Damien Charlotin. His database only tracks cases in which a court has explicitly found or implied that a party relied on hallucinated content.

Charlotin’s database includes three cases in which U.S. judges were found to have written orders or opinions containing AI hallucinations. Meanwhile, the New York Times recently reported that a district attorney in Northern California has been accused of filing briefs containing mistakes typical of AI, one of the first known cases involving suspicions of prosecutorial misuse of the technology.

So far in San Diego, there are two known cases involving court documents containing AI hallucinations.

On Oct. 2, a panel of judges from the California Court of Appeals’ 4th Appellate District sanctioned longtime San Diego criminal defense attorney George Siddell, finding that he violated the Rules of Professional Conduct. They ordered him to pay $1,500 as part of the sanction.

A member of the California State Bar since 1971, Siddell admitted to filing a motion in a client’s criminal appeal that contained a citation to a case that doesn’t exist, a fake quote from a real case and two citations to cases that did not address the issues for which they were cited, according to a published appellate opinion. Siddell declined to comment for this story.

The judges wrote that Siddell’s conduct, when compared to similar conduct by attorneys in civil matters, was “particularly disturbing because it involves the rights of a criminal defendant, who is entitled to due process … and representation by competent counsel.”

The next day, San Diego Superior Court Judge Carolyn Caietti ruled that two attorneys from Tyson & Mendes, a national firm headquartered in San Diego, had filed multiple documents containing AI hallucinations in the case defending the local company in the auto injury lawsuit.

A Tyson & Mendes partner wrote in a declaration prior to the ruling that he took responsibility for the mistakes, though he blamed the errors on a younger associate attorney who he said “neglected to confirm the accuracy of certain case citations.”

In her own declaration, the associate attorney took responsibility and wrote that she was fired from the firm “as a direct result of my actions and conduct in this case.”

In a statement provided by Tyson & Mendes, the firm said in part: “As the Court in this case noted, we accept responsibility for our obligation to present the highest quality work product to the Court. We affirm this responsibility, even and especially in the face of technological transformation.”

The firm also added a lengthy explanation about how it is endeavoring to be a leader in the use of AI in the legal industry.

“As the practice of law continues to evolve through new challenges, opportunities, and technologies, we must also continue to hold ourselves accountable through introspection and transparency,” the firm said in its statement. “Tyson & Mendes remains steadfast in our commitment to our clients, our industry, and our profession to leverage the transformative power of AI and new technologies with keen professional and ethical judgment, ongoing education, and agility.”

Caietti did not ultimately sanction either attorney, though her decision was based on procedural issues rather than their conduct.

“Notwithstanding the denial on procedural grounds, the Court is deeply troubled by the conduct of Defense counsel,” Caietti wrote. “… All of this conduct is contrary to the rules of professional responsibility and is the type of conduct that erodes trust in the legal profession … This is hopefully an experience that will never be repeated by the attorneys involved in this matter, let alone others in the profession.”

Client confidentiality

Since AI learns from the data fed to it by its users, attorneys must also take care that confidential client information is not used to train AI models and that it does not inadvertently become public.

For patent attorneys such as McWhorter, those risks revolve around business interests and market competition. Other areas of the law — Cooper mentioned due process and evidentiary issues, as examples — could implicate constitutional rights and protections.

Cooper said that unless and until there are stronger regulations, it will be up to each attorney and law firm to understand the AI technology they use and mitigate any potential risks and harms.

‘Effectively and ethically’

Newer attorneys especially run the risk of becoming over-reliant on AI tools without first building a foundational knowledge of how to practice the law, Cooper said.

At California Western School of Law, the use of AI is a balancing act. The faculty is navigating how best to ensure that students don’t abuse AI technology in their coursework while also teaching them how practicing attorneys are using it.

“We’re trying to make sure that we prepare our students to be able to enter the workforce, enter the profession, and use it effectively and ethically,” said Liam Vavasour, vice dean for academic affairs.

Vavasour said students are not allowed to use ChatGPT or other generative AI tools for writing assignments unless given explicit permission to do so, and even then the use is typically limited to idea-generation or editing and must be disclosed.

Vavasour said that from his understanding, practicing attorneys and judges are using AI in a variety of ways, “so we’re trying to make sure that our students know how to use it effectively and some of the pitfalls to avoid.”

McWhorter supervises younger associates at his firm and believes fears about them being over-reliant on AI are overblown.

“Because the value of generative AI is not in legal strategy, (young attorneys) will develop the ability to provide legal strategy the same as anyone else,” McWhorter said.

Source link


Attorneys and law firms can elevate their online presence with professionally written content from SEO Content Writing Services monthly plan. Our team of experienced writers specializes in crafting blog posts, articles, and written content that accurately reflect the expertise and knowledge of our clients in the legal field. With a keen eye for detail and a thorough understanding of legal terminology, we provide high-quality writing that helps our clients stand out from their competition and engage with their target audience. Trust SEO Content Writing Services for one time article writing or monthly written content to handle all of your written content needs and showcase your law firm's expertise.
If you need written content, blog posts, or articles professionally written for your website, we can help. Go HERE to find out more.
or email us here: myseowritingservices@gmail.com
To find out more about our article writing or blog post services, fill out the form, thank you.

Name *

First

Last

Business Name

Email *

What type of articles are you intertested in?

Submit

The post AI hallucinations discovered in 2 San Diego court cases appeared first on Attorney Legal Counsel.

San Diego County District attorney Summer Stephan spent Tuesday on Capitol Hill, testifying before lawmakers about organized retail theft.

“It is not just an economic issue. If you go to the ground level and actually talk to the employees in the stores, you will sense the fear and the trauma and how much impact this has on human beings,” Stephan said.

Stephan spoke about the special team she set up here in San Diego to go after what she called the “criminal industry” of retail theft.

So far, the team has prosecuted 76 people for organized retail theft. In three of those cases, thieves stole more than $250,000 in merchandise, including $700,000 in products from multiple Ulta Beauty stores around the county.

Stephan also criticized the laws against this type of crime as weak and inadequate.

The district attorney has said before that making a case that reaches the level of a felony isn’t easy, since the threshold for felony charges more than doubled, from $400 to $950 dollars in California. 

Source link


Attorneys and law firms can elevate their online presence with professionally written content from SEO Content Writing Services monthly plan. Our team of experienced writers specializes in crafting blog posts, articles, and written content that accurately reflect the expertise and knowledge of our clients in the legal field. With a keen eye for detail and a thorough understanding of legal terminology, we provide high-quality writing that helps our clients stand out from their competition and engage with their target audience. Trust SEO Content Writing Services for one time article writing or monthly written content to handle all of your written content needs and showcase your law firm's expertise.
If you need written content, blog posts, or articles professionally written for your website, we can help. Go HERE to find out more.
or email us here: myseowritingservices@gmail.com
To find out more about our article writing or blog post services, fill out the form, thank you.

Name *

First

Last

Business Name

Email *

What type of articles are you intertested in?

Submit

The post San Diego County DA heads to Capitol Hill to speak out on organized retail theft – NBC 7 San Diego appeared first on Attorney Legal Counsel.

A man was found guilty of a scheme that resulted in over $400,000 worth of stolen vehicles across Southern California.

The suspect, Jean Parret, targeted car dealerships in multiple counties including Los Angeles, Orange, Riverside, Kern and San Diego counties, according to the California attorney General’s Office.

Between November 2021 and February 2022, Parret used victims’ stolen identities to open lines of credit and purchase numerous high-end vehicles from car dealerships, authorities said.

The total amount of stolen vehicles is estimated at over $400,000, according to court documents, with many dealerships victimized in the scheme.

A large amount of the stolen vehicles were eventually transported across the border to Mexico for displacement, officials said.

“His victims included not only the lenders and dealerships who lost hundreds of thousands of dollars, but also the identity theft victims who were left dealing with the financial, legal, and emotional impacts of having their identity stolen and their credit damaged,” said the L.A. County Sheriff’s Department.

3 arrested for $30,000 luxury handbag theft in Glendale

“These are not victimless crimes,” said Orange County District attorney, Todd Spitzer. “Becoming the victim of identity theft can have profound consequences that can take years if not decades to overcome, including having credit histories ruined and losing the ability to qualify for employment opportunities and housing as a result of financial predators.”

“The defendant’s pattern of stealing identities to purchase high-end cars was part of a criminal operation that was stopped in its tracks,” said San Diego District attorney, Summer Stephan. 

Parret was sentenced to 11 years in state prison for charges connected to his extensive identity and auto theft scheme.

His guilty plea and sentencing were the result of an investigation led by the L.A. County Sheriff’s Department’s Taskforce for Regional Auto-Theft Prevention (TRAP). Parret also pled guilty to cases prosecuted by the Orange and San Diego counties’ District attorney Offices.

Close Modal

Suggest a Correction

Suggest a Correction

Source link


Attorneys and law firms can elevate their online presence with professionally written content from SEO Content Writing Services monthly plan. Our team of experienced writers specializes in crafting blog posts, articles, and written content that accurately reflect the expertise and knowledge of our clients in the legal field. With a keen eye for detail and a thorough understanding of legal terminology, we provide high-quality writing that helps our clients stand out from their competition and engage with their target audience. Trust SEO Content Writing Services for one time article writing or monthly written content to handle all of your written content needs and showcase your law firm's expertise.
If you need written content, blog posts, or articles professionally written for your website, we can help. Go HERE to find out more.
or email us here: myseowritingservices@gmail.com
To find out more about our article writing or blog post services, fill out the form, thank you.

Name *

First

Last

Business Name

Email *

What type of articles are you intertested in?

Submit

The post Man stole over $400,000 worth of vehicles from Southern California dealerships appeared first on Attorney Legal Counsel.