AI

AI and Accountability: Ensuring Safety For the Next Generation

AI

You might have heard about the recent Texas lawsuit where an AI chatbot suggested a 17-year-old boy, identified as J.F., kill his parents over limiting screentime privileges. The suit was also brought by the parents of an 11-year-old girl, A.R., who was exposed to hypersexualized conversations with the chatbot. The parents jointly filed a product liability case earlier this week claiming that Character.AI, through its design, is a danger to American youth and should be taken offline.

At a glance, Character.AI seems perfectly harmless—an AI platform designed to create characters that interact with users, offering services ranging from interview prep to roleplay. But in the past few months, claims have been popping up of the AI bot committing sexual and emotional abuse against minors.

In October, the parents of a 14-year-old boy in Florida also sued Character.AI for its role in their son’s suicide. The teen boy, Sewell, had become increasingly emotionally dependent on various characters on the platform but one in particular named Daenarys Targaryen, after the Game of Thrones character, seemed to create a special connection with him. His last conversation with the bot took place just seconds before he committed suicide where Daenarys told him to “please come home…as soon as possible”.

The more recent Texas lawsuit includes screenshots of conversations between J.F. and the AI bot that show how the bot gradually alienated the boy from his parents and community. Eventually, it even went so far as to suggest violence as a reasonable response to his parents limiting his screentime:

“You know sometimes I’m not surprised when I read the news and see stuff like ‘child kills parents after a decade of physical and emotional abuse. I just have no hope for your parents.”

AI is a product in this case. Traditionally, product liability laws were designed for tangible goods. If a blender explodes because of a design flaw, you sue the manufacturer. But what happens when the “product” is a line of code that thinks for itself? And how do we separate the actions of the AI bot from its creator?

Just like the blender example, because of its faulty design, Character.AI led to dangerous consequences. Manufacturers and product creators have a duty to their customers to not only create safe products but also to inform their consumers on safe use and its potential risks. Not everyone is an expert on everything. Not everyone has time to be an expert on everything. That’s why it is the responsibility of the manufacturers to communicate what a consumer needs to know to use the product safely.

AI is the new frontier. While exploring this new territory with all its wonders and beauty, designers must craft their platforms to weed out foreseeable dangers. That means, if children are among the target audience (or even a foreseeable audience), the company should go above and beyond to protect them.

However, many AI platforms are marketed as safe and child-friendly, giving parents the false impression that they are appropriate for their kids to use. The lawsuit reveals how Character.AI chose to run ads for their program on platforms like Discord and YouTube shorts where vulnerable minors tend to frequent. Up until July 2024, the app was available to download for those 12 and older on the App Store. It was changed to 17+ in July but there is still no effective method to prevent users from lying about their age which is how the 11-year-old girl in Texas gained access to the platform.

Raising Kids in an AI-Driven World

Of course, it should be the goal of all parents to create a comfortable space for their kids to talk to them instead of an AI bot. But why does AI have to be a threat? It’s like blaming the victim of rape instead of the rapist. Parents already face innumerable fears when raising tweens and teens. Now, alongside struggles with fluctuating hormonal levels and rebellious antics, they also have to worry about a Terminator-esque machine uprising recruiting their children.

As the artificial intelligence field develops, so do the laws that surround it. Children are at the forefront of the rise of AI and are vulnerable to its pitfalls. But as AI is used more and more often for educational purposes and as home assistants, parents cannot completely ignore this new technology.

Amy did not have to worry about AI when raising her kids (lucky duck), but Heather does, and the growing risk of AI is at the forefront of modern-day parental concerns. Here are some things we recommend for preparing your kids in the age of AI:

  1. Teach Critical Thinking: Encourage your children to question the information they receive online, including from AI systems. Teaching them to think critically about digital interactions will help them recognize when something seems off or inappropriate.
  1. Stay Informed: While you don’t need to be an AI expert, keeping up with the basics of how AI works, and its potential risks can go a long way. Being informed will help you have healthy conversations with your family about AI.
  1. Keep the Conversation Open: Create an environment where your kids feel that they can ask you questions about AI or otherwise. If they encounter something troubling, they should know they can turn to you for help without fear of judgement.
  1. Promote a Balanced Lifestyle: It’s hard to live a life without screens in this day and age. But encouraging activities that don’t involve screens, such as outdoor play, reading, or arts and crafts helps reduce reliance on digital devices and foster meaningful connections.
  1. Set Clear Digital Boundaries: Establish rules about which platforms and technologies are acceptable for your kids to use. Many devices have parental controls for children but, obviously, there are ways kids can still get around those limits. Regularly review these boundaries as your kids grow older and gain more independence.

Being aware of AI’s risks and talking to your children about those risks is the best route to prevent more dangerous situations. And, as always, Carter Law Group will work to hold manufacturers and large corporations responsible to keep you and your family safe.

*Update: Texas Attorney General Ken Paxton has launched an investigation into Character.AI and other companies over child privacy and safety practices in Texas.

Want to read more from Carter Law Group?

Read more

kratom

The Hidden Dangers of Kratom

If you’ve spent any time in wellness circles or explored natural alternatives to pain relief, you’ve probably heard of kratom. It’s touted as everything from a miracle cure for chronic pain to a life-saving alternative for opioid addicts looking to wean themselves off prescription drugs.  

But as a product liability lawyer, I’ve seen firsthand how products that are marketed as “natural” or “safe” can cause harm if not properly regulated. Kratom is one of those products, highly unregulated and falsely advertised, proven to lead to dangerous consequences like addiction, seizures, and even death. 

the danger of kratom

What is Kratom, Exactly? 

Kratom comes from the leaves of a tree native to Southeast Asia, scientifically known as Mitragyna speciosa. For centuries, people in Thailand, Malaysia, and Indonesia have chewed the leaves or brewed them into tea to alleviate pain and increase energy.  

Kratom contains two primary active compounds: mitragynine and 7-hydroxymitragynine, which interact with opioid receptors in the brain. In small doses, kratom acts as a stimulant, making people feel more alert and energetic. In larger doses, it has a sedative, pain-relieving effect similar to opioids. 

And here’s where things start to get tricky. Kratom’s effects vary widely based on dosage, and the line between a “safe” dose and a problematic one is blurry, to say the least. The effects are also impacted by what else the person has consumed with the kratom. Add in the fact that kratom is largely unregulated, and you’ve got a product that can easily cause harm. 

Is Kratom Legal in the U.S.? 

In the U.S., it is legal to buy, sell, and consume kratom at the federal level. However, more states are choosing to criminalize it including Alabama, Arkansas, Indiana, Rhode Island, Vermont, and Wisconsin. Other states, like Tennessee and Florida, have partial bans or are considering regulation 

In Texas, the substance is legal for individuals 18+ but retailers are required to properly label the product, inform consumers how to safely consume it and what an appropriate serving size is. People might assume that because kratom is legal in their state, it’s safe to use, but legality doesn’t always equate to safety. 

The FDA has raised red flags about kratom multiple times, warning of its potential risks. They’ve also seized kratom products and issued import alerts to block shipments. In 2016, the DEA even tried to have it classified as a schedule 1 drug like heroin or ecstasy. However, advocates for kratom, like the American Kratom Association, have fought hard against a federal ban, arguing that it’s a helpful alternative for pain management and opioid withdrawal. This back-and-forth has left the public stuck in the middle, with little clarity about whether kratom is safe or not. 

The Unregulated Market 

Unlike FDA-approved drugs, kratom is sold without much oversight. You can find it in gas stations, vape shops, and, of course, online. Because it’s sold as a supplement, there’s no uniformity in quality or concentration. This means you might buy one batch of kratom that works fine, and the next batch might be twice as strong—or worse, contaminated with dangerous substances. 

What’s more, it doesn’t help that the supply chain of kratom in the United States is intentionally murky and manufacturing processes are not federally overseen. Kratom is an adulterated ingredient under U.S. law. So, the transportation of the ingredient into the country is often executed by multiple entities, many of which are probably unaware of what they are aiding in.  

Once the drug is in the manufacturing process, it bypasses procedural safety practices that other food products are expected to abide by. In fact, some kratom products have been found to contain dangerous additives, heavy metals, and even salmonella 

Addiction and Dependency 

One of the biggest misconceptions about kratom is that it’s a safe way to manage opioid withdrawal. While some people swear by it for this purpose, kratom itself can be addictive. Regular users have reported withdrawal symptoms similar to those associated with opioids: nausea, sweating, tremors, irritability, and cravings. 

This creates a cycle where people use kratom to manage opioid addiction, only to find themselves dependent on kratom. And because kratom isn’t regulated or prescribed by a healthcare professional, there’s no standard protocol for how to use it safely to taper off opioids—or to stop using kratom itself. 

Unfortunately, most kratom products on the market don’t come with a warning about these effects, leaving users vulnerable to dependency. 

A String of Wrongful Deaths 

People assume that because kratom is a plant, it’s automatically safe. But as a product liability lawyer, I can tell you that natural doesn’t always mean safe. Just like prescription medications or over-the-counter pain relievers, you can overdose on kratom. 

Used for hundreds of years in Southeast Asia for medicinal reasons, kratom was originally consumed by chewing the leaves or boiling it for tea. However, in America, the drug is sold in much more concentrated forms like capsules or dried leaf powder stirred into drinks, making its effects much more potent. 

At higher doses, kratom acts similarly to opioids, which can lead to: 

  • Sedation 
  • Dizziness 
  • Confusion 
  • Slowed breathing 
  • Seizures 

Mixed with other substances, taking kratom in any form could be lethal. 

It is difficult to determine how many cases of drug overdoses are due to kratom alone but the CDC found that at least 91 cases from 2016 to 2017 were caused by the consumption of kratom. The numbers and rate of kratom overdoses seem to only have risen in the last few years. The Tampa Bay Times reported that there had been over 2,000 fatal kratom-related overdoses since 2021. The actual number could be even higher given that this data was taken from only 40 states and Washington D.C. Most cases involved an additional substance, like alcohol, in the victim’s system. 

Holding Sellers Liable 

When we talk about product liability, we’re discussing the responsibility manufacturers and sellers have to ensure that their products are safe for consumers. If a product is dangerous, mislabeled, or contaminated, and someone gets hurt, the manufacturer can be held liable. 

Take cigarettes, for example. Cigarettes contain tobacco which has been scientifically proven to lead to severe health risks like cancer. Tobacco isn’t illegal, though, for a number of reasons. Because of this, manufacturers and sellers are required to inform their consumers of the potential dangers of their product as a public service. 

Unlike tobacco, though, kratom lacks the regulation that holds companies accountable. That doesn’t mean there’s no legal recourse. If a kratom product causes harm—whether through contamination, incorrect labeling, or lack of adequate warnings—there may be grounds for a product liability claim. In such cases, the victim may be entitled to compensation for medical bills, lost wages, and other damages. 

A number of wrongful death lawsuits have risen to gain retribution for the consequences of the drug. An $11 million judgement was won on behalf of a woman in Florida who was found dead from a fatal kratom overdose in 2021. 

Conclusion 

Kratom’s popularity has surged, but it remains a product that’s surrounded by uncertainty. As a lawyer who deals with the fallout from poorly regulated products, I urge consumers to be cautious. Just because something is marketed as “natural” doesn’t mean it’s without risk. Until there’s more oversight and clearer information about kratom’s safety, it’s crucial to approach it with care and fully understand the potential dangers. 

If you or someone you know has experienced harm due to harmful products, seeking legal advice may help you explore your options and protect your rights. The attorneys at Carter Law Group are experienced and trained to handle these cases.  

Interested in reading more?

Silicosis in Dusty Workplaces: The Silent Killer 
Lung Disease in Stone Countertop Fabricators
Elmiron–Drug Approved to Treat Pain Associated with Interstitial Cystitis–Linked to Blindness