Three Examples of Problems That Are Inappropriate to Solve with Generative AI (and Why)
When Not to Use Generative AI: 3 High-Stakes Problems Better Left to Humans
Generative AI has captured the imagination of professionals across industries, thanks to its ability to enhance creativity, productivity, and problem-solving. However, not every challenge is appropriate for AI to tackle. As we learned in the ACHIEVE Framework, AI should act as an augmented layer that enhances human capabilities—not replace them. Here are three key areas where using Generative AI can cause more harm than good.
1. Diagnosing Mental Health Conditions Without Human Oversight
Generative AI can simulate empathy, summarize psychological research, and even generate therapeutic scripts—but it lacks the human insight, compassion, and ethical responsibility needed in mental health care. Diagnosing or treating mental health conditions without proper human oversight can result in misdiagnosis or harmful guidance.
We learned in the course that augmented intelligence should assist human decision-making, not replace it. AI can help clinicians by organizing notes or summarizing sessions, but the core responsibilities must remain with licensed professionals. This is a domain where human-centered design is critical.
2. Legal Decision-Making in Criminal Justice
Using AI to determine sentencing or parole eligibility introduces serious ethical risks. Generative AI models are trained on historical data, which often contains systemic biases. This can lead to unfair outcomes and erode trust in the justice system.
The ACHIEVE Framework emphasizes that AI should serve as a safety net—summarizing, flagging, or assisting legal professionals—not making the decisions. The nuance required in legal reasoning goes far beyond what statistical models can comprehend.
3. Generating Misinformation or Deepfakes for Political Influence
Perhaps the most dangerous misuse of Generative AI is in creating convincing misinformation. Deepfakes and AI-generated propaganda can spread rapidly, eroding public trust and distorting reality.
AI should help scale great ideas, not manipulate the truth. As we discussed in the course, ethical use of AI means using it to inform and inspire—not deceive. Creating fake content that mimics real people or institutions crosses a moral and societal line.
Conclusion
Generative AI offers incredible benefits—but only when used with care. The ACHIEVE Framework reminds us to focus on augmentation over automation. Knowing when not to use AI is just as critical as learning how to apply it. As creators, leaders, and decision-makers, our responsibility is to ensure AI serves the greater good while respecting human dignity, expertise, and judgment.
