Outperformed by AI: Time to Replace Your Analyst?
Your Analysts Have Competition — And It’s Not Human. Six AI models recently went head-to-head with seasoned equity analysts to produce SWOT analyses, and the results were striking. In many cases, the AI didn’t just hold its own; it uncovered risks and strategic gaps the human experts missed. This wasn’t theory. My colleagues and I ran a controlled test of leading large language models (LLMs) against analyst consensus on three companies: Deutsche Telekom (Germany), Daiichi Sankyo (Japan), and Kirby Corporation (USA). Each was the most positively rated stock in its region as of February 2025 — the kind of “sure bet” that analysts overwhelmingly endorse. We deliberately chose market favorites because if AI can identify weaknesses where humans see only strengths, that’s a powerful signal. It suggests that AI has the potential not just to support analyst workflows, but to challenge consensus thinking and possibly change the way investment research gets done. The Uncomfortable Truth About AI Performance Here’s what should make you sit up: With sophisticated prompting, certain LLMs exceeded human analysts in specificity and depth of analysis. Let that sink in. The machines produced more detailed, comprehensive SWOTs than professionals who have spent years in the industry. But before you eliminate the need for human analysts, there’s a crucial caveat. While AI excels at data synthesis and pattern recognition, it can’t read a CEO’s body language or detect the subtext in management’s “cautiously optimistic” guidance. As one portfolio manager told us, “Nothing replaces talking to management to understand how they really think about their business.” The 40% Difference That Changes Everything The most striking finding? Advanced prompting improved AI performance by up to 40%. The difference between asking “Give me a SWOT for Deutsche Telekom” and providing detailed instructions is the difference between a Wikipedia summary and institutional-grade research. This isn’t optional anymore — prompt engineering is becoming as essential as Excel was in the 2000s. Investment professionals who master this skill will extract exponentially more value from AI tools. Those who don’t will watch competitors produce superior analysis in a fraction of the time. The Model Hierarchy: Not All AI Is Created Equal We tested and ranked six state-of-the-art models: Google’s Gemini Advanced 2.5 (Deep Research mode) — The clear winner OpenAI’s o1 Pro — Close second with exceptional reasoning ChatGPT 4.5 — Solid but notably behind the leaders Grok 3 — Elon Musk’s challenger showing promise DeepSeek R1 — China’s dark horse, fast but less refined ChatGPT 4o — The baseline for comparison The reasoning-optimized models (those with “Deep Research” capabilities) consistently outperformed standard versions such as ChatGPT-4o. They provided more context, better fact-checking, and fewer generic statements. Think of it as hiring a senior analyst versus a junior analyst — both can do the job, but one needs far less handholding. Timing matters too. The best models took 10 to 15 minutes to produce comprehensive SWOTs, while simpler models delivered in less than a minute. There’s a direct correlation between thinking time and output quality — something human analysts have always known. The European AI Deficit: A Strategic Vulnerability Here’s an uncomfortable reality for European readers: Of the models tested, five are American and one is Chinese. Europe’s absence from the AI leadership board isn’t just embarrassing — it’s strategically dangerous. When DeepSeek emerged from China with competitive performance at a fraction of Western costs, it triggered what some called a “Sputnik moment” for AI. The message was clear: AI leadership can shift rapidly, and those without domestic capabilities risk technological dependence. For European fund managers, this means relying on foreign AI for critical analysis. Do these models truly understand ECB communications or German regulatory filings as well as they grasp Fed statements? The jury’s out, but the risk is real. The Practical Integration Playbook Our research points to a clear four-step approach for how investment professionals should use these tools 1. Hybrid, Not Replacement: Use AI for the heavy lifting — initial research, data synthesis, pattern identification. Reserve human judgment for interpretation, strategy, and anything requiring genuine insight into management thinking. The optimal workflow: AI drafts, humans refine. 2. Prompt Libraries Are Your New Alpha Source: Develop standardized prompts for common tasks. A well-crafted SWOT prompt is intellectual property. Share best practices internally but guard your best prompts like trading strategies. 3. Model Selection Matters: For deep analysis, pay for reasoning-optimized models. For quick summaries, standard models suffice. Using GPT-4o for complex analysis is like bringing a knife to a gunfight. 4. Continuous Evaluation: New models launch almost weekly. Our six-criteria evaluation framework (Structure, Plausibility, Specificity, Depth, Cross-checking, Meta-evaluation) provides a consistent way to assess whether the latest model truly improves on its predecessors. Please refer to the full research report for more details: “Outperformed by AI: Time to Replace Your analyst?” (Michael Schopf, April 2025). Beyond SWOT: The Expanding Frontier While we focused on SWOT analysis, the implications extend across the entire investment process. We list a few of these below, but there are many more: Earnings call summarization and analysis in minutes, not hours ESG red flag identification across entire portfolios Regulatory filing analysis at scale Competitive intelligence gathering Market sentiment synthesis Each application frees human analysts for higher-value work. The question isn’t whether to adopt AI — it’s how quickly you can integrate it effectively. The Uncomfortable Questions Let’s address what many are thinking: “Will AI replace analysts?” Not entirely, but it will replace analysts who don’t use AI. The combination of human + AI will outperform either alone. “Can I trust AI output?” Trust but verify. AI can hallucinate facts or miss context. Human oversight remains essential, especially for investment decisions. “Which model should I use?” Start with Gemini Advanced 2.5 or o1 Pro (or the successors) for complex analysis. But given the pace of change, reassess quarterly. “What if my competitors use AI better?” Then you’ll be playing catch-up while they’re finding alpha. Staying on the sidelines while competitors build AI advantage means ceding ground in an increasingly competitive landscape. The Path Forward The genie is out of the bottle. LLMs have
Outperformed by AI: Time to Replace Your Analyst? Read More »











