Author(s): Amit | AI & Side Hustle

Originally published on Towards AI.

A practical developer-first comparison of LangGraph, CrewAI, AutoGen, OpenAI Agents SDK, DSPy, and more after real experimentation.

Six months ago, I decided to evaluate AI agent frameworks seriously. Not because I needed to — I had a working system — but because the space was moving so fast that I felt like I was missing something. The tools available now are genuinely different from what existed a year prior, and the conversations I was seeing online felt reductive. People would declare one framework “the winner,” then pivot three weeks later. I wanted to understand what was actually happening beneath the hype.

The author reports results from experimenting with ten AI agent frameworks (LangGraph, CrewAI, AutoGen, Semantic Kernel, OpenAI’s Agents SDK, PydanticAI, Haystack Agents, LlamaIndex Workflows, Atomic Agents, and DSPy) and argues that the ecosystem is fragmented rather than converging: each framework makes different bets about control vs. abstraction, orchestration style, tool-calling behavior, and state/memory management. Key pain points include messy tool calling (stop/retry/error semantics), underestimated work around state and memory (often requiring wrapper logic), and orchestration complexity that scales poorly beyond a few agents. They highlight which frameworks do well for structured outputs (PydanticAI, DSPy) and where debugging/observability and documentation quality vary dramatically, with many frameworks not built with cross-framework lifecycle visibility in mind. The piece also stresses practical selection criteria—framework fit to the specific problem, integration and dependency footprint, local model and provider support, and production readiness/stability—not just feature checklists. The conclusion recommends choosing based on immediate constraints (and starting with simpler function-calling loops when orchestration isn’t truly needed) and expecting the market to keep evolving.

Read the full blog for free on Medium.

Join thousands of data leaders on the AI newsletter. Join over 80,000 subscribers and keep up to date with the latest developments in AI. From research to projects and ideas. If you are building an AI startup, an AI-related product, or a service, we invite you to consider becoming a sponsor.

Published via Towards AI