Starter stack

Python AI backend with a web front end

The AI part of your product lives in Python — models, data work, the libraries researchers publish first — and the front end is a separate web app talking to it.

0 makers' products and 35 open-source projects use at least half of these 9 tools.

The picks

Backend Framework

Typed request and response models, async handlers for slow model calls, and automatic OpenAPI docs your front end can generate a client from.

Chosen for backend framework by 29 makers' products we track · the alternatives →
Database Access & ORMs

The standard Python data layer, with Alembic for migrations.

No maker's product we track shows it for database access & ORMs yet · the alternatives →
Database
PostgreSQLIn Replit

One database for app data and, with pgvector, embeddings too.

Chosen for database by 74 makers' products we track · the alternatives →
AI SDK & Agent Framework

A small, typed agent loop in the same Pydantic style as FastAPI — structured outputs you can validate.

No maker's product we track shows it for AI SDK & agent framework yet · the alternatives →
LLM API
Claudellms.txtIn Lovable, Replit

Strong at long documents and tool use; switch per task when another model is cheaper.

Chosen for LLM API by 251 makers' products we track · the alternatives →
Vector Database

An open-source vector store with filtering and hybrid search, self-hosted or managed.

Chosen for vector database by 18 makers' products we track · the alternatives →
LLM Observability & Evals

Traces, costs and evals with a first-class Python SDK, self-hostable.

Chosen for LLM observability & evals by 33 makers' products we track · the alternatives →
Frontend Framework

The web app in front, calling the FastAPI backend through a generated, typed client.

Chosen for frontend framework by 1510 makers' products we track · the alternatives →
Hosting

Runs a long-lived Python server, background workers and Postgres side by side, without servers to manage.

Chosen for hosting by 128 makers' products we track · the alternatives →

What this costs you

Two languages mean two deploys, two sets of dependencies and an API contract to keep in sync. If the AI work is mostly calling model APIs, a TypeScript-only stack is simpler; go Python when you need its libraries.

Ask your AI about this, with this page as the source:ChatGPT ↗Claude ↗Perplexity ↗

Who builds this way

Using at least half of these tools, each with a source: makers' products from their own words, customer stories, subprocessor lists or websites; open-source projects from their code.

awesome-llm-appsopen source100+ AI Agents, Agent Skills and RAG Apps - Free and Open Source.7 of these 9 toolsAutoGPTopen sourceAutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.6 of these 9 toolscamelopen source🐫 CAMEL: The first and the best multi-agent framework. Finding the Scaling Law of Agents. https://www.camel-ai.org6 of these 9 toolsFinSynthopen source基于Open WebUI框架的金融大模型交互平台——支持多模态非结构化数据处理6 of these 9 toolspuppyone-cloudopen sourceContext drive for your AI agents6 of these 9 toolsagentfieldopen sourceBuild, run and scale AI agents like API and microservices5 of these 9 toolsever-worksopen sourceEver® Works™ - The Workshop for AI. An open agentic runtime that autonomously researches, ships, and maintains entire businesses, 24/7 - https://ever.works5 of these 9 toolsmonitoropen sourceReal-time monitoring, slowlog analysis, and audit trails for Valkey and Redis5 of these 9 toolsomiopen sourceOpen-source AI wearable with mobile and desktop apps that records conversations and meetings and turns them into searchable summaries and action items.5 of these 9 toolssupoclipopen sourceAn open-source OpusClip alternative5 of these 9 toolstracecatopen sourceOpen-source security automation platform for teams and AI agents5 of these 9 toolsAcontextopen sourceAgent Skills as a Memory Layer5 of these 9 toolsagenticaopen sourceOne person, a team of agents. Multi-session CLI that collaborates across terminals; /goal keeps long tasks running; WeChat/WeCom/Feishu gateway lets you call them back when you walk away. Async Python5 of these 9 toolsatomopen sourceAtom Agent, Open-Source Governed AI Agent Platform for Self-Hosted Automation5 of these 9 toolsCopilotKitopen sourceThe Frontend Stack for Agents & Generative UI. React, Angular, Mobile, Slack, and more. Makers of the AG-UI Protocol5 of these 9 toolsCortexONopen sourceOpen-source generalized AI agent for everyday task automations.5 of these 9 toolsDAMO-ConvAIopen sourceDAMO-ConvAI: The official repository which contains the codebase for Alibaba DAMO Conversational AI.5 of these 9 toolsDatus-agentopen sourceThe Future of Data Engineering — A CLI SQL client for the modern data stack, enabling AI-native context engineering for data.5 of these 9 toolsdecipher-research-agentopen sourceTurn topics, links, and files into AI-generated research notebooks — summarize, explore, and ask anything.5 of these 9 toolsdeer-flowopen sourceAn open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, subagents and message gateway, it handles different levels of ta5 of these 9 toolsdustopen sourceCustom AI agent platform to speed up your work.5 of these 9 toolsdynamiqopen sourceDynamiq is an orchestration framework for agentic AI and LLM applications5 of these 9 toolsGenerativeAIExamplesopen sourceGenerative AI reference workflows optimized for accelerated infrastructure and microservice architecture.5 of these 9 toolshonchoopen source Memory library for building stateful agents5 of these 9 toolsLangChain-GPT-Researcheropen sourceGPT-Researcher as a LangChain tool to be used in Agents and Chains5 of these 9 toolsMemOSopen sourceSelf-evolving memory OS for LLM & AI Agents: ultra-persistent memory, hybrid-retrieval, and cross-task skill reuse, with 35.24% token savings and DeepSeek Harness support.5 of these 9 toolsmindroomopen sourceYour AI is trapped in apps. We set it free — Self-hostable AI stack for multi-user, multi-agent workflows on Matrix.5 of these 9 toolsMIRIXopen sourceMirix is a multi-agent personal assistant designed to track on-screen activities and answer user questions intelligently. By capturing real-time visual data and consolidating it into structured memori5 of these 9 toolsonyx-fossopen sourceOpen Source AI Platform - AI Chat with advanced features that works with every LLM5 of these 9 toolsopen-webui-developer-toolkitopen sourcePipes • Filters • Tools for Open WebUI5 of these 9 toolspyspuropen sourceA visual playground for agentic workflows: Iterate over your agents 10x faster5 of these 9 toolsRealCharopen source🎙️🤖Create, Customize and Talk to your AI Character/Companion in Realtime (All in One Codebase!). Have a natural seamless conversation with AI everywhere (mobile, web and terminal) using LLM OpenAI G5 of these 9 toolsrocketride-serveropen sourceHigh-performance AI pipeline engine with a C++ core and 50+ Python-extensible nodes. Build, debug, and scale LLM workflows with 13+ model providers, 8+ vector databases, and agent orchestration, all f5 of these 9 toolssuperduperopen sourceSuperduper: End-to-end framework for building custom AI applications and agents.5 of these 9 toolsyoutube_video_codeopen sourceThe code for all the YouTube videos I publish on YouTube.5 of these 9 tools

Other starter stacks