LLM API · for Astro

LLM API for Astro

Among 25 makers' products we track that are built with Astro, here's what they chose for LLM API — each counted from a live-product source.

Which provider, and whether to go through a gateway. Going direct to a provider gets its newest models and features first and the lowest latency; a gateway gives you one key and one bill for hundreds of models, with fallbacks when a provider is down, for a small markup or a proxy you run. The code that calls the model — an AI SDK or agent framework — is its own decision.

What makers on Astro chose

Counts are live products with a source, not market share; a product using two options counts in both.

OpenAI APIModel provider

llms.txtIn Lovable, Replit

Best forThe broadest model lineup — text, images, speech, embeddings — and the largest ecosystem.

Trade-offFrequent model and API changes to keep up with, and no option to run its hosted models elsewhere.

15 of the 25 Astro products here

Gemini APIModel provider

In Lovable, Replit

Best forVery long context and multimodal input, with a free tier to start.

Trade-offFree-tier prompts may be used to improve Google's products, so paid tier is the one for user data.

6 of the 25 Astro products here · free tier

ClaudeModel provider

llms.txtIn Lovable, Replit

Best forCoding, long documents and agent-style tool use.

Trade-offNo image generation or embedding models of its own, so those need a second provider.

4 of the 25 Astro products here

GroqOpen models, hosted

Best forVery low-latency inference on open models, for real-time features.

Trade-offOnly the open models it chooses to host, and no frontier closed models.

2 of the 25 Astro products here · free tier

Grok APIModel provider

llms.txtIn v0

Best forGrok models with built-in web and X search, plus image, video and voice APIs.

Trade-offReal-time data only arrives when you enable the search tools, which are billed as tool calls.

2 of the 25 Astro products here

OpenRouterGateway (many providers, one API)

llms.txtIn Replit

Best forTrying many models from many providers with one API key and one bill, without opening an account at each.

Trade-offA fee on top of provider prices, and your traffic and data pass through a third party.

2 of the 25 Astro products here · free tier

Mistral AIModel provider

llms.txtIn Replit

Best forA European provider whose API covers chat, coding, OCR and speech models.

Trade-offA smaller ecosystem of third-party integrations than the largest providers.

1 of the 25 Astro products here · free tier

LiteLLMGateway (many providers, one API)

llms.txt MCP

Best forRunning your own OpenAI-compatible proxy in front of your own provider keys, with retries, routing and per-key budgets.

Trade-offYou deploy, monitor and upgrade it yourself; SSO and audit logs are in the paid enterprise tier.

1 of the 25 Astro products here · free tier · open source

Together AIOpen models, hosted

Best forPer-token access to a wide catalog of open-weight models, with fine-tuning and dedicated GPUs from the same vendor.

Trade-offSeveral billing models to compare — per token, per GPU-hour, dedicated and reserved — and only the models it chooses to host.

1 of the 25 Astro products here

Also real options for LLM API, not seen among these Astro products yet: DeepSeek.