Exploring Alternative AI Chat Apps

4 min read
ProductivityLLM ToolsCost Optimization

I regularly use AI chat applications like ChatGPT and Claude.ai for both daily tasks and my work as an ML engineer. While these tools provide convenient access to the latest large language models (LLMs), I've lately been dealing with limitations like rate limits and subscription costs. This led me to explore alternatives with API access, such as the open-source LibreChat.

Subscription-based Chat Apps

ChatGPT and Claude.ai are effective for providing free but limited access to advanced LLMs like GPT-4o and Claude 3.7 Sonnet. Their premium tiers unlock higher usage limits, additional models and features. However, these benefits come with trade-offs:

  1. Multiple Subscriptions Add Up - I often switch between models (GPT for general tasks, Claude for coding), but maintaining paid plans for both is costly.

  2. Rate Limits Still Apply - Even when paying for the “entry-level” tiers (ChatGPT Plus or Claude Pro) the rate limits still apply.

  3. Platform-Locked Features - Each platform offers its own unique features. ChatGPT includes web search and persistent memory, Claude.ai provides its Artifacts feature for prototyping UI elements.

API-based Alternatives

An alternative approach are third-party clients that integrate LLM APIs from providers like OpenAI, Anthropic, Google, Mistral, TogetherAI and others. Most require: (1) adding credits to the provider account, and (2) linking API keys in the client.

I found several advantages:

  • All Models and Chats in One Place - Instead of switching between different apps, I can query different LLMs and have all chats in a single app.

  • Pay-as-you-go Pricing - API pricing is token-based, which is often cheaper than subscriptions for moderate usage.

  • Extended access to models - I can access advanced models like OpenAI’s reasoning models (o1, o3, o4-mini), which may not always be available through the standard web apps.

  • Fewer Rate Limits - So far, I haven’t encountered any rate limits while using APIs.

That said, there are few downsides:

  • Uncapped Costs – API usage can drain credits quickly if unchecked, especially when using strong models. To avoid surprises, I add small balances (e.g., $10) and monitor spending.

  • Potential Reliability Issues - Community-maintained tools may not have the same uptime guarantees as commercial services.

LibreChat

Recently, I started using LibreChat as my primary AI chat application. These are some features I’ve particularly enjoyed:

  • Artifacts UI - LibreChat includes a feature similar to Claude’s Artifacts, which renders React components, HTML, and diagram. This is useful for prototyping, as I’ve discussed in my AI for Web Designs article.

  • Easy Setup and Configuration - Setting up API keys is straightforward.

  • Similar to ChatGPT - The UI resembles ChatGPT’s, so there’s no steep learning curve.

Final Thoughts

For developers and power users, API-based tools like LibreChat offer more flexibility than subscription services. The ability to combine multiple models, have all chats in one place, avoid rate limits, and pay per use aligns well with my workflow.

While ChatGPT and Claude.ai remain good options for casual users who prefer simplicity. But if you’re running into subscription constraints or want finer control over model access, exploring API-based alternatives is worth the effort.