Platforms and infrastructural frameworks that enable agent development, research, and deployment
Coding Agents#
| Name | Description |
|---|
| Cognition Devin | Autonomous AI software engineer for complex coding tasks |
| Cursor | AI-native code editor with intelligent code generation |
| GitHub Copilot | AI pair programmer that suggests code and completions |
| Hugging Face | Open-source platform for ML models and datasets |
| LangChain | Framework for building LLM-powered applications |
| Ollama | Tool for running LLMs locally on your machine |
| Opencode | Interactive CLI tool for software engineering tasks |
| Perplexity AI | AI-powered answer engine with real-time information retrieval |
| Umans | Open models inference for coding |
Evals#
| Name | Description |
|---|
| Braintrust | Platform for evaluating and improving LLM applications |
| DeepEval | Open-source evaluation framework for LLM apps, agents, prompts, RAG systems |
| Galileo | AI observability and evaluation platform |
| Harbor | Framework for evaluating agent tasks for optimization |
| Inspect AI | Open-source framework for LLM evaluations |
| LangSmith | Framework agnostic agent engineering observability, evaluation platform |
| OpenAI Evals | Framework for evaluating LLM systems, open-source registry of benchmarks |
| Phoenix | Open-source AI observability platform |
| RAGAS | Systematic evaluation library for AI applications |
LLM Providers#
| Name | Description |
|---|
| Anthropic | AI safety company that develops Claude LLMs and related tools |
| Cohere | Enterprise AI platform for building language models |
| Google Gemini | Google’s multimodal AI model and platform |
| Inflection AI | AI company focused on personal AI assistants |
| Lowdown Labs | AI models using Fourier Neural Operators, linear attention, commodity hardware |
| Meta AI | AI research lab developing LLaMA models and open-source AI tools |
| Mistral | Open-weight LLM company specializing in efficient models |
| OpenAI | AI research company that develops GPT models and API platform |