Portkey

It is a platform for building production-grade LLM applications. It lets you debug, test, evaluate, and monitor chains and intelligent agents built on any LLM framework and seamlessly integrates with LangChain, the go-to open source framework for building with LLMs.

It is an AI observability and LLM evaluation platform designed to help ML and LLM engineers and data scientists surface model issues quicker, resolve their root cause, and ultimately, improve model performance.

It is the leading observability platform trusted by high-performing teams to help maintain the quality and performance of ML models, LLMs, and data pipelines.

It is a collaborative, developer-centric, and cloud-based workspace that helps you monitor and improve AI features powered by LLMs and other foundation models.

It helps AI teams build, monitor, and iterate their LLM applications. It provides a suite of tools, accessible through both UI and SDK, for AI teams to collaborate throughout the product development cycle.

It is the first platform built for prompt engineers. Visually manage prompts, log LLM requests, search usage history, collaborate as a team, and more.

It is a platform for structured prompt engineering. It helps you develop, test, and monitor your LLM structured tasks using templates, queries, collections, and functions.

It is a tool for testing and evaluating LLM output quality. With this tool, you can systematically test prompts, models, and RAGs with predefined test cases. It can be utilized as a CLI, a library, or integrated into CI/CD pipelines.

It is an AI-powered LLMOps platform that enables developers to build continuously improving LLM-powered applications and ship them into production.

It leverages the power of cutting-edge deep learning to enhance the world of file type detection. It provides increased accuracy and support for a comprehensive range of content types, outperforming traditional tools with 99%+ average precision and recall.

It helps AI teams rigorously test, validate, and improve GenAI applications throughout the entire development lifecycle.

Continuously validate your LLM-based application throughout the entire lifecycle from pre-deployment and internal experimentation to production.

It is a no-code compute platform for language models. It is aimed at AI developers and product builders. You can also vibe-check and compare quality, performance, and cost at once across a wide selection of open-source and proprietary LLMs.

It is an interactive AI evaluation platform for exploring, debugging, and sharing how your AI systems perform. Evaluate any task and data type with Zeno's modular views which support everything from chatbot conversations to object detection and audio transcription.

It is the toolkit for evaluating and developing robust and reliable AI agents. Build compliant virtual employees with observability, evals, and replay analytics. No more black boxes and prompt guessing.