Haystack NLP Framework

It is a framework built around LLMs. It can be used for chatbots, generative question-answering, summarization, and much more. The core idea of the library is that we can “chain” together different components to create more advanced use cases around LLMs.

It is an open-source library designed to help developers build conversational streaming user interfaces in JavaScript and TypeScript. The SDK supports React/Next.js, Svelte/SvelteKit, and Vue/Nuxt as well as Node.js, Serverless, and the Edge Runtime.

It provides general-purpose architectures (BERT, GPT-2, RoBERTa, XLM, DistilBert, XLNet…) for Natural Language Understanding (NLU) and Natural Language Generation (NLG) with over 32+ pretrained models in 100+ languages and deep interoperability between TensorFlow 2.0 and PyTorch.

It is a library for advanced Natural Language Processing in Python and Cython. It's built on the very latest research, and was designed from day one to be used in real products. It comes with pre-trained statistical models and word vectors, and currently supports tokenization for 49+ languages.

rasa NLU (Natural Language Understanding) is a tool for intent classification and entity extraction. You can think of rasa NLU as a set of high level APIs for building your own language parser using existing NLP and ML libraries.

Build, train, and deploy state of the art models powered by the reference open source in machine learning.

It is a Python library for topic modelling, document indexing and similarity retrieval with large corpora. Target audience is the natural language processing (NLP) and information retrieval (IR) community.

It allows you to run open-source large language models, such as Llama 2, locally.

It provides an easy method to compute dense vector representations for sentences, paragraphs, and images. The models are based on transformer networks like BERT / RoBERTa / XLM-RoBERTa etc. and achieve state-of-the-art performance in various tasks.

It is a project that provides a central interface to connect your LLMs with external data. It offers you a comprehensive toolset trading off cost and performance.

It is an open-source embedding database. Chroma makes it easy to build LLM apps by making knowledge, facts, and skills pluggable for LLMs.

Amazon Comprehend is a natural language processing (NLP) service that uses machine learning to discover insights from text. Amazon Comprehend provides Keyphrase Extraction, Sentiment Analysis, Entity Recognition, Topic Modeling, and Language Detection APIs so you can easily integrate natural language processing into your applications.

You can use it to extract information about people, places, events and much more, mentioned in text documents, news articles or blog posts. You can use it to understand sentiment about your product on social media or parse intent from customer conversations happening in a call center or a messaging app. You can analyze text uploaded in your request or integrate with your document storage on Google Cloud Storage.

It is a Rust ecosystem of libraries for running inference on large language models, inspired by llama.cpp. On top of llm, there is a CLI application, llm-cli, which provides a convenient interface for running inference on supported models.

It is an open-source, free, lightweight library that allows users to learn text representations and text classifiers. It works on standard, generic hardware. Models can later be reduced in size to even fit on mobile devices.

It is an open-source, drag & drop UI to build your customized LLM flow. It is built on top of LangChainJS, with the aim to make it easy for people to visualize and build LLM apps.

It is a Natural Language Processing library built on top of Apache Spark ML. It provides simple, performant & accurate NLP annotations for machine learning pipelines that scale easily in a distributed environment. It comes with 160+ pretrained pipelines and models in more than 20+ languages.

It provides a set of natural language analysis tools written in Java. It can take raw human language text input and give the base forms of words, their parts of speech, whether they are names of companies, people, etc., normalize and interpret dates, times, and numeric quantities, mark up the structure of sentences in terms of phrases or word dependencies, and indicate which noun phrases refer to the same entities.

AlchemyLanguageTM is the world’s most popular natural language processing service. AlchemyVisionTM is the world’s first computer vision service for understanding complex scenes. AlchemyAPI is used by more than 40,000 developers across 36 countries and a wide variety of industries to process over 3 billion texts and images every month.

It is the easiest way for customers to build and scale generative AI-based applications using FMs, democratizing access for all builders.

Turn emails, tweets, surveys or any text into actionable data. Automate business workflows and saveExtract and classify information from text. Integrate with your App within minutes. Get started for free.

Flair allows you to apply our state-of-the-art natural language processing (NLP) models to your text, such as named entity recognition (NER), part-of-speech tagging (PoS), sense disambiguation and classification.

It is a library for building stateful, multi-actor applications with LLMs, built on top of (and intended to be used with) LangChain. It extends the LangChain Expression Language with the ability to coordinate multiple chains (or actors) across multiple steps of computation in a cyclic manner.

Wit enables developers to add a modern natural language interface to their app or device with minimal effort. Precisely, Wit turns sentences into structured information that the app can use. Developers don’t need to worry about Natural Language Processing algorithms, configuration data, performance and tuning. Wit encapsulates all this and lets you focus on the core features of your apps and devices.

It is geared towards building search systems for any kind of data, including text, images, audio, video and many more. With the modular design & multi-layer abstraction, you can leverage the efficient patterns to build the system by parts, or chaining them into a Flow for an end-to-end experience.

It aims to enable developers (and even non-developers) to quickly build useful applications based on large language models, ensuring they are visual, operable, and improvable.

It is an easy to use desktop app for experimenting with local and open-source Large Language Models (LLMs). It supports any ggml Llama, MPT, and StarCoder model on Hugging Face (Llama 2, Orca, Vicuna, Nous Hermes, WizardCoder, MPT, etc.)

It is a full-stack application and tool suite that enables you to turn any document, resource, or piece of content into a piece of data that any LLM can use as reference during chatting. This application runs with very minimal overhead as by default the LLM and vectorDB are hosted remotely, but can be swapped for local instances.

It is a Python natural language analysis package. It contains tools, which can be used in a pipeline, to convert a string containing human language text into lists of sentences and words, to generate base forms of those words, their parts of speech and morphological features, to give a syntactic structure dependency parse, and to recognize named entities. The toolkit is designed to be parallel among more than 70 languages, using the Universal Dependencies formalism.

High performance NLP models based on spaCy and HuggingFace transformers, for NER, sentiment-analysis, classification, summarization, question answering, and POS tagging. All models are production-ready and served through a REST API. You can also deploy your own spaCy models. No DevOps required.

It is an open-source product analytics suite for LLM-based applications. Iterate faster on your application with a granular view of exact execution traces, quality, cost, and latency.

At the top of each mountain of data lies a nugget of invaluable knowledge, but it takes an incredibly powerful tool to bring that mountain to its knees. That's precisely what our Text Analysis API does.

It is a framework that enables the development of LLM applications using multiple agents that can converse with each other to solve tasks. AutoGen agents are customizable, conversable, and seamlessly allow human participation.

It is a platform for building production-grade LLM applications. It lets you debug, test, evaluate, and monitor chains and intelligent agents built on any LLM framework and seamlessly integrates with LangChain, the go-to open source framework for building with LLMs.

It is the framework for solving advanced tasks with language models (LMs) and retrieval models (RMs). It unifies techniques for prompting and fine-tuning LMs — and approaches for reasoning, self-improvement, and augmentation with retrieval and tools.

It is an SDK that integrates Large Language Models (LLMs) like OpenAI, Azure OpenAI, and Hugging Face with conventional programming languages like C#, Python, and Java. It achieves this by allowing you to define plugins that can be chained together in just a few lines of code.

It provides all you need to build and deploy computer vision models, from data annotation and organization tools to scalable deployment solutions that work across devices.

It is a chat interface that lets you interact with Ollama. It offers features such as code syntax highlighting, Markdown and LaTeX support, local RAG integration, and prompt preset support. It can be installed using Docker or Kubernetes.

Reduce development cost and complexity, and increase developer happiness, with the most powerful companion to any conversational AI project.

It can be used to complement any regular touch user interface with a real time voice user interface. It offers real time feedback for faster and more intuitive experience that enables end user to recover from possible errors quickly and with no interruptions.

prose is a natural language processing library (English only, at the moment) in pure Go. It supports tokenization, segmentation, part-of-speech tagging, and named-entity extraction.

It is an open-source monitoring & observability for AI apps and agents. It is designed to be usable with any model, not just OpenAI. It is easy to integrate and simple to self-host.

Dasha is a conversational AI as a Service platform. Dasha lets you create conversational apps that are more human-like than ever before, quicker than ever before and quickly integrate them into your products.

It is an open platform for operating large language models (LLMs) in production. Fine-tune, serve, deploy, and monitor any LLMs with ease. Run inference with any open-source large-language models, deploy to the cloud or on-premise, and build powerful AI apps.

It enables LLMs to use tools by invoking APIs. Given a natural language query, it comes up with the semantically and syntactically correct API to invoke.

It is a powerful generative large language model that is designed to improve search accuracy and provide personalized recommendations. It is capable of performing a range of generative AI tasks, including text summarization, and text generation, etc.

It is a lightning-fast inference platform that helps you serve your large language models (LLMs). Use a state-of-the-art, open-source model or fine-tune and deploy your own at no additional cost.

Today's personal assistants and conversational interfaces fail to handle variations in a user's wording or multiple requests in one sentence. We take a language-based semantic approach to handle complex dialogue.

It is a low code platform to rapidly annotate data, train and then deploy custom Natural Language Processing (NLP) models. It takes care of model training, data selection and deployment for you. You upload your data and we provide an annotation interface for you to teach a classifier. As you label we train a model, work out what data is most valuable and then deploy the model for you.

It is a framework and no-code GUI designed for fine-tuning state-of-the-art large language models (LLMs).