Canopy

frameworkragtiered

Retrieval Augmented Generation (RAG) framework and context engine powered by Pinecone - pinecone-io/canopy

The Canopy team is no longer maintaining this repository. Thank you for your support and enthusiasm for the project! If you're looking for a high quality managed RAG solution with continued updates and improvements, please check out the Pinecone Assistant. Canopy takes on the heavy lifting for building RAG applications: from chunking and embedding your text data to chat history management, query optimization, context retrieval (including prompt engineering), and augmented generation. Canopy provides a configurable built-in server so you can effortlessly deploy a RAG-powered chat application to your existing chat UI or interface. Or you can build your own, custom RAG application using the Canopy library. Canopy lets you evaluate your RAG workflow with a CLI based chat tool. With a simple command in the Canopy CLI you can interactively chat with your text data and compare RAG vs. non-RAG workflows side-by-side. Canopy implements the full RAG workflow to prevent hallucinations and augment your LLM with your own text data. Canopy has two flows: knowledge base creation and chat. In the knowledge base creation flow, users upload their documents and transform them into meaningful representations stored in Pinecone's Vector Database. In the chat flow, incoming queries and chat history are optimized to retrieve the most relevant documents, the knowledge base is queried, and a meaningful context is generated for the LLM to answer. More information about the Core Library usage can be found in the Library Documentation More information about virtual environments can be found here These optional environment variables are used to authenticate to other supported services for embeddings and LLMs. If you configure Canopy to use any of these providers - you would need to set the relevant environment variables. Output should be similar to this: In this quickstart, we will show you how to use the Canopy to build a simple question answering system using RAG (retrieval augmented generation). As a one-time setup, Canopy needs to create a new Pinecone index that is configured to work with Canopy, just run: To learn more about Pinecone indexes and how to manage them, please refer to the following guide: Understanding indexes You can load data into your Canopy index using the command: The Canopy server exposes Canopy's functionality via a REST API. Namely, it allows you to upload documents, retrieve relevant docs for a given query, and chat with your data. The server exposes a /chat.completion endpoint that can be easily integrated with any chat application. To start the server, run: Now, you should be prompted with the following standard Uvicorn message: To stop the server, simply press CTRL+C in the terminal where you started it. Canopy's CLI comes with a built-in chat app that allows you to interactively chat with your text data and compare RAG vs. non-RAG workflows side-by-side to evaluate the results In a new terminal window, set the required enviro

Mentions (30d)

Reviews

Platforms

GitHub Stars

1,030

129 forks

Voices Discussing Canopy

Luma AI Team

Company at Luma AI (3D/Video)

1 mention

Luma AI

Company at Luma AI (Dream Machine)

1 mention

Share:Twitter LinkedIn

Product Screenshots

Features & Use Cases

Features

set up a virtual environment (optional)install the packageSet up the environment variablesCheck that installation is successful and environment is set, run:Rate limits and pricing set by model providers apply to Canopy usage. Canopy currently works with OpenAI, Azure OpenAI, Anyscale, and Cohere models.More integrations will be supported in the near future.ExtrasMandatory Environment VariablesOptional Environment Variables2. Uploading data

Company Intel

Industry

information technology & services

Employees

6,000

Funding Stage

Other

Total Funding

$7.9B

Social Reach

1,684

GitHub followers

Developer Ecosystem

104

GitHub repos

1,030

GitHub stars

npm packages

Top Mention

twitter@@github5,738 engagement3/16/2026

Brazil, Indonesia, Japan, Germany, and India fueled a massive surge in 2025, adding nearly 36 million new developers to GitHub. 🌏 India alone added 5.2 million. 🇮🇳

Canopy

Compare Canopy With