EdgeChains

EdgeChains.js is Full-Stack GenAI library. Front-end, backend, apis, prompt management, distributed computing. All core prompts & chains are managed declarative

What is EdgeChains?

EdgeChains.js is Full-Stack GenAI library. Front-end, backend, apis, prompt management, distributed computing. All core prompts & chains are managed declaratively in jsonnet (and not hidden in classes)

Overview of EdgeChains

What it is

EdgeChains.js is a full-stack GenAI library that covers front-end, backend, APIs, prompt management, and distributed computing. All core prompts and chains are managed declaratively in Jsonnet (not hidden in classes). It is built on top of Honojs and Jsonnet, developed by Cloudflare and Google respectively.

Key features

  • Just One Script File: Executing production-ready GenAI applications requires only one script file and one Jsonnet file.
  • Versioning for Prompts: Prompts written in Jsonnet are easily versionable and diffable.
  • Automatic parallelism: EdgeChains automatically parallelizes LLM chains and chain-of-thought tasks across CPUs, GPUs, and TPUs using the WebAssembly runtime.
  • Fault tolerance: Designed to be fault-tolerant, it can continue to retry and backoff even if some requests in the system fail.
  • Scalability: Can be used to write chain-of-thought applications on a large number of APIs, prompt lengths, and vector datasets.

Use cases

  • Building chain-of-thought applications that require automatic parallelism and fault tolerance.
  • Managing prompts across multiple LLMs (e.g., GPT-3.5, Llama2) to handle prompt explosion and drift.
  • Deploying production GenAI applications with declarative prompt and chain management outside the code (e.g., in S3 or an API).
  • Tracking token costs and measuring prompt performance with built-in fine-grained tracking.

Getting started

git clone https://github.com/arakoodev/EdgeChains/ cd EdgeChains cd JS/edgechains/examples/chat-with-pdf/ npm install # Set up secrets in secrets.jsonnet (see README for details) npm run start Then hit the GET endpoint at http://localhost:3000/chatWithpdf?question=....

License and pricing

EdgeChains is licensed under the GNU Affero General Public License v3.0 (AGPL-3.0) and is also available as commercial software. For commercial licensing, contact the maintainers or raise an issue on GitHub.

Based on the project's public README and repository metadata.

Add this badge to your README

Featured on YunoDB Badge styles & help

Maintain this project? Show that it is featured on YunoDB.

Markdown[![Featured on YunoDB](https://yunodb.com/badge/arakoodevedgechains.svg)](https://yunodb.com/tools/arakoodevedgechains?utm_source=github&utm_medium=badge)
HTML<a href="https://yunodb.com/tools/arakoodevedgechains?utm_source=github&utm_medium=badge"><img src="https://yunodb.com/badge/arakoodevedgechains.svg" alt="Featured on YunoDB" height="20"></a>