What is LangStream?

Open-source framework for building and running event-driven Gen AI applications

LangStream is a powerful framework for building and running Generative AI (Gen AI) applications. If you're a developer keen on leveraging the prowess of Large Language Models (LLMs) like GPT-4 or vector databases like Astra DB or Pinecone, all while maintaining the flexibility of stream processing, LangStream is your go-to solution.

Why Choose LangStream?

Easy Development to Production

Develop and test robust Gen AI apps right on your laptop. When you're ready, deploy to a production environment powered by Kubernetes and Kafka—all through a single CLI command.

Event-Driven Architecture

LangStream is engineered event-driven computing by a team with decades of experience. Build reactive, scalable, and fault-tolerant Gen AI applications with ease.

Configurable Agents

Out of the box, LangStream offers configuration-driven agents designed for various tasks—be it AI chat completions, text processing, or working with vector databases. If they don't meet your unique needs, craft your own agents in Python.

Up-to-Date Libraries

The LangStream runtime is always stocked with the latest Gen AI libraries like LangChain and LlamaIndex, so you're never left behind.

Open Source

LangStream is an open source project under the Apache 2 licence, so you are free to use it in your projects. We also welcome contributions from the community.

Notable Features

• Built on Solid Foundations: Utilizes industry-tested technologies like Kubernetes and Apache Kafka.

• LLM Support: Comes with support for LLM services such as ChatGPT, Google Vertex AI, and HuggingFace.

• Vector Embedding Support: Seamless integration with vector databases like Pinecone and Astra DB Vector.

• Rich Prompt Templating: Generate context-rich prompts through event data, semantic searches, and database queries.

• Versatile Data Processing: Handle both unstructured and structured data formats.

• Real-time External Integration: Kafka Connect sinks and sources for immediate system integration.

• Full Observability: Comprehensive Prometheus metrics and Kubernetes logs.

• Developer-Friendly: An exclusive VS Code Extension for development and debugging.

Ideal Use Cases

• Develop Q&A chatbots with advanced Retrieval-Augmented Generation (RAG).

• Create and manage vector embedding pipelines.

• Automated text summarization and personalized recommendation pipelines.

LangStream is a toolkit for unlocking the full potential of Gen AI.