Pathway
A Python ETL framework designed for efficient stream processing, real-time analytics, large language model (LLM) pipelines, and retrieval-augmented generation (RAG). pathway enables building robust and scalable data workflows with support for complex, real-time data transformations and AI-driven analytics.
Pathway is built in Python, distributed under the Other license, 63.5k GitHub stars, latest release v0.30.0.
Stats refreshed
- Language
- Python
- Latest Release
- v0.30.0
- License
- Other
Our Newsletter
Get new Development tools right in your inbox
Get short emails with useful development projects, releases, and repos worth watching.
Key Features
- Stream processing with low latency
- Supports real-time analytics workflows
- Integrated LLM and RAG pipeline support
- Flexible ETL pipeline design
- Scalable for large data volumes
Alternative Tools
Resources
Community
More Development tools
Build Your Own X
Master programming by recreating well-known technologies from scratch with hands-on projects.
FreeCodeCamp
freeCodeCamp.org's open-source codebase and curriculum. Learn math, programming, and computer science for free.
Public APIs
A curated list of free APIs for use in software and web development, enabling easy discovery of public API resources.
System-design-primer
An essential resource for learning how to design large-scale systems, preparing for system design interviews, and includes comprehensive Anki flashcards.
Project-Based Learning
A curated list of practical project-based tutorials to learn programming and software development skills.
React
The library for web and native user interfaces, enabling the creation of complex, interactive UIs with a component-based approach.