RocketRide: A C++ Pipeline Engine for AI Workflows (GitHub Repo)
RocketRide provides a multithreaded C++ engine for executing portable, visual AI pipelines with support for over 100 processing nodes.
Deep dive
- Engine: Built on a high-performance, multithreaded C++ runtime.
- Workflow Format: Pipelines are defined in portable, diffable JSON (
.pipefiles). - Node Catalog: Over 100 nodes covering LLMs, vector search, OCR, NER, and agentic loops.
- Observability: Built-in tracing for token usage, latency, and node execution.
- Integration: SDKs for Python and TypeScript allow embedding pipelines as callable functions in host applications.
Decoder
- OCR (Optical Character Recognition): Software that converts images of text into machine-readable text.
- NER (Named Entity Recognition): A sub-task of information extraction that identifies entities like names, organizations, or dates in text.
- PII (Personally Identifiable Information): Data that can be used to identify a specific individual, which requires automated sanitization in AI pipelines.
Original article
RocketRide is the open source AIDE: the AI Development Environment.
Build, deploy and harness production-ready AI solutions at light speed, all within your IDE or using the CLI in your terminal.
Your code editor just became the AIDE. RocketRide turns the classic IDE you already use into a full AI Development Environment: one place to compose, debug, observe, and deploy AI runtimes using any model, any tool, any framework, with zero vendor lock-in. Equipped with deep observability and backed by a battle-tested, high-throughput C++ engine, what you build is production-ready the moment it runs. It's the harness for everything behind your AI applications, not just the agents, but the whole stack beneath them.
Under the hood, RocketRide is an open source data pipeline builder and runtime built for AI and ML workloads. With 100+ pipeline nodes spanning 15+ LLM providers, 9 vector databases, OCR, NER, and more, pipelines are defined as portable JSON, built visually in VS Code, and executed by a multithreaded C++ runtime. From real-time data processing to multimodal AI search, RocketRide runs entirely on your own infrastructure.
Design, test, and ship complex AI workflows from a visual canvas, right where you write code.
Drop pipelines into any Python or TypeScript app with a few lines of code, no infrastructure glue required.
Where to start
| Run it locally Install the extension, pick Local, and run a pipeline on your own machine. Nothing to sign up for. |
Shipping your first AI feature? Start from what you already know: a working pipeline in three steps, no API keys. |
| Want to contribute? Claim an issue with one comment, add a node in Python, or fix the docs you're reading. |
Want to run it without ops? We operate the engine; your .pipe runs unchanged, with nothing to provision. |
Open source, MIT. The whole engine is MIT-licensed and OSI-compliant. No enterprise edition, nothing behind a paywall.
Features
| Feature | Description |
|---|---|
| Rocket Builder | Drag, connect, and configure nodes visually, no boilerplate. Real-time observability tracks token usage, LLM calls, latency, and execution. Pipelines are portable JSON, version-controllable, shareable, and runnable anywhere. |
| High-Performance C++ Runtime | Native multithreading purpose-built for the throughput demands of AI and data workloads. No bottlenecks, no compromises for production scale. |
| 100+ Pipeline Nodes | 15+ LLM providers, 9 vector databases, OCR, NER, PII anonymization, chunking strategies, embedding models, and more. All nodes are Python-extensible, build and publish your own. |
| Multi-Agent Workflows | Built-in CrewAI and LangChain support. Chain agents, share memory across pipeline runs, and manage multi-step reasoning at scale. |
| Coding Agent Ready | RocketRide auto-detects your coding agent: Claude, Cursor, and more. Build, modify, and deploy pipelines through natural language. |
| TypeScript, Python & MCP SDKs | Integrate pipelines into native apps, expose them as callable tools for AI assistants, or build programmatic workflows into your existing codebase. |
| Zero Dependency Headaches | Python environments, C++ toolchains, Java/Tika, and all node dependencies managed automatically. Clone, build, run, no manual setup. |
| One-Click Deploy | Run on Docker, on-prem, or RocketRide Cloud. Production-ready architecture from day one, not retrofitted from a demo. |
Quick Start
- Install the extension for your IDE. Search for RocketRide in the extension marketplace.
- Click the RocketRide extension in your IDE.
- Deploy a server - you'll be prompted on how you want to run the server. Choose the option that fits your setup:
- Local (Recommended) - This pulls the server directly into your IDE without any additional setup.
- On-Premises - Run the server on your own hardware for full control and data residency. Pull the image and deploy to Docker or clone this repo and build from source.
Your first AI feature
Whether you build web apps, integrate APIs, or run backend services, you already have the mental model.
| You already know | Same idea in RocketRide |
|---|---|
| A route that receives a request | A source node: webhook, chat, or dropper |
| Middleware chained in order | Nodes, wired together on a canvas. Most are Python you can open and read |
| The response you return | A response node |
| Config in git, like a Dockerfile | The .pipe file: plain JSON, diffable, reviewable |
| Calling a service from your app | The Python or TypeScript SDK: one call in, one result out |
Three steps, no API keys:
- Run it locally. Follow the Quick Start and pick Local when asked. That's the whole install.
- Open a working pipeline. Open
examples/document-processor.pipein your IDE. Give it a PDF or an image and it pulls out the text, finds names, addresses and other personal data, and returns a cleaned copy. - Call it from your code. The pipeline is now a function your service can call.
pip install rocketrideimport asyncio from rocketride import RocketRideClient async def main(): async with RocketRideClient() as client: run = await client.use(filepath='examples/document-processor.pipe') out = await client.send( run['token'], 'Alice Smith, 12 Elm St, Springfield.', objinfo={'name': 'note.txt'}, mimetype='text/plain' ) print(out) await client.terminate(run['token']) asyncio.run(main())
Observability
Selecting running pipelines allows for in-depth analytics. Trace call trees, token usage, memory consumption, and more to optimize your pipelines before scaling and deploying.
Contributing
Good places to start
- Claim an issue with one comment. Comment
/assignon any open issue and it's yours. - Add a node. Every node is a small Python package. A new provider, tool, or store makes a good first contribution.
- Fix what you just read. Docs PRs are welcome, including this README.
How it works
- One build tool for the whole monorepo:
./buildermanages the C++ toolchain, Python environments, and Java/Tika for you. Clone, build, run.
Fresh dev news, AI-digested daily. Never miss a trend at devoured.fyi