VectorSwift: Visual Pipeline Builder
Build, connect, and validate data pipelines visually with VectorSwift, a React-based DAG editor featuring real-time validation and backend integration.

VectorSwift: Visual Pipeline Builder
VectorSwift is a visual pipeline builder designed to simplify the creation and management of complex data processing workflows. It offers an intuitive drag-and-drop interface, real-time validation, and backend integration for robust pipeline analysis. This application caters to users who need a visual tool to design and manage their data pipelines, especially in scenarios with multiple data transformation and validation steps.

Overview
VectorSwift allows users to visually design data pipelines using a node-based editor. Users drag and drop nodes representing different processing steps (e.g., data input, transformation, validation, output) and connect them to define the data flow. The application provides real-time validation to ensure the pipeline's integrity and allows for seamless integration with a backend service for more advanced validation and analysis.
Key Features
- Drag-and-drop interface for building pipelines
- Support for multiple node types (Input, Output, LLM, Text, Merge, Filter, Template, Validation, Transform)
- Real-time pipeline validation
- Backend integration via FastAPI for advanced validation and analysis
- Customizable dark/light themes
- Auto-resizing Text node with {{variable}} syntax for dynamic input handles
- Glassmorphism UI design
Technical Implementation
Frontend: React 18, Zustand, React Flow, Framer Motion, React Toastify, AJV. Backend: FastAPI, Python. A Node abstraction simplifies adding new node types. The backend's /pipelines/parse endpoint validates DAGs and counts nodes/edges. Frontend sends pipeline data to this endpoint on submit for validation, displaying results using React Toastify.
Challenges & Solutions
Maintaining consistent styling across different node types and managing complex state updates were key challenges. Solutions included a well-defined component structure, leveraging Zustand's capabilities for state management, and using a custom styling system for cohesive UI.
VectorSwift empowers users to build robust and efficient data pipelines through an intuitive and visually appealing interface.
See more
More projects

GitHub Wiki Vault: A Brain Map of My Code
An Obsidian vault that maps every repository on my GitHub account from its source code, grown every night by an AI agent pipeline that I designed and review. The code is private on purpose.

Tally: Bank Statements to Answers
A personal finance app for Indian bank and UPI statements. It parses, de-duplicates and categorises every transaction, then answers questions about your spending in plain English.

Knowledger: Chapters, Blocks and a Knowledge Graph
A Notion-style knowledge app. Organise what you learn into chapters made of text, code, image, PDF and link blocks, reorder them by drag and drop, and see how chapters connect in a graph.