Projects
50views
CompletedWeb Development, React-Flow, Canvas

VectorSwift: Visual Pipeline Builder

Build, connect, and validate data pipelines visually with VectorSwift, a React-based DAG editor featuring real-time validation and backend integration.

R

Rishabh Dubey

August 4, 2025 – August 10, 2025

VectorSwift: Visual Pipeline Builder

VectorSwift: Visual Pipeline Builder

VectorSwift is a visual pipeline builder designed to simplify the creation and management of complex data processing workflows. It offers an intuitive drag-and-drop interface, real-time validation, and backend integration for robust pipeline analysis. This application caters to users who need a visual tool to design and manage their data pipelines, especially in scenarios with multiple data transformation and validation steps.

dark flow.jpg

Overview

VectorSwift allows users to visually design data pipelines using a node-based editor. Users drag and drop nodes representing different processing steps (e.g., data input, transformation, validation, output) and connect them to define the data flow. The application provides real-time validation to ensure the pipeline's integrity and allows for seamless integration with a backend service for more advanced validation and analysis.

Key Features

  • Drag-and-drop interface for building pipelines
  • Support for multiple node types (Input, Output, LLM, Text, Merge, Filter, Template, Validation, Transform)
  • Real-time pipeline validation
  • Backend integration via FastAPI for advanced validation and analysis
  • Customizable dark/light themes
  • Auto-resizing Text node with {{variable}} syntax for dynamic input handles
  • Glassmorphism UI design

Technical Implementation

Frontend: React 18, Zustand, React Flow, Framer Motion, React Toastify, AJV. Backend: FastAPI, Python. A Node abstraction simplifies adding new node types. The backend's /pipelines/parse endpoint validates DAGs and counts nodes/edges. Frontend sends pipeline data to this endpoint on submit for validation, displaying results using React Toastify.

Challenges & Solutions

Maintaining consistent styling across different node types and managing complex state updates were key challenges. Solutions included a well-defined component structure, leveraging Zustand's capabilities for state management, and using a custom styling system for cohesive UI.

VectorSwift empowers users to build robust and efficient data pipelines through an intuitive and visually appealing interface.

See more

More projects