Skip to content

13Ayushman/COSMEON-FS-LITE

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

35 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

πŸš€ COSMEON FS-LITE A Distributed Cloud Shredding & Retrieval System

🌐 Live Demo: https://cosme-8fg.pages.dev/

βš™οΈ Backend API: FastAPI (Render) ☁️ Cloud Storage: Supabase Object Storage

🧩 Abstract

COSMEON FS-LITE is a prototype distributed file system designed to demonstrate secure, resilient, and decentralized cloud storage. Instead of storing files as a single object, the system cryptographically fragments data, distributes it across independent cloud nodes, and reconstructs the original file with bit-level accuracy on demand.

The project focuses on data integrity, fault awareness, and cloud-native deployment, making it suitable for hackathon evaluation, academic demos, and distributed systems experimentation.

❓ Problem Statement

Traditional cloud storage systems rely on centralized file storage, which introduces:

Single points of failure

Increased blast radius during breaches

Limited transparency into data integrity

Weak resilience to partial outages

Modern systems require fragmentation, decentralization, and verifiable recovery.

πŸ’‘ Solution Overview

COSMEON FS-LITE implements a distributed shredding protocol:

Files are split into fixed-size fragments

Each fragment is cryptographically hashed

Fragments are distributed across multiple cloud nodes

Metadata tracks fragment order and integrity

Files are reconstructed exactly as uploaded

At no point does any single node contain the complete file.

πŸ—οΈ System Architecture β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”‚ Frontend Dashboardβ”‚ β”‚ (Cloudflare Pages)β”‚ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β”‚ HTTPS β–Ό β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”‚ FastAPI Backend β”‚ β”‚ (Render Cloud) β”‚ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β”‚ β–Ό β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”‚ Supabase Object Storage β”‚ β”‚ Distributed Shard Containers β”‚ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

πŸ” Core Features βœ… Distributed Shredding

Files are split into multiple independent fragments

No fragment contains meaningful standalone data

βœ… Cryptographic Integrity

SHA-256 hashing applied to fragments

Ensures tamper detection and data correctness

βœ… Cloud-Backed Decentralization

Fragments stored across independent cloud objects

Demonstrates decentralized storage logic

βœ… Exact Reconstruction

Fragments are reassembled in order

Output file matches original byte-for-byte

βœ… Real-Time Ground Control UI

Upload & shred files

View active fragments

Reassemble and download files

Detect backend availability in real time

πŸ–₯️ Frontend

Pure HTML + TailwindCSS

Zero framework overhead

Hosted on Cloudflare Pages

Stateless and fully decoupled from backend

πŸ”— Live UI: πŸ‘‰ https://cosme-8fg.pages.dev/

βš™οΈ Backend

FastAPI (Python)

Stateless REST architecture

Handles:

File ingestion

Fragment metadata

Integrity validation

Recovery orchestration

Deployed on Render

Key API Endpoints GET /api/status GET /api/files POST /api/upload GET /api/download/{file_id} DELETE /api/delete/{file_id}

☁️ Storage Layer

Fragments are stored using Supabase Object Storage.

Each uploaded file is stored as a directory:

filename_timestamp/ β”œβ”€β”€ part_0.bin β”œβ”€β”€ part_1.bin β”œβ”€β”€ part_2.bin └── part_3.bin

This layout enables:

Fragment isolation

Independent deletion

Ordered reconstruction

πŸ§ͺ Resilience Model (Prototype)

Node availability is monitored logically

Missing fragments are detected during recovery

System fails safely if reconstruction is impossible

This simulates real distributed system behavior under partial failure.

πŸš€ Local Development (Optional) Backend cd backend pip install -r requirements.txt python main.py

Frontend

Open index.html directly or

Deploy using Cloudflare Pages / Netlify

πŸ§‘β€πŸ’» Technology Stack

Frontend: HTML, TailwindCSS, JavaScript

Backend: Python, FastAPI

Cloud: Render, Supabase, Cloudflare Pages

Security: SHA-256 hashing

πŸ“Œ Use Cases

Secure cloud storage prototypes

Distributed systems demonstrations

Fault-tolerant storage research

Hackathon & academic evaluations

🏁 Project Status

βœ” Fully functional prototype βœ” Cloud-deployed frontend & backend βœ” End-to-end file recovery verified

πŸ“„ License

MIT License β€” free to use, modify, and extend.

About

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors