Skip to content

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 
 
 
 
 

Repository files navigation

📄 Firecrawl AnyDoc Markdown Engine

PyPI Ollama Speed License

An enterprise multi-format document conversion and AI intelligence pipeline powered by Firecrawl AnyDoc (firecrawl-anydoc) sub-5ms Rust C-extension bindings and local Ollama LLM (llama3.2:3b) reasoning.


🚨 Problem to be Solved & Target Solution

Important

Enterprise Document Challenge: Multi-format document workflows suffer from high latency (500ms–1100ms+ per doc), incomplete file coverage (failing on .pptm, .docm, .rtf, .odt), and cloud privacy risks. Firecrawl AnyDoc Solution: Converts 14/14 office formats into unified GFM Markdown in sub-5ms with zero cloud token cost and 100% local on-premise execution.

🎯 Enterprise Document Challenge vs Firecrawl AnyDoc Solution

Feature Category ❌ Legacy Document Parsers (LibreOffice / Docling) ✅ Firecrawl AnyDoc Engine
⏱️ Conversion Latency 500ms – 1,129ms per document (Heavy ML/JVM overhead) 4.4ms median speed (100x faster pure Rust C-extension)
📁 Format Coverage 4 – 8 formats (Fails on .pptm, .docm, .rtf, .odt) 📦 14 / 14 Formats (.docx, .pptx, .xlsx, .pdf, .epub, .csv)
🧠 LLM Readiness Inconsistent Markdown, broken tables, missing anchors 📄 Unified GFM Markdown (Shared document model & single serializer)
🔒 Privacy & Cost High cloud API costs / Third-party data exposure 🛡️ 100% On-Premise & Local (Zero external cloud token fees)
┌───────────────────────────────────┐      ┌───────────────────────────────────┐      ┌───────────────────────────────────┐
│   📁 14+ Document Formats         │      │  ⚡ Firecrawl AnyDoc Engine       │      │   🧠 Local Ollama AI Pipeline     │
│                                   │      │                                   │      │                                   │
│   • PowerPoint (.pptx, .ppt)      │ ───► │   • Content-Based Format Detection│ ───► │   • llama3.2:3b Reasoning Model   │
│   • Word (.docx, .doc)            │      │   • Shared Document Representation│      │   • Multi-Document Synthesis      │
│   • Excel (.csv, .xlsx)           │      │   • Sub-5ms GFM Markdown Stream   │      │   • Output: Executive AI Report   │
└───────────────────────────────────┘      └───────────────────────────────────┘      └───────────────────────────────────┘

⚡ Quick Start & Run Commands

Execute these steps in your Windows PowerShell terminal:

1. Install Python Dependencies

pip install firecrawl-anydoc requests

2. Launch Local Ollama Model

Ensure Ollama is running locally and pull the target reasoning model:

ollama run llama3.2:3b

3. Run Document Intelligence Engine

Execute the conversion pipeline to convert all files inside sample_docs/ to Markdown and synthesize executive insights:

python main.py

📐 Technical Architecture & Module Structure

The project maintains a high-performance Python engine leveraging Firecrawl AnyDoc Rust native binaries:

Anydoc/
├── main.py              # ⚡ Primary Python engine invoking firecrawl-anydoc & Ollama LLM
├── sample_docs/         # 📂 Multi-format document workspace (PPTX, DOCX, CSV, HTML, TXT)
│   ├── Q4_AI_Strategy.pptx
│   ├── Vendor_Agreement.docx
│   ├── Financial_Metrics.csv
│   ├── Release_Notes.html
│   └── System_Audit.txt
└── README.md            # 📄 Root project documentation

Module Explanations

  • main.py: Invokes anydoc.to_markdown(filepath) C-extension calls. Automatically detects format signatures, converts Word, PPT, Excel, CSV, and PDF documents into unified GFM Markdown in <5ms, and posts combined Markdown context to local Ollama REST endpoints.
  • sample_docs/: Working document directory containing multi-category open-source test files demonstrating slide deck parsing, table mapping, spreadsheet numerical ingestion, and text log analysis.
  • README.md: Project documentation covering setup, architecture, installation, and usage commands.

🌟 5 Real-World Enterprise Use Cases

  1. ⚡ Sub-5ms LLM RAG Ingestion: Convert incoming email attachments (DOCX, PPTX, XLSX) into clean Markdown instantly before vector embedding in RAG pipelines.
  2. 📈 M&A Financial Auditing: Ingest quarterly financial spreadsheets (CSV/XLSX) and presentation decks (PPTX) into unified Markdown reports for instant compliance checks.
  3. 📜 Legal Contract Review: Convert multi-page Word contracts (.docx/.doc) to GFM Markdown with preserved heading anchors and table structures for automated risk scoring.
  4. 🔒 Offline Air-Gapped Intelligence: Process sensitive enterprise documents locally without external OCR services, cloud API keys, or internet connectivity.
  5. 🌐 Cross-Format Knowledge Migration: Convert legacy office documents (.doc, .ppt, .rtf, .odt) into standardized GitHub-Flavored Markdown for developer documentation portals.

🚀 5 Future Engineering Roadmap Features

  1. ☁️ Hosted Firecrawl Parse Cloud OCR: Integrate Firecrawl Parse hosted API for scanned image-only PDF OCR extraction.
  2. 🌐 WASM Browser Client Integration: Embed @firecrawl/anydoc-wasm for zero-server client-side document conversions inside web apps.
  3. ⚡ Multi-Threaded Directory Ingestion: Process large document folders using Python thread pools to convert thousands of files per second.
  4. 🗄️ Vector Database Chroma Integration: Embed converted GFM document chunks directly into local ChromaDB collection indexes.
  5. 🤖 CLI Skill Distribution: Package as an Agent Skill (npx skills add firecrawl/anydoc) for automated LLM coding agent document reading.

🏷️ Keywords & Search Tags

firecrawl-anydoc document-parsing rust-converter gfm-markdown ollama-llm python-bindings fast-markdown-converter anydoc firecrawl document-ai

About

Firecrawl AnyDoc: Blazing Fast 4ms Document Parsing! Fast Rust library converting office documents (PPTX, DOCX, CSV, PDF, RTF) to clean GFM Markdown and local Ollama LLM synthesis.

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages