Skip to content
Closed
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 6 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,12 @@

Mojo is a high-performance, multithreaded web crawler tailored for creating high-quality datasets for Large Language Models (LLMs) and AI training. Written in modern C++20 with coroutines, it rapidly fetches entire websites and converts them into clean, structured Markdown, making it the ideal tool for building knowledge bases and RAG (Retrieval-Augmented Generation) pipelines.

## Requirements

- C++20 compatible compiler (GCC 11+, Clang 14+, MSVC 2022+)
- CMake 3.20+
- Boost 1.81+ (Beast, Asio, URL)
Comment on lines +27 to +29

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

There are inconsistencies between this new Requirements section and the existing Prerequisites section (lines 212-215), as well as CMakeLists.txt:

  1. CMake: CMakeLists.txt specifies cmake_minimum_required(VERSION 3.10) and the prerequisites section lists CMake 3.10+, but here it says CMake 3.20+.
  2. GCC: The prerequisites section lists GCC 12+, but here it says GCC 11+.

Let's align these to ensure consistency across the documentation and build files.

Suggested change
- C++20 compatible compiler (GCC 11+, Clang 14+, MSVC 2022+)
- CMake 3.20+
- Boost 1.81+ (Beast, Asio, URL)
- C++20 compatible compiler (GCC 12+, Clang 14+, MSVC 2022+)
- CMake 3.10+
- Boost 1.81+ (Beast, Asio, URL)


## Installation

You can download the latest pre-compiled binaries from the [Releases](https://github.com/malvads/mojo/releases) page.
Expand Down
Loading