A C++ distributed word counting system using ZeroMQ for parallel text file processing and trying communicating via sockets in c++ with zmq. As there is still a lot of room for improvement, it might be adjusted in the future.
- ZeroMQ library
- CMake
- C++17 compiler
mkdir build
cd build
cmake ..
make- Start workers:
./worker- In another terminal, run distributor:
./distributor <input_file.txt>- Split file across workers
- Process chunks concurrently
- Merge word counts
- Display results