C MapReduce WordCount

Minimal MapReduce-style word count system written in C using ZeroMQ and pthreads.

Overview

• Distributor splits input text into chunks
• Workers process chunks (map + reduce)
• Results are aggregated into a final word frequency list

Build

cmake -B build && make -C build

Run

1. Start workers (in separate terminals)

./build/zmq_worker 5555
./build/zmq_worker 5556
...

2. Run distributor

./build/zmq_distributor input.txt 5555 5556 ... > output.csv

Output

word,frequency
example,42
test,17

Notes

• Uses a custom hashmap implementation
• Communication via ZeroMQ request/reply pattern
• Chunking avoids splitting words across boundaries