docs: improve worker docs, and add internals docs

docs: improve worker docs, and add internals docs #517