Remove Dependencies Caching on CI

[threeal]

This issue proposes removing the steps for caching dependencies in the build workflow. The main reason for this is that caching the dependencies is not worthwhile, considering that installing the dependencies currently doesn't take much time.