Refactor CandidateFilter

[kroese]

If CandidateFilter would take fast_graph as the input instead of filtered_graph, it would make the whole creation of both types of graphs unnecessary. As only fast_graph would have to be generated instead of both, saving a few seconds.

[Gridflare]

I do plan to completely refactor all graph related code in the repository.
I think that would cover this need.