perf: reduce memory footprint of cyrcular graph breakends command#7
perf: reduce memory footprint of cyrcular graph breakends command#7dlaehnemann wants to merge 1 commit into
cyrcular graph breakends command#7Conversation
dlaehnemann
commented
Nov 1, 2024
- reduce max usable read coverage to 32767 by switching Count to i16 from i32, this just about halves memory usage
…i16 from i32, this just about halves memory usage
|
Also, in a second step, could we go and simply use |
Yes, I don't see why not (apart from requiring additional external input files) |
|
Yeah, but it would also be more in the spirit of specialized tools that do one thing, but do it well... But I have to admit that the D4 crate does not come with any examples in the docs, so one would probably have to scour the |
|
Also, this PR here seems to have fit all of my current data into the respective HPCs memory. Just barely, but it worked. So I am assuming there's probably also another code path that uses a lot of memory at some point. I'll have to run heaptrack with a large sample on the HPC at some point. |