#22276 was an attempt to fix unnecessarily high memory usage during set_meta() for sequence filetypes on files with extremely long lines. Unfortunately, this doesn't work, since upon failing to read an entire line, we immediately fall through to an unchunked fh.readline().
Here's a memray-flamegraph showing this.
#22276 was an attempt to fix unnecessarily high memory usage during
set_meta()for sequence filetypes on files with extremely long lines. Unfortunately, this doesn't work, since upon failing to read an entire line, we immediately fall through to an unchunkedfh.readline().Here's a memray-flamegraph showing this.