Skip to content

True random access support for LZ4 lazy decompression #90

@embray

Description

@embray

Follow-up to #88

Should split this to a separate task since it will take a little longer to get right, and isn't of the highest priority since lazy decompression is experimental anyways.

Lazy decompression does still work with LZ4 but only sequentially. But since we store the LZ4 compressed data in a serious of individual blocks, from which we can easily build an index of which block contains which chunk of the decompressed data, it is possible to decompress only individual blocks.

I have in mind how to do this but it does require a fair bit more bookkeeping overhead regarding building the index, tracking which blocks have been fully read in, so on.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or requestrefactoringChanges to code structure or APIs

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions