Affected Component
HNSW index
Current Behavior
The current behavior is fairly general: when reading a vector, we obtain the corresponding segment through storage and call its read method. However, for different scenarios, there are more efficient approaches.
For example, when memory is plentiful, all vectors can be organized using a linear data structure. This significantly speeds up vector reading.
The HNSW index contains many such general behaviors, and we aim to optimize for some high-frequency scenarios to improve retrieval performance.
Desired Improvement
See Current Behavior for details
Impact
faster queries and lower memory.
Affected Component
HNSW index
Current Behavior
The current behavior is fairly general: when reading a vector, we obtain the corresponding segment through storage and call its
readmethod. However, for different scenarios, there are more efficient approaches.For example, when memory is plentiful, all vectors can be organized using a linear data structure. This significantly speeds up vector reading.
The HNSW index contains many such general behaviors, and we aim to optimize for some high-frequency scenarios to improve retrieval performance.
Desired Improvement
See Current Behavior for details
Impact
faster queries and lower memory.