Skip to content

CHANGELOG.md

Latest commit

 

History

History
144 lines (84 loc) · 6.44 KB

CHANGELOG.md

File metadata and controls

144 lines (84 loc) · 6.44 KB

Changelog

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.

v2.2.0

Add:

  • Added BasicDiskVectorDatabase to provide a basic automatically disk persistent vector database, and associated BasicDiskVectorStore and BasicDiskVocabularyStore.

v2.1.3

Add:

  • Added IBatchEmbeddingsGenerator and .AddTextsAsync to support batch adding of texts to database.
  • Added OpenAI support for IBatchEmbeddingsGenerator
  • Added IVectorTextResultItem.Similarity and marked IVectorTextResultItem.VectorComparison obsolete. VectorComparison will be removed in the future.
  • Added more comment metadata to code

v2.1.2

Fixed:

  • Fixed a bug when loading saved database from file/stream where IntIdGenerator or NumericIdGenerator lose max Id, resulting in adding new texts to database causes existing texts to be overwritten. This specifically affected SharpVector.OpenAI and SharpVector.Ollama libraries but the fix is implemented within the core Build5Nines.SharpVector library.

v2.1.1

Add:

  • Add optional filter parameter to .Search and .SearchAsync methods that is of type Func<TMetadata, bool> that is called for each text item in the database for more advanced filtering prior to performing vector similarity search and returning results. If undefined or null it's ignored.

v2.1.0

Add:

  • Added VectorTextResultItem.Id property so it's easy to get the database ID for search results if necessary.
  • IVectorDatabase now inherits from IEnumerable so you can easily look through the texts documents that have been added to the database.

Fixed:

  • Fixed text tokenization to correctly remove special characters
  • Update BasicTextPreprocessor to support Emoji characters too
  • Refactorings for more Clean Code

Breaking Changes:

  • The .Search and .SearchAsync methods now return a IVectorTextResultItem<TId, TDocument, TMetadata> instead of VectorTextResultItem<TDocument, TMetadata>. If you're using things like the documentation shows, then you wont see any changes or have any issues with this update.

v2.0.4 (2025-04-16)

Add:

  • Add Ollama support via Build5Nines.SharpVector.Ollama nuget package
  • Added Build5Nines.SharpVector.Embeddings.IEmbeddingsGenerator to support creating external embeddings providers
  • Added Build5Nines.OpenAI.IOpenAIMemoryVectorDatabase interface

Fixed:

  • Internal refactoring of save/load database persistence file code to make more maintainable and reusable going forward.
  • Implement some performance tweaks in the code; adding const string and other best practices to help overall performance for handling larger amounts of data.

2.0.2 (2025-04-15)

Add:

  • Add SerializeToBinaryStream and DeserializeFromBinaryStream methods to replace (and mark obsolete) SerializeToJsonStream and DeserializeFromJsonStream methods. They read/write binary zip file data, not json, so they were named incorrectly.

Fixed:

  • Fixed .LoadFromFile method that was previously inaccessible.

2.0.1 (2025-03-17)

Added:

  • Expose internal vector array of VectorTextItem from VectorTextResultItem.Vectors property, to make vector array accessible for consuming code in cases where access is required. This is mostly for more flexible usage of the library.
  • Added Overlapping Window text chunking (TextChunkingMethod.OverlappingWindow) to TextDataLoader for enhanced document segmentation with overlapping content, improving metadata extraction and search result relevance.

Fixed:

  • When using Data.TextDataLoader with TextChunkingMethod.FixedLength it was splitting on a space character which wouldn't work correctly with Chinese text characters. This is now fixed to work correctly with Chinese characters too.

v2.0.0 (2025-02-23)

Added:

  • Add data persistence capability to save/load from a file or to/from a Stream (Both SharpVector and SharpVector.OpenAI)
  • Add Chinese language/character support

Breaking Change:

  • Refactor IVocabularyStore to be used within MemoryDictionaryVectorStoreWithVocabulary. This simplifies implementation of MemoryVectorDatabaseBase, and helps to enable data persistence capability.

Notes:

  • The breaking change only applies if the base classes are being used. If the BasicMemoryVectorDatabase is being used, this will likely not break applications that depend on this library. However, in some instances where explicitly depending on VectorTextResult it's properties (without using var in consuming code) there might be minor code changes needed when migrating from previous versions of the library.

v1.0.1 (2025-02-06)

  • Upgrade to .NET 8 or higher

v1.0.0 (2024-05-24)

Added:

  • Simplify object model by combining Async and non-Async classes, BasicMemoryVectorDatabase now support both synchronous and asynchronous operations.
  • Refactored to remove unnecessary classes where the Async versions will work just fine.
  • Improve async/await and multi-threading use

v0.9.8-beta (2024-05-20)

Added:

  • Added Async version of classes to support multi-threading
  • Metadata is no longer required when calling .AddText() and .AddTextAsync()
  • Refactor IVectorSimilarityCalculator to IVectorComparer and CosineVectorSimilarityCalculatorAsync to CosineSimilarityVectorComparerAsync
  • Add new EuclideanDistanceVectorComparerAsync
  • Fix MemoryVectorDatabase to no longer requird unused TId generic type
  • Rename VectorSimilarity and Similarity properties to VectorComparison

v0.9.5-beta (2024-05-18)

Added:

  • Add TextDataLoader class to provide support for different methods of text chunking when loading documents into the vector database.

v0.9.0-beta (2024-05-18)

Added:

  • Introduced the BasicMemoryVectorDatabase class as the basic Vector Database implementations that uses a Bag of Words vectorization strategy, with Cosine similarity, a dictionary vocabulary store, and a basic text preprocessor.
  • Add more C# Generics use, so the library is more customizable when used, and custom vector databases can be implemented if desired.
  • Added VectorTextResultItem.Similarity so consuming code can inspect similarity of the Text in the vector search results.
  • Update .Search method to support search result paging and threshold support for similarity comparison
  • Add some basic Unit Tests

v0.8.0-beta (2024-05-17)

Added:

  • Initial release - let's do this!