Merge with upstream and made replication as an optional support#8

Merged

hkadayam merged 186 commits into

clean-integration

Aug 8, 2025

Commits on Sep 25, 2024

Add support for raft repl dev replace member. (#546)
sanebay
authored

Commits on Oct 2, 2024

Add raft commit quorum for replace member if two members down. (#559)
sanebay
authored

Commits on Oct 15, 2024

Commits on Oct 16, 2024

fix nit
yuwmao
committed

Commits on Oct 17, 2024

Merge pull request #566 from yuwmao/raft
yuwmao
authored

Commits on Oct 18, 2024

Fix read_io in dataservice test.
xiaoxichen
committed

Commits on Oct 22, 2024

Commits on Oct 23, 2024

Reduce logs (#571)
shosseinimotlagh
authored
Change replace member api signature.

sanebay
authored and
xiaoxichen
committed

Commits on Oct 28, 2024

Add package version and show in log (#575)
shosseinimotlagh
authored

Commits on Oct 29, 2024

Commits on Nov 1, 2024

Add additional tests for replace member (#574)
sanebay
authored

Commits on Nov 5, 2024

Add protection for concurrent access to m_down_buffers (#577)
koujl
authored

Commits on Nov 6, 2024

Implement GC_REPL_REQ Based on DSN to Prevent Resource Leaks (#576)
xiaoxichen
authored

Commits on Nov 7, 2024

Releasing data buf from memory after written to disk.
xiaoxichen
committed

Commits on Nov 11, 2024

add rollback on state machine add open Leader_Restart ut (#585)
Besroy
authored

Commits on Nov 13, 2024

Commits on Nov 14, 2024

Commits on Nov 18, 2024

Disable dynamic repl ut temporarily. (#593)
sanebay
authored

Commits on Nov 25, 2024

handle RemovedFromCluster event (#594)
JacksonYao287
authored

Commits on Nov 26, 2024

Fix grpc crash (#595)
Besroy
authored

Commits on Nov 30, 2024

Support flexible virtual device creation in `homestore::BlkDataService` with num_chunks or chunk_size.
Hooper9973
committed

Commits on Dec 4, 2024

Commits on Dec 5, 2024

Bump up nuraft_mesg to >=3.7
xiaoxichen
committed

Commits on Dec 9, 2024

Add on_repl_devs_init_completed cb.
xiaoxichen
committed

Commits on Dec 12, 2024

Calling pre_commit for lsn > dc_lsn.
xiaoxichen
committed

Commits on Dec 16, 2024

fix potential bug of home raft log store initialization

JacksonYao287
authored and
xiaoxichen
committed

Commits on Dec 17, 2024

disable restart for destroy-pending repl-dev (#605)
JacksonYao287
authored

Commits on Dec 18, 2024

fix twice call of leave

JacksonYao287
authored and
Hooper9973
committed
Add lock for log dev read api's. (#612)
sanebay
authored

Commits on Dec 19, 2024

Ensure Consistent LSN Before Opening for Traffic in Raft Group
xiaoxichen
committed

Commits on Dec 20, 2024

Commits on Dec 23, 2024

Commits on Dec 24, 2024

Fix Index recovery path for split(put) (#609)
shosseinimotlagh
authored
reset rreq time every time we reuse a rreq

yawzhang
authored and
Besroy
committed
fix HomeRaftLogStore::last_entry (#619)
JacksonYao287
authored

Commits on Dec 31, 2024

minor fix for homeobject's homestore_test

Besroy
authored and
xiaoxichen
committed

Commits on Jan 2, 2025

update last_commit_lsn in commit_config

yawzhang
authored and
xiaoxichen
committed

Commits on Jan 3, 2025

Remove log store truncation from resource mgr.

yawzhang
authored and
xiaoxichen
committed

Commits on Jan 7, 2025

Support async snapshot io config

yuwmao
authored and
xiaoxichen
committed

Commits on Jan 9, 2025

Commits on Jan 16, 2025

skip appending dummy logs to log dev

yawzhang
authored and
xiaoxichen
committed
Adjust cp_io num_fiber to Prevent Deadlock (#630)
Hooper9973
authored

Commits on Jan 17, 2025

Ensure end_of_append_batch is Called for All Raft Log Types

yawzhang
authored and
xiaoxichen
committed
Fix logic for setting flush_ld_key while loading logs, makes it consistent with the logic in on_write_completion

yawzhang
authored and
xiaoxichen
committed

Commits on Jan 23, 2025

Commits on Jan 24, 2025

Commits on Feb 4, 2025

Change long index setting (#640)
shosseinimotlagh
authored

Commits on Feb 10, 2025

Persist logstore superblock when logdev truncation is unnecessary

yawzhang
authored and
xiaoxichen
committed
Add timeout cfg for snapshot sync context

yuwmao
authored and
xiaoxichen
committed

Commits on Feb 12, 2025

Remove snapshot creation when add_member done

yuwmao
authored and
xiaoxichen
committed
Add function to support purging existing logs. (#643)

Besroy
and
yawzhang
authored

Commits on Feb 13, 2025

Improve active peer determination logic

yuwmao
authored and
xiaoxichen
committed
Return grpc error if a non originator receives fetch data request

Ravi Nagarjun Akella
authored and
Ravi Nagarjun Akella
committed

Commits on Feb 14, 2025

Remove optimization on blk free operation

yawzhang
authored and
Besroy
committed
Merge pull request #649 from raakella1/issue_116
raakella1
authored

Commits on Feb 20, 2025

graceful shutdown (#636)
JacksonYao287
authored

Commits on Feb 21, 2025

Modify snapshot_context structure for persistency (#650)
koujl
authored

Commits on Feb 24, 2025

fix dead lock in graceful shutdown (#652)
JacksonYao287
authored

Commits on Feb 25, 2025

Minor fixs

yawzhang
authored and
xiaoxichen
committed

Commits on Feb 27, 2025

Fix missing fields in RaftReplDev::save_state (#654)
koujl
authored

Commits on Mar 12, 2025

Commits on Mar 13, 2025

Fixes on gc repl devs.

yawzhang
authored and
xiaoxichen
committed

Commits on Mar 19, 2025

Send response if failed to save pushed_data

yawzhang
authored and
Besroy
committed
issue: 667 Enable on_repl_devs_init_completed callback on SoloReplService (#668)
yamingk
authored

Commits on Mar 21, 2025

Add Disk Layout Diagram for device layer
yamingk
authored

Commits on Mar 24, 2025

Use an atomic in crash simulator to wait for the crash only if the flip is set and triggered

Ravi Nagarjun Akella
authored and
Ravi Nagarjun Akella
committed

Commits on Mar 25, 2025

retain the default behaviour of the method wait_for_crash_recovery to avoid wrong usage of the will_crash in crash simulator

Ravi Nagarjun Akella
authored and
Ravi Nagarjun Akella
committed
issue: 669 update physical superblk's mgaic and product_name to distinguish homestore 4.x with 1.3 which is massive written in prod (#673)
yamingk
authored

Commits on Mar 26, 2025

Commits on Apr 2, 2025

Fix baseline resync corner cases.

yawzhang
authored and
Besroy
committed
Support blk reservation

yuwmao
authored and
xiaoxichen
committed
Adding group_id to RD_LOG
xiaoxichen
committed
Add traceID into repl_key
xiaoxichen
committed
Adopt traceID for all RD_LOG
xiaoxichen
committed
bump version
xiaoxichen
committed
Fix NPE
xiaoxichen
committed

Commits on Apr 3, 2025

Merge pull request #679 from xiaoxichen/logging
yuwmao
authored

Commits on Apr 8, 2025

Commits on Apr 9, 2025

add grpc message size as config

yawzhang
authored and
xiaoxichen
committed
add metric for blk usage

yawzhang
authored and
xiaoxichen
committed
Fix solo repl dev log flush and graceful shutdown.
sanebay
authored

Commits on Apr 17, 2025

Support handling no_space_left error in raft channel (#682)
JacksonYao287
authored

Commits on Apr 18, 2025

Adjust grpc message size according to fetch data limit as well (#691)

Besroy
and
yawzhang
authored

Commits on Apr 21, 2025

Add additional on_commit repldev listener api's. (#692)
sanebay
authored

Commits on Apr 22, 2025

Commits on Apr 23, 2025

fix repl lsn (#699)
JacksonYao287
authored

Commits on Apr 24, 2025

Make a single on_commit listener function. (#700)
sanebay
authored
Add unit test to trigger eviction

Ravi Nagarjun Akella
authored and
Ravi Nagarjun Akella
committed
Use the index_buffer.is_clean() to determine if it is safe to evict a btree node from cache

Ravi Nagarjun Akella
authored and
Ravi Nagarjun Akella
committed
Merge pull request #690 from raakella1/cache_overflow_test
raakella1
authored

Commits on Apr 25, 2025

Commits on Apr 27, 2025

add traceid for replace member

yawzhang
authored and
xiaoxichen
committed

Commits on Apr 28, 2025

adopt api signature change

yamingk
authored and
xiaoxichen
committed

Commits on Apr 29, 2025

Commits on Apr 30, 2025

Commits on May 1, 2025

Commits on May 5, 2025

Use application context in req struct for multi put and multi remove. (#712)
sanebay
authored

Commits on May 6, 2025

Issue 713: Fix index table destroy race with wb_cache cp flush (#714)
yamingk
authored

Commits on May 8, 2025

Issue 716: Fix log periodic cancelt_imer issue and solo repl dev init/destroy ra… (#715)
yamingk
authored

Commits on May 12, 2025

Issue 717: expose data service drive type (#718)
yamingk
authored

Commits on May 13, 2025

Fix occupied_size for prefix (#719)
shosseinimotlagh
authored

Commits on May 15, 2025

add long running test with put and remove

Ravi Nagarjun Akella
authored and
Ravi Nagarjun Akella
committed
Merge pull request #720 from raakella1/index_put_remove_ut
raakella1
authored

Commits on May 16, 2025

Fix prefix - reload compactbitset after updating node phys buffer (#724)
shosseinimotlagh
authored

Commits on May 17, 2025

[Solo repl dev] Fix log dev flush timer cancel race (#723)
yamingk
authored

Commits on May 20, 2025

Add submit_io_batch api in repl dev. (#725)
sanebay
authored

Commits on May 27, 2025

Redesign replacemember API
yuwmao
committed

Commits on May 28, 2025

Add a reaper thread to check and complete replace member
yuwmao
committed

Commits on May 29, 2025

Commits on May 31, 2025

fix bug in get_replication_status

yuwmao
authored and
xiaoxichen
committed

Commits on Jun 2, 2025

The usage of EVP_DigestInit_ex2 in meta_blk test requires openssl3.x (#732)
szmyd
authored

Commits on Jun 3, 2025

Commits on Jun 4, 2025

Commits on Jun 9, 2025

Commits on Jun 10, 2025

determine proposer based on server_id

yawzhang
authored and
Besroy
committed

Commits on Jun 11, 2025

remove rreq after listener commit && handle gc free blk error according to error code (#744)

Besroy
and
yawzhang
authored

Commits on Jun 17, 2025

Commits on Jun 18, 2025

Support setting stage of ReplDev

yuwmao
authored and
xiaoxichen
committed

Commits on Jun 26, 2025

Commits on Jun 27, 2025

Change task_id to string (#758)
yuwmao
authored

Commits on Jul 9, 2025

minor fix on log dev

yawzhang
authored and
Besroy
committed
support effective log truncation

yawzhang
authored and
Besroy
committed

Commits on Jul 10, 2025

Commits on Jul 11, 2025

Fix bugs in rapair links during crash recovery of the btree (#749)

raakella1
and
Ravi Nagarjun Akella
authored

Commits on Jul 15, 2025

Support formatting new disk after bootstrap (#766)
yuwmao
authored

Commits on Jul 17, 2025

Refine the algorithm to calculate pdev chunks on vdev (#772)
yuwmao
authored

Commits on Jul 22, 2025

Commits on Jul 23, 2025

Fix prefix merge (#742)
shosseinimotlagh
authored

Commits on Jul 24, 2025

Fix table ordinal (#777)
shosseinimotlagh
authored

Commits on Jul 25, 2025

Adding more logs to check actual vdev cp flush and freeing blkids (#778)
shosseinimotlagh
authored

Commits on Jul 26, 2025

flush a buffer only if it is dirtied in the current cp

Ravi Nagarjun Akella
authored and
Ravi Nagarjun Akella
committed
add comment explaining the change

Ravi Nagarjun Akella
authored and
Ravi Nagarjun Akella
committed

Commits on Jul 28, 2025

skip sanity check for the new bufs which are not considered after recovery

Ravi Nagarjun Akella
authored and
Ravi Nagarjun Akella
committed

Commits on Jul 29, 2025

Merge pull request #781 from raakella1/wbcache_cp
raakella1
authored

Commits on Jul 30, 2025

Add metrics for cp and blk alloc latency. (#782)
sanebay
authored
set buf state clean after getting its down buf during cp flush

Ravi Nagarjun Akella
authored and
Ravi Nagarjun Akella
committed

Commits on Jul 31, 2025

Merge pull request #783 from raakella1/buf_status
raakella1
authored

Commits on Aug 4, 2025

return no-op if no chunk available (#785)
JacksonYao287
authored

Commits on Aug 7, 2025

UTs for simulating tombstone and GC (#737)
shosseinimotlagh
authored

Commits on Aug 8, 2025