Skip to content

DatasetGenerator - classes of reconciliation tests#73

Open
arorashu wants to merge 9 commits intomasterfrom
more-recon-tests
Open

DatasetGenerator - classes of reconciliation tests#73
arorashu wants to merge 9 commits intomasterfrom
more-recon-tests

Conversation

@arorashu
Copy link
Collaborator

@arorashu arorashu commented Jul 27, 2020

Addresses Issue#62

Create DatasetGenerator class to create different standard types of datasets.
Accepts isMultiset and isLargeSync as boolean flags to generate these specific datasets as well.

@arorashu
Copy link
Collaborator Author

The failing tests for CPISync are probably due to Issue#74. I will need to take a look why the CuckooSyncTest fails.

@arorashu arorashu requested a review from novakboskov July 28, 2020 00:08
@arorashu arorashu changed the title More recon tests DatasetGenerator - classes of reconciliation tests Jul 28, 2020
@novakboskov
Copy link
Collaborator

novakboskov commented Jul 28, 2020

What I see in the CI build report is very weird. For example, it says that CuckooSyncTest.cpp:61:Assertion fails and that assertion is still commented out in your code, should not be executed at all (you seem not to pull from master recently, see #71).

Could you please merge master to your branch and make sure why these tests fail?

@novakboskov
Copy link
Collaborator

novakboskov commented Jul 28, 2020

Additionally, consider supporting the very basic test set generation function that would just simply return two std::multiset<shared_ptr<DataObject>>, as DataObject is our primary abstraction for the set elements. Set A and the set B, just to keep it simple.

@arorashu
Copy link
Collaborator Author

What I see in the CI build report is very weird. For example, it says that CuckooSyncTest.cpp:61:Assertion fails and that assertion is still commented out in your code, should not be executed at all (you seem not to pull from master recently, see #71).

So this is because Github merges the two branches itself, and runs the CI on the merge. I validated it from the CI output.

Could you please merge master to your branch and make sure why these tests fail?

Yeah, in effect the test failures are resultant of merging with master

@novakboskov
Copy link
Collaborator

@arorashu I see... Can you please look a bit closer into that to find the root cause of those failures?

@arorashu
Copy link
Collaborator Author

arorashu commented Jul 28, 2020

@novakboskov Yeah, added some relevant info at Issue#75

@arorashu
Copy link
Collaborator Author

arorashu commented Jul 29, 2020

So, CPISync fails for the case where server is empty. I have currently narrowed it down to the CPISync::set_reconcile function. For the case where server is empty, it does not populate the delta_self and delta_other entries. I will update when I have fixed that.

@arorashu
Copy link
Collaborator Author

Increasing Cuckoo filter size from 2^8 to 2^17, gives better sync performance at the expense of running time

@arorashu arorashu linked an issue Aug 3, 2020 that may be closed by this pull request
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

The classes of reconciliation tests

2 participants

Comments