Skip to content

test_dataset failing intermittently  #88

@StephenOman

Description

@StephenOman

Test failed at PR but succeeded on rerun without any changes:

        for _, (mb1, mb2) in enumerate(zip(data, data2)):
            for k in mb1.keys():
>               np.testing.assert_array_equal(mb1[k], mb2[k])
E               AssertionError: 
E               Arrays are not equal
E               
E               Mismatched elements: 1440 / 384000 (0.375%)
E               Max absolute difference among violations: 74
E               Max relative difference among violations: 1.94285714
E                ACTUAL: array([[[[ 32,  32,  32, ...,  32,  32,  32],
E                        [ 78, 101, 116, ...,  32,  32,  32],
E                        [ 32,  32,  32, ...,  32,  32,  32],...
E                DESIRED: array([[[[ 32,  32,  32, ...,  32,  32,  32],
E                        [ 78, 101, 116, ...,  32,  32,  32],
E                        [ 32,  32,  32, ...,  32,  32,  32],...

/Users/runner/work/nle/nle/nle/tests/test_dataset.py:295: AssertionError
=========================== short test summary info ============================
FAILED nle/tests/test_dataset.py::TestDataset::test_sql[threadpool] - AssertionError: 
Arrays are not equal

Mismatched elements: 1440 / 384000 (0.375%)
Max absolute difference among violations: 74
Max relative difference among violations: 1.94285714
 ACTUAL: array([[[[ 32,  32,  32, ...,  32,  32,  32],
         [ 78, 101, 116, ...,  32,  32,  32],
         [ 32,  32,  32, ...,  32,  32,  32],...
 DESIRED: array([[[[ 32,  32,  32, ...,  32,  32,  32],
         [ 78, 101, 116, ...,  32,  32,  32],
         [ 32,  32,  32, ...,  32,  32,  32],...
!!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!!
=================== 1 failed, 31 passed, 1 skipped in 13.75s ===================

Originally posted by @jbcoe in #82 (comment)

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions