Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

failing unit test test_extrema #3928

Open
ajpotts opened this issue Dec 6, 2024 · 0 comments
Open

failing unit test test_extrema #3928

ajpotts opened this issue Dec 6, 2024 · 0 comments
Assignees
Labels
bug Something isn't working

Comments

@ajpotts
Copy link
Contributor

ajpotts commented Dec 6, 2024

Describe the bug
The unit test test_extrema fails locally with size >= 10**5 for dtype=int64.

To Reproduce
Steps to reproduce the behavior:
make test size=10**5

Expected behavior
The test passes.

Error Message

Started arkouda_server in TEST_CLASS mode with host: localhost port: 5555 locales: 1
connected to arkouda server tcp://*:5555
FAILED          [  9%][Arkouda Client] Line 559 DEBUG: sending message RequestMessage(user='amandapotts', token=None, cmd='array<int64,1>', format=BINARY, args='["{\\"key\\": \\"dtype\\", \\"dtype\\": \\"str\\", \\"val\\": \\"int64\\"}", "{\\"key\\": \\"shape\\", \\"dtype\\": \\"int64\\", \\"val\\": \\"[\\\\\\"100000\\\\\\"]\\"}", "{\\"key\\": \\"seg_string\\", \\"dtype\\": \\"bool\\", \\"val\\": \\"False\\"}"]', size=3)
[pdarrayclass] Line 2641 DEBUG: created Chapel array with name: id_GptZ0Jz_1 dtype: int64 size: 100000 ndim: 1 shape: [100000] itemsize: 8
[pdarrayclass] Line 2641 DEBUG: created Chapel array with name: id_GptZ0Jz_2 dtype: int64 size: 100000 ndim: 1 shape: [100000] itemsize: 8
[pdarrayclass] Line 2641 DEBUG: created Chapel array with name: id_GptZ0Jz_3 dtype: int64 size: 50000 ndim: 1 shape: [50000] itemsize: 8
[pdarrayclass] Line 2641 DEBUG: created Chapel array with name: id_GptZ0Jz_4 dtype: int64 size: 50000 ndim: 1 shape: [50000] itemsize: 8
[pdarrayclass] Line 2641 DEBUG: created Chapel array with name: id_GptZ0Jz_5 dtype: bool size: 50000 ndim: 1 shape: [50000] itemsize: 1
[pdarrayclass] Line 400 DEBUG: deleting pdarray with name id_GptZ0Jz_3
[pdarrayclass] Line 400 DEBUG: deleting pdarray with name id_GptZ0Jz_4
[pdarrayclass] Line 400 DEBUG: deleting pdarray with name id_GptZ0Jz_5
[pdarrayclass] Line 2641 DEBUG: created Chapel array with name: id_GptZ0Jz_6 dtype: int64 size: 50000 ndim: 1 shape: [50000] itemsize: 8
[pdarrayclass] Line 2641 DEBUG: created Chapel array with name: id_GptZ0Jz_7 dtype: int64 size: 50000 ndim: 1 shape: [50000] itemsize: 8
[pdarrayclass] Line 400 DEBUG: deleting pdarray with name id_GptZ0Jz_6
[pdarrayclass] Line 2641 DEBUG: created Chapel array with name: id_GptZ0Jz_8 dtype: int64 size: 50000 ndim: 1 shape: [50000] itemsize: 8
[pdarrayclass] Line 2641 DEBUG: created Chapel array with name: id_GptZ0Jz_9 dtype: bool size: 50000 ndim: 1 shape: [50000] itemsize: 1

tests/extrema_test.py:44 (TestExtrema.test_extrema[int64-100000])
array([-4294964121 -4294911077 -4294859677 ... -7310645 -7276619 -7207235]) != array([-4294964121 -4294911077 -4294859677 ... 8349054 8416966 8641865])

Expected :array([-4294964121 -4294911077 -4294859677 ... 8349054 8416966 8641865])
Actual   :array([-4294964121 -4294911077 -4294859677 ... -7310645 -7276619 -7207235])
<Click to see difference>

self = <extrema_test.TestExtrema object at 0x7f431ce542f0>, prob_size = 100000
dtype = 'int64'

    @pytest.mark.parametrize("prob_size", pytest.prob_size)
    @pytest.mark.parametrize("dtype", ["int64", "uint64", "float64"])
    def test_extrema(self, prob_size, dtype):
        pda = ak.array(make_np_arrays(prob_size, dtype))
        ak_sorted = ak.sort(pda)
        K = prob_size // 2
    
        # compare minimums against first K elements from sorted array
        assert (ak.mink(pda, K) == ak_sorted[:K]).all()
>       assert (pda[ak.argmink(pda, K)] == ak_sorted[:K]).all()
E       assert False
E        +  where False = all()
E        +    where all = array([-4294964121 -4294911077 -4294859677 ... -7310645 -7276619 -7207235]) == array([-4294964121 -4294911077 -4294859677 ... 8349054 8416966 8641865]).all

Is this a Blocking Issue
Unknown.

ak.get_config() Output

In [5]: ak.get_config()
Out[5]: 
{'arkoudaVersion': 'v2024.10.02+52.g586d10610.dirty',
 'chplVersion': '2.0.0',
 'ZMQVersion': '4.3.5',
 'HDF5Version': '1.14.3',
 'serverHostname': 'pop-os',
 'ServerPort': 5555,
 'numLocales': 1,
 'numPUs': 8,
 'maxTaskPar': 8,
 'physicalMemory': 67257028608,
 'distributionType': 'domain(1,int(64),one)',
 'LocaleConfigs': [{'id': 0,
   'name': 'pop-os',
   'numPUs': 8,
   'maxTaskPar': 8,
   'physicalMemory': 67257028608}],
 'authenticate': False,
 'logLevel': 'INFO',
 'logChannel': 'CONSOLE',
 'regexMaxCaptures': 20,
 'byteorder': 'little',
 'autoShutdown': False,
 'serverInfoNoSplash': False,
 'maxArrayDims': 3,
 'ARROW_VERSION': '18.1.0'}

Additional context
N/A

@ajpotts ajpotts added the bug Something isn't working label Dec 6, 2024
@ajpotts ajpotts self-assigned this Dec 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant