Release Notes v2024.12.06

Bug Fixes

• Issue #3870 - fixes bug in reshape for bigint type
• Issue #3821 - fixes bug in stridable indexing of Strings in multilocale
• PR #3804 - fixes sparseMatToPdarray test failures for distributed arrays
• PR #3857 - fixes file location reporting in register-commands.py
• Issue #3842 - fixes mypy CI failures

Major changes

• PRs #3840, #3877 - adds Sparse Matrix creation from Pdarrays
• Issues #3823, #3827 - adds flatten function
• Issues #3782, #3851, #3820 - adds flip function
• Issue #3300 - adds shape function
• Issue #3904 - adds function to return list of all compiled dimensions available
• Issues #3886, #3813, #3866, #3855, #3809, and PRs #3874, #3854, #3847,#3845, #3841, #3832, #3799, #3878 - refactor and improve server side message argument handling and convert modules to new framework

Minor changes

• Numpy Alignment
  • Issues #3868, #3884, #3781 - code reorganization to align with numpy
  • Issue #3864 - max and min of bool to return bool to match numpy
  • Issue #3714 - pdarray.shape returns a tuple
  • Issue #3283 - adds mixed types to work with histogram2d and match the return dtypes with Numpy
• Issues #3839, #3560, #3796 - refactor benchmarks to use pytest framework and add to CI.
• Issue #3815, PRs #3880, #3812, #3926, #3912, #3802 - unit test improvements
• Issues #3902, #3896, #3818, #3883, #3887 - reduce warnings
• Issue #3708 - refactors array_api to call functions from arkouda.pdarray_creation
• PRs #3814 and #3826 - performance improvements to array function
• PR #3862 - updated the hdf5 download link in the Makefile
• Issue #3905 - assert_equivalent compares shapes of pdarrays
• PR #3818 - improves documentation for LINUX_INSTALL
• Issue #3849 - adds SortingAlgorithm enum to all in sorting module

Auto-generated release notes

* #3802: sporadic failures of test_assert_frame_equal_check_exact by @ajpotts in https://github.com//pull/3808 * Closes #3796: Add benchmarks to CI by @ajpotts in https://github.com//pull/3810 * Closes #3283: histogram2d between different dtypes by @jaketrookman in https://github.com//pull/3763 * Closes #3811: Roll back test change to determine impact on testing by @bmcdonald3 in https://github.com//pull/3812 * Fix performance regression in array transfer performance by @jeremiah-corrado in https://github.com//pull/3814 * Closes #3782: flip function to match numpy by @ajpotts in https://github.com//pull/3791 * Closes #3815: Disable `client_test` for nightly due to machine issues by @stress-tess in https://github.com//pull/3817 * small instruction fix by @ItsQuinnMoore in https://github.com//pull/3818 * Closes #3820: bug in flip multi-local by @ajpotts in https://github.com//pull/3822 * remove Commands.chpl from tree by @jeremiah-corrado in https://github.com//pull/3799 * Fix array transfer performance regression by @jeremiah-corrado in https://github.com//pull/3826 * Closes #3714: pdarray.shape should be a tuple by @ajpotts in https://github.com//pull/3803 * Fix sparseMatToPdarray test failures for distributed arrays by @jeremiah-corrado in https://github.com//pull/3804 * Closes #3827: rename flatten to split by @ajpotts in https://github.com//pull/3828 * Fixes #3821: Bug in stridable indexing of Strings in multilocale by @stress-tess in https://github.com//pull/3830 * Closes #3823 flatten function to match numpy by @ajpotts in https://github.com//pull/3825 * Closes 3818 -- eliminates warning messages about tilde vs not by @drculhane in https://github.com//pull/3829 * Refactor `SparseMatrixMsg` to use automated registration by @jeremiah-corrado in https://github.com//pull/3832 * Closes #3781 move random module to numpy submodule by @ajpotts in https://github.com//pull/3835 * Closes #3842: Fixes mypy CI failures by @stress-tess in https://github.com//pull/3843 * Part of argTypeReductionMessage refactor by @ajpotts in https://github.com//pull/3845 * Refactor arg type reduction message pt2 by @ajpotts in https://github.com//pull/3847 * Closes #3560 Update argsort_benchmark by @ajpotts in https://github.com//pull/3838 * Creating Sparse Matrix from Pdarrays by @ShreyasKhandekar in https://github.com//pull/3840 * Closes #3849: Add `SortingAlgorithm` enum to `__all__` by @stress-tess in https://github.com//pull/3853 * Fixes #3851: Error when running string `flip` by @stress-tess in https://github.com//pull/3852 * Support where-clause evaluation in registration annotations by @jeremiah-corrado in https://github.com//pull/3841 * Closes #3861: Update hdf5 download link in `Makefile` by @stress-tess in https://github.com//pull/3862 * Part 3 of argTypeReductionMessage refactor by @ajpotts in https://github.com//pull/3854 * Fix broken error reporting for Chapel 2.0 in `register-commands.py` by @jeremiah-corrado in https://github.com//pull/3857 * Closes 3809 moves trig and hyp fns to new interface by @drculhane in https://github.com//pull/3863 * Closes #3868: move squeeze functionality to arkouda.numpy. by @ajpotts in https://github.com//pull/3869 * Part of #3708: array_api to call functions from arkouda.pdarray_crea… by @ajpotts in https://github.com//pull/3758 * Fix performance regression in reductions benchmark by @jeremiah-corrado in https://github.com//pull/3874 * Optimize creation of sparrays from pdarrays by @ShreyasKhandekar in https://github.com//pull/3877 * Eliminates duplicates in tests/numpy/numeric_test.py by @drculhane in https://github.com//pull/3880 * LayoutCS deprecation warning fix by @jeremiah-corrado in https://github.com//pull/3883 * Closes #3884: Remove _squeeze function by @ajpotts in https://github.com//pull/3885 * Fix build error caused by #3883 by @jeremiah-corrado in https://github.com//pull/3887 * Closes #3855: refactor boolReductionMsg by @ajpotts in https://github.com//pull/3876 * Closes 3813 and 3866 -- moves several new functions to the new interface (abs, square, all exp and log, isnan, isinf, isfinite) by @drculhane in https://github.com//pull/3873 * Closes #3896 PytestUnknownMarkWarning for pytest.mark.skip_if_nl_grea… by @ajpotts in https://github.com//pull/3897 * Closes #3300: shape function by @ajpotts in https://github.com//pull/3900 * Closes #3886 refactor idx reduction msg by @ajpotts in https://github.com//pull/3889 * Closes #3902: truth value of an empty array DeprecationWarning by @ajpotts in https://github.com//pull/3903 * Closes 3878 - refactors rounding functions to new interface, pulls hash function into their own procs by @drculhane in https://github.com//pull/3898 * Part of #3839 new benchmarks to output performance graph format by @ajpotts in https://github.com//pull/3894 * Closes #3864 max and min of bool to return bool like numpy by @ajpotts in https://github.com//pull/3901 * Closes #3870: bug in reshape for bigint type by @ajpotts in https://github.com//pull/3907 * Closes #3904: function to return list of all compiled dimensions avai… by @ajpotts in https://github.com//pull/3909 * Closes #3905: assert_equivalent to compare shapes of pdarrays by @ajpotts in https://github.com//pull/3906 * Closes #3912: failing unit test test_is_locally_sorted_multidim unde… by @ajpotts in https://github.com//pull/3913 * Closes #3926: OverMemoryLimitError in pdarrayclass_test by @ajpotts in https://github.com//pull/3927

New Contributors

• @ItsQuinnMoore made their first contribution in #3818

Full Changelog: v2024.10.02...v2024.12.06

Release Notes v2024.10.02

Bug Fixes

• Issue #3762 - Fix dataframe groupby aggregations when keys contain NaNs
• Issues #3658, #3650, #3654, #3783, #3784, #3788 and PR #3386 - Fix IO bugs including:
  • reading segarrays containing NaNs and empty segments with hdf5 and parquet
  • reading dataframes containing uint and int segarray columns
  • CSV address sanitizer "use after free" memory issues
• Issues #3648, #3676, #3682, #3679, #3687, #3666 - Fix multidimensional bugs in sorting, nonzero, repeat, flatten, and unflatten
• Issue #3367 - Fixes racy condition in SegHead function
• Issue #3468 - Fixes round trip discrepancies for Index with Categorical values
• Issue #3649 - Fixes bitshift failures
• Issue #3467 - Fixes indexing error in DataFrame instantiation

Major Updates

• Issues #3628, #3703 - Drop python 3.8 support
• Issue #3355 - Pins scipy<=1.13.1
• Issues #3332, #3334, #3351, #3360, #3417, #3419, #3504, #3613, #3695, #3769, #3767, #3711 and PRs #3363, #3368, #3379 -parquet optimizations:
  • Added fixed length flag for string reads
  • Read strings and byte sizes in batches
  • Simplified source code
• Issues #3336, #3362, #3183, #3364, #3226, #3523, #3278,#3373, #3372, #3627 - Improve random module with a focus on numpy alignment. Adding:
  • exponential, lognormal, logistic
  • multidimensional functionality to Random module
• Issues #3294, #3639, #3665, #3709 - Improve testing and add delete function for multidimensional arrays
• Issues #3425, #3526, #3632, #3656, #3631, #3718, #3720, #3722, #3771, #3657 and PRs #3345, #3358, #3359, #3371, #3518, #3474, #3521, #3525, #3590, #3606, #3603, #3685, #3672, #3691, #3789, #3773, #3786, #3634, #3671, #3655, #3697 - Refactor and improve server side message argument handling
• PRs #3516, #3593, #3745 - Add initial implementation of sparse matrix functionality including matrix multiplication, fill_vals, and to_pdarray

Minor Updates

• Issues #2978, #3702 - Strip out ArrayView (replaced by multidimensional pdarray functionality)
• Issue #3302 - Adds GroupBy.head
• Issue #3326 - Adds DataFrame.assign
• Issue #3510, #3511 - Update DataFrame.to_pandas and Series.to_pandas to handle categoricals
• Issue #3293, #3428 - Add putmask functionality
• Issue #3297 - Adds array_equal
• Issue #3742 - move numeric module to arkouda.numpy
• Issues #3289, #3288, #3291, #3295, #3299, #3298, #3301, #3287, #3296 - Modify dtypes for better numpy alignment
  • rename bool to bool_, align with numpy scalar type, remove translate_np_dtype
• Issues #3259, #3265, #3267, #3271, #3275, #3269, #3263, #3273, #3261, #3385, #3400, #3403, #3409, #3440, #3445, #3457, #3448, #3452, #3454, #3459, #3461, #3463, #3465, #3407, #3442, #3446, #3405, #3411, #3389, #3212, #3145, #3144, #3143, #3231, #3441, #3447, #3458, #3443, #3462, #3466 , #3455, #3444, #3438, #3450, #3460, #3464 , #3388, #3430, #3624 , #3453, #3413, #3646, #3402, #3439, #3669, #3415, #3421 - Transitions to new testing suite including updating make test
• Issues #3508, #3748, #3759, #3727, #3378 - Updates documentation including:
  • chapel tutorial, installation docs, and documentation about memory pressure during server builds
• Issues #3793, #3798, #3797 and PR #3730 - Updates to benchmarks

Auto-Generated Release Notes

• Closes #3308 Unify file permissions by @ajpotts in #3309
• Closes #3332: Split Parquet code into multiple files by @bmcdonald3 in #3333
• temporary fix for #3355: pin scipy<=1.13.1 to avoid CI failures by @ajpotts in #3356
• Closes #3334, #3351: Simplify server side string code and added fixed length by @bmcdonald3 in #3335
• Ignore new Parquet object files by @bmcdonald3 in #3363
• Closes #3336, #3362: Reuse random number generation loop structure by @stress-tess in #3352
• Closes #3259: deprecate test/scipy/scipy_test.py and special_test.py by @ajpotts in #3260
• Closes #3265 deprecate tests/numeric_test by @ajpotts in #3266
• Closes #3267 deprecate tests/dtypes_test by @ajpotts in #3268
• Closes #3271 deprecate tests/index_test by @ajpotts in #3272
• Closes #3275 deprecate tests/categorical_test by @ajpotts in #3277
• Closes #3360: Reduce code duplication in Parquet read code with templates by @bmcdonald3 in #3361
• Closes #3183, #3364: Add exponential distribution and aggregation to random generator loop by @stress-tess in #3310
• Simplify Command Map by @jeremiah-corrado in #3345
• Adds arkouda.testing module by @ajpotts in #3186
• Closes #3269 deprecate tests/datetime_test by @ajpotts in #3270
• Remove string.doFormat, replacing with string.format by @jeremiah-corrado in #3365
• Closes #3302 GroupBy.head by @ajpotts in #3324
• Refactor MessageArgs by @jeremiah-corrado in #3358
• Closes Ticket #3263: deprecate tests/dataframe_test by @ajpotts in #3264
• Closes #3273 deprecate tests/series_test by @ajpotts in #3274
• Remove number of files multiplication for IO benchmark by @bmcdonald3 in #3368
• 3231 unique unit tests by @drculhane in #3258
• Adds missing numpy dtypes by @ajpotts in #3330
• Closes #3367 racy condition in SegHead function by @ajpotts in #3369
• Closes #3261 deprecate tests/numpy by @ajpotts in #3262
• Closes #3375: Cleanup indexof1d code by @stress-tess in #3377
• Disable Parquet multi row group test until resolved by @bmcdonald3 in #3379
• Closes #3326 DataFrame.assign by @ajpotts in #3327
• Refactor SymbolTable and error handling by @jeremiah-corrado in #3359
• Resolves #3294 - Add numpy-like delete function by @jeremiah-corrado in #3321
• Closes #3281 rename bool to bool_ to match numpy by @ajpotts in #3282
• Fixes #3392: Fix mypy CI failures by @stress-tess in #3394
• Resolve CSV Asan "use after free" memory issues by @ShreyasKhandekar in #3386
• Closes #3376 more numpy imports by @ajpotts in #3381
• Closes #3385 groupby_test.py by @ajpotts in #3397
• Closes #3400 deprecate alignment_tests.py by @ajpotts in #3401
• Closes #3403 deprecate bigint_agg_test.py by @ajpotts in #3404
• Closes #3409 deprecate tests/client_dtypes_test.py by @ajpotts in #3410
• Closes #3417: Separate Parquet string read code from generic read function by @bmcdonald3 in #3418
• Closes #3419: Remove intertwined list column and string column byte calculation logic by @bmcdonald3 in #3420
• Closes #3425: Improve Msg Function Registration for Module Tracking by @bmcdonald3 in #3424
• Closes #3226: Adds parameterization to test_shuffle and test_permutation by @drculhane in #3320
• Closes #3414 deprecate compare_test.py by @ajpotts in #3416
• Closes #3293: Add putmask by @drculhane in #3370
• add-path modification for building on Horizon by @brandon-neth in #3423
• Closes #3405 deprecate tests/bitops_test.py by @ajpotts in #3406
• Closes #3411 deprecate tests/client_test.py by @ajpotts in #3412
• Automated command registration by @jeremiah-corrado in #3371
• Closes #3475 make fails when lib and lib64 directories are both present by @ajpotts in #3503
• Closes #3504: Improve Parquet Integration: Stop Using Array Views by @bmcdonald3 in #3505
• Remove support for pre-2.0 versions of Chapel by @jeremiah-corrado in #3477
• Adds skip configuration for multidimensional histogram test by @brandon-neth in #3506
• Updates PROTOs pdarray_creation_test by @drculhane in #3393
• Closes #3514-add pandas-stubs to arkouda-env-dev.yml by @ajpotts in #3515
• Stop requiring manual installation of chapel-py to register commands by @jeremiah-corrado in #3518
• Closes #3407 deprecate tests/check.py by @ajpotts in #34...

Release Notes v2024.06.21

Bug Fixes

• Issues #3074, #3234 - Fix bug reading Segarrays from parquet files
• Issues #3001, #3185 - Fix broadcast bugs involving nans and Strings
• Issue #3156 - Fixes Categorical.sort_values bug
• Issues #3311, #3112 - Fix Parquet multi column byte writing and Parquet string column free
• Issue #3115 - Fixes non-deterministic sparse_sum failure
• Issue #3089 - Avoids out of memory crashes caused by in intents on makeDistArray
• Issue #3009 and PRs #3232, #3316 - Improve performance of indexof1d and fix handling of null values
• Issues #3158, #3222 - Fix print bugs involving Dataframe or Series containing a Segarray

Major Updates

• PR #3303 - Drops support for Chapel 1.31
• Issues #3343, #3346 - Pin numpy < 2.0 and python < 3.12.4
• Issue #3148 - Updates IO functions to always return a dictionary
• PRs #3238, #3314 and Issue #3347 - Reimplements CSV read to increase performance
• Issue #3108 - Adds groupby.sample and dataframe.groupby.sample
• Issue #2893 - Changes the behavior of dataframe.GroupBy.count to align with pandas
• Issues #3086, #3118, #3245, #3322, #3167 and PRs #3110, #3280 - Add updates to Random module:
  • Adds choice, poisson, normal to random number generators
• PRs #3242, #3305, #3160, #3223, #3237, #3142 - Improvements to Array API:
  • Add documentation for Array API functions
  • Add implementations ofvstack, clip, diff,pad and missing stats, search, and sort functions to Array API module
  • Compatibility improvements for Xarray chunk-manager
• Issues #3213, #3206, #3202, #3208, #3217, #3188 - Add Index and MultiIndex properties:
  • Including levels,equals, names, ndim, etc
• Issues #3050, #3192, #3128, #3196, #3198, #3200, #3130, #3123, #3194 - Work on proto tests:
  • Improvements to tests for dataframe, dtypes, groupby, io,numeric, symbol_table
  • Adds make-proto-tests command and updates our CI to run it

Minor Updates

• Issues #3006, #3007 - Add median and count_nonzero
• Issues #3079, #3080 - Add sum and += for boolean pdarrays
• PRs #3221, #3211 - Add NYC taxi tutorial from CUG 2024

Auto-Generated Release Notes

• Closes #3068 add doc strings for numpy imports by @ajpotts in #3077
• Add a random sampling with support for a weights array by @jeremiah-corrado in #3110
• Closes #3112: Fix Parquet string column free by @bmcdonald3 in #3113
• Closes #3115: Fix non-deterministic sparse_sum failure by @stress-tess in #3117
• Closes #3086: Add choice to random number generators by @stress-tess in #3114
• Closes #3118: Move choice implementation into arkouda by @stress-tess in #3138
• Closes #2947 change the name of the class dataframe.GroupBy by @ajpotts in #3146
• Avoid a warning about mismatched parSafe settings for list initialization by @lydia-duncan in #3149
• Closes #3116 remove DataFrame._columns by @ajpotts in #3147
• Closes #3124-dataframe.pyi-file and Closes #3097 numpy import docs at module level by @ajpotts in #3141
• Closes #3135 Update scipy/special_test by @ajpotts in #3137
• 3050 groupby etc by @drculhane in #3111
• multidimensional array bug fixes by @jeremiah-corrado in #3142
• Closes #3123-make-proto-tests by @ajpotts in #3126
• Closes #2893 dataframe.GroupBy.count to align with pandas by @ajpotts in #3125
• Closes #3051 Update akscipy_test by @ajpotts in #3136
• Fixes #3158: Dataframe containing a Segarray .__str__() bug by @stress-tess in #3161
• Closes #3089: Avoid OOM Crashes caused due to in intents on makeDistArray by @ShreyasKhandekar in #3163
• Resolve deprecation warning about not using 'new' in dmapped expressions by @jeremiah-corrado in #3162
• Closes #3079 and #3080: Sum and Plus Equal of Boolean Arrays by @jaketrookman in #3154
• Closes #3108: Add groupby.sample and dataframe.groupby.sample by @stress-tess in #3157
• Closes #3174: loosens type return restrictions of sum by @stress-tess in #3175
• Fixes #3001: nan broadcast bug by @stress-tess in #3173
• Dataframe Indexing by @brandon-neth in #3109
• Closes 3190 add mypy.ini by @ajpotts in #3191
• Closes #3192 PROTO_tests/tests/dtypes_test.py is failing by @ajpotts in #3193
• Fixes #3156:Categorical.sort_values bug by @stress-tess in #3168
• Closes #3148: Update IO functions to always return a dictionary by @stress-tess in #3164
• Re # 3128 fixes errors and omissions in PROTO-tests version of datafr… by @drculhane in #3139
• 3130 numeric test slight revamp by @drculhane in #3151
• 1D implementations of median and count_nonzero by @drculhane in #3187
• Closes #3196 PROTO_tests/tests/symbol_table.py failing by @ajpotts in #3197
• Closes #3198 PROTO_tests/tests/io_test.py failing by @ajpotts in #3199
• Closes #3200 PROTO_tests/tests/dataframe_test.py failing by @ajpotts in #3201
• Closes #3204 is_numeric to handle Index and Series type by @ajpotts in #3205
• Closes #3206 MultiIndex.levels by @ajpotts in #3207
• Array-API slice Assignment by @jeremiah-corrado in #3166
• Implement missing stats, search and sort functions for Array API by @jeremiah-corrado in #3160
• Closes #3202 Index.inferred_type by @ajpotts in #3203
• Closes #3208-Index.equals by @ajpotts in #3209
• Closes #3194 add proto tests to CI by @ajpotts in #3195
• Add benchmark for for CSV Read and write perf by @ShreyasKhandekar in #3189
• Fixes #3185: strings broadcast bug by @stress-tess in #3210
• Closes #3167: Add normal to random number generators by @stress-tess in #3180
• Add NYC taxi tutorial from CUG 2024 by @bmcdonald3 in #3211
• Fix jupyter notebook formatting by @bmcdonald3 in #3221
• Closes #3009: indexof1d to handle null values by @stress-tess in #3169
• Compatibility improvements for Xarray chunk-manager by @jeremiah-corrado in #3223
• Closes #3215: Index.__get__item can accept a list by @ajpotts in #3216
• Closes #3217: MultiIndex.get_level_values by @ajpotts in #3218
• Move some definitions from ArrowFunctions header to source by @e-kayrakli in #3236
• Reduce file size for csvIO benchmark by @ShreyasKhandekar in #3239
• Part of #3229: CI failures due to indexof1d by @stress-tess in #3232
• Fixes #3074: Bug reading segarrays from parquet files by @stress-tess in #3233
• Closes #3227 add pandas stubs library by @ajpotts in #3228
• Closes #3213 Index properties by @ajpotts in #3214
• Add implementations of clip, diff,pad to Array API module by @jeremiah-corrado in #3237
• Closes #3188 multi index.equals by @ajpotts in #3225
• Fixes #3222: series of segarray print bug by @stress-tess in #3240
• Fixing a missing iloc usage by @brandon-neth in #3243
• Closes #3249: Fix issue with finding incorrect conftest file for proto tests by @bmcdonald3 in #3250
• Fixes #3234: segarray with empty segments and nans parquet bug by @stress-tess in #3241
• Array API Documentation by @jeremiah-corrado in #3242
• Fixes #3252: proto test_segarray_read failure with multi-locale by @stress-tess in #3254
• Closes #3255 move numeric.floor to numpy module by @ajpotts in #3257
• Remove single-column cases from multi-col-merge test. by @brandon-neth in #3248
• Benchmark Display P...

Release Notes v2024.04.19

Bug Fixes

• PR #3091 - Fixes Parquet double reads to properly account for null values
• Issue #3087 - Fixes bug when reading non-float parquet columns with null values
• Issue #3088 and PR #3090 - Fix an off by 1 bug in sparse_sum_helper

Major Updates

• Issue #3083 - Optimizes Parquet Strings read
• Issues #3033, #3054 - Optimize CSV write
• Issues #3020, #3040 - Adds nan functions to DataFrame and Series
  • isna, notna, dropna, ...
• Issues #3071, #3084 - Add permutation and shuffle to random number generators
• Issue #3030 - Creates numpy subdirectory as part of the alignment effort
• PRs #3056, #3093, #3070, #3072 - Improves and adds Array API functionality including manipulation and set functions

Minor Updates

• PR #3076 - Adds support for large string Parquet type
• Issue #3092 - Adds support for TLS token authentication
• Issue #3045 - Adds map method to Index
• Issue #3065 - Adds count to DataFrame
• Issue #2913 - Adds isdecimal to Strings
• Issue #3002 - Adds clip to pdarray
• Issue #3062 - Enhances arkouda metrics capability

Auto-Generated Release Notes

• Closes #3030 numpy alignment directory structure by @ajpotts in #3038
• Closes #3040 isna and notna for series by @ajpotts in #3048
• Closes #3033: Optimize CSV write by @stress-tess in #3053
• Closes #3063: Fix deprecation warnings by @stress-tess in #3064
• Closes #2913: add isdecimal by @jaketrookman in #3015
• Closes #3045 index.map by @ajpotts in #3057
• Array API Set functions by @jeremiah-corrado in #3070
• Fix --print-used-modules for functions registered with @arkouda.registerND by @jeremiah-corrado in #3072
• Closes #3054: Dynamically switch to batching for larger csv writes by @stress-tess in #3061
• Closes #3002: Add ak.clip functionality by @drculhane in #3043
• enhance arkouda metrics capability by @hokiegeek2 in #3067
• Partially addresses issue #3050, updating PROTO tests. by @drculhane in #3075
• Add support for large string Parquet type by @bmcdonald3 in #3076
• Closes #3071: Add permutation to our generators by @stress-tess in #3078
• Closes #3065 DataFrame.count by @ajpotts in #3081
• Part of #3088: Generate seed for sparse sum test by @stress-tess in #3090
• Fix Parquet double reads to properly account for null values by @bmcdonald3 in #3091
• Array API Manipulation Function Improvements by @jeremiah-corrado in #3056
• Closes #3084: Add shuffle to random number generators by @stress-tess in #3085
• Pdarray indexing by @jeremiah-corrado in #3093
• Fixes #3087: Failure reading non-float parquet columns with null values by @stress-tess in #3094
• Closes #3083: Optimize Parquet string read code by @bmcdonald3 in #3082
• add support for TLS token authentication by @hokiegeek2 in #3096
• Fixes #3088: sparse sum nightly failures by @stress-tess in #3098
• Closes #3020 dataframe.dropna by @ajpotts in #3101

New Contributors

• @drculhane made their first contribution in #3043

Full Changelog: v2024.03.18...v2024.04.19

Release Notes v2024.03.18

Bug Fixes

• Issue #3035 - Fixes inconsistent results when broadcasting with empty segments
• Issue #2939 - Fixes TypeError in DataFrame.reset_index
• Issue #2966 - Fixes error when pip installing from a tar file
• Issue #2897 - Fixes bug where DataFrame.corr returns DataFrame without index
• PR #3021 - Adds SegArray optimization and benchmark bug fix

Major Updates

• Issue #2958 - Renames akstats to akscipy
• Issue #2942 - Removes DataFrame.sorted
• Issue #3024 and PR #2976 - Add sparse sum helper to util with merge based and sort based workflows
• Issues #2993, #3008, #3017 - Add a random subfolder and stateful Generator objects
• Issue #2974 - Adds Series.map
• Issue #3019 - Adds outer join option to DataFrame merge
• PRs #2936, #2967, #3014, #3027 - Improve Array API functionality specifically adding stats and manipulation functions

Minor Updates

• Issue #2929 - Updates DataFrame.size to match pandas
• Issues #2906, #2945 - Add shift operators between 2 bool pdarrays and between a combination bool and int64 pdarrays
• Issues #2916, #2919 - Add isspace and capitalize to Strings
• Issue #3023 - Adds to_markdown to DataFrame and Series
• Issue #2957 - Adds Dot Function
• Issue #2960 - Adds memory_usage functions
• Issue #2924 - Updates DataFrame documentation
• Issue #2896 - Updates DataFrame columns to return an Index
• Issue #2952 - Makes Chapel 1.33 release default for CI testing
• Issue #2985 - Updates libzmq version in Makefile
• Issue #2981 - adds LICENSES folder including the licenses for numpy, pandas, and scipy
• Issues #2969, #2971, #2977, #2989 - Update failing proto_tests

Auto-Generated Release Notes

• Add sort compat modules for new sorting algorithm by @bmcdonald3 in #2941
• Closes #2906 shift operator for boolean vectors by @ajpotts in #2944
• Closes #2916 add isspace for pdarrays by @ajpotts in #2946
• Closes #2949: Add compat modules for 1.34 by @bmcdonald3 in #2950
• Closes #2952: Make Chapel 1.33 release default for CI testing by @bmcdonald3 in #2951
• Remove deprecation warnings about domain(?) vs. domain by @jeremiah-corrado in #2953
• Closes #2919 add capitalize to pdarrays by @ajpotts in #2948
• Closes #2945: add Shift Operators for Boolean and Int64 by @jaketrookman in #2954
• Closes #2924 update pydoc strings for arkouda dataframe by @ajpotts in #2943
• Closes #2942 bug in sorted by @ajpotts in #2955
• Closes #2958 rename akstats to akscipy by @ajpotts in #2959
• Closes #2929-dataframe-size-to-match-pandas by @ajpotts in #2961
• Closes #2963-PROTO_tests-tests-akscipy-unit-tests-failing by @ajpotts in #2964
• Fixes #2966: pip install from tar error by @stress-tess in #2968
• Array API manipulation functions by @jeremiah-corrado in #2936
• Add sparse sum helper to util by @stress-tess in #2976
• Closes #2969 PROTO_tests/tests/client_test.py unit tests failing by @ajpotts in #2970
• Closes #2971 PROTO_tests/tests/dtypes_test.py unit tests failing by @ajpotts in #2972
• Closes #2977 PROTO_tests/tests/setops_test.py unit tests failing by @ajpotts in #2979
• Address Random.choice deprecation by @jeremiah-corrado in #2983
• Closes #2985: Update libzmq version in Makefile by @stress-tess in #2986
• Resolve formatting issue in NumpyDType server docs by @jeremiah-corrado in #2992
• Closes #2981 add licenses by @ajpotts in #2988
• Closes #2989 PROTO_tests/tests/pdarray_creation_test.py has failing test by @ajpotts in #2990
• Remove deprecation messages for reader/writer locking default change by @jeremiah-corrado in #2987
• Closes #2994: Remove upper bound on pandas version by @stress-tess in #2995
• Closes #2896 DataFrame columns should return an Index by @ajpotts in #2962
• Closes #2993: Create random subfolder and foundation for generator by @stress-tess in #2997
• Closes #2957: Dot Function by @jaketrookman in #2996
• Closes #2934 DataFrame.unregister_dataframe_by_name string return typ… by @ajpotts in #3011
• Closes #2897 DataFrame.corr returns dataframe without index by @ajpotts in #3012
• Closes #2939 DataFrame.reset_index by @ajpotts in #3013
• Array API stats functions by @jeremiah-corrado in #2967
• Support for creating Array API objects from numpy arrays by @jeremiah-corrado in #3014
• Closes #2960 int version of memory_usage by @ajpotts in #3018
• SegArray optimization & bug fix by @brandon-neth in #3021
• Closes #3019 Add outer join option for dataframe merge by @ajpotts in #3022
• Closes #3031: Update Arkouda for upcoming Chapel 2.0 release by @bmcdonald3 in #3032
• Closes #3008: Add generator sym entry and stateful uniform distribution by @stress-tess in #3016
• Closes #2974 Series.map by @ajpotts in #3010
• Closes #3024: Add merge based workflow and update sort workflow for sparse sum helper by @stress-tess in #3025
• Remove I/O-locking and randomStream.skipTo deprecation messages by @jeremiah-corrado in #3037
• Closes #3023 to_markdown by @ajpotts in #3026
• Array API improvements by @jeremiah-corrado in #3027
• Fixes #3035 - Inconsistent results when broadcasting with empty segments by @stress-tess in #3039
• Closes #3017: Add documentation for our random number generation by @stress-tess in #3044

Full Changelog: v2024.02.02...v2024.03.18

Release Notes v2024.02.02

Bug Fixes

• Issues #2647, #2650, #2661, #2666 - Fix bugs in filter, remove_repeats, append_single and get_jth for segarrays with empty segments
• Issue #2937 - Fixes string read bug for large Parquet files

Major Updates

• Issue #2853 - Adds df.merge on a mix of String and integer columns
• Issues #2862, #2863, #2871 - Implement histogram2d and histogramdd
• Issue #2927 - Adds power divergence statistic, chisquare, and xlogy
• Issues #2905, #2912, #2914, #2918 - Add isalpha, isalnum, isdigit, and isempty for Strings
• Issues #2888, #2878 - Add float support to in1d and groupby

Minor Updates

• Issues #2873, #2886 - Enable short strings optimization for multi-column groupby
• Issue #2894 - Adds dropna option to dataframe groupby
• Issue #2461 - Adds where argument to trig functions
• Issue #2430 - Adds shift equals for pdarray
• Issue #2831 - Aligns dataframe.groupby().size() and dataframe.groupby().sum() with pandas
• PRs #2829, #2865, #2876 - Add infrastructure and partial implementation of array API
• PR #2870 - Expands DataFrame initializer
• PR #2931 - Aligns Series indexing methods with pandas
• Issue #2909 - Renames is_upper/lower/title and to_upper/lower/title to match numpy

Auto-Generated Release Notes

• Scaffolding for multi-dimensional arrays by @jeremiah-corrado in #2829
• Closes #2836: Remove computeOnSegmentsWithoutAggregation by @pierce314159 in #2854
• Closes #2857: Move init methods to compat modules for 132 by @bmcdonald3 in #2858
• Closes #2855: Read batches for Parquet strings by @bmcdonald3 in #2856
• Closes #2853: df.merge on a mix of String and integer columns by @pierce314159 in #2859
• Closes #2862: Implement histogram2d by @pierce314159 in #2864
• Closes #2866: Fix empty domain creation for block arrays by @bmcdonald3 in #2867
• Close #2871: Fix numeric precision issue in testHistogram by @pierce314159 in #2872
• DataFrame initializer improvements by @brandon-neth in #2870
• Fixes #2666: Segarray.filter bug with empty segments by @pierce314159 in #2860
• Fixes #2661: segarray.remove_repeats bug with empty segments by @pierce314159 in #2861
• Closes #2863: Implement histogramdd by @pierce314159 in #2868
• Array creation perf patch by @jeremiah-corrado in #2869
• Closes #2875: Clean up deprecations in advance of 1.33 release by @bmcdonald3 in #2874
• Closes #2873: Short strings optimization for multicol groupby by @pierce314159 in #2877
• Only use tryCreateArray interface to create 1D arrays by @jeremiah-corrado in #2879
• Fix typo in #2879 by @jeremiah-corrado in #2882
• Closes #2878: Add groupby for floats by @pierce314159 in #2884
• Fixes #2883: Fix ambiguity in makeDistArray where clauses by @jeremiah-corrado in #2885
• Closes #2886: Cap small strs groupby optimization by @pierce314159 in #2887
• Closes #2888: Add in1d float support by @pierce314159 in #2889
• Fixes #2650: Fixes segarray.append_single with empty segments by @pierce314159 in #2891
• Closes #2461: Implementation of where feature for trig functions by @jaketrookman in #2851
• Fixes #2647: Segarray.get_jth bug with bool values by @pierce314159 in #2895
• Array API infrastructure and partial implementation by @jeremiah-corrado in #2865
• Closes ticket #2831 to align dataframe.groupby().size(), dataframe.groupby().sum() to pandas by @ajpotts in #2892
• Adjustments to remove some chpl unstable warnings by @jeremiah-corrado in #2890
• Fix CommAggregation build error on 1.32 by @jeremiah-corrado in #2900
• Closes #2901: Fix performance regression due to setting ndim field in sym entry by @bmcdonald3 in #2902
• Replace use of binary 'or' with logical 'or' by @DanilaFe in #2907
• Closes #2894 add dropna option to dataframe groupby by @ajpotts in #2904
• closes #2430 add shift equals for pdarray by @ajpotts in #2908
• Closes #2905 add strings isalnum by @ajpotts in #2910
• Closes ticket #2909 rename is_upper and similar ops to match numpy by @ajpotts in #2920
• Closes #2922: Pin pandas<2.2.0 to avoid CI failures by @pierce314159 in #2923
• Closes #2912 add isalpha for pdarray by @ajpotts in #2921
• Apply black formatter to array_api frontend code by @jeremiah-corrado in #2928
• Modify fix to performance regression in #2902 by @jeremiah-corrado in #2930
• Closes #2914-add-isdigit-for-pdarray by @ajpotts in #2925
• Make arkouda server configurable w.r.t. supported types by @jeremiah-corrado in #2876
• Indexing methods for Series by @brandon-neth in #2931
• Closes #2937 : Fix string read bug for large Parquet files by @bmcdonald3 in #2938
• Closes #2918 add isempty for pdarray by @ajpotts in #2933
• closes #2927 power divergence statistic by @ajpotts in #2932

New Contributors

• @ajpotts made their first contribution in #2892

Full Changelog: v2023.11.15...v2024.02.02

Release Notes v2023.11.15

Bug Fixes

• Issue #2816 - Resolves nil config file bug
• Issue #2804 - Fixes missing values in CSV bug
• Issue #2825 - Fixes inconsistent Categorical print
• Issue #2849 - Fixes bug in getEnv

Major Updates

• PR #2844 - Drops support for Chapel 1.30
• Issue #2838 - Expands dataframe merge functions to accept multiple columns
• Issue #2810 - Expands inner_join to accept a list of pdarrays
• Issues #1882, #2833, #2843 - Update dependencies to support python 3.x/3.12

Minor Updates

• Issue #2823 - Adds casting between Strings and Categorical
• Issue #2830 - Implements division and floor division for int64 and uint64 dtypes
• PR #2821 - Adds support for reading Decimal128 Parquet columns
• Issue #2819 - Adds error when reading a Parquet type that isn't supported

Auto-Generated Release Notes

• Fixes #2816: Resolve nil config file bug by @pierce314159 in #2817
• Fixes #2804: Missing values in CSV bug by @pierce314159 in #2813
• fixed typo in README.md by @daulatojha17 in #2818
• Closes #2819 - Throw error when reading a Parquet type that isn't supported by @bmcdonald3 in #2820
• Closes #2815: Update install docs by @pierce314159 in #2822
• Fixes #2825: Inconsistent Categorical print by @pierce314159 in #2826
• Closes #2823: Casting between Strings and Categorical by @pierce314159 in #2827
• Add support for reading Decimal128 Parquet columns by @bmcdonald3 in #2821
• Closes #1882, #2833: CI failures due to python 3.x/3.12 by @pierce314159 in #2834
• Add directory with files for Parquet C++ comparison by @bmcdonald3 in #2832
• Closes #2810: Expand inner_join to accept a list of pdarrays by @pierce314159 in #2837
• Fix a Makefile conditional to test for empty string instead of 'none' by @bradcray in #2841
• Closes #2843: Add python 3.12/3.x check to CI by @pierce314159 in #2840
• Drop support for Chapel 1.30 by @brandon-neth in #2844
• Updates to the macOS build instructions + additional contributor guide by @brandon-neth in #2845
• Fixes #2849: bug in getEnv by @pierce314159 in #2850
• Closes #2830 Implement division and floor division for int64 and uint64 dtypes. by @jaketrookman in #2847
• Closes #2838: Expand dataframe merge functions to accept multiple columns by @pierce314159 in #2848

Full Changelog: v2023.10.06...v2023.11.15

Release Notes v2023.10.06

Bug Fixes

• Issue #2802 - Fixes concatenate and arange mishandling max_bits
• Issues #2472, #2800 - Fix bug in bigint indexing with max_bits set
• Issues #2675, #2773 - Fix argsort and coargsort on boolean arrays

Major Updates

• Issues #2724, #2730 - Add HDF5 support for Index and MultiIndex
• Issues #2679, #2767, #2774, #2783, #2798 - Resolve chpl 1.32 deprecation warnings
• Issue #2805 - Upgrades arrow to 11.0.0
• Issues #2759, #2757, #2762, #2764, #2790, #2794 - Work to improve pdarray creation performance and out of memory error handling
• Issue #2405 - Adds server <-> server transfers of pdarrays
• Issue #2716 - Adds dataframe merge functionality
• Issue #2712 - Adds stridable slicing to Strings
• Issue #2744 - Implements skew and hist_all

Minor Updates

• Issue #2778 - Adds convert_categoricals flag to dataframe.to_parquet
• Issue #2771 - Adds pda.value_counts
• Issue #2521 - Adds uint support to histogram
• Issue #2474 - Updates ConcatenateMsg to use aggregation for bigint

Auto-Generated Release Notes

• Closes #2757: Add overload of makeDistArray that takes an array by @bmcdonald3 in #2758
• Closes #2759: Fix tryCreateArray call in 1.32 compat module by @bmcdonald3 in #2760
• Closes #2762: Fix last outstanding error regarding OOM handling compat modules by @bmcdonald3 in #2763
• Closes #2675: Argsort for bool arrays by @pierce314159 in #2761
• Closes #2405: Add server <-> server transfers of pdarrays by @bmcdonald3 in #2406
• Closes #2744 - Implement skew and hist_all by @egelberg in #2756
• Closes #2764: Add throws to new makeDistArray compat function by @bmcdonald3 in #2765
• Closes #2767: Resolve deprecation warnings introduced by array transfer PR by @bmcdonald3 in #2766
• Closes #2679: Convert check for re2 in the compiler from a .compile() method to new regex() by @bradcray in #2777
• Closes #2712: Adds stridable slicing to Strings by @pierce314159 in #2770
• Closes #2771: Add pda.value_counts by @pierce314159 in #2772
• Fixes #2773: Fixes bug in multi-locale coargsort with bool arrays by @pierce314159 in #2776
• Closes #2768: Verify that all test files pass flake8 by @jaketrookman in #2769
• Closes #2778: Add convert_categoricals flag to dataframe.to_parquet by @pierce314159 in #2780
• Closes #2521: Add uint support to histogram by @TheOddCzar789 in #2782
• Closes #2774: Resolve deprecation warnings in advance of 1.32 release by @bmcdonald3 in #2775
• Closes #2783: Add ref this intents to comm aggregation code by @bmcdonald3 in #2784
• Closes #2724 & #2730 - Adds HDF5 support for Index and MultiIndex by @Ethan-DeBandi99 in #2731
• Closes #2790: Convert non sym entry array creations to new throwing interface by @bmcdonald3 in #2791
• Closes #2789: Updates to HDF5 for Index by @pierce314159 in #2792
• Closes #2794: Fix distributed makeDistArray call for Chapel 1.30 and 1.31 by @bmcdonald3 in #2795
• Closes #2796: Reduce Parquet IO benchmark default size by @bmcdonald3 in #2797
• Cloases #2798: Resolve chpl 1.32 deprecations for make check-deps by @pierce314159 in #2799
• Closes #2474: Update ConcatenateMsg to use aggregation for bigint by @jaketrookman in #2801
• Fixes #2802: concatenate and arange mishandling max_bits by @pierce314159 in #2803
• Closes #2807: Pin tables<3.9.0 to avoid CI failures by @pierce314159 in #2808
• Closes #2805: Upgrade arrow to 11 and add python 3.x compat by @pierce314159 in #2806
• Closes #2472, #2800: Update IndexingMsg to use & instead of mod for setting bigint pdarrays by @jaketrookman in #2793
• Closes #2716: Add dataframe merge functionality by @egelberg in #2781

New Contributors

• @egelberg made their first contribution in #2756

Full Changelog: v2023.09.06...v2023.10.06

Release Notes v2023.09.06

Bug Fixes

• Issue #2596 - Fixes datetime columns in dataframe display bug
• Issue #2612 - Fixes an oob error with multilocale read_hdf of a segarray with string values and empty segments
• Issues #2560, #2268, #2566 - Fix missing empty segments for parquet read of segarray with string values
• Issue #2567 - Fixes error when reading SegArray containing nan with parquet
• Issue #2581 - Fixes Strings.get_null_indicies incorrect results
• Issues #2681, #1493 - Fix Series equality bug
• Issues #2644, #2645 - Fix uint cast to str/float and add str cast to str
• Issue #2703 - Fixes sort bug with nans
• Issue #2617 - Fixes bug in comparison of segarrays containing empty segments
• Issue #2711 - Fixes bug in Multindex indexing with bigint values
• Issue #2579 - Fixes compression when writing bools with Parquet
• Issues #2508, #2519, #2505 - Fix uint scalar binops handling and overhauls mod/fmod
• Issue #2635 - Fixes Strings double delete

Major Updates

• Issues #2548, #2550 - Drop support for Chapel 1.29 and recommend 1.31
• Issues #2395, #2723, #2726, #2737 - Rework Register/Attach
• Issues #2512, #2541, #2614 - Adds Snapshotting via HDF5
• Issue #2493 - Adds parquet support for multi-column SegArray with String values
• Issues #2749, #1166 - Add missing aggregations for Dataframe groupby and ability to aggregate on a list column names
• Issue #2708 - Adds support for preserving DateTime, TimeDelta, and IPV4 when reading/writing with HDF5

Added New Testing Architecture

• Issue #2504 - numeric_tests.py conversion for new test framework
• Issue #2538 - client_test.py conversion for new test framework
• Issue #2542 - message_test.py Conversion for new test framework
• Issues #2547, #2553, #2554, #2555 - setops_tests.py conversion for new test framework
• Issue #2526 - Add arc/hyperbolic Tests to new test framework
• Issue #2570 - bigint_agg_test.py Conversion for new test framework
• Issue #2536 - alignment_test.py Conversion for new test framework
• Issue #2559 - dataframe_test.py conversion for new framework
• Issue #2585 - parquet_test.py conversion for new framework
• Issue #2537 - array_view_test conversion for new framework
• Issue #2607 - groupby_test.py conversion to new framework
• Issue #2616 - index_test.py conversion for new framework
• Issue #2625 - coargsort_test.py conversion for new test framework
• Issue #2602 - io_test.py conversion for new framework
• Issue #2640 - Convert security_test.py to new test framework
• Issue #2648 - logger_test.py conversion for new framework
• Issue #2583 - client_dtypes_test conversion for new framework
• Issue #2624 - import_export_test.py conversion for new test framework
• Issue #2572 - bit_ops.py Conversion for new test framework
• Issue #2605 - dtypes_test.py Conversion for new test framework
• Issue #2659 - regex_test.py conversion to new test framework
• Issue #2626 - join_test.py Conversion for new test framework
• Issue #2668 - io_util_test.py refactor for new framework
• Issue #2642 - segarray_test.py refactor for new test framework
• Issue #2694 - extrema_test.py conversion for new test framework
• Issue #2688 - operator_test.py conversion for new test framework
• Issue #2684 - symbol_table_test.py refactor for new test framework
• Issue #2705 - where_test.py refactor to new test framework
• Issue #2700 - string_test.py conversion for new test framework
• Issue #2654 - sort_test.py conversion for new test framework
• Issue #2620 - indexing_test.py conversion for new framework
• Issue #2656 - stats_test.py conversion for new test framework
• Issue #2686 - categorical_test.py conversion for new test framework
• Issue #2573 - pdarray_creation_test.py Conversion for new test framework
• Issue #2697 - datetime_test.py conversion for new test framework
• Issue #2651 - series_test.py conversion for new framework
• Issue #2591 - Add dtype testing to test_multi_array_search_interval

Minor Updates

• Issue #2053 - Adds Strings property accessors
• Issue #2568 - Provides client access to arkouda locale memory information
• Issue #2419 - Adds ability to log arkouda commands to a file
• Issue #2702 - Capture only user-specified arkouda commands on client
• Issues #2524, #2721, #2746 - Extend client to enable gRPC proxy server channel implementations
• Issues #2477, #2728 - Provide dynamic available memory calculation for all locales
• Issue #2400 - Adds arc and hyperbolic trig functions
• Issue #2471 - Adds ak.full() for Strings
• Issue #2603 - Reworks arange handling of uint and bigint arguments
• Issue #2714 - Adds regex argument to categorical substring search
• Issue #2695 - Adds uint support to extrema methods
• Issues #2658, #2575 - Implement ServerStatusDaemon
• Issue #2690 - Updates ak.load_all glob expression

Auto-Generated Release Notes

• Replace c_memcpy with OS.POSIX.memcpy in CommAggregation module by @jeremiah-corrado in #2517
• Closes #2504 - Adds New Testing Architecture by @Ethan-DeBandi99 in #2511
• Closes #2400: Add arc and hyperbolic trig functions by @jaketrookman in #2447
• 2524 extend arkouda client to enable alternative channel implementations by @hokiegeek2 in #2525
• update readme by @pierce314159 in #2530
• Closes #2529: Adjust getUserMetrics to return borrowed by @mppf in #2527
• Fixes #2508 and #2519: Fixes uint scalar handling and overhauls mod/fmod for floats by @pierce314159 in #2520
• Closes #2505: Update resolve_scalar_dtype to handle uint and bigint by @pierce314159 in #2532
• dynamic available memory calculation for all locales by @hokiegeek2 in #2533
• Closes #2493 - Multi-Column SegArray with String Values by @Ethan-DeBandi99 in #2523
• Closes #2538 - client_test.py conversion for new test framework by @Ethan-DeBandi99 in #2540
• Closes #2268 - Fixes Sporadic failures of Parquet segarray_write test with gasnet by @Ethan-DeBandi99 in #2534
• Closes #2542 - message_test.py Conversion for new test framework by @Ethan-DeBandi99 in #2544
• Closes #2545: Update MemoryMgmt to use compat modules by @pierce314159 in #2546
• Closes #2547, #2553, #2554, #2555 - setops_tests.py conversion for new test framework by @Ethan-DeBandi99 in #2556
• Closes #2548: Recommend Chapel 1.31.0 and use it for CI testing by @bmcdonald3 in #2552
• Closes #2560 - Fixes Missing empty segments for parquet read of segarray with string values by @Ethan-DeBandi99 in #2562
• Closes #2471: ak.full() for Strings by @TheOddCzar789 in #2557
• Fixes #2564 - SetOps Test Sporadic Failures by @Ethan-DeBandi99 in #2565
• Closes #2561: Add casting directly from bool to bigint by @pierce314159 in #2563
• Fixes #2566 - multi-locale failures for test_segarray_string by @Ethan-DeBandi99 in #2574
• Closes #2581 - Strings.get_null_indicies Not Reporting Correct Results in Parquet by @Ethan-DeBandi99 in #2582
• Fixes #2567 - Error when reading SegArray containing nan with parquet by @Ethan-DeBandi99 in #2587
• Closes #2588: Remove BigInt casting from 132 compat and add new compat dir by @bmcdonald3 in #2589
• Closes #2550: Drop support for Chapel 1.29 by @bmcdonald3 in #2551
• provide client access to arkouda locale memory information by @hokiegeek2 in #2595
• Closes #2053: Strings Property Accessors by @jaketrookman in #2498
• Closes #2526: Add arc/hyperbolic Tests to new test framework by @jaketrookman in #2531
• Closes #2570: bigint_agg_test.py Conversion for new test framework by @TheOddCzar789 in #2578
• Closes #2597: Remove leftover e-129 compat folder by @pierce314159 in #2598
• Closes #2536: alignment_test.py Conversion for new test framework by @TheOddCzar789 in #2569
• Closes #2559 - dataframe_test.py conversion for new framework by @Ethan-DeBandi99 in #2580
• Closes #2593: Add compat version of c_void_ptr for new c_ptr(void) by @riftEmber in #2594
• Closes #2585: parquet_test.py conversion for new framework by @pierce314159 in #2586
• Closes #2537: array_view_test conversion for new framework by @jaketrookman in #2590
• Fixes #2579 - Compression when writing bools with Parquet by @Ethan-DeBandi99 in #2601
• Fixes #2596: datetime columns in dataframe display bug by @pierce314159 in #2600
• Closes #2541 - DataFra...

Release Notes v2023.06.20

Bug Fixes

• Issue #2513 - Fixes bug where channel connection doesn't account for slurm changing the server host between connections. Refactored to create a new Channel for each client.connect execution.

Minor Updates

• Issue #2515 - Updates file I/O documentation to include SegArrays containing string values

Auto-Generated Release Notes

* refactored to create a new Channel for each client.connect execution by @hokiegeek2 in https://github.com//pull/2514 * Closes #2515 - File I/O Doc Updates by @Ethan-DeBandi99 in https://github.com//pull/2516

Full Changelog: v2023.06.16...v2023.06.20