7 Releases published by 2 people

• 53.0.0

  published Jan 27, 2025

• 53.1.0

  published Jan 27, 2025

• 53.2.0

  published Jan 27, 2025

• 53.3.0

  published Jan 27, 2025

• 53.4.0

  published Jan 27, 2025

• 54.0.0

  published Jan 27, 2025

• 54.1.0 arrow 54.1.0

  published Jan 29, 2025

16 Pull requests merged by 9 people

• Prepare for 54.1.0 release

  #7031 merged Jan 29, 2025

• Fix concat for sliced ListArrays

  #7037 merged Jan 29, 2025

• Create GitHub releases automatically on tagging

  #7042 merged Jan 29, 2025

• Change Log On Succesful S3 Copy / Multipart Upload to Debug

  #7033 merged Jan 28, 2025

• Add is_valid and truncate methods to NullBufferBuilder

  #7013 merged Jan 27, 2025

• docs: add to bit slice iterator docs that the start value is inclusive and end value is exclusive

  #7022 merged Jan 27, 2025

• Refactor ipc reading code into methods on ArrayReader

  #7006 merged Jan 27, 2025

• Add support for deserializing list-encoded JSON structs [#6558]

  #6643 merged Jan 26, 2025

• fix: use the values builder capacity for the hash map in PrimitiveDictionaryBuilder::new_from_builders

  #7012 merged Jan 25, 2025

• Expose min/max values for Decimal128/256 and improve docs

  #6992 merged Jan 25, 2025

• Minor: Clarify NullBufferBuilder::new capacity parameter

  #7016 merged Jan 25, 2025

• Fix duplicate link references in README

  #7020 merged Jan 25, 2025

• fix: Panic on reencoding offsets in arrow-ipc with sliced nested arrays

  #6998 merged Jan 25, 2025

• feat(arrow-ord): support boolean in rank and add tests for sorting lists of booleans

  #6912 merged Jan 25, 2025

• Enhance ListViewArray related docs

  #7007 merged Jan 24, 2025

• RecordBatch normalization (flattening)

  #6758 merged Jan 24, 2025

11 Pull requests opened by 6 people

• Add hooks to json encoder to override default encoding or add support for unsupported types

  #7015 opened Jan 24, 2025

• Add a custom implementation `LocalFileSystem::list_with_offset`

  #7019 opened Jan 24, 2025

• Optimise decimal casting for infallible conversions

  #7021 opened Jan 25, 2025

• Introduce `UnsafeFlag` to manage disabling `ArrayData` validation

  #7027 opened Jan 27, 2025

• Refactor arrow-ipc: Rename `ArrayReader` to `RecodeBatchDecoder`

  #7028 opened Jan 27, 2025

• Refactor arrow-ipc: Move `create_*_array` methods into `RecordBatchDecoder`

  #7029 opened Jan 27, 2025

• Update flatbuffers requirement from 24.12.23 to 25.1.24

  #7032 opened Jan 27, 2025

• Update rand requirement from 0.8 to 0.9 in /object_store

  #7035 opened Jan 28, 2025

• Update rand requirement from 0.8 to 0.9

  #7036 opened Jan 28, 2025

• Improve `ListArray` documentation for slices

  #7039 opened Jan 28, 2025

• Update rand requirement from 0.8 to 0.9

  #7045 opened Jan 29, 2025

8 Issues closed by 3 people

• Regression: Concatenating sliced `ListArray`s is broken

  #7034 closed Jan 29, 2025

• Create GitHub releases automatically on tagging

  #7041 closed Jan 29, 2025

• Add required methods to access inner builder for `NullBufferBuilder`

  #7002 closed Jan 27, 2025

• Allow JSON deserialization of StructArray from JSON List

  #6558 closed Jan 26, 2025

• `PrimitiveDictionaryBuilder` with specific value data type and capacity

  #7011 closed Jan 25, 2025

• Arrow IPC Writer Panics for sliced nested arrays

  #6997 closed Jan 25, 2025

• Are we sure that removing dict_id is not removing important functionality?

  #7017 closed Jan 25, 2025

• Support RecordBatch.flatten

  #6369 closed Jan 24, 2025

11 Issues opened by 10 people

• object_store: Support `container@account.dfs.core.windows.net/path` URL style for `az` protocol

  #7046 opened Jan 30, 2025

• Missing safety comments for calling ArrowDataBuilder::build_unchecked in Parquet

  #7044 opened Jan 29, 2025

• First None in ListArray panics in `cast_with_options`

  #7043 opened Jan 29, 2025

• Parquet reader can incorrectly return null (or error) for uint8, uint16 values

  #7040 opened Jan 28, 2025

• object_store: Directory Support

  #7030 opened Jan 27, 2025

• object_store: Should the object_store::path:Path allow a trailing '/'

  #7026 opened Jan 27, 2025

• Enhance arrow-json reader/writer builder pattern to enforce constraints

  #7025 opened Jan 26, 2025

• Rank behaves differently from other systems

  #7024 opened Jan 26, 2025

• Expose whether can use the regular sort or lexsort for given data type

  #7023 opened Jan 26, 2025

• LocalFileSystem::list_with_offset is very slow over network file system

  #7018 opened Jan 24, 2025

• Support using simdutf8 for `validate_string_view` and other utf8 validation

  #7014 opened Jan 24, 2025

15 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• Add `ExtensionType` trait and `CanonicalExtensionType` enum

  #5822 commented on Jan 24, 2025 • 12 new comments

• Experimental parquet decoder with first-class selection pushdown support

  #6921 commented on Jan 27, 2025 • 3 new comments

• Add gRPC reflection support to arrow flight

  #7009 commented on Jan 29, 2025 • 2 new comments

• Support auth using AssumeRoleWithWebIdentity for non-AWS S3-compatible implementations

  #7010 commented on Jan 25, 2025 • 0 new comments

• Optimise Decimal Casting

  #6877 commented on Jan 25, 2025 • 0 new comments

• Remove `dict_id` from `arrow_schema::field::Field` and make dictionary IDs an internal implementation detail of flight encoding/decoding

  #5981 commented on Jan 25, 2025 • 0 new comments

• [Parquet] Implement Variant type support in Parquet

  #6736 commented on Jan 25, 2025 • 0 new comments

• Support EKS Pod Identity (alternative to IRSA)

  #7005 commented on Jan 29, 2025 • 0 new comments

• Release arrow-rs / parquet minor version 54.1.0 (Jan 2025)

  #6929 commented on Jan 29, 2025 • 0 new comments

• object_store: retry on response decoding errors

  #6519 commented on Jan 29, 2025 • 0 new comments

• Parquet Modular decryption support

  #6637 commented on Jan 24, 2025 • 0 new comments

• deduplicate variadic buffers in MutableArrayData::extend for ByteView arrays

  #6808 commented on Jan 25, 2025 • 0 new comments

• feat(arrow-ipc) Add: Support FileReader and StreamReader skip array data validation

  #6938 commented on Jan 24, 2025 • 0 new comments

• Avro codec enhancements + Avro Reader

  #6965 commented on Jan 29, 2025 • 0 new comments

• chore: Add initial benchmarks for Arrow IPC Stream writer

  #6972 commented on Jan 25, 2025 • 0 new comments