GitHub user zeroshade created a discussion: Apache Arrow Go v18.7.0
## What's Changed * fix(release): keys download by @zeroshade in https://github.com/apache/arrow-go/pull/781 * parquet/compress: enable WithAllLitEntropyCompression(true) for zstd by @varun0630 in https://github.com/apache/arrow-go/pull/779 * release: fix syntax error in verify_rc.sh by @amoeba in https://github.com/apache/arrow-go/pull/782 * chore: Bump modernc.org/sqlite from 1.49.1 to 1.50.0 by @dependabot[bot] in https://github.com/apache/arrow-go/pull/783 * fix(parquet): align dictionary fallback with parquet-mr by @twuebi in https://github.com/apache/arrow-go/pull/786 * fix(arrow/cdata): make nativeCRecordBatchReader deterministic by @zeroshade in https://github.com/apache/arrow-go/pull/793 * fix(compute/kernels): map FSB byte-width to numeric memo type for is_in by @SAY-5 in https://github.com/apache/arrow-go/pull/797 * chore: Bump google.golang.org/grpc from 1.80.0 to 1.81.0 by @dependabot[bot] in https://github.com/apache/arrow-go/pull/798 * chore: Bump github.com/klauspost/compress from 1.18.5 to 1.18.6 by @dependabot[bot] in https://github.com/apache/arrow-go/pull/799 * fix(arrow/flight): deliver response headers eagerly in streaming client middleware by @zeroshade in https://github.com/apache/arrow-go/pull/801 * chore: Bump golang.org/x/sys from 0.43.0 to 0.44.0 by @dependabot[bot] in https://github.com/apache/arrow-go/pull/810 * chore: Bump modernc.org/sqlite from 1.50.0 to 1.50.1 by @dependabot[bot] in https://github.com/apache/arrow-go/pull/811 * fix(ipc): preserve map child field metadata by @dimakuz in https://github.com/apache/arrow-go/pull/809 * fix(avro): error on complex (non-nullable) unions instead of silently dropping (#777) by @SAY-5 in https://github.com/apache/arrow-go/pull/808 * fix(parquet/metadata): do not pre-set hasDistinctCount in stat factories by @SAY-5 in https://github.com/apache/arrow-go/pull/807 * feat(compute): support casts between binary/string and binary_view/string_view by @zeroshade in https://github.com/apache/arrow-go/pull/802 * fix(arrow/array): preserve large integer precision in JSON decoding by @zeroshade in https://github.com/apache/arrow-go/pull/816 * feat(arrow/array): add Resize method to RecordBuilder by @oakad in https://github.com/apache/arrow-go/pull/805 * chore: Bump google.golang.org/grpc from 1.81.0 to 1.81.1 by @dependabot[bot] in https://github.com/apache/arrow-go/pull/818 * chore: Bump github.com/substrait-io/substrait-go/v8 from 8.1.0 to 8.1.1 by @dependabot[bot] in https://github.com/apache/arrow-go/pull/819 * perf(parquet/pqarrow): cap RecordReader batch size to actual row count by @paveon in https://github.com/apache/arrow-go/pull/817 * docs(parquet): correct DefaultDataPageSize comment from 1K to 1M by @zeroshade in https://github.com/apache/arrow-go/pull/822 * fix(arrow/array): silence copylocks warning in numeric_generic.go by @zeroshade in https://github.com/apache/arrow-go/pull/823 * feat(arrow/compute/exprs): support expr.IntervalYearToMonthLiteral in literalToDatum by @zeroshade in https://github.com/apache/arrow-go/pull/825 * chore: Bump golang.org/x/sys from 0.44.0 to 0.45.0 by @dependabot[bot] in https://github.com/apache/arrow-go/pull/829 * chore: Bump docker/login-action from 4.1.0 to 4.2.0 by @dependabot[bot] in https://github.com/apache/arrow-go/pull/828 * fix(parquet): return error instead of panicking on first-write failure by @zeroshade in https://github.com/apache/arrow-go/pull/824 * [Parquet] Add SIMD-accelerated byte-stream-split decoding by @daniel-adam-tfs in https://github.com/apache/arrow-go/pull/654 * perf(parquet/metadata): avoid constructing ColumnChunkMetaData in page index range determination by @paveon in https://github.com/apache/arrow-go/pull/831 * chore: Bump modernc.org/sqlite from 1.50.1 to 1.51.0 by @dependabot[bot] in https://github.com/apache/arrow-go/pull/837 * chore: Bump github.com/pierrec/lz4/v4 from 4.1.26 to 4.1.27 by @dependabot[bot] in https://github.com/apache/arrow-go/pull/836 * chore: Bump actions/checkout from 6.0.2 to 6.0.3 by @dependabot[bot] in https://github.com/apache/arrow-go/pull/835 * feat: filter and take for dictionary arrays by @lesam in https://github.com/apache/arrow-go/pull/716 * fix(arrow/array): adding string boundary checking for (*String).Value by @happydave1 in https://github.com/apache/arrow-go/pull/844 * fix(parquet/variant): correct binary search bounds in ObjectValue.ValueByKey by @qzyu999 in https://github.com/apache/arrow-go/pull/841 * fix(parquet/variant): correct is_large bit position in valueSize for arrays by @qzyu999 in https://github.com/apache/arrow-go/pull/840 * feat(avro): support local-timestamp logical types by @abir-eon in https://github.com/apache/arrow-go/pull/832 * chore: Bump modernc.org/sqlite from 1.51.0 to 1.52.0 by @dependabot[bot] in https://github.com/apache/arrow-go/pull/845 * chore: Bump golang.org/x/sys from 0.45.0 to 0.46.0 by @dependabot[bot] in https://github.com/apache/arrow-go/pull/846 * fix(avro): append raw bytes by @matan129 in https://github.com/apache/arrow-go/pull/850 * fix(arrow/array): use scale-aware ValueStr in decimal array String() by @zeroshade in https://github.com/apache/arrow-go/pull/849 * feat(parquet/pqarrow): support writing LARGE_LIST types by @lidavidm in https://github.com/apache/arrow-go/pull/838 * chore: Bump golang.org/x/sync from 0.20.0 to 0.21.0 by @dependabot[bot] in https://github.com/apache/arrow-go/pull/847 * fix(arrow/scalar): implement Release()/Retain() on *scalar.Extension by @zeroshade in https://github.com/apache/arrow-go/pull/851 * docs(arrow/ipc): document that Writer and FileWriter are not concurrency safe by @zeroshade in https://github.com/apache/arrow-go/pull/856 * fix(parquet): add WriteBatchSpacedWithError to surface spaced-write failures by @zeroshade in https://github.com/apache/arrow-go/pull/852 * ci: pin Go to go.mod in RC verify so the matching toolchain is used by @zeroshade in https://github.com/apache/arrow-go/pull/857 * chore: Bump actions/checkout from 6.0.3 to 7.0.0 by @dependabot[bot] in https://github.com/apache/arrow-go/pull/860 * chore: Bump modernc.org/sqlite from 1.52.0 to 1.53.0 by @dependabot[bot] in https://github.com/apache/arrow-go/pull/861 * feat(arrow/extensions): add UnshredVariant to collapse a shredded variant array by @nssalian in https://github.com/apache/arrow-go/pull/859 * fix(arrow/compute): accept type max value in safe decimal-to-int cast by @zeroshade in https://github.com/apache/arrow-go/pull/862 * chore: Bump github.com/andybalholm/brotli from 1.2.1 to 1.2.2 by @dependabot[bot] in https://github.com/apache/arrow-go/pull/869 * chore: Bump actions/setup-go from 6.4.0 to 6.5.0 by @dependabot[bot] in https://github.com/apache/arrow-go/pull/866 * chore: Bump actions/cache from 5 to 6 by @dependabot[bot] in https://github.com/apache/arrow-go/pull/867 * chore: Bump actions/setup-python from 6.2.0 to 6.3.0 by @dependabot[bot] in https://github.com/apache/arrow-go/pull/868 * fix(array): validate negative bounds in NewSliceData by @fallintoplace in https://github.com/apache/arrow-go/pull/870 * fix(array): dictionary null index zeroing by @fallintoplace in https://github.com/apache/arrow-go/pull/871 * fix(array): struct stringer required child mask by @fallintoplace in https://github.com/apache/arrow-go/pull/873 * fix(array): empty chunked approximate equality by @fallintoplace in https://github.com/apache/arrow-go/pull/874 * fix(array): validate dense union offset lengths by @fallintoplace in https://github.com/apache/arrow-go/pull/875 * Use semantic type equality in AddColumn by @fallintoplace in https://github.com/apache/arrow-go/pull/878 * fix(array): clear dictionary data on reset by @fallintoplace in https://github.com/apache/arrow-go/pull/876 * Reject negative chunked slice bounds by @fallintoplace in https://github.com/apache/arrow-go/pull/879 * fix(array): array data hashing coverage by @fallintoplace in https://github.com/apache/arrow-go/pull/872 * Support dense union slice offsets by @fallintoplace in https://github.com/apache/arrow-go/pull/877 * Support sparse union sliced type ids by @fallintoplace in https://github.com/apache/arrow-go/pull/881 * fix(build): correct phony target declaration by @fallintoplace in https://github.com/apache/arrow-go/pull/890 * fix(parquet/compress): Gzip CompressBound by @fallintoplace in https://github.com/apache/arrow-go/pull/886 * fix(parquet): free excluded stats bytes in ApplyStatSizeLimits by @mdibaiee in https://github.com/apache/arrow-go/pull/885 * fix(tmpl): preserve escaped JSON string bytes by @fallintoplace in https://github.com/apache/arrow-go/pull/889 * fix(parquet/compress): Brotli CompressBound by @fallintoplace in https://github.com/apache/arrow-go/pull/884 * chore: Bump golang.org/x/net from 0.54.0 to 0.55.0 by @dependabot[bot] in https://github.com/apache/arrow-go/pull/893 * fix(parquet): align DataPageV2 pages to row boundaries in spaced writes by @truffle-dev in https://github.com/apache/arrow-go/pull/883 * fix(array): guard BinaryViewBuilder size checks by @fallintoplace in https://github.com/apache/arrow-go/pull/888 * fix: clarify StringViewBuilder UnmarshalJSON error message by @fallintoplace in https://github.com/apache/arrow-go/pull/894 * chore: Bump docker/login-action from 4.2.0 to 4.4.0 by @dependabot[bot] in https://github.com/apache/arrow-go/pull/912 * chore: Bump google.golang.org/grpc from 1.81.1 to 1.82.0 by @dependabot[bot] in https://github.com/apache/arrow-go/pull/915 * chore: Bump github.com/klauspost/cpuid/v2 from 2.3.0 to 2.4.0 by @dependabot[bot] in https://github.com/apache/arrow-go/pull/914 * fix: clarify StringViewBuilder.UnmarshalOne expected type by @fallintoplace in https://github.com/apache/arrow-go/pull/897 * chore: Bump github.com/klauspost/compress from 1.18.6 to 1.19.0 by @dependabot[bot] in https://github.com/apache/arrow-go/pull/913 * fix: guard multiBufferBuilder UnsafeAppend against short copy by @fallintoplace in https://github.com/apache/arrow-go/pull/896 * fix(array): make SetNull idempotent and track null count by @fallintoplace in https://github.com/apache/arrow-go/pull/905 * fix(ci): accept --json and pin gobenchdata by @fallintoplace in https://github.com/apache/arrow-go/pull/906 * build: verify Apache RAT jar checksum before execution by @fallintoplace in https://github.com/apache/arrow-go/pull/908 * fix(parquet): read full bloom filter buffers by @fallintoplace in https://github.com/apache/arrow-go/pull/892 * fix(docs): fix CPU markdown link in README by @fallintoplace in https://github.com/apache/arrow-go/pull/907 * fix(parquet): validate DataPageV2 decoded length by @fallintoplace in https://github.com/apache/arrow-go/pull/911 * fix(arreflect): validate primitive conversion assignment overflow checks by @fallintoplace in https://github.com/apache/arrow-go/pull/903 * fix(parquet): clamp repLevels in byte-array DataPageV2 row-boundary alignment by @zeroshade in https://github.com/apache/arrow-go/pull/919 * fix(parquet/metadata): fix BloomFilter memory recycling, doc contract, and benchmark by @Patzifist in https://github.com/apache/arrow-go/pull/864 * fix(flight/flightsql): recover real error when prepared DoPut stream closes early by @fornwall in https://github.com/apache/arrow-go/pull/920 * fix: guard protobuf oneof/union reflection on nil oneof values by @fallintoplace in https://github.com/apache/arrow-go/pull/910 * fix(parquet): copy ByteArray statistics min/max to prevent use-after-free by @zeroshade in https://github.com/apache/arrow-go/pull/917 * fix(array): bounds check FixedSizeBinary.Value by @fallintoplace in https://github.com/apache/arrow-go/pull/923 * fix(array): reject unsupported type IDs by @fallintoplace in https://github.com/apache/arrow-go/pull/925 * fix(array): validate JSON start offsets by @fallintoplace in https://github.com/apache/arrow-go/pull/929 * fix(scalar): validate dictionary indices before conversion by @fallintoplace in https://github.com/apache/arrow-go/pull/927 * fix(array): retain dictionary before replacement by @fallintoplace in https://github.com/apache/arrow-go/pull/926 * feat(parquet): opt-in streaming reads for large data pages by @joechenrh in https://github.com/apache/arrow-go/pull/880 * chore: Bump golang.org/x/sync from 0.21.0 to 0.22.0 by @dependabot[bot] in https://github.com/apache/arrow-go/pull/934 * chore: Bump github.com/apache/thrift from 0.22.0 to 0.24.0 by @dependabot[bot] in https://github.com/apache/arrow-go/pull/932 * chore: Bump golang.org/x/sys from 0.46.0 to 0.47.0 by @dependabot[bot] in https://github.com/apache/arrow-go/pull/933 * fix(parquet): propagate row-group and page-index write errors by @fallintoplace in https://github.com/apache/arrow-go/pull/921 * fix(array): honor struct offsets in constructors and validity masks by @fallintoplace in https://github.com/apache/arrow-go/pull/922 * fix(parquet): make column reader cleanup idempotent by @fallintoplace in https://github.com/apache/arrow-go/pull/924 * fix(scalar): hash list values logically by @fallintoplace in https://github.com/apache/arrow-go/pull/928 * fix(array): recursively validate nested arrays by @fallintoplace in https://github.com/apache/arrow-go/pull/930 * feat(parquet/variant): add Metadata.SizeBytes to split a concatenated variant by @nssalian in https://github.com/apache/arrow-go/pull/939 * fix(cdata): validate imported array sizes by @fallintoplace in https://github.com/apache/arrow-go/pull/931 * fix(avro): decode nullable logical timestamps by @abir-eon in https://github.com/apache/arrow-go/pull/935 * fix(flight/flightsql/example): support dictionary-encoded parameter columns by @fornwall in https://github.com/apache/arrow-go/pull/936 * fix(arrow/scalar): reject negative indices in GetScalar by @fornwall in https://github.com/apache/arrow-go/pull/940 * fix(flight): reject malformed unary bearer headers by @fallintoplace in https://github.com/apache/arrow-go/pull/941 * fix(flight): reject Basic credentials without a separator by @fallintoplace in https://github.com/apache/arrow-go/pull/942 * fix(memory): keep allocator ownership across Buffer.Reset by @fallintoplace in https://github.com/apache/arrow-go/pull/947 * fix(parquet): limit page allocations by @fallintoplace in https://github.com/apache/arrow-go/pull/953 * fix(parquet): return decompression errors by @fallintoplace in https://github.com/apache/arrow-go/pull/954 * fix(parquet): return errors for malformed encrypted payloads by @fallintoplace in https://github.com/apache/arrow-go/pull/945 * fix: repair failing benchmarks and stop bench.sh masking failures by @zeroshade in https://github.com/apache/arrow-go/pull/938 * fix(parquet): handle short input in GetBatchBools by @fallintoplace in https://github.com/apache/arrow-go/pull/946 * fix(arrow): validate timestamp timezones by @fallintoplace in https://github.com/apache/arrow-go/pull/952 * fix(ipc): validate message framing bounds by @fallintoplace in https://github.com/apache/arrow-go/pull/955 * fix(parquet): reject truncated bit-packed batches by @fallintoplace in https://github.com/apache/arrow-go/pull/943 * fix(compute): handle comparison output offsets by @fallintoplace in https://github.com/apache/arrow-go/pull/956 * fix(arrow/array): avoid allocating for ReserveData(0) by @fallintoplace in https://github.com/apache/arrow-go/pull/895 * fix(compute): release temporary arrays in binary view casts by @fallintoplace in https://github.com/apache/arrow-go/pull/898 * fix(arrow/array): validate map builder entry lengths by @fallintoplace in https://github.com/apache/arrow-go/pull/957 * Add `TimestampWithOffset` canonical extension type by @serramatutu in https://github.com/apache/arrow-go/pull/558 * chore: bump version number by @zeroshade in https://github.com/apache/arrow-go/pull/959 ## New Contributors * @varun0630 made their first contribution in https://github.com/apache/arrow-go/pull/779 * @twuebi made their first contribution in https://github.com/apache/arrow-go/pull/786 * @SAY-5 made their first contribution in https://github.com/apache/arrow-go/pull/797 * @oakad made their first contribution in https://github.com/apache/arrow-go/pull/805 * @paveon made their first contribution in https://github.com/apache/arrow-go/pull/817 * @lesam made their first contribution in https://github.com/apache/arrow-go/pull/716 * @happydave1 made their first contribution in https://github.com/apache/arrow-go/pull/844 * @qzyu999 made their first contribution in https://github.com/apache/arrow-go/pull/841 * @abir-eon made their first contribution in https://github.com/apache/arrow-go/pull/832 * @matan129 made their first contribution in https://github.com/apache/arrow-go/pull/850 * @nssalian made their first contribution in https://github.com/apache/arrow-go/pull/859 * @fallintoplace made their first contribution in https://github.com/apache/arrow-go/pull/870 * @mdibaiee made their first contribution in https://github.com/apache/arrow-go/pull/885 * @truffle-dev made their first contribution in https://github.com/apache/arrow-go/pull/883 * @Patzifist made their first contribution in https://github.com/apache/arrow-go/pull/864 * @fornwall made their first contribution in https://github.com/apache/arrow-go/pull/920 **Full Changelog**: https://github.com/apache/arrow-go/compare/v18.6.0...v18.7.0 <hr /><em>This discussion was created from the release <a href='https://github.com/apache/arrow-go/releases/tag/v18.7.0'>Apache Arrow Go v18.7.0</a>.</em> GitHub link: https://github.com/apache/arrow-go/discussions/979 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
