Re: [VOTE] Release Apache Arrow 7.0.0 - RC10

2022-02-03 Thread Krisztián Szűcs
I managed to upload the wheels to pypi. Here is the current status with the updated assignments: 1. [done] make the released version as "RELEASED" on JIRA 2. [done] start the new version on JIRA 4. [done] upload source 5. [done] upload binaries 6. [in-pr] update website 7. [todo:kou] update

Re: [VOTE] Release Apache Arrow 7.0.0 - RC10

2022-02-03 Thread Rok Mihevc
@kou I've never built Ruby on this machine and it could be I'm just missing something very obvious. Are there docs I can refer to? Below is the error that stops the Ruby/glib verification: Rok Bundle complete! 2 Gemfile dependencies, 7 gems now installed. Bundled gems are installed into

Re: [VOTE] Release Apache Arrow 7.0.0 - RC10

2022-02-03 Thread Neal Richardson
I will handle the R package submission to CRAN. Neal On Thu, Feb 3, 2022 at 4:11 PM Sutou Kouhei wrote: > Hi, > > I'll update/upload Homebrew, MSYS2 and RubyGems. > > 1. [done] make the released version as "RELEASED" on JIRA > 2. [done] start the new version on JIRA > 4. [done] upload source >

Re: [C++] Build/Link against master / custom branch

2022-02-03 Thread Li Jin
Thanks David! Will take a look On Thu, Feb 3, 2022 at 3:58 PM David Li wrote: > Check out the "minimal build" example, which builds Arrow, then links to > it separately using CMake: > https://github.com/apache/arrow/tree/master/cpp/examples/minimal_build > > In general you can use CMake options

Re: [VOTE] Release Apache Arrow 7.0.0 - RC10

2022-02-03 Thread Sutou Kouhei
Hi, I'll update/upload Homebrew, MSYS2 and RubyGems. 1. [done] make the released version as "RELEASED" on JIRA 2. [done] start the new version on JIRA 4. [done] upload source 5. [done] upload binaries 6. [in-pr] update website 7. [todo:kou] update Homebrew packages 8. [todo:kou] update MSYS2

Re: [VOTE] Release Apache Arrow 7.0.0 - RC10

2022-02-03 Thread Sutou Kouhei
Hi, Could you show error log for GLib and Ruby? Thanks, -- kou In "Re: [VOTE] Release Apache Arrow 7.0.0 - RC10" on Thu, 3 Feb 2022 15:16:04 +0100, Rok Mihevc wrote: > +1 (non-binding) > > I've successfully ran the following on Apple M1 Pro (macOS 12.1 > (21C52), Kernel Darwin

Re: [C++] Build/Link against master / custom branch

2022-02-03 Thread David Li
Check out the "minimal build" example, which builds Arrow, then links to it separately using CMake: https://github.com/apache/arrow/tree/master/cpp/examples/minimal_build In general you can use CMake options to install to a directory (-DCMAKE_INSTALL_PREFIX) and then use CMake options in your

[C++] Build/Link against master / custom branch

2022-02-03 Thread Li Jin
Hello! We are trying to write some program similar to: https://github.com/apache/arrow/blob/master/cpp/examples/arrow/execution_plan_documentation_examples.cc to test Arrow compute engine performance. We would like to build the example against Arrow default because we added a "square root"

Re: [VOTE] Release Apache Arrow 7.0.0 - RC10

2022-02-03 Thread Krisztián Szűcs
On Thu, Feb 3, 2022 at 8:58 PM Ian Cook wrote: > > Thanks Krisztián! > > I will update the vcpkg port. Thanks Ian! Here is the updated todo list: 1. [done] make the released version as "RELEASED" on JIRA 2. [done] start the new version on JIRA 4. [done] upload source 5. [done] upload binaries

Re: [VOTE] Release Apache Arrow 7.0.0 - RC10

2022-02-03 Thread Ian Cook
Thanks Krisztián! I will update the vcpkg port. Ian On Thu, Feb 3, 2022 at 2:35 PM Krisztián Szűcs wrote: > > Current status of the post release tasks: > > 1. [done] make the released version as "RELEASED" on JIRA > 2. [done] start the new version on JIRA > 4. [done] upload source > 5. [done]

Re: [VOTE] Release Apache Arrow 7.0.0 - RC10

2022-02-03 Thread Krisztián Szűcs
Current status of the post release tasks: 1. [done] make the released version as "RELEASED" on JIRA 2. [done] start the new version on JIRA 4. [done] upload source 5. [done] upload binaries 6. [in-pr] update website 7. [TODO] update Homebrew packages 8. [TODO] update MSYS2 package 9. [TODO]

Re: [C++] Implement function for time zone conversion

2022-02-03 Thread Rok Mihevc
By the way - if you're extracting components to segment time you might prefer temporal rounding https://arrow.apache.org/docs/dev/cpp/compute.html?highlight=floor_temporal#conversions. On Thu, Feb 3, 2022 at 5:19 PM Li Jin wrote: > > Gotcha. Thanks for the pointer! > > On Thu, Feb 3, 2022 at

Re: [VOTE] Release Apache Arrow 7.0.0 - RC10

2022-02-03 Thread Micah Kornfield
Sorry I wasn't able to verify Java last night, I will try to check tonight. On Thu, Feb 3, 2022 at 6:16 AM Rok Mihevc wrote: > +1 (non-binding) > > I've successfully ran the following on Apple M1 Pro (macOS 12.1 > (21C52), Kernel Darwin 21.2.0): > TEST_PYTHON=0 TEST_GLIB=0 TEST_RUBY=0 >

[RESULT][VOTE] Release Apache Arrow 7.0.0 - RC10

2022-02-03 Thread Krisztián Szűcs
Hi, The vote carries with 5 +1 binding votes, 2 +1 non-binding votes and no -1 votes. I'm starting to work on the post-release tasks and keep this thread updated about the current status. Thanks everyone! - Krisztian On Thu, Feb 3, 2022 at 3:17 PM Rok Mihevc wrote: > > +1 (non-binding) > >

[RUST] Discuss: Datafusion 7.0.0 release

2022-02-03 Thread Andrew Lamb
I am hoping to start preparing for a release of datafusion 7.0.0 to crates.io in the next few days: Let's coordinate on [1] Thanks Andrew [1] https://github.com/apache/arrow-datafusion/issues/1587

Re: [C++] Implement function for time zone conversion

2022-02-03 Thread Li Jin
Gotcha. Thanks for the pointer! On Thu, Feb 3, 2022 at 11:06 AM Rok Mihevc wrote: > > Gotcha. "Assume timezone" is like "tz_localize" in pandas. > > Indeed! > > > I didn't see any target timezone information being passed in the "cast" > > function - how would I do that? > > Just cast with: >

Re: [Python] Parquet CMake issue

2022-02-03 Thread Ian Joiner
Hi Antoine, Yes I did. It was installed in the correct directory in the correct conda env. Moreover make can definitely find the other libraries under the same directory such as libarrow.a & libarrow.dylib but oddly not libparquet.a or libparquet.dylib. Ian On Thursday, February 3, 2022,

Re: [C++] Implement function for time zone conversion

2022-02-03 Thread Rok Mihevc
> Gotcha. "Assume timezone" is like "tz_localize" in pandas. Indeed! > I didn't see any target timezone information being passed in the "cast" > function - how would I do that? Just cast with: auto options = CastOptions::Safe(timestamp(TimeUnit::NANO, "America/New_York")); See examples in:

Re: [C++] Implement function for time zone conversion

2022-02-03 Thread Li Jin
Gotcha. "Assume timezone" is like "tz_localize" in pandas. > If you are starting from a UTC-zoned timestamp you can just cast it, as David suggests, to the desired timezone (this is a metadata only change) I didn't see any target timezone information being passed in the "cast" function - how

Re: [C++] Implement function for time zone conversion

2022-02-03 Thread Rok Mihevc
Assume_timezone will "assume timezone" of the local time you pass it and give you a zoned timestamp. This means your timestamps will be interpreted as local times and converted to UTC in the background. Resulting array will have timezone metadata of your assumed timezone. If you are starting from

Re: [C++] Implement function for time zone conversion

2022-02-03 Thread Li Jin
David - Thanks for the pointers. I didn't know you could cast a timestamp to time type to extract the hour/minute information. Nice! Rok - Not sure I understand what you mean... My input is UTC but I want to extract the time information local to New York Timezone (e.g. filter time to 10 AM New

Re: [C++] Implement function for time zone conversion

2022-02-03 Thread Rok Mihevc
Hey Li, If your input data is in UTC you don't need assume_timezone [1]. You would need it if your input was America/New_York local time and you wanted to convert to a zoned timestamp array where underlying data is in UTC and timezone is metadata only. Perhaps python tests are interesting for

Re: [C++] Implement function for time zone conversion

2022-02-03 Thread David Li
We just added some documentation and examples around the C++ ExecPlan: - https://arrow.apache.org/docs/dev/cpp/streaming_execution.html - https://github.com/apache/arrow/blob/master/cpp/examples/arrow/execution_plan_documentation_examples.cc For this, "cast" should work. Here's an example in

[C++] Implement function for time zone conversion

2022-02-03 Thread Li Jin
Hello! I am new to the Arrow C++ compute engine and trying to figure out this time zone conversion and time extraction: t.dt.tz_convert('America/New_York').dt.time == datetime.time(11, 30, 0) So I started looking at:

Re: [VOTE] Release Apache Arrow 7.0.0 - RC10

2022-02-03 Thread Rok Mihevc
+1 (non-binding) I've successfully ran the following on Apple M1 Pro (macOS 12.1 (21C52), Kernel Darwin 21.2.0): TEST_PYTHON=0 TEST_GLIB=0 TEST_RUBY=0 ./dev/release/verify-release-candidate.sh source 7.0.0 10 There was a minor issue with protobuf on M1:

Re: [Python] Parquet CMake issue

2022-02-03 Thread Antoine Pitrou
Hi Ian, Did you run "make install" as well after compiling Arrow C++? Perhaps PyArrow is picking up an old installed version? Regards Antoine. Le 03/02/2022 à 08:35, Ian Joiner a écrit : Hi, In order to prevent problematic PRs from happening again I’m cleaning up my local env. Here is

Re: [DISCUSS][Rust] Biweekly sync call for arrow/datafusion again?

2022-02-03 Thread Andrew Lamb
I don't see any discussion items for today, so I won't plan on any call today. If anyone still wants to have a call please let me know Andrew On Wed, Jan 19, 2022 at 4:23 PM Andrew Lamb wrote: > I don't see any items on the agenda[1] for tomorrow's sync at 16:00 UTC; > Please add items if