[jira] [Created] (ARROW-14161) [C++][Parquet][Docs] Reading/Writing Parquet Files
Rares Vernica created ARROW-14161: - Summary: [C++][Parquet][Docs] Reading/Writing Parquet Files Key: ARROW-14161 URL: https://issues.apache.org/jira/browse/ARROW-14161 Project: Apache Arrow Issue Type: Improvement Reporter: Rares Vernica Missing documentation on Reading/Writing Parquet files C++ api: * [WriteTable|https://arrow.apache.org/docs/cpp/api/formats.html#_CPPv4N7parquet5arrow10WriteTableERKN5arrow5TableEP10MemoryPoolNSt10shared_ptrIN5arrow2io12OutputStreamEEE7int64_tNSt10shared_ptrI16WriterPropertiesEENSt10shared_ptrI21ArrowWriterPropertiesEE] missing docs on chunk_size found some [here|https://github.com/apache/parquet-cpp/blob/642da055adf009652689b20e68a198cffb857651/examples/parquet-arrow/src/reader-writer.cc#L53] _size of the RowGroup in the parquet file. Normally you would choose this to be rather large_ -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ARROW-14160) [C++][Build] Cannot build with Parquet/Thrift support on CentOS 7
Rares Vernica created ARROW-14160:
-
Summary: [C++][Build] Cannot build with Parquet/Thrift support on
CentOS 7
Key: ARROW-14160
URL: https://issues.apache.org/jira/browse/ARROW-14160
Project: Apache Arrow
Issue Type: Improvement
Components: C++, Parquet
Affects Versions: 3.0.0
Reporter: Rares Vernica
Cannot compile the C++ library for Arrow 3.0.0 in CentOS 7. It breaks if I set
{{ARROW_PARQUET=ON}}. It stops while trying to build {{thrift_ep}}
{code:java}
> scl enable devtoolset-3 "cmake3 .. \
-DARROW_PARQUET=ON \
-DARROW_WITH_LZ4=ON \
-DARROW_WITH_ZLIB=ON \
-DARROW_COMPUTE=ON \
-DCMAKE_CXX_COMPILER=/opt/rh/devtoolset-3/root/usr/bin/g++ \
-DCMAKE_C_COMPILER=/opt/rh/devtoolset-3/root/usr/bin/gcc \
-DCMAKE_INSTALL_PREFIX=/opt/apache-arrow"
...
apache-arrow-3.0.0/cpp/build> make
Scanning dependencies of target jemalloc_ep
[ 1%] Creating directories for 'jemalloc_ep'
[ 1%] Performing download step (download, verify and extract) for
'jemalloc_ep'
-- jemalloc_ep download command succeeded. See also
apache-arrow-3.0.0/cpp/build/jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-download-*.log
[ 2%] Performing patch step for 'jemalloc_ep'
[ 2%] No update step for 'jemalloc_ep'
[ 2%] Performing configure step for 'jemalloc_ep'
-- jemalloc_ep configure command succeeded. See also
apache-arrow-3.0.0/cpp/build/jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-configure-*.log
[ 3%] Performing build step for 'jemalloc_ep'
-- jemalloc_ep build command succeeded. See also
apache-arrow-3.0.0/cpp/build/jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-build-*.log
[ 3%] Performing install step for 'jemalloc_ep'
-- jemalloc_ep install command succeeded. See also
apache-arrow-3.0.0/cpp/build/jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-install-*.log
[ 4%] Completed 'jemalloc_ep'
[ 4%] Built target jemalloc_ep
Scanning dependencies of target boost_ep
[ 4%] Creating directories for 'boost_ep'
[ 5%] Performing download step (download, verify and extract) for
'boost_ep'
-- boost_ep download command succeeded. See also
apache-arrow-3.0.0/cpp/build/boost_ep-prefix/src/boost_ep-stamp/boost_ep-download-*.log
[ 5%] No patch step for 'boost_ep'
[ 5%] No update step for 'boost_ep'
[ 6%] No configure step for 'boost_ep'
[ 6%] No build step for 'boost_ep'
[ 7%] No install step for 'boost_ep'
[ 7%] Completed 'boost_ep'
[ 7%] Built target boost_ep
Scanning dependencies of target thrift_ep
[ 7%] Creating directories for 'thrift_ep'
[ 7%] Performing download step (download, verify and extract) for
'thrift_ep'
-- thrift_ep download command succeeded. See also
apache-arrow-3.0.0/cpp/build/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-download-*.log
[ 7%] No patch step for 'thrift_ep'
[ 8%] No update step for 'thrift_ep'
[ 9%] Performing configure step for 'thrift_ep'
-- thrift_ep configure command succeeded. See also
apache-arrow-3.0.0/cpp/build/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-configure-*.log
[ 9%] Performing build step for 'thrift_ep'
-- thrift_ep build command succeeded. See also
apache-arrow-3.0.0/cpp/build/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-build-*.log
[ 10%] Performing install step for 'thrift_ep'
CMake Error at
apache-arrow-3.0.0/cpp/build/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-install-RELEASE.cmake:37
(message):
Command failed: 2
'make' 'install'
See also
apache-arrow-3.0.0/cpp/build/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-install-*.log
-- stdout output is:
-- stderr output is:
make[3]: *** No rule to make target `install'. Stop.
CMake Error at
apache-arrow-3.0.0/cpp/build/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-install-RELEASE.cmake:47
(message):
Stopping after outputting logs.
make[2]: *** [thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-install] Error
1
make[1]: *** [CMakeFiles/thrift_ep.dir/all] Error 2
make: *** [all] Error 2
> cat
apache-arrow-3.0.0/cpp/build/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-install-*.log
make[3]: *** No rule to make target `install'. Stop.
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-13527) [C++] RecordBatch::Add/SetColumn w/ ArrayData
Rares Vernica created ARROW-13527:
-
Summary: [C++] RecordBatch::Add/SetColumn w/ ArrayData
Key: ARROW-13527
URL: https://issues.apache.org/jira/browse/ARROW-13527
Project: Apache Arrow
Issue Type: Improvement
Reporter: Rares Vernica
Given the following use case:
# Starting from a {{RecordBatch}}
# Apply a Compute Function on one column
# Add the result ({{Datum}}) as a new column to the {{RecordBatch}}
Since {{Datum::array}} returns {{ArrayData}}, it might be useful to have
{{RecordBatch::AddColumn}} and {{SetColumn}} work with {{ArrayData}} as well.
This would avoid having to call {{Datum::make_array}}.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (ARROW-13526) [C++][Docs] Missing docs for many Datum members
Rares Vernica created ARROW-13526: - Summary: [C++][Docs] Missing docs for many Datum members Key: ARROW-13526 URL: https://issues.apache.org/jira/browse/ARROW-13526 Project: Apache Arrow Issue Type: Improvement Reporter: Rares Vernica Many of the Datum members are missing documentation and don't show up in the API reference page [https://arrow.apache.org/docs/cpp/api/compute.html?highlight=datum#_CPPv4N5arrow5DatumE] The missing members include array(), make_array(), etc. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ARROW-13513) [C++][Docs] Missing docs for ArrayData
Rares Vernica created ARROW-13513: - Summary: [C++][Docs] Missing docs for ArrayData Key: ARROW-13513 URL: https://issues.apache.org/jira/browse/ARROW-13513 Project: Apache Arrow Issue Type: Improvement Reporter: Rares Vernica No documentation is available for the ArrayData class on the docs site [https://arrow.apache.org/docs/search.html?q=arraydata] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ARROW-13459) [C++][Docs] Missing param docs for RecordBatch::SetColumn
Rares Vernica created ARROW-13459: - Summary: [C++][Docs] Missing param docs for RecordBatch::SetColumn Key: ARROW-13459 URL: https://issues.apache.org/jira/browse/ARROW-13459 Project: Apache Arrow Issue Type: Improvement Reporter: Rares Vernica RecordBatch::SetColumn as documented in [https://arrow.apache.org/docs/cpp/api/table.html#_CPPv4NK5arrow11RecordBatch9SetColumnEiRKNSt10shared_ptrI5FieldEERKNSt10shared_ptrI5ArrayEE ]is missing parameter documentation -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ARROW-13458) [C++][Docs] Typo in RecordBatch::schema
Rares Vernica created ARROW-13458: - Summary: [C++][Docs] Typo in RecordBatch::schema Key: ARROW-13458 URL: https://issues.apache.org/jira/browse/ARROW-13458 Project: Apache Arrow Issue Type: Improvement Reporter: Rares Vernica The API docs for RecordBatch state: _inline const std::shared_ptr<[Schema|https://arrow.apache.org/docs/cpp/api/datatype.html#_CPPv4N5arrow6SchemaE]> () const[¶|https://arrow.apache.org/docs/cpp/api/table.html#_CPPv4NK5arrow11RecordBatch6schemaEv]_ _Returns_ _true if batches are equal_ This looks like out of place. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ARROW-13457) [C++][Docs] Scalars User Guide
Rares Vernica created ARROW-13457: - Summary: [C++][Docs] Scalars User Guide Key: ARROW-13457 URL: https://issues.apache.org/jira/browse/ARROW-13457 Project: Apache Arrow Issue Type: Improvement Reporter: Rares Vernica In the C++ User Guide, Scalars are briefly mentioned in Compute Functions [https://arrow.apache.org/docs/cpp/compute.html] It would be nice to have some examples on some of the ways a Scalar can be created or manipulated. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ARROW-13455) [C++][Docs] Typo in RecordBatch::SetColumn
Rares Vernica created ARROW-13455: - Summary: [C++][Docs] Typo in RecordBatch::SetColumn Key: ARROW-13455 URL: https://issues.apache.org/jira/browse/ARROW-13455 Project: Apache Arrow Issue Type: Improvement Reporter: Rares Vernica The docs for RecordBatch::SetColumn in [https://arrow.apache.org/docs/cpp/api/table.html#_CPPv4N5arrow11RecordBatchE] incorrectly state: _Replace a column in the table, producing a new [Table|https://arrow.apache.org/docs/cpp/api/table.html#classarrow_1_1_table]._ it should be: _Replace a column in the record batch, producing a new RecordBatch._ -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ARROW-13454) [C++][Docs] Tables vs Record Batches
Rares Vernica created ARROW-13454:
-
Summary: [C++][Docs] Tables vs Record Batches
Key: ARROW-13454
URL: https://issues.apache.org/jira/browse/ARROW-13454
Project: Apache Arrow
Issue Type: Improvement
Reporter: Rares Vernica
It is not clear what the difference is between Tables and Record Batches is as
described on [https://arrow.apache.org/docs/cpp/tables.html#tables]
_A
[{{arrow::Table}}|https://arrow.apache.org/docs/cpp/api/table.html#_CPPv4N5arrow5TableE]
is a two-dimensional dataset with chunked arrays for columns_
_A
[{{arrow::RecordBatch}}|https://arrow.apache.org/docs/cpp/api/table.html#_CPPv4N5arrow11RecordBatchE]
is a two-dimensional dataset of a number of contiguous arrays_
Or maybe the distinction between _chunked arrays_ and _contiguous arrays_ can
be clarified.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (ARROW-2351) [C++] StringBuilder::append(vector...) not implemented
[
https://issues.apache.org/jira/browse/ARROW-2351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16424246#comment-16424246
]
Rares Vernica commented on ARROW-2351:
--
Thanks for addressing this. Shall I open a new JIRA issue for using
{{vector null_bytes}} to make the API consistent as discussed earlier?
> [C++] StringBuilder::append(vector...) not implemented
> --
>
> Key: ARROW-2351
> URL: https://issues.apache.org/jira/browse/ARROW-2351
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Affects Versions: 0.9.0
>Reporter: Rares Vernica
>Priority: Major
> Labels: pull-request-available
> Fix For: 0.10.0
>
>
> For {{StringBuilder}} an {{append(vector, uint8_t*)}} function is
> [declared|https://github.com/apache/arrow/blob/7b2c79765cf92760e1f8cca079159d9613b86412/cpp/src/arrow/builder.h#L721]
> and
> [documented|http://arrow.apache.org/docs/cpp/classarrow_1_1_string_builder.html#a59be34b5e11017a392b4ee019d90da3c]
> but it does not seem to be implemented.
> {code:java}
> undefined reference to `arrow::StringBuilder::Append(std::vector std::allocator > const&, unsigned char*)'
> collect2: error: ld returned 1 exit status
> {code}
> Also worth noting is that the similar function in {{NumericBuilder}} uses
> {{vector}} for the null values instead of {{uint8_t*}}. It might be
> worth making them consistent.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-2189) [C++] Seg. fault on make_shared
[
https://issues.apache.org/jira/browse/ARROW-2189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421861#comment-16421861
]
Rares Vernica commented on ARROW-2189:
--
I'm linking Arrow to a "plugin" which I load in SciDB. SciDB is complied with
g++-4.9.
I'm also trying to use Ubuntu Trusty packages on Debian Jessie (I know this is
not advised) but the problem disappears if I compile Arrow with g++ 4.9.
> [C++] Seg. fault on make_shared
> ---
>
> Key: ARROW-2189
> URL: https://issues.apache.org/jira/browse/ARROW-2189
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Affects Versions: 0.8.0
> Environment: Debian jessie in a Docker container
> libarrow-dev 0.8.0-2 (Ubuntu trusty)
>Reporter: Rares Vernica
>Priority: Major
> Attachments: Dockerfile, foo.cpp
>
>
> When creating a {{PoolBuffer}}, I get a {{Segmentation fault}} when I use
> {{make_shared}}. If I use the {{shared_ptr}} constructor of {{reset}}, it
> works fine. Here is an example:
> {code:java}
> #include
> int main()
> {
> arrow::MemoryPool* pool = arrow::default_memory_pool();
> arrow::Int64Builder builder(pool);
> builder.Append(1);
> // #1
> // std::shared_ptr buffer(new arrow::PoolBuffer(pool));
> // #2
> // std::shared_ptr buffer;
> // buffer.reset(new arrow::PoolBuffer(pool));
> // #3
> auto buffer = std::make_shared(pool);
> }
> {code}
> {code:java}
> > g++-4.9 -std=c++11 -larrow foo.cpp && ./a.out
> Segmentation fault (core dumped)
> {code}
> The example works fine with {{#1}} or {{#2}} options. It also works if the
> builder is commented out.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-2189) [C++] Seg. fault on make_shared
[
https://issues.apache.org/jira/browse/ARROW-2189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421531#comment-16421531
]
Rares Vernica commented on ARROW-2189:
--
I did some tests and it does not look like these differences help with the
issue.
On the other hand, I compiled Arrow using {{g++-4.9}} and the issue is gone.
> [C++] Seg. fault on make_shared
> ---
>
> Key: ARROW-2189
> URL: https://issues.apache.org/jira/browse/ARROW-2189
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Affects Versions: 0.8.0
> Environment: Debian jessie in a Docker container
> libarrow-dev 0.8.0-2 (Ubuntu trusty)
>Reporter: Rares Vernica
>Priority: Major
> Attachments: Dockerfile, foo.cpp
>
>
> When creating a {{PoolBuffer}}, I get a {{Segmentation fault}} when I use
> {{make_shared}}. If I use the {{shared_ptr}} constructor of {{reset}}, it
> works fine. Here is an example:
> {code:java}
> #include
> int main()
> {
> arrow::MemoryPool* pool = arrow::default_memory_pool();
> arrow::Int64Builder builder(pool);
> builder.Append(1);
> // #1
> // std::shared_ptr buffer(new arrow::PoolBuffer(pool));
> // #2
> // std::shared_ptr buffer;
> // buffer.reset(new arrow::PoolBuffer(pool));
> // #3
> auto buffer = std::make_shared(pool);
> }
> {code}
> {code:java}
> > g++-4.9 -std=c++11 -larrow foo.cpp && ./a.out
> Segmentation fault (core dumped)
> {code}
> The example works fine with {{#1}} or {{#2}} options. It also works if the
> builder is commented out.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-2189) [C++] Seg. fault on make_shared
[
https://issues.apache.org/jira/browse/ARROW-2189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421483#comment-16421483
]
Rares Vernica commented on ARROW-2189:
--
[~kou] could this issue be caused by the differences in the {{rules}} file used
to build Ubuntu Trusty packages vs. other Debian packages?
{code:java}
> diff debian/rules debian.ubuntu-trusty/rules
12,16c12
< dh $@ --with gir,autoreconf
<
< override_dh_autoreconf:
< dh_autoreconf \
< --sourcedirectory=c_glib
---
> dh $@ --with gir
25,30c21
< -DARROW_PYTHON=ON \
< -DARROW_BOOST_USE_SHARED=ON \
< -DARROW_ORC=ON \
< -DPythonInterp_FIND_VERSION=ON \
< -DPythonInterp_FIND_VERSION_MAJOR=3 \
< -DARROW_GPU=ON
---
> -DARROW_ORC=ON
56a48,49
> mv debian/tmp/usr/lib/*/girepository-1.0/ \
> debian/tmp/usr/lib/
{code}
> [C++] Seg. fault on make_shared
> ---
>
> Key: ARROW-2189
> URL: https://issues.apache.org/jira/browse/ARROW-2189
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Affects Versions: 0.8.0
> Environment: Debian jessie in a Docker container
> libarrow-dev 0.8.0-2 (Ubuntu trusty)
>Reporter: Rares Vernica
>Priority: Major
> Attachments: Dockerfile, foo.cpp
>
>
> When creating a {{PoolBuffer}}, I get a {{Segmentation fault}} when I use
> {{make_shared}}. If I use the {{shared_ptr}} constructor of {{reset}}, it
> works fine. Here is an example:
> {code:java}
> #include
> int main()
> {
> arrow::MemoryPool* pool = arrow::default_memory_pool();
> arrow::Int64Builder builder(pool);
> builder.Append(1);
> // #1
> // std::shared_ptr buffer(new arrow::PoolBuffer(pool));
> // #2
> // std::shared_ptr buffer;
> // buffer.reset(new arrow::PoolBuffer(pool));
> // #3
> auto buffer = std::make_shared(pool);
> }
> {code}
> {code:java}
> > g++-4.9 -std=c++11 -larrow foo.cpp && ./a.out
> Segmentation fault (core dumped)
> {code}
> The example works fine with {{#1}} or {{#2}} options. It also works if the
> builder is commented out.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (ARROW-2351) [C++] StringBuilder::append(vector...) not implemented
Rares Vernica created ARROW-2351:
Summary: [C++] StringBuilder::append(vector...) not
implemented
Key: ARROW-2351
URL: https://issues.apache.org/jira/browse/ARROW-2351
Project: Apache Arrow
Issue Type: Bug
Components: C++
Affects Versions: 0.9.0
Reporter: Rares Vernica
For {{StringBuilder}} an {{append(vector, uint8_t*)}} function is
[declared|https://github.com/apache/arrow/blob/7b2c79765cf92760e1f8cca079159d9613b86412/cpp/src/arrow/builder.h#L721]
and
[documented|http://arrow.apache.org/docs/cpp/classarrow_1_1_string_builder.html#a59be34b5e11017a392b4ee019d90da3c]
but it does not seem to be implemented.
{code:java}
undefined reference to `arrow::StringBuilder::Append(std::vector const&, unsigned char*)'
collect2: error: ld returned 1 exit status
{code}
Also worth noting is that the similar function in {{NumericBuilder}} uses
{{vector}} for the null values instead of {{uint8_t*}}. It might be worth
making them consistent.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-2189) [C++] Seg. fault on make_shared
[
https://issues.apache.org/jira/browse/ARROW-2189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16376504#comment-16376504
]
Rares Vernica commented on ARROW-2189:
--
See the attached {{Dokerfile}} and {{foo.cpp}}. You should be able to reproduce
with:
{code:java}
> docker build .
...
Step 18/18 : RUN /a.out
---> Running in de9d8736cf20
Segmentation fault (core dumped)
The command '/bin/sh -c /a.out' returned a non-zero code: 139{code}
> [C++] Seg. fault on make_shared
> ---
>
> Key: ARROW-2189
> URL: https://issues.apache.org/jira/browse/ARROW-2189
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Affects Versions: 0.8.0
> Environment: Debian jessie in a Docker container
> libarrow-dev 0.8.0-2 (Ubuntu trusty)
>Reporter: Rares Vernica
>Priority: Major
> Attachments: Dockerfile, foo.cpp
>
>
> When creating a {{PoolBuffer}}, I get a {{Segmentation fault}} when I use
> {{make_shared}}. If I use the {{shared_ptr}} constructor of {{reset}}, it
> works fine. Here is an example:
> {code:java}
> #include
> int main()
> {
> arrow::MemoryPool* pool = arrow::default_memory_pool();
> arrow::Int64Builder builder(pool);
> builder.Append(1);
> // #1
> // std::shared_ptr buffer(new arrow::PoolBuffer(pool));
> // #2
> // std::shared_ptr buffer;
> // buffer.reset(new arrow::PoolBuffer(pool));
> // #3
> auto buffer = std::make_shared(pool);
> }
> {code}
> {code:java}
> > g++-4.9 -std=c++11 -larrow foo.cpp && ./a.out
> Segmentation fault (core dumped)
> {code}
> The example works fine with {{#1}} or {{#2}} options. It also works if the
> builder is commented out.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (ARROW-2189) [C++] Seg. fault on make_shared
[
https://issues.apache.org/jira/browse/ARROW-2189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rares Vernica updated ARROW-2189:
-
Attachment: Dockerfile
> [C++] Seg. fault on make_shared
> ---
>
> Key: ARROW-2189
> URL: https://issues.apache.org/jira/browse/ARROW-2189
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Affects Versions: 0.8.0
> Environment: Debian jessie in a Docker container
> libarrow-dev 0.8.0-2 (Ubuntu trusty)
>Reporter: Rares Vernica
>Priority: Major
> Attachments: Dockerfile, foo.cpp
>
>
> When creating a {{PoolBuffer}}, I get a {{Segmentation fault}} when I use
> {{make_shared}}. If I use the {{shared_ptr}} constructor of {{reset}}, it
> works fine. Here is an example:
> {code:java}
> #include
> int main()
> {
> arrow::MemoryPool* pool = arrow::default_memory_pool();
> arrow::Int64Builder builder(pool);
> builder.Append(1);
> // #1
> // std::shared_ptr buffer(new arrow::PoolBuffer(pool));
> // #2
> // std::shared_ptr buffer;
> // buffer.reset(new arrow::PoolBuffer(pool));
> // #3
> auto buffer = std::make_shared(pool);
> }
> {code}
> {code:java}
> > g++-4.9 -std=c++11 -larrow foo.cpp && ./a.out
> Segmentation fault (core dumped)
> {code}
> The example works fine with {{#1}} or {{#2}} options. It also works if the
> builder is commented out.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (ARROW-2189) [C++] Seg. fault on make_shared
[
https://issues.apache.org/jira/browse/ARROW-2189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rares Vernica updated ARROW-2189:
-
Attachment: foo.cpp
> [C++] Seg. fault on make_shared
> ---
>
> Key: ARROW-2189
> URL: https://issues.apache.org/jira/browse/ARROW-2189
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Affects Versions: 0.8.0
> Environment: Debian jessie in a Docker container
> libarrow-dev 0.8.0-2 (Ubuntu trusty)
>Reporter: Rares Vernica
>Priority: Major
> Attachments: Dockerfile, foo.cpp
>
>
> When creating a {{PoolBuffer}}, I get a {{Segmentation fault}} when I use
> {{make_shared}}. If I use the {{shared_ptr}} constructor of {{reset}}, it
> works fine. Here is an example:
> {code:java}
> #include
> int main()
> {
> arrow::MemoryPool* pool = arrow::default_memory_pool();
> arrow::Int64Builder builder(pool);
> builder.Append(1);
> // #1
> // std::shared_ptr buffer(new arrow::PoolBuffer(pool));
> // #2
> // std::shared_ptr buffer;
> // buffer.reset(new arrow::PoolBuffer(pool));
> // #3
> auto buffer = std::make_shared(pool);
> }
> {code}
> {code:java}
> > g++-4.9 -std=c++11 -larrow foo.cpp && ./a.out
> Segmentation fault (core dumped)
> {code}
> The example works fine with {{#1}} or {{#2}} options. It also works if the
> builder is commented out.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Reopened] (ARROW-2189) [C++] Seg. fault on make_shared
[
https://issues.apache.org/jira/browse/ARROW-2189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rares Vernica reopened ARROW-2189:
--
> [C++] Seg. fault on make_shared
> ---
>
> Key: ARROW-2189
> URL: https://issues.apache.org/jira/browse/ARROW-2189
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Affects Versions: 0.8.0
> Environment: Debian jessie in a Docker container
> libarrow-dev 0.8.0-2 (Ubuntu trusty)
>Reporter: Rares Vernica
>Priority: Major
>
> When creating a {{PoolBuffer}}, I get a {{Segmentation fault}} when I use
> {{make_shared}}. If I use the {{shared_ptr}} constructor of {{reset}}, it
> works fine. Here is an example:
> {code:java}
> #include
> int main()
> {
> arrow::MemoryPool* pool = arrow::default_memory_pool();
> arrow::Int64Builder builder(pool);
> builder.Append(1);
> // #1
> // std::shared_ptr buffer(new arrow::PoolBuffer(pool));
> // #2
> // std::shared_ptr buffer;
> // buffer.reset(new arrow::PoolBuffer(pool));
> // #3
> auto buffer = std::make_shared(pool);
> }
> {code}
> {code:java}
> > g++-4.9 -std=c++11 -larrow foo.cpp && ./a.out
> Segmentation fault (core dumped)
> {code}
> The example works fine with {{#1}} or {{#2}} options. It also works if the
> builder is commented out.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-2189) [C++] Seg. fault on make_shared
[
https://issues.apache.org/jira/browse/ARROW-2189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16376340#comment-16376340
]
Rares Vernica commented on ARROW-2189:
--
It works fine in Ubuntu Trusty if I use the default g++ compiler to compile
this example.
On the other hand, I still get the Segmentation Fault if I use the g++-4.9
compiler from ppa:ubuntu-toolchain-r/test.
Is it because arrow is compiled with g++ and I compile this example with
g++-4.9?
> [C++] Seg. fault on make_shared
> ---
>
> Key: ARROW-2189
> URL: https://issues.apache.org/jira/browse/ARROW-2189
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Affects Versions: 0.8.0
> Environment: Debian jessie in a Docker container
> libarrow-dev 0.8.0-2 (Ubuntu trusty)
>Reporter: Rares Vernica
>Priority: Major
>
> When creating a {{PoolBuffer}}, I get a {{Segmentation fault}} when I use
> {{make_shared}}. If I use the {{shared_ptr}} constructor of {{reset}}, it
> works fine. Here is an example:
> {code:java}
> #include
> int main()
> {
> arrow::MemoryPool* pool = arrow::default_memory_pool();
> arrow::Int64Builder builder(pool);
> builder.Append(1);
> // #1
> // std::shared_ptr buffer(new arrow::PoolBuffer(pool));
> // #2
> // std::shared_ptr buffer;
> // buffer.reset(new arrow::PoolBuffer(pool));
> // #3
> auto buffer = std::make_shared(pool);
> }
> {code}
> {code:java}
> > g++-4.9 -std=c++11 -larrow foo.cpp && ./a.out
> Segmentation fault (core dumped)
> {code}
> The example works fine with {{#1}} or {{#2}} options. It also works if the
> builder is commented out.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Assigned] (ARROW-2203) [C++] StderrStream class
[ https://issues.apache.org/jira/browse/ARROW-2203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rares Vernica reassigned ARROW-2203: Assignee: Rares Vernica > [C++] StderrStream class > > > Key: ARROW-2203 > URL: https://issues.apache.org/jira/browse/ARROW-2203 > Project: Apache Arrow > Issue Type: Improvement >Affects Versions: 0.8.0 >Reporter: Rares Vernica >Assignee: Rares Vernica >Priority: Trivial > > The C++ API has support for reading and writing data from and to STDIN and > STDOUT. The classes are arrow::io::StdinStream and arrow::io::StdoutStream. > It some scenarios it might be useful to write data to STDERR. Adding a > StderrStream class should be a trivial addition given the StdoutStream class. > If you think a StderrStream class is a good idea, I am more than happy to > submit a PR. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (ARROW-2203) [C++] StderrStream class
Rares Vernica created ARROW-2203: Summary: [C++] StderrStream class Key: ARROW-2203 URL: https://issues.apache.org/jira/browse/ARROW-2203 Project: Apache Arrow Issue Type: Improvement Affects Versions: 0.8.0 Reporter: Rares Vernica The C++ API has support for reading and writing data from and to STDIN and STDOUT. The classes are arrow::io::StdinStream and arrow::io::StdoutStream. It some scenarios it might be useful to write data to STDERR. Adding a StderrStream class should be a trivial addition given the StdoutStream class. If you think a StderrStream class is a good idea, I am more than happy to submit a PR. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (ARROW-2189) [C++] Seg. fault on make_shared
[
https://issues.apache.org/jira/browse/ARROW-2189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rares Vernica closed ARROW-2189.
Resolution: Not A Bug
> [C++] Seg. fault on make_shared
> ---
>
> Key: ARROW-2189
> URL: https://issues.apache.org/jira/browse/ARROW-2189
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Affects Versions: 0.8.0
> Environment: Debian jessie in a Docker container
> libarrow-dev 0.8.0-2 (Ubuntu trusty)
>Reporter: Rares Vernica
>Priority: Major
>
> When creating a {{PoolBuffer}}, I get a {{Segmentation fault}} when I use
> {{make_shared}}. If I use the {{shared_ptr}} constructor of {{reset}}, it
> works fine. Here is an example:
> {code:java}
> #include
> int main()
> {
> arrow::MemoryPool* pool = arrow::default_memory_pool();
> arrow::Int64Builder builder(pool);
> builder.Append(1);
> // #1
> // std::shared_ptr buffer(new arrow::PoolBuffer(pool));
> // #2
> // std::shared_ptr buffer;
> // buffer.reset(new arrow::PoolBuffer(pool));
> // #3
> auto buffer = std::make_shared(pool);
> }
> {code}
> {code:java}
> > g++-4.9 -std=c++11 -larrow foo.cpp && ./a.out
> Segmentation fault (core dumped)
> {code}
> The example works fine with {{#1}} or {{#2}} options. It also works if the
> builder is commented out.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-2189) [C++] Seg. fault on make_shared
[
https://issues.apache.org/jira/browse/ARROW-2189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16370985#comment-16370985
]
Rares Vernica commented on ARROW-2189:
--
It works fine with Debian Stretch or Ubuntu Trusty. It seems to be a
package/toolchain mixing issues. Sorry for the trouble.
> [C++] Seg. fault on make_shared
> ---
>
> Key: ARROW-2189
> URL: https://issues.apache.org/jira/browse/ARROW-2189
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Affects Versions: 0.8.0
> Environment: Debian jessie in a Docker container
> libarrow-dev 0.8.0-2 (Ubuntu trusty)
>Reporter: Rares Vernica
>Priority: Major
>
> When creating a {{PoolBuffer}}, I get a {{Segmentation fault}} when I use
> {{make_shared}}. If I use the {{shared_ptr}} constructor of {{reset}}, it
> works fine. Here is an example:
> {code:java}
> #include
> int main()
> {
> arrow::MemoryPool* pool = arrow::default_memory_pool();
> arrow::Int64Builder builder(pool);
> builder.Append(1);
> // #1
> // std::shared_ptr buffer(new arrow::PoolBuffer(pool));
> // #2
> // std::shared_ptr buffer;
> // buffer.reset(new arrow::PoolBuffer(pool));
> // #3
> auto buffer = std::make_shared(pool);
> }
> {code}
> {code:java}
> > g++-4.9 -std=c++11 -larrow foo.cpp && ./a.out
> Segmentation fault (core dumped)
> {code}
> The example works fine with {{#1}} or {{#2}} options. It also works if the
> builder is commented out.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Comment Edited] (ARROW-2189) [C++] Seg. fault on make_shared
[
https://issues.apache.org/jira/browse/ARROW-2189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369721#comment-16369721
]
Rares Vernica edited comment on ARROW-2189 at 2/20/18 5:02 AM:
---
Does this help?
{code:java}
> g++-4.9 -ggdb -std=c++11 -larrow foo.cpp
> strace ./a.out
strace: test_ptrace_setoptions_for_all: PTRACE_TRACEME doesn't work: Operation
not permitted
strace: test_ptrace_setoptions_for_all: unexpected exit status 1
> gdb ./a.out
GNU gdb (Debian 7.7.1+dfsg-5) 7.7.1
Copyright (C) 2014 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
[jira] [Commented] (ARROW-2189) [C++] Seg. fault on make_shared
[
https://issues.apache.org/jira/browse/ARROW-2189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369721#comment-16369721
]
Rares Vernica commented on ARROW-2189:
--
Does this help?
{code:java}
> g++-4.9 -ggdb -std=c++11 -larrow foo.cpp
> strace ./a.out
strace: test_ptrace_setoptions_for_all: PTRACE_TRACEME doesn't work: Operation
not permitted
strace: test_ptrace_setoptions_for_all: unexpected exit status 1
> gdb ./a.out
GNU gdb (Debian 7.7.1+dfsg-5) 7.7.1
Copyright (C) 2014 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
[jira] [Created] (ARROW-2189) [C++] Seg. fault on make_shared
Rares Vernica created ARROW-2189:
Summary: [C++] Seg. fault on make_shared
Key: ARROW-2189
URL: https://issues.apache.org/jira/browse/ARROW-2189
Project: Apache Arrow
Issue Type: Bug
Components: C++
Affects Versions: 0.8.0
Environment: Debian jessie in a Docker container
libarrow-dev 0.8.0-2 (Ubuntu trusty)
Reporter: Rares Vernica
When creating a {{PoolBuffer}}, I get a {{Segmentation fault}} when I use
{{make_shared}}. If I use the {{shared_ptr}} constructor of {{reset}}, it works
fine. Here is an example:
{code:java}
#include
int main()
{
arrow::MemoryPool* pool = arrow::default_memory_pool();
arrow::Int64Builder builder(pool);
builder.Append(1);
// #1
// std::shared_ptr buffer(new arrow::PoolBuffer(pool));
// #2
// std::shared_ptr buffer;
// buffer.reset(new arrow::PoolBuffer(pool));
// #3
auto buffer = std::make_shared(pool);
}
{code}
{code:java}
> g++-4.9 -std=c++11 -larrow foo.cpp && ./a.out
Segmentation fault (core dumped)
{code}
The example works fine with {{#1}} or {{#2}} options. It also works if the
builder is commented out.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (ARROW-2179) [C++] arrow/util/io-util.h missing from libarrow-dev
Rares Vernica created ARROW-2179:
Summary: [C++] arrow/util/io-util.h missing from libarrow-dev
Key: ARROW-2179
URL: https://issues.apache.org/jira/browse/ARROW-2179
Project: Apache Arrow
Issue Type: Bug
Affects Versions: 0.8.0
Reporter: Rares Vernica
{{arrow/util/io-util.h}} is missing from the {{libarow-dev}} package
(ubuntu/trusty):
{code:java}
> ls -1 /usr/include/arrow/util/
bit-stream-utils.h
bit-util.h
bpacking.h
compiler-util.h
compression.h
compression_brotli.h
compression_lz4.h
compression_snappy.h
compression_zlib.h
compression_zstd.h
cpu-info.h
decimal.h
hash-util.h
hash.h
key_value_metadata.h
logging.h
macros.h
parallel.h
rle-encoding.h
sse-util.h
stl.h
type_traits.h
variant
variant.h
visibility.h
{code}
{code:java}
> apt-cache show libarrow-dev
Package: libarrow-dev
Architecture: amd64
Version: 0.8.0-2
Multi-Arch: same
Priority: optional
Section: libdevel
Source: apache-arrow
Maintainer: Kouhei Sutou
Installed-Size: 5696
Depends: libarrow0 (= 0.8.0-2)
Filename: pool/trusty/universe/a/apache-arrow/libarrow-dev_0.8.0-2_amd64.deb
Size: 602716
MD5sum: de5f2bfafd90ff29e4b192f4e5d26605
SHA1: e3d9146b30f07c07b62f8bdf9f779d0ee5d05a75
SHA256: 30a89b2ac6845998f22434e660b1a7c9d91dc8b2ba947e1f4333b3cf74c69982
SHA512:
99f511bee6645a68708848a58b4eba669a2ec8c45fb411c56ed2c920d3ff34552c77821eff7e428c886d16e450bdd25cc4e67597972f77a4255f302a56d1eac8
Homepage: https://arrow.apache.org/
Description: Apache Arrow is a data processing library for analysis
.
This package provides header files.
Description-md5: e4855d5dbadacb872bf8c4ca67f624e3
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (ARROW-1801) [Docs] Update install instructions to use red-data-tools repos
Rares Vernica created ARROW-1801: Summary: [Docs] Update install instructions to use red-data-tools repos Key: ARROW-1801 URL: https://issues.apache.org/jira/browse/ARROW-1801 Project: Apache Arrow Issue Type: Improvement Affects Versions: 0.7.1 Reporter: Rares Vernica Assignee: Rares Vernica Priority: Minor Fix For: 0.8.0 Update install instructions to use red-data-tools repositories. Instructions for red-data-tools are available [here|https://github.com/red-data-tools/packages.red-data-tools.org/blob/master/README.md]. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (ARROW-1676) [C++] Feather inserts 0 in the beginning and trims one value at the end
[
https://issues.apache.org/jira/browse/ARROW-1676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rares Vernica updated ARROW-1676:
-
Summary: [C++] Feather inserts 0 in the beginning and trims one value at
the end (was: [C++] Featehr inserts 0 in the beginning and trims one value at
the end)
> [C++] Feather inserts 0 in the beginning and trims one value at the end
> ---
>
> Key: ARROW-1676
> URL: https://issues.apache.org/jira/browse/ARROW-1676
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Affects Versions: 0.7.1
> Environment: libarrow-dev
> Architecture: amd64
> Version: 0.7.1-1
> Python 2.7.13
> >>> pyarrow.__version__
> '0.7.1'
> >>> feather.__version__
> '0.4.0'
> >>> pandas.__version__
> u'0.20.3'
>Reporter: Rares Vernica
>
> An extra {{0}} appears in the beginning when serializing and deserializing an
> array with more than {{128}} values and at least one {{NULL}} value using
> {{Feather}}. Once the extra {{0}} is inserted a value is trimmed at the end.
> Here is the C++ code to write such an array:
> {code:java}
> #include
> #include
> #include
> #include
> #include
> int main() {
> // 1. Build Array
> arrow::DoubleBuilder builder;
> for (int i = 0; i < 129; i++)
> if (i == 0)
> builder.AppendNull();
> else
> builder.Append(i);
> std::shared_ptr array;
> builder.Finish();
> arrow::PrettyPrint(*array, 0, ::cout);
> std::cout << std::endl;
> // 2. Write to Feather file
> std::shared_ptr stream;
> arrow::io::FileOutputStream::Open("out.f", false, );
> std::unique_ptr writer;
> arrow::ipc::feather::TableWriter::Open(stream, );
> writer->SetNumRows(129);
> writer->Append("id", *array);
> writer->Finalize();
> stream->Close();
> return 0;
> }
> {code}
> The output of running this code is:
> {code:java}
> # g++-4.9 -std=c++11 example.cpp -larrow && ./a.out
> [null, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20,
> 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39,
> 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58,
> 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77,
> 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96,
> 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112,
> 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127,
> 128]
> {code}
> The array is deserialized in Python and looks like this:
>
> {code:java}
> >>> pandas.read_feather('out.f')
> id
> 0 NaN
> 1 0.0
> 2 1.0
> 3 2.0
> 4 3.0
> 5 4.0
> 6 5.0
> 7 6.0
> 8 7.0
> 9 8.0
> 10 9.0
> 1110.0
> 1211.0
> 1312.0
> 1413.0
> 1514.0
> 1615.0
> 1716.0
> 1817.0
> 1918.0
> 2019.0
> 2120.0
> 2221.0
> 2322.0
> 2423.0
> 2524.0
> 2625.0
> 2726.0
> 2827.0
> 2928.0
> .. ...
> 9998.0
> 100 99.0
> 101 100.0
> 102 101.0
> 103 102.0
> 104 103.0
> 105 104.0
> 106 105.0
> 107 106.0
> 108 107.0
> 109 108.0
> 110 109.0
> 111 110.0
> 112 111.0
> 113 112.0
> 114 113.0
> 115 114.0
> 116 115.0
> 117 116.0
> 118 117.0
> 119 118.0
> 120 119.0
> 121 120.0
> 122 121.0
> 123 122.0
> 124 123.0
> 125 124.0
> 126 125.0
> 127 126.0
> 128 127.0
> [129 rows x 1 columns]
> {code}
> Notice the {{0.0}} value on index {{1}}. The value should have been {{1.0}}.
> Also, the last value is {{127.0}} instead of {{128.0}}.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Created] (ARROW-1676) [C++] Featehr inserts 0 in the beginning and trims one value at the end
Rares Vernica created ARROW-1676:
Summary: [C++] Featehr inserts 0 in the beginning and trims one
value at the end
Key: ARROW-1676
URL: https://issues.apache.org/jira/browse/ARROW-1676
Project: Apache Arrow
Issue Type: Bug
Components: C++
Affects Versions: 0.7.1
Environment: libarrow-dev
Architecture: amd64
Version: 0.7.1-1
Python 2.7.13
>>> pyarrow.__version__
'0.7.1'
>>> feather.__version__
'0.4.0'
>>> pandas.__version__
u'0.20.3'
Reporter: Rares Vernica
An extra {{0}} appears in the beginning when serializing and deserializing an
array with more than {{128}} values and at least one {{NULL}} value using
{{Feather}}. Once the extra {{0}} is inserted a value is trimmed at the end.
Here is the C++ code to write such an array:
{code:java}
#include
#include
#include
#include
#include
int main() {
// 1. Build Array
arrow::DoubleBuilder builder;
for (int i = 0; i < 129; i++)
if (i == 0)
builder.AppendNull();
else
builder.Append(i);
std::shared_ptr array;
builder.Finish();
arrow::PrettyPrint(*array, 0, ::cout);
std::cout << std::endl;
// 2. Write to Feather file
std::shared_ptr stream;
arrow::io::FileOutputStream::Open("out.f", false, );
std::unique_ptr writer;
arrow::ipc::feather::TableWriter::Open(stream, );
writer->SetNumRows(129);
writer->Append("id", *array);
writer->Finalize();
stream->Close();
return 0;
}
{code}
The output of running this code is:
{code:java}
# g++-4.9 -std=c++11 example.cpp -larrow && ./a.out
[null, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20,
21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40,
41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60,
61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80,
81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99,
100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115,
116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128]
{code}
The array is deserialized in Python and looks like this:
{code:java}
>>> pandas.read_feather('out.f')
id
0 NaN
1 0.0
2 1.0
3 2.0
4 3.0
5 4.0
6 5.0
7 6.0
8 7.0
9 8.0
10 9.0
1110.0
1211.0
1312.0
1413.0
1514.0
1615.0
1716.0
1817.0
1918.0
2019.0
2120.0
2221.0
2322.0
2423.0
2524.0
2625.0
2726.0
2827.0
2928.0
.. ...
9998.0
100 99.0
101 100.0
102 101.0
103 102.0
104 103.0
105 104.0
106 105.0
107 106.0
108 107.0
109 108.0
110 109.0
111 110.0
112 111.0
113 112.0
114 113.0
115 114.0
116 115.0
117 116.0
118 117.0
119 118.0
120 119.0
121 120.0
122 121.0
123 122.0
124 123.0
125 124.0
126 125.0
127 126.0
128 127.0
[129 rows x 1 columns]
{code}
Notice the {{0.0}} value on index {{1}}. The value should have been {{1.0}}.
Also, the last value is {{127.0}} instead of {{128.0}}.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (ARROW-1538) [C++] Support Ubuntu 14.04 in .deb packaging automation
[ https://issues.apache.org/jira/browse/ARROW-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177585#comment-16177585 ] Rares Vernica commented on ARROW-1538: -- PR: https://github.com/apache/arrow-dist/pull/11 > [C++] Support Ubuntu 14.04 in .deb packaging automation > --- > > Key: ARROW-1538 > URL: https://issues.apache.org/jira/browse/ARROW-1538 > Project: Apache Arrow > Issue Type: Improvement > Components: C++, Packaging >Reporter: Wes McKinney > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (ARROW-1538) [C++] Support Ubuntu 14.04 in .deb packaging automation
[ https://issues.apache.org/jira/browse/ARROW-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177570#comment-16177570 ] Rares Vernica commented on ARROW-1538: -- I figured it out. I was applying the patch on the git clone and then doing git archive. The resulting archive did not contain all the necessary Makefiles. Instead, I applied the patch on the distributed archive and it worked. > [C++] Support Ubuntu 14.04 in .deb packaging automation > --- > > Key: ARROW-1538 > URL: https://issues.apache.org/jira/browse/ARROW-1538 > Project: Apache Arrow > Issue Type: Improvement > Components: C++, Packaging >Reporter: Wes McKinney > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (ARROW-1538) [C++] Support Ubuntu 14.04 in .deb packaging automation
[
https://issues.apache.org/jira/browse/ARROW-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16174290#comment-16174290
]
Rares Vernica commented on ARROW-1538:
--
Thanks for the pointer on glib. I applied the {{bfe65790}} commit on top of the
{{0.7.0}} tag and I am able to move past that error, but I get some errors
related to missing files, even while building for Ubuntu {{16.04}}:
{code}
# docker run --rm --tty --volume /arrow-dist/cpp-linux/apt:/host:rw --env
DEBUG=yes apache-arrow-ubuntu-16.04 /host/build.sh
...
-- Installing:
/build/apache-arrow-0.7.0/debian/tmp/usr/include/arrow/python/type_traits.h
-- Installing:
/build/apache-arrow-0.7.0/debian/tmp/usr/lib/x86_64-linux-gnu/pkgconfig/arrow-python.pc
make[2]: Leaving directory '/build/apache-arrow-0.7.0/cpp_build'
dh_auto_install \
--sourcedirectory=c_glib \
--builddirectory=c_glib_build
make[1]: Leaving directory '/build/apache-arrow-0.7.0'
dh_install
dh_install: libarrow-glib0 missing files: usr/lib/*/libarrow-glib.so.*
dh_install: gir1.2-arrow-1.0 missing files: usr/lib/*/girepository-1.0/
dh_install: libarrow-glib-dev missing files: usr/include/arrow-glib/
dh_install: libarrow-glib-dev missing files: usr/lib/*/libarrow-glib.a
dh_install: libarrow-glib-dev missing files: usr/lib/*/libarrow-glib.so
dh_install: libarrow-glib-dev missing files: usr/lib/*/pkgconfig/arrow-glib.pc
dh_install: libarrow-glib-dev missing files: usr/share/gir-1.0/
dh_install: libarrow-glib-dev missing files: usr/share/arrow-glib/example/
dh_install: libarrow-glib-doc missing files:
usr/share/doc/libarrow-glib-doc/arrow-glib/
dh_install: missing files, aborting
debian/rules:12: recipe for target 'binary' failed
make: *** [binary] Error 2
dpkg-buildpackage: error: fakeroot debian/rules binary gave error exit status 2
debuild: fatal error at line 1376:
dpkg-buildpackage -rfakeroot -D -us -uc failed
Failed debuild -us -uc
{code}
It seems like nothing is happening for {{c_glib}} during {{dh_auto_install}}.
> [C++] Support Ubuntu 14.04 in .deb packaging automation
> ---
>
> Key: ARROW-1538
> URL: https://issues.apache.org/jira/browse/ARROW-1538
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++, Packaging
>Reporter: Wes McKinney
>
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (ARROW-1538) [C++] Support Ubuntu 14.04 in .deb packaging automation
[
https://issues.apache.org/jira/browse/ARROW-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171132#comment-16171132
]
Rares Vernica commented on ARROW-1538:
--
I'm trying to build Arrow {{0.7.0}} in Ubuntu {{14.04}} using the patches from
[here|https://issues.apache.org/jira/browse/ARROW-592?focusedCommentId=16143048=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16143048]
but I am having some issues with glib:
{code}
# docker run --rm --tty --volume /arrow/arrow-dist/cpp-linux/apt:/host:rw --env
DEBUG=yes apache-arrow-ubuntu-14.04 /host/build.sh
...
make[2]: Entering directory `/build/apache-arrow-0.7.0/c_glib_build'
make all-recursive
make[3]: Entering directory `/build/apache-arrow-0.7.0/c_glib_build'
Making all in arrow-glib
make[4]: Entering directory `/build/apache-arrow-0.7.0/c_glib_build/arrow-glib'
GEN stamp-enums.c
touch stamp-enums.c
GEN stamp-enums.h
touch stamp-enums.h
make all-am
make[5]: Entering directory `/build/apache-arrow-0.7.0/c_glib_build/arrow-glib'
CXX libarrow_glib_la-array.lo
In file included from ../../c_glib/arrow-glib/array.h:23:0,
from ../../c_glib/arrow-glib/array.hpp:24,
from ../../c_glib/arrow-glib/array.cpp:24:
../../c_glib/arrow-glib/compute.h:27:25: error: expected constructor,
destructor, or type conversion before '(' token
G_DECLARE_DERIVABLE_TYPE(GArrowCastOptions,
^
../../c_glib/arrow-glib/compute.h:37:1: error: 'GArrowCastOptions' does not
name a type
GArrowCastOptions *garrow_cast_options_new(void);
^
In file included from ../../c_glib/arrow-glib/array.hpp:24:0,
from ../../c_glib/arrow-glib/array.cpp:24:
../../c_glib/arrow-glib/array.h:88:42: error: 'GArrowCastOptions' has not been
declared
GArrowCastOptions *options,
^
In file included from ../../c_glib/arrow-glib/array.cpp:26:0:
../../c_glib/arrow-glib/compute.hpp:26:1: error: 'GArrowCastOptions' does not
name a type
GArrowCastOptions *garrow_cast_options_new_raw(arrow::compute::CastOptions
*arrow_cast_options);
^
../../c_glib/arrow-glib/compute.hpp:27:58: error: 'GArrowCastOptions' was not
declared in this scope
arrow::compute::CastOptions *garrow_cast_options_get_raw(GArrowCastOptions
*cast_options);
^
../../c_glib/arrow-glib/compute.hpp:27:77: error: 'cast_options' was not
declared in this scope
arrow::compute::CastOptions *garrow_cast_options_get_raw(GArrowCastOptions
*cast_options);
^
../../c_glib/arrow-glib/array.cpp:519:19: error: 'GArrowCastOptions' has not
been declared
GArrowCastOptions *options,
^
../../c_glib/arrow-glib/array.cpp: In function 'GArrowArray*
garrow_array_cast(GArrowArray*, GArrowDataType*, int*, GError**)':
../../c_glib/arrow-glib/array.cpp:530:61: error: 'garrow_cast_options_get_raw'
cannot be used as a function
auto arrow_options = garrow_cast_options_get_raw(options);
^
make[5]: *** [libarrow_glib_la-array.lo] Error 1
make[5]: Leaving directory `/build/apache-arrow-0.7.0/c_glib_build/arrow-glib'
make[4]: *** [all] Error 2
make[4]: Leaving directory `/build/apache-arrow-0.7.0/c_glib_build/arrow-glib'
make[3]: *** [all-recursive] Error 1
make[3]: Leaving directory `/build/apache-arrow-0.7.0/c_glib_build'
make[2]: *** [all] Error 2
make[2]: Leaving directory `/build/apache-arrow-0.7.0/c_glib_build'
dh_auto_build: make -j1 returned exit code 2
make[1]: *** [override_dh_auto_build] Error 2
make[1]: Leaving directory `/build/apache-arrow-0.7.0'
make: *** [build] Error 2
dpkg-buildpackage: error: debian/rules build gave error exit status 2
debuild: fatal error at line 1364:
dpkg-buildpackage -rfakeroot -D -us -uc failed
Failed debuild -us -uc
{code}
> [C++] Support Ubuntu 14.04 in .deb packaging automation
> ---
>
> Key: ARROW-1538
> URL: https://issues.apache.org/jira/browse/ARROW-1538
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++, Packaging
>Reporter: Wes McKinney
>
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Assigned] (ARROW-1545) Int64Builder should not need int64() as arg
[
https://issues.apache.org/jira/browse/ARROW-1545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rares Vernica reassigned ARROW-1545:
Assignee: Rares Vernica
> Int64Builder should not need int64() as arg
> ---
>
> Key: ARROW-1545
> URL: https://issues.apache.org/jira/browse/ARROW-1545
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++, Documentation
>Reporter: Rares Vernica
>Assignee: Rares Vernica
>Priority: Trivial
> Labels: pull-request-available
>
> The first line in the [Getting Started|https://arrow.apache.org/docs/cpp/]
> example uses a {{Int64Builder}} like this:
> {code:java}
> Int64Builder builder(arrow::default_memory_pool(), arrow::int64());
> {code}
> The example works, but the {{arrow::int64()}} argument is not required.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (ARROW-1545) Int64Builder should not need int64() as arg
[
https://issues.apache.org/jira/browse/ARROW-1545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168790#comment-16168790
]
Rares Vernica commented on ARROW-1545:
--
I would be happy to submit a PR if you agree that this should be fixed.
> Int64Builder should not need int64() as arg
> ---
>
> Key: ARROW-1545
> URL: https://issues.apache.org/jira/browse/ARROW-1545
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++, Documentation
>Reporter: Rares Vernica
>Priority: Trivial
>
> The first line in the [Getting Started|https://arrow.apache.org/docs/cpp/]
> example uses a {{Int64Builder}} like this:
> {code:java}
> Int64Builder builder(arrow::default_memory_pool(), arrow::int64());
> {code}
> The example works, but the {{arrow::int64()}} argument is not required.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Created] (ARROW-1545) Int64Builder should not need int64() as arg
Rares Vernica created ARROW-1545:
Summary: Int64Builder should not need int64() as arg
Key: ARROW-1545
URL: https://issues.apache.org/jira/browse/ARROW-1545
Project: Apache Arrow
Issue Type: Bug
Components: C++, Documentation
Reporter: Rares Vernica
Priority: Trivial
The first line in the [Getting Started|https://arrow.apache.org/docs/cpp/]
example uses a {{Int64Builder}} like this:
{code:java}
Int64Builder builder(arrow::default_memory_pool(), arrow::int64());
{code}
The example works, but the {{arrow::int64()}} argument is not required.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (ARROW-592) [C++] Provide .deb and .rpm packages
[ https://issues.apache.org/jira/browse/ARROW-592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165783#comment-16165783 ] Rares Vernica commented on ARROW-592: - I would be glad to. I built the 14.04 packages using the scripts in arrow-dist and the patch that Kouhei kindly provided earlier in this thread. > [C++] Provide .deb and .rpm packages > > > Key: ARROW-592 > URL: https://issues.apache.org/jira/browse/ARROW-592 > Project: Apache Arrow > Issue Type: New Feature > Components: C++ > Environment: GNU/Linux >Reporter: Kouhei Sutou >Assignee: Kouhei Sutou >Priority: Minor > Fix For: 0.7.0 > > > If we provide .deb and .rpm packages for C++ Arrow, users can install it > easily. (At least, I'm happy as an user.) > Is there any location to provide .deb and .rpm packages? If it doesn't exist, > how about using https://packagecloud.io/ with "Open Source plan"? We can find > "Open Source plan" by clicking "Looking for free or open-source plans" at > https://packagecloud.io/pricing . -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (ARROW-592) [C++] Provide .deb and .rpm packages
[ https://issues.apache.org/jira/browse/ARROW-592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165750#comment-16165750 ] Rares Vernica commented on ARROW-592: - Thanks for setting this up. I was able to use your CentOS 6 packages from Bintray. I assume Arrow 0.7 packages will be available for CentOS 6 as well when time comes. I also needed Ubuntu 14.04 packages and I was able to build them myself for now. If it is not too much trouble, it would be nice to have Ubuntu 14.04 packages for Arrow 0.7 available as well when time comes. > [C++] Provide .deb and .rpm packages > > > Key: ARROW-592 > URL: https://issues.apache.org/jira/browse/ARROW-592 > Project: Apache Arrow > Issue Type: New Feature > Components: C++ > Environment: GNU/Linux >Reporter: Kouhei Sutou >Assignee: Kouhei Sutou >Priority: Minor > Fix For: 0.7.0 > > > If we provide .deb and .rpm packages for C++ Arrow, users can install it > easily. (At least, I'm happy as an user.) > Is there any location to provide .deb and .rpm packages? If it doesn't exist, > how about using https://packagecloud.io/ with "Open Source plan"? We can find > "Open Source plan" by clicking "Looking for free or open-source plans" at > https://packagecloud.io/pricing . -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (ARROW-1520) [Docs] PyArrow docs missing Feather documentation
[ https://issues.apache.org/jira/browse/ARROW-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16160576#comment-16160576 ] Rares Vernica commented on ARROW-1520: -- Got it, I just did it. See PR: https://github.com/apache/arrow/pull/1084 > [Docs] PyArrow docs missing Feather documentation > - > > Key: ARROW-1520 > URL: https://issues.apache.org/jira/browse/ARROW-1520 > Project: Apache Arrow > Issue Type: Improvement > Components: Documentation, Python >Affects Versions: 0.6.0 >Reporter: Rares Vernica >Assignee: Wes McKinney >Priority: Minor > > The Feather documentation seems to be missing from the PyArrow documentation > site: > https://arrow.apache.org/docs/python/search.html?q=feather_keywords=yes=default -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (ARROW-1520) [Docs] PyArrow docs missing Feather documentation
Rares Vernica created ARROW-1520: Summary: [Docs] PyArrow docs missing Feather documentation Key: ARROW-1520 URL: https://issues.apache.org/jira/browse/ARROW-1520 Project: Apache Arrow Issue Type: Improvement Components: Documentation, Python Affects Versions: 0.6.0 Reporter: Rares Vernica Priority: Minor The Feather documentation seems to be missing from the PyArrow documentation site: https://arrow.apache.org/docs/python/search.html?q=feather_keywords=yes=default -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (ARROW-1512) [Docs] NumericArray has no member named 'raw_data'
[
https://issues.apache.org/jira/browse/ARROW-1512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16160163#comment-16160163
]
Rares Vernica commented on ARROW-1512:
--
PR: https://github.com/apache/arrow/pull/1078
> [Docs] NumericArray has no member named 'raw_data'
> --
>
> Key: ARROW-1512
> URL: https://issues.apache.org/jira/browse/ARROW-1512
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++, Documentation
>Affects Versions: 0.6.0
>Reporter: Rares Vernica
>Priority: Trivial
>
> The example in the C++ docs uses a non-existing {{raw_data}} function
> https://arrow.apache.org/docs/cpp/index.html
> {code:java}
> // Get the pointer to the actual data
> const int64_t* data = int64_array->raw_data();
> {code}
> Trying to compile it, you get:
> {code:java}
> error: 'class arrow::NumericArray' has no member named
> 'raw_data'
> const int64_t* data = int64_array->raw_data();
> {code}
> The function used should be {{raw_values}}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Created] (ARROW-1512) [Docs] NumericArray has no member named 'raw_data'
Rares Vernica created ARROW-1512:
Summary: [Docs] NumericArray has no member named 'raw_data'
Key: ARROW-1512
URL: https://issues.apache.org/jira/browse/ARROW-1512
Project: Apache Arrow
Issue Type: Bug
Components: C++, Documentation
Affects Versions: 0.6.0
Reporter: Rares Vernica
Priority: Trivial
The example in the C++ docs uses a non-existing {{raw_data}} function
https://arrow.apache.org/docs/cpp/index.html
{code:java}
// Get the pointer to the actual data
const int64_t* data = int64_array->raw_data();
{code}
Trying to compile it, you get:
{code:java}
error: 'class arrow::NumericArray' has no member named
'raw_data'
const int64_t* data = int64_array->raw_data();
{code}
The function used should be {{raw_values}}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (ARROW-592) [C++] Provide .deb and .rpm packages
[ https://issues.apache.org/jira/browse/ARROW-592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144520#comment-16144520 ] Rares Vernica commented on ARROW-592: - Never mind. I checked out the 0.6.0 tag and it works fine. Thanks again! > [C++] Provide .deb and .rpm packages > > > Key: ARROW-592 > URL: https://issues.apache.org/jira/browse/ARROW-592 > Project: Apache Arrow > Issue Type: Wish > Components: C++ > Environment: GNU/Linux >Reporter: Kouhei Sutou >Assignee: Kouhei Sutou >Priority: Minor > Fix For: 0.7.0 > > > If we provide .deb and .rpm packages for C++ Arrow, users can install it > easily. (At least, I'm happy as an user.) > Is there any location to provide .deb and .rpm packages? If it doesn't exist, > how about using https://packagecloud.io/ with "Open Source plan"? We can find > "Open Source plan" by clicking "Looking for free or open-source plans" at > https://packagecloud.io/pricing . -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (ARROW-592) [C++] Provide .deb and .rpm packages
[
https://issues.apache.org/jira/browse/ARROW-592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144462#comment-16144462
]
Rares Vernica commented on ARROW-592:
-
Thanks. This is very helpful. I am in the final stages, but I am getting an
error with {{debuild}}.
{code}
# docker run --rm --tty --interactive --volume `pwd`:/host:rw --env DEBUG=yes
apache-arrow-ubuntu-14.04 bash -x /host/build.sh
+ LANG=C
+ . /host/env.sh
++ PACKAGE=apache-arrow
++ VERSION=0.7.0.20170827
++ lsb_release --id --short
++ tr A-Z a-z
+ distribution=ubuntu
++ lsb_release --codename --short
+ code_name=trusty
+ case "${distribution}" in
+ component=universe
+ run mkdir -p build
+ mkdir -p build
+ test 0 -ne 0
+ run cp /host/tmp/apache-arrow-0.7.0.20170827.tar.gz
build/apache-arrow_0.7.0.20170827.orig.tar.gz
+ cp /host/tmp/apache-arrow-0.7.0.20170827.tar.gz
build/apache-arrow_0.7.0.20170827.orig.tar.gz
+ test 0 -ne 0
+ run cd build
+ cd build
+ test 0 -ne 0
+ run tar xfz apache-arrow_0.7.0.20170827.orig.tar.gz
+ tar xfz apache-arrow_0.7.0.20170827.orig.tar.gz
+ test 0 -ne 0
+ run cd apache-arrow-0.7.0.20170827/
+ cd apache-arrow-0.7.0.20170827/
+ test 0 -ne 0
+ run cp -rp /host/tmp/debian debian
+ cp -rp /host/tmp/debian debian
+ test 0 -ne 0
+ '[' yes = yes ']'
+ run debuild -us -uc
+ debuild -us -uc
This package has a Debian revision number but there does not seem to be
an appropriate original tar file or .orig directory in the parent directory;
(expected one of apache-arrow_0.6.0.orig.tar.gz,
apache-arrow_0.6.0.orig.tar.bz2,
apache-arrow_0.6.0.orig.tar.lzma, apache-arrow_0.6.0.orig.tar.xz or
apache-arrow-0.7.0.20170827.orig)
continue anyway? (y/n) y
dpkg-buildpackage -rfakeroot -D -us -uc
dpkg-buildpackage: warning: using a gain-root-command while being root
dpkg-buildpackage: source package apache-arrow
dpkg-buildpackage: source version 0.6.0-1
dpkg-buildpackage: source distribution unstable
dpkg-buildpackage: source changed by Kouhei Sutou
dpkg-source --before-build apache-arrow-0.7.0.20170827
dpkg-buildpackage: host architecture amd64
fakeroot debian/rules clean
dh clean --with gir
dh_testdir
dh_auto_clean
dh_clean
dpkg-source -b apache-arrow-0.7.0.20170827
dpkg-source: error: can't build with source format '3.0 (quilt)': no upstream
tarball found at ../apache-arrow_0.6.0.orig.tar.{bz2,gz,lzma,xz}
dpkg-buildpackage: error: dpkg-source -b apache-arrow-0.7.0.20170827 gave error
exit status 255
debuild: fatal error at line 1364:
dpkg-buildpackage -rfakeroot -D -us -uc failed
+ test 29 -ne 0
+ echo 'Failed debuild' -us -uc
Failed debuild -us -uc
+ exit 1
{code}
Here are the {{apache-arrow*}} filtes in the container, after {{build.sh}} runs:
{code}
root@1cbdea4671f5:/# find . -name "apache-arrow*"
./host/tmp/apache-arrow-0.7.0.20170827.tar.gz
./build/apache-arrow_0.7.0.20170827.orig.tar.gz
./build/apache-arrow-0.7.0.20170827
./build/apache-arrow_0.6.0-1_amd64.build
{code}
> [C++] Provide .deb and .rpm packages
>
>
> Key: ARROW-592
> URL: https://issues.apache.org/jira/browse/ARROW-592
> Project: Apache Arrow
> Issue Type: Wish
> Components: C++
> Environment: GNU/Linux
>Reporter: Kouhei Sutou
>Assignee: Kouhei Sutou
>Priority: Minor
> Fix For: 0.7.0
>
>
> If we provide .deb and .rpm packages for C++ Arrow, users can install it
> easily. (At least, I'm happy as an user.)
> Is there any location to provide .deb and .rpm packages? If it doesn't exist,
> how about using https://packagecloud.io/ with "Open Source plan"? We can find
> "Open Source plan" by clicking "Looking for free or open-source plans" at
> https://packagecloud.io/pricing .
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (ARROW-592) [C++] Provide .deb and .rpm packages
[
https://issues.apache.org/jira/browse/ARROW-592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143001#comment-16143001
]
Rares Vernica commented on ARROW-592:
-
{code:java}
# ruby -v
ruby 1.9.3p484 (2013-11-22 revision 43786) [x86_64-linux]
{code}
I am trying to get the {{.deb}} files generated for Ubuntu {{14.04}}. I'll
upgrade {{ruby}} if necessary.
> [C++] Provide .deb and .rpm packages
>
>
> Key: ARROW-592
> URL: https://issues.apache.org/jira/browse/ARROW-592
> Project: Apache Arrow
> Issue Type: Wish
> Components: C++
> Environment: GNU/Linux
>Reporter: Kouhei Sutou
>Assignee: Kouhei Sutou
>Priority: Minor
> Fix For: 0.7.0
>
>
> If we provide .deb and .rpm packages for C++ Arrow, users can install it
> easily. (At least, I'm happy as an user.)
> Is there any location to provide .deb and .rpm packages? If it doesn't exist,
> how about using https://packagecloud.io/ with "Open Source plan"? We can find
> "Open Source plan" by clicking "Looking for free or open-source plans" at
> https://packagecloud.io/pricing .
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (ARROW-592) [C++] Provide .deb and .rpm packages
[
https://issues.apache.org/jira/browse/ARROW-592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142638#comment-16142638
]
Rares Vernica commented on ARROW-592:
-
I tried {{rake apt}} in {{arrow-dist}} and I get this:
{code:java}
arrow-dist/cpp-linux# rake --trace apt
rake aborted!
undefined local variable or method `__dir__' for
#
/arrow-dist/cpp-linux/Rakefile:31:in `arrow_source_dir'
/arrow-dist/cpp-linux/Rakefile:24:in `initialize'
/arrow-dist/cpp-linux/Rakefile:110:in `new'
/arrow-dist/cpp-linux/Rakefile:110:in `'
/usr/lib/ruby/vendor_ruby/rake/rake_module.rb:25:in `load'
/usr/lib/ruby/vendor_ruby/rake/rake_module.rb:25:in `load_rakefile'
/usr/lib/ruby/vendor_ruby/rake/application.rb:589:in `raw_load_rakefile'
/usr/lib/ruby/vendor_ruby/rake/application.rb:89:in `block in load_rakefile'
/usr/lib/ruby/vendor_ruby/rake/application.rb:160:in
`standard_exception_handling'
/usr/lib/ruby/vendor_ruby/rake/application.rb:88:in `load_rakefile'
/usr/lib/ruby/vendor_ruby/rake/application.rb:72:in `block in run'
/usr/lib/ruby/vendor_ruby/rake/application.rb:160:in
`standard_exception_handling'
/usr/lib/ruby/vendor_ruby/rake/application.rb:70:in `run'
/usr/bin/rake:27:in `'
{code}
Am I using it the wrong way?
> [C++] Provide .deb and .rpm packages
>
>
> Key: ARROW-592
> URL: https://issues.apache.org/jira/browse/ARROW-592
> Project: Apache Arrow
> Issue Type: Wish
> Components: C++
> Environment: GNU/Linux
>Reporter: Kouhei Sutou
>Assignee: Kouhei Sutou
>Priority: Minor
> Fix For: 0.7.0
>
>
> If we provide .deb and .rpm packages for C++ Arrow, users can install it
> easily. (At least, I'm happy as an user.)
> Is there any location to provide .deb and .rpm packages? If it doesn't exist,
> how about using https://packagecloud.io/ with "Open Source plan"? We can find
> "Open Source plan" by clicking "Looking for free or open-source plans" at
> https://packagecloud.io/pricing .
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Closed] (ARROW-1378) [Python] whl is not a supported wheel on this platform on Debian/Jessie
[
https://issues.apache.org/jira/browse/ARROW-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rares Vernica closed ARROW-1378.
Resolution: Not A Problem
I think you are right. I tried again from scratch and installed pip with:
{code:java}
# python get-pip.py
{code}
This time installing pyarrow worked fine.
> [Python] whl is not a supported wheel on this platform on Debian/Jessie
> ---
>
> Key: ARROW-1378
> URL: https://issues.apache.org/jira/browse/ARROW-1378
> Project: Apache Arrow
> Issue Type: Bug
> Components: Python
>Affects Versions: 0.6.0
> Environment: Debian Jessie
> Python 2.7.9
> pip 9.0.1
>Reporter: Rares Vernica
> Fix For: 0.7.0
>
>
> pip does not find 0.6.0:
> {code:java}
> # pip install --verbose pyarrow==0.6.0
> Downloading/unpacking pyarrow==0.6.0
> Could not fetch URL https://pypi.python.org/simple/pyarrow/0.6.0: 404
> Client Error: Not Found (pyarrow/0.6.0)
> Will skip URL https://pypi.python.org/simple/pyarrow/0.6.0 when looking for
> download links for pyarrow==0.6.0
> Ignoring link
> https://pypi.python.org/packages/21/8f/afae2b4b61ccd38732270fa26df04f7409eb10b64cf5881c56e50c6209af/pyarrow-0.3.0.tar.gz#md5=8f4f44cc0042994aa3e761488625d587
> (from https://pypi.python.org/simple/pyarrow/), version 0.3.0 doesn't match
> ==0.6.0
> Ignoring link
> https://pypi.python.org/packages/67/7d/06c8b820c6289cdd46307fec33bcf55e59e8d4d54e1776266d0d0d1d2f83/pyarrow-0.2.0.tar.gz#md5=8cbb2769bb6594fe1839510f067d480f
> (from https://pypi.python.org/simple/pyarrow/), version 0.2.0 doesn't match
> ==0.6.0
> Could not find a version that satisfies the requirement pyarrow==0.6.0
> (from versions: 0.3.0, 0.2.0)
> Cleaning up...
> No distributions matching the version for pyarrow==0.6.0
> Exception information:
> Traceback (most recent call last):
> File "/usr/lib/python2.7/dist-packages/pip/basecommand.py", line 122, in
> main
> status = self.run(options, args)
> File "/usr/lib/python2.7/dist-packages/pip/commands/install.py", line 290,
> in run
> requirement_set.prepare_files(finder, force_root_egg_info=self.bundle,
> bundle=self.bundle)
> File "/usr/lib/python2.7/dist-packages/pip/req.py", line 1178, in
> prepare_files
> url = finder.find_requirement(req_to_install, upgrade=self.upgrade)
> File "/usr/lib/python2.7/dist-packages/pip/index.py", line 322, in
> find_requirement
> raise DistributionNotFound('No distributions matching the version for %s'
> % req)
> DistributionNotFound: No distributions matching the version for pyarrow==0.6.0
> Storing debug log for failure in /root/.pip/pip.log
> {code}
> I downloaded the wheel locally, but it cannot be installed:
> {code:java}
> # pip install --verbose pyarrow-0.6.0-cp27-cp27mu-manylinux1_x86_64.whl
> pyarrow-0.6.0-cp27-cp27mu-manylinux1_x86_64.whl is not a supported wheel on
> this platform.
> Exception information:
> Traceback (most recent call last):
> File "/usr/lib/python2.7/dist-packages/pip/basecommand.py", line 122, in
> main
> status = self.run(options, args)
> File "/usr/lib/python2.7/dist-packages/pip/commands/install.py", line 269,
> in run
> InstallRequirement.from_line(name, None))
> File "/usr/lib/python2.7/dist-packages/pip/req.py", line 168, in from_line
> raise UnsupportedWheel("%s is not a supported wheel on this platform." %
> wheel.filename)
> UnsupportedWheel: pyarrow-0.6.0-cp27-cp27mu-manylinux1_x86_64.whl is not a
> supported wheel on this platform.
> Storing debug log for failure in /root/.pip/pip.log
> {code}
> System info:
> {code:java}
> # uname -a
> Linux b31005df8d85 4.11.12-100.fc24.x86_64 #1 SMP Fri Jul 21 17:35:20 UTC
> 2017 x86_64 GNU/Linux
> # python
> Python 2.7.9 (default, Jun 29 2016, 13:08:31)
> [GCC 4.9.2] on linux2
> Type "help", "copyright", "credits" or "license" for more information.
> >>> import pip
> >>> print(pip.pep425tags.get_supported())
> [('cp27', 'cp27mu', 'manylinux1_x86_64'), ('cp27', 'cp27mu', 'linux_x86_64'),
> ('cp27', 'none', 'manylinux1_x86_64'), ('cp27', 'none', 'linux_x86_64'),
> ('py2', 'none', 'manylinux1_x86_64'), ('py2', 'none', 'linux_x86_64'),
> ('cp27', 'none', 'any'), ('cp2', 'none', 'any'), ('py27', 'none', 'any'),
> ('py2', 'none', 'any'), ('py26', 'none', 'any'), ('py25', 'none', 'any'),
> ('py24', 'none', 'any'), ('py23', 'none', 'any'), ('py22', 'none', 'any'),
> ('py21', 'none', 'any'), ('py20', 'none', 'any')]
> >>> pip.__version__
> '9.0.1'
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (ARROW-1378) whl is not a supported wheel on this platform on Debian/Jessie
[
https://issues.apache.org/jira/browse/ARROW-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134298#comment-16134298
]
Rares Vernica commented on ARROW-1378:
--
To install pip, I did:
{code:java}
# apt install python-pip
# pip install --upgrade pip
{code}
> whl is not a supported wheel on this platform on Debian/Jessie
> --
>
> Key: ARROW-1378
> URL: https://issues.apache.org/jira/browse/ARROW-1378
> Project: Apache Arrow
> Issue Type: Bug
> Components: Python
>Affects Versions: 0.6.0
> Environment: Debian Jessie
> Python 2.7.9
> pip 9.0.1
>Reporter: Rares Vernica
>
> pip does not find 0.6.0:
> {code:java}
> # pip install --verbose pyarrow==0.6.0
> Downloading/unpacking pyarrow==0.6.0
> Could not fetch URL https://pypi.python.org/simple/pyarrow/0.6.0: 404
> Client Error: Not Found (pyarrow/0.6.0)
> Will skip URL https://pypi.python.org/simple/pyarrow/0.6.0 when looking for
> download links for pyarrow==0.6.0
> Ignoring link
> https://pypi.python.org/packages/21/8f/afae2b4b61ccd38732270fa26df04f7409eb10b64cf5881c56e50c6209af/pyarrow-0.3.0.tar.gz#md5=8f4f44cc0042994aa3e761488625d587
> (from https://pypi.python.org/simple/pyarrow/), version 0.3.0 doesn't match
> ==0.6.0
> Ignoring link
> https://pypi.python.org/packages/67/7d/06c8b820c6289cdd46307fec33bcf55e59e8d4d54e1776266d0d0d1d2f83/pyarrow-0.2.0.tar.gz#md5=8cbb2769bb6594fe1839510f067d480f
> (from https://pypi.python.org/simple/pyarrow/), version 0.2.0 doesn't match
> ==0.6.0
> Could not find a version that satisfies the requirement pyarrow==0.6.0
> (from versions: 0.3.0, 0.2.0)
> Cleaning up...
> No distributions matching the version for pyarrow==0.6.0
> Exception information:
> Traceback (most recent call last):
> File "/usr/lib/python2.7/dist-packages/pip/basecommand.py", line 122, in
> main
> status = self.run(options, args)
> File "/usr/lib/python2.7/dist-packages/pip/commands/install.py", line 290,
> in run
> requirement_set.prepare_files(finder, force_root_egg_info=self.bundle,
> bundle=self.bundle)
> File "/usr/lib/python2.7/dist-packages/pip/req.py", line 1178, in
> prepare_files
> url = finder.find_requirement(req_to_install, upgrade=self.upgrade)
> File "/usr/lib/python2.7/dist-packages/pip/index.py", line 322, in
> find_requirement
> raise DistributionNotFound('No distributions matching the version for %s'
> % req)
> DistributionNotFound: No distributions matching the version for pyarrow==0.6.0
> Storing debug log for failure in /root/.pip/pip.log
> {code}
> I downloaded the wheel locally, but it cannot be installed:
> {code:java}
> # pip install --verbose pyarrow-0.6.0-cp27-cp27mu-manylinux1_x86_64.whl
> pyarrow-0.6.0-cp27-cp27mu-manylinux1_x86_64.whl is not a supported wheel on
> this platform.
> Exception information:
> Traceback (most recent call last):
> File "/usr/lib/python2.7/dist-packages/pip/basecommand.py", line 122, in
> main
> status = self.run(options, args)
> File "/usr/lib/python2.7/dist-packages/pip/commands/install.py", line 269,
> in run
> InstallRequirement.from_line(name, None))
> File "/usr/lib/python2.7/dist-packages/pip/req.py", line 168, in from_line
> raise UnsupportedWheel("%s is not a supported wheel on this platform." %
> wheel.filename)
> UnsupportedWheel: pyarrow-0.6.0-cp27-cp27mu-manylinux1_x86_64.whl is not a
> supported wheel on this platform.
> Storing debug log for failure in /root/.pip/pip.log
> {code}
> System info:
> {code:java}
> # uname -a
> Linux b31005df8d85 4.11.12-100.fc24.x86_64 #1 SMP Fri Jul 21 17:35:20 UTC
> 2017 x86_64 GNU/Linux
> # python
> Python 2.7.9 (default, Jun 29 2016, 13:08:31)
> [GCC 4.9.2] on linux2
> Type "help", "copyright", "credits" or "license" for more information.
> >>> import pip
> >>> print(pip.pep425tags.get_supported())
> [('cp27', 'cp27mu', 'manylinux1_x86_64'), ('cp27', 'cp27mu', 'linux_x86_64'),
> ('cp27', 'none', 'manylinux1_x86_64'), ('cp27', 'none', 'linux_x86_64'),
> ('py2', 'none', 'manylinux1_x86_64'), ('py2', 'none', 'linux_x86_64'),
> ('cp27', 'none', 'any'), ('cp2', 'none', 'any'), ('py27', 'none', 'any'),
> ('py2', 'none', 'any'), ('py26', 'none', 'any'), ('py25', 'none', 'any'),
> ('py24', 'none', 'any'), ('py23', 'none', 'any'), ('py22', 'none', 'any'),
> ('py21', 'none', 'any'), ('py20', 'none', 'any')]
> >>> pip.__version__
> '9.0.1'
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Created] (ARROW-1378) whl is not a supported wheel on this platform on Debian/Jessie
Rares Vernica created ARROW-1378:
Summary: whl is not a supported wheel on this platform on
Debian/Jessie
Key: ARROW-1378
URL: https://issues.apache.org/jira/browse/ARROW-1378
Project: Apache Arrow
Issue Type: Bug
Components: Python
Affects Versions: 0.6.0
Environment: Debian Jessie
Python 2.7.9
pip 9.0.1
Reporter: Rares Vernica
pip does not find 0.6.0:
{code:java}
# pip install --verbose pyarrow==0.6.0
Downloading/unpacking pyarrow==0.6.0
Could not fetch URL https://pypi.python.org/simple/pyarrow/0.6.0: 404 Client
Error: Not Found (pyarrow/0.6.0)
Will skip URL https://pypi.python.org/simple/pyarrow/0.6.0 when looking for
download links for pyarrow==0.6.0
Ignoring link
https://pypi.python.org/packages/21/8f/afae2b4b61ccd38732270fa26df04f7409eb10b64cf5881c56e50c6209af/pyarrow-0.3.0.tar.gz#md5=8f4f44cc0042994aa3e761488625d587
(from https://pypi.python.org/simple/pyarrow/), version 0.3.0 doesn't match
==0.6.0
Ignoring link
https://pypi.python.org/packages/67/7d/06c8b820c6289cdd46307fec33bcf55e59e8d4d54e1776266d0d0d1d2f83/pyarrow-0.2.0.tar.gz#md5=8cbb2769bb6594fe1839510f067d480f
(from https://pypi.python.org/simple/pyarrow/), version 0.2.0 doesn't match
==0.6.0
Could not find a version that satisfies the requirement pyarrow==0.6.0 (from
versions: 0.3.0, 0.2.0)
Cleaning up...
No distributions matching the version for pyarrow==0.6.0
Exception information:
Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/pip/basecommand.py", line 122, in main
status = self.run(options, args)
File "/usr/lib/python2.7/dist-packages/pip/commands/install.py", line 290, in
run
requirement_set.prepare_files(finder, force_root_egg_info=self.bundle,
bundle=self.bundle)
File "/usr/lib/python2.7/dist-packages/pip/req.py", line 1178, in
prepare_files
url = finder.find_requirement(req_to_install, upgrade=self.upgrade)
File "/usr/lib/python2.7/dist-packages/pip/index.py", line 322, in
find_requirement
raise DistributionNotFound('No distributions matching the version for %s' %
req)
DistributionNotFound: No distributions matching the version for pyarrow==0.6.0
Storing debug log for failure in /root/.pip/pip.log
{code}
I downloaded the wheel locally, but it cannot be installed:
{code:java}
# pip install --verbose pyarrow-0.6.0-cp27-cp27mu-manylinux1_x86_64.whl
pyarrow-0.6.0-cp27-cp27mu-manylinux1_x86_64.whl is not a supported wheel on
this platform.
Exception information:
Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/pip/basecommand.py", line 122, in main
status = self.run(options, args)
File "/usr/lib/python2.7/dist-packages/pip/commands/install.py", line 269, in
run
InstallRequirement.from_line(name, None))
File "/usr/lib/python2.7/dist-packages/pip/req.py", line 168, in from_line
raise UnsupportedWheel("%s is not a supported wheel on this platform." %
wheel.filename)
UnsupportedWheel: pyarrow-0.6.0-cp27-cp27mu-manylinux1_x86_64.whl is not a
supported wheel on this platform.
Storing debug log for failure in /root/.pip/pip.log
{code}
System info:
{code:java}
# uname -a
Linux b31005df8d85 4.11.12-100.fc24.x86_64 #1 SMP Fri Jul 21 17:35:20 UTC 2017
x86_64 GNU/Linux
# python
Python 2.7.9 (default, Jun 29 2016, 13:08:31)
[GCC 4.9.2] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> import pip
>>> print(pip.pep425tags.get_supported())
[('cp27', 'cp27mu', 'manylinux1_x86_64'), ('cp27', 'cp27mu', 'linux_x86_64'),
('cp27', 'none', 'manylinux1_x86_64'), ('cp27', 'none', 'linux_x86_64'),
('py2', 'none', 'manylinux1_x86_64'), ('py2', 'none', 'linux_x86_64'), ('cp27',
'none', 'any'), ('cp2', 'none', 'any'), ('py27', 'none', 'any'), ('py2',
'none', 'any'), ('py26', 'none', 'any'), ('py25', 'none', 'any'), ('py24',
'none', 'any'), ('py23', 'none', 'any'), ('py22', 'none', 'any'), ('py21',
'none', 'any'), ('py20', 'none', 'any')]
>>> pip.__version__
'9.0.1'
{code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
