[jira] [Commented] (ARROW-1919) Plasma hanging if object id is not 20 bytes
[ https://issues.apache.org/jira/browse/ARROW-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16288743#comment-16288743 ] Mitar commented on ARROW-1919: -- The error should probably be in put, no? > Plasma hanging if object id is not 20 bytes > --- > > Key: ARROW-1919 > URL: https://issues.apache.org/jira/browse/ARROW-1919 > Project: Apache Arrow > Issue Type: Bug >Reporter: Philipp Moritz >Assignee: Philipp Moritz >Priority: Minor > > This happens if plasma's capability to put an object with a user defined > object id is used if the object id is not 20 bytes long. Plasma will hang > upon get in that case, we should give an error instead. > See https://github.com/ray-project/ray/issues/1315 -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (ARROW-1919) Plasma hanging if object id is not 20 bytes
Philipp Moritz created ARROW-1919: - Summary: Plasma hanging if object id is not 20 bytes Key: ARROW-1919 URL: https://issues.apache.org/jira/browse/ARROW-1919 Project: Apache Arrow Issue Type: Bug Reporter: Philipp Moritz Assignee: Philipp Moritz Priority: Minor This happens if plasma's capability to put an object with a user defined object id is used if the object id is not 20 bytes long. Plasma will hang upon get in that case, we should give an error instead. See https://github.com/ray-project/ray/issues/1315 -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (ARROW-1917) [GLib] Must set GI_TYPELIB_PATH in verify-release-candidate.sh
[ https://issues.apache.org/jira/browse/ARROW-1917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney reassigned ARROW-1917: --- Assignee: Wes McKinney > [GLib] Must set GI_TYPELIB_PATH in verify-release-candidate.sh > -- > > Key: ARROW-1917 > URL: https://issues.apache.org/jira/browse/ARROW-1917 > Project: Apache Arrow > Issue Type: Bug > Components: GLib >Reporter: Wes McKinney >Assignee: Wes McKinney > Labels: pull-request-available > Fix For: 0.8.0 > > > This is a new necessary step when validating a release candidate -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (ARROW-1917) [GLib] Must set GI_TYPELIB_PATH in verify-release-candidate.sh
[ https://issues.apache.org/jira/browse/ARROW-1917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-1917. - Resolution: Fixed Issue resolved by pull request 1417 [https://github.com/apache/arrow/pull/1417] > [GLib] Must set GI_TYPELIB_PATH in verify-release-candidate.sh > -- > > Key: ARROW-1917 > URL: https://issues.apache.org/jira/browse/ARROW-1917 > Project: Apache Arrow > Issue Type: Bug > Components: GLib >Reporter: Wes McKinney > Labels: pull-request-available > Fix For: 0.8.0 > > > This is a new necessary step when validating a release candidate -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (ARROW-1917) [GLib] Must set GI_TYPELIB_PATH in verify-release-candidate.sh
[ https://issues.apache.org/jira/browse/ARROW-1917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16288370#comment-16288370 ] ASF GitHub Bot commented on ARROW-1917: --- wesm commented on issue #1417: ARROW-1917: Fixes to enable verify-release-candidate.sh to work for 0.8.0 URL: https://github.com/apache/arrow/pull/1417#issuecomment-351213705 +1 This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > [GLib] Must set GI_TYPELIB_PATH in verify-release-candidate.sh > -- > > Key: ARROW-1917 > URL: https://issues.apache.org/jira/browse/ARROW-1917 > Project: Apache Arrow > Issue Type: Bug > Components: GLib >Reporter: Wes McKinney > Labels: pull-request-available > Fix For: 0.8.0 > > > This is a new necessary step when validating a release candidate -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (ARROW-1915) [Python] Parquet tests should be optional
[
https://issues.apache.org/jira/browse/ARROW-1915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16288368#comment-16288368
]
ASF GitHub Bot commented on ARROW-1915:
---
wesm closed pull request #1415: ARROW-1915: [Python] Add missing parquet
decorator to decimal tests
URL: https://github.com/apache/arrow/pull/1415
This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:
As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):
diff --git a/python/pyarrow/tests/test_parquet.py
b/python/pyarrow/tests/test_parquet.py
index 79e24d8d4..fc8c8f0c9 100644
--- a/python/pyarrow/tests/test_parquet.py
+++ b/python/pyarrow/tests/test_parquet.py
@@ -1593,6 +1593,7 @@ def test_backwards_compatible_column_metadata_handling():
tm.assert_frame_equal(result, expected[['a']].reset_index(drop=True))
+@parquet
def test_decimal_roundtrip(tmpdir):
num_values = 10
@@ -1619,6 +1620,7 @@ def test_decimal_roundtrip(tmpdir):
tm.assert_frame_equal(result, expected)
+@parquet
@pytest.mark.xfail(
raises=pa.ArrowException, reason='Parquet does not support negative scale'
)
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> [Python] Parquet tests should be optional
> -
>
> Key: ARROW-1915
> URL: https://issues.apache.org/jira/browse/ARROW-1915
> Project: Apache Arrow
> Issue Type: Bug
> Components: Python
>Reporter: Bryan Cutler
>Assignee: Bryan Cutler
>Priority: Trivial
> Labels: pull-request-available
> Fix For: 0.8.0
>
>
> Two decimal tests in {{test_parquet.py}} are missing the @parquet decorator
> to allow skipping if parquet is not install, resulting in failure
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Resolved] (ARROW-1915) [Python] Parquet tests should be optional
[
https://issues.apache.org/jira/browse/ARROW-1915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wes McKinney resolved ARROW-1915.
-
Resolution: Fixed
Fix Version/s: 0.8.0
Issue resolved by pull request 1415
[https://github.com/apache/arrow/pull/1415]
> [Python] Parquet tests should be optional
> -
>
> Key: ARROW-1915
> URL: https://issues.apache.org/jira/browse/ARROW-1915
> Project: Apache Arrow
> Issue Type: Bug
> Components: Python
>Reporter: Bryan Cutler
>Assignee: Bryan Cutler
>Priority: Trivial
> Labels: pull-request-available
> Fix For: 0.8.0
>
>
> Two decimal tests in {{test_parquet.py}} are missing the @parquet decorator
> to allow skipping if parquet is not install, resulting in failure
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (ARROW-1917) [GLib] Must set GI_TYPELIB_PATH in verify-release-candidate.sh
[ https://issues.apache.org/jira/browse/ARROW-1917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16288365#comment-16288365 ] ASF GitHub Bot commented on ARROW-1917: --- wesm opened a new pull request #1417: ARROW-1917: Fixes to enable verify-release-candidate.sh to work for 0.8.0 URL: https://github.com/apache/arrow/pull/1417 This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > [GLib] Must set GI_TYPELIB_PATH in verify-release-candidate.sh > -- > > Key: ARROW-1917 > URL: https://issues.apache.org/jira/browse/ARROW-1917 > Project: Apache Arrow > Issue Type: Bug > Components: GLib >Reporter: Wes McKinney > Labels: pull-request-available > Fix For: 0.8.0 > > > This is a new necessary step when validating a release candidate -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (ARROW-1917) [GLib] Must set GI_TYPELIB_PATH in verify-release-candidate.sh
[ https://issues.apache.org/jira/browse/ARROW-1917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-1917: -- Labels: pull-request-available (was: ) > [GLib] Must set GI_TYPELIB_PATH in verify-release-candidate.sh > -- > > Key: ARROW-1917 > URL: https://issues.apache.org/jira/browse/ARROW-1917 > Project: Apache Arrow > Issue Type: Bug > Components: GLib >Reporter: Wes McKinney > Labels: pull-request-available > Fix For: 0.8.0 > > > This is a new necessary step when validating a release candidate -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (ARROW-1918) [JS] Integration portion of verify-release-candidate.sh fails
Wes McKinney created ARROW-1918: --- Summary: [JS] Integration portion of verify-release-candidate.sh fails Key: ARROW-1918 URL: https://issues.apache.org/jira/browse/ARROW-1918 Project: Apache Arrow Issue Type: Bug Components: JavaScript Affects Versions: 0.8.0 Reporter: Wes McKinney I'm going to temporarily disable this in my fixes in ARROW-1917 -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (ARROW-1917) [GLib] Must set GI_TYPELIB_PATH in verify-release-candidate.sh
Wes McKinney created ARROW-1917: --- Summary: [GLib] Must set GI_TYPELIB_PATH in verify-release-candidate.sh Key: ARROW-1917 URL: https://issues.apache.org/jira/browse/ARROW-1917 Project: Apache Arrow Issue Type: Bug Components: GLib Reporter: Wes McKinney Fix For: 0.8.0 This is a new necessary step when validating a release candidate -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (ARROW-1916) [Java] Do not exclude java/dev/checkstyle from source releases
[ https://issues.apache.org/jira/browse/ARROW-1916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16288260#comment-16288260 ] ASF GitHub Bot commented on ARROW-1916: --- wesm closed pull request #1416: ARROW-1916: [Java] Include java/dev/checkstyle in git archive for source releases URL: https://github.com/apache/arrow/pull/1416 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a foreign pull request (from a fork), the diff is supplied below (as it won't show otherwise due to GitHub magic): diff --git a/java/.gitattributes b/java/.gitattributes index cb02d8226..596615322 100644 --- a/java/.gitattributes +++ b/java/.gitattributes @@ -1,3 +1,2 @@ .gitattributes export-ignore .gitignore export-ignore -/dev export-ignore This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > [Java] Do not exclude java/dev/checkstyle from source releases > -- > > Key: ARROW-1916 > URL: https://issues.apache.org/jira/browse/ARROW-1916 > Project: Apache Arrow > Issue Type: Bug > Components: Java - Vectors >Reporter: Wes McKinney >Priority: Blocker > Labels: pull-request-available > Fix For: 0.8.0 > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (ARROW-1916) [Java] Do not exclude java/dev/checkstyle from source releases
[ https://issues.apache.org/jira/browse/ARROW-1916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-1916. - Resolution: Fixed Issue resolved by pull request 1416 [https://github.com/apache/arrow/pull/1416] > [Java] Do not exclude java/dev/checkstyle from source releases > -- > > Key: ARROW-1916 > URL: https://issues.apache.org/jira/browse/ARROW-1916 > Project: Apache Arrow > Issue Type: Bug > Components: Java - Vectors >Reporter: Wes McKinney >Priority: Blocker > Labels: pull-request-available > Fix For: 0.8.0 > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (ARROW-1916) [Java] Do not exclude java/dev/checkstyle from source releases
[ https://issues.apache.org/jira/browse/ARROW-1916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney reassigned ARROW-1916: --- Assignee: Wes McKinney > [Java] Do not exclude java/dev/checkstyle from source releases > -- > > Key: ARROW-1916 > URL: https://issues.apache.org/jira/browse/ARROW-1916 > Project: Apache Arrow > Issue Type: Bug > Components: Java - Vectors >Reporter: Wes McKinney >Assignee: Wes McKinney >Priority: Blocker > Labels: pull-request-available > Fix For: 0.8.0 > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (ARROW-1916) [Java] Do not exclude java/dev/checkstyle from source releases
[ https://issues.apache.org/jira/browse/ARROW-1916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16288259#comment-16288259 ] ASF GitHub Bot commented on ARROW-1916: --- wesm commented on issue #1416: ARROW-1916: [Java] Include java/dev/checkstyle in git archive for source releases URL: https://github.com/apache/arrow/pull/1416#issuecomment-351191880 +1 This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > [Java] Do not exclude java/dev/checkstyle from source releases > -- > > Key: ARROW-1916 > URL: https://issues.apache.org/jira/browse/ARROW-1916 > Project: Apache Arrow > Issue Type: Bug > Components: Java - Vectors >Reporter: Wes McKinney >Priority: Blocker > Labels: pull-request-available > Fix For: 0.8.0 > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (ARROW-1916) [Java] Do not exclude java/dev/checkstyle from source releases
[ https://issues.apache.org/jira/browse/ARROW-1916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16288256#comment-16288256 ] ASF GitHub Bot commented on ARROW-1916: --- wesm opened a new pull request #1416: ARROW-1916: [Java] Include java/dev/checkstyle in git archive for source releases URL: https://github.com/apache/arrow/pull/1416 This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > [Java] Do not exclude java/dev/checkstyle from source releases > -- > > Key: ARROW-1916 > URL: https://issues.apache.org/jira/browse/ARROW-1916 > Project: Apache Arrow > Issue Type: Bug > Components: Java - Vectors >Reporter: Wes McKinney >Priority: Blocker > Labels: pull-request-available > Fix For: 0.8.0 > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (ARROW-1916) [Java] Do not exclude java/dev/checkstyle from source releases
[ https://issues.apache.org/jira/browse/ARROW-1916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16288257#comment-16288257 ] ASF GitHub Bot commented on ARROW-1916: --- wesm commented on issue #1416: ARROW-1916: [Java] Include java/dev/checkstyle in git archive for source releases URL: https://github.com/apache/arrow/pull/1416#issuecomment-351190753 cc @BryanCutler This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > [Java] Do not exclude java/dev/checkstyle from source releases > -- > > Key: ARROW-1916 > URL: https://issues.apache.org/jira/browse/ARROW-1916 > Project: Apache Arrow > Issue Type: Bug > Components: Java - Vectors >Reporter: Wes McKinney >Priority: Blocker > Labels: pull-request-available > Fix For: 0.8.0 > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (ARROW-1916) [Java] Do not exclude java/dev/checkstyle from source releases
[ https://issues.apache.org/jira/browse/ARROW-1916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-1916: -- Labels: pull-request-available (was: ) > [Java] Do not exclude java/dev/checkstyle from source releases > -- > > Key: ARROW-1916 > URL: https://issues.apache.org/jira/browse/ARROW-1916 > Project: Apache Arrow > Issue Type: Bug > Components: Java - Vectors >Reporter: Wes McKinney >Priority: Blocker > Labels: pull-request-available > Fix For: 0.8.0 > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (ARROW-1916) [Java] Do not exclude java/dev/checkstyle from source releases
Wes McKinney created ARROW-1916: --- Summary: [Java] Do not exclude java/dev/checkstyle from source releases Key: ARROW-1916 URL: https://issues.apache.org/jira/browse/ARROW-1916 Project: Apache Arrow Issue Type: Bug Components: Java - Vectors Reporter: Wes McKinney Priority: Blocker Fix For: 0.8.0 -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (ARROW-1915) [Python] Parquet tests should be optional
[
https://issues.apache.org/jira/browse/ARROW-1915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated ARROW-1915:
--
Labels: pull-request-available (was: )
> [Python] Parquet tests should be optional
> -
>
> Key: ARROW-1915
> URL: https://issues.apache.org/jira/browse/ARROW-1915
> Project: Apache Arrow
> Issue Type: Bug
> Components: Python
>Reporter: Bryan Cutler
>Assignee: Bryan Cutler
>Priority: Trivial
> Labels: pull-request-available
>
> Two decimal tests in {{test_parquet.py}} are missing the @parquet decorator
> to allow skipping if parquet is not install, resulting in failure
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (ARROW-1915) [Python] Parquet tests should be optional
[
https://issues.apache.org/jira/browse/ARROW-1915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16288214#comment-16288214
]
ASF GitHub Bot commented on ARROW-1915:
---
BryanCutler opened a new pull request #1415: ARROW-1915: [Python] Add missing
parquet decorator to decimal tests
URL: https://github.com/apache/arrow/pull/1415
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> [Python] Parquet tests should be optional
> -
>
> Key: ARROW-1915
> URL: https://issues.apache.org/jira/browse/ARROW-1915
> Project: Apache Arrow
> Issue Type: Bug
> Components: Python
>Reporter: Bryan Cutler
>Assignee: Bryan Cutler
>Priority: Trivial
> Labels: pull-request-available
>
> Two decimal tests in {{test_parquet.py}} are missing the @parquet decorator
> to allow skipping if parquet is not install, resulting in failure
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (ARROW-1915) [Python] Parquet tests should be optional
[
https://issues.apache.org/jira/browse/ARROW-1915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16288215#comment-16288215
]
ASF GitHub Bot commented on ARROW-1915:
---
BryanCutler commented on issue #1415: ARROW-1915: [Python] Add missing parquet
decorator to decimal tests
URL: https://github.com/apache/arrow/pull/1415#issuecomment-351181715
cc @wesm
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> [Python] Parquet tests should be optional
> -
>
> Key: ARROW-1915
> URL: https://issues.apache.org/jira/browse/ARROW-1915
> Project: Apache Arrow
> Issue Type: Bug
> Components: Python
>Reporter: Bryan Cutler
>Assignee: Bryan Cutler
>Priority: Trivial
> Labels: pull-request-available
>
> Two decimal tests in {{test_parquet.py}} are missing the @parquet decorator
> to allow skipping if parquet is not install, resulting in failure
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Created] (ARROW-1915) [Python] Parquet tests should be optional
Bryan Cutler created ARROW-1915:
---
Summary: [Python] Parquet tests should be optional
Key: ARROW-1915
URL: https://issues.apache.org/jira/browse/ARROW-1915
Project: Apache Arrow
Issue Type: Bug
Components: Python
Reporter: Bryan Cutler
Assignee: Bryan Cutler
Priority: Trivial
Two decimal tests in {{test_parquet.py}} are missing the @parquet decorator to
allow skipping if parquet is not install, resulting in failure
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (ARROW-1914) [C++] make -j may fail to build with -DARROW_GPU=on
[
https://issues.apache.org/jira/browse/ARROW-1914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16288195#comment-16288195
]
ASF GitHub Bot commented on ARROW-1914:
---
wesm closed pull request #1414: ARROW-1914: [C++] Fix build dependency for GPU
support build
URL: https://github.com/apache/arrow/pull/1414
This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:
As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):
diff --git a/cpp/src/arrow/gpu/CMakeLists.txt b/cpp/src/arrow/gpu/CMakeLists.txt
index 3ddf2c797..be474131e 100644
--- a/cpp/src/arrow/gpu/CMakeLists.txt
+++ b/cpp/src/arrow/gpu/CMakeLists.txt
@@ -32,9 +32,6 @@ set(ARROW_GPU_SRCS
cuda_memory.cc
)
-add_custom_target(arrow_gpu_sources DEPENDS ${ARROW_GPU_SRCS})
-add_dependencies(arrow_gpu_sources metadata_fbs)
-
set(ARROW_GPU_SHARED_LINK_LIBS
arrow_shared
${CUDA_LIBRARIES}
@@ -43,6 +40,7 @@ set(ARROW_GPU_SHARED_LINK_LIBS
ADD_ARROW_LIB(arrow_gpu
SOURCES ${ARROW_GPU_SRCS}
+ DEPENDENCIES metadata_fbs
SHARED_LINK_FLAGS ""
SHARED_LINK_LIBS ${ARROW_GPU_SHARED_LINK_LIBS}
STATIC_LINK_LIBS ""
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> [C++] make -j may fail to build with -DARROW_GPU=on
> ---
>
> Key: ARROW-1914
> URL: https://issues.apache.org/jira/browse/ARROW-1914
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Reporter: Kouhei Sutou
>Assignee: Kouhei Sutou
>Priority: Minor
> Labels: pull-request-available
> Fix For: 0.8.0
>
>
> Here is a error log:
> {code}
> [100%] Built target gflags_nothreads_static
> Install the project...
> -- Install configuration: "RELEASE"
> -- Installing:
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/cmake/gflags/gflags-config.cmake
> -- Installing:
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/cmake/gflags/gflags-config-version.cmake
> -- Installing:
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/cmake/gflags/gflags-targets.cmake
> -- Installing:
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/cmake/gflags/gflags-targets-release.cmake
> -- Installing:
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/bin/gflags_completions.sh
> -- Installing:
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/pkgconfig/gflags.pc
> -- Installing:
> /home/kou/.cmake/packages/gflags/fb801def37c922433975cbfefb3aa08d
> [ 26%] Completed 'gflags_ep'
> [ 55%] Building C object CMakeFiles/brotlienc.dir/enc/literal_cost.c.o
> [ 26%] Built target gflags_ep
> Scanning dependencies of target arrow_gpu_objlib
> [ 26%] Building CXX object
> src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/cuda_arrow_ipc.cc.o
> [ 59%] Building C object CMakeFiles/brotlienc.dir/enc/memory.c.o
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/src/arrow/gpu/cuda_arrow_ipc.cc:26:10:
> fatal error: arrow/ipc/Message_generated.h: No such file or directory
> #include "arrow/ipc/Message_generated.h"
> ^~~
> compilation terminated.
> src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/build.make:62: recipe for
> target 'src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/cuda_arrow_ipc.cc.o'
> failed
> make[2]: ***
> [src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/cuda_arrow_ipc.cc.o] Error 1
> CMakeFiles/Makefile2:2108: recipe for target
> 'src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/all' failed
> make[1]: *** [src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/all] Error 2
> make[1]: *** Waiting for unfinished jobs
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Resolved] (ARROW-1914) [C++] make -j may fail to build with -DARROW_GPU=on
[
https://issues.apache.org/jira/browse/ARROW-1914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wes McKinney resolved ARROW-1914.
-
Resolution: Fixed
Fix Version/s: (was: 0.9.0)
0.8.0
Issue resolved by pull request 1414
[https://github.com/apache/arrow/pull/1414]
> [C++] make -j may fail to build with -DARROW_GPU=on
> ---
>
> Key: ARROW-1914
> URL: https://issues.apache.org/jira/browse/ARROW-1914
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Reporter: Kouhei Sutou
>Assignee: Kouhei Sutou
>Priority: Minor
> Labels: pull-request-available
> Fix For: 0.8.0
>
>
> Here is a error log:
> {code}
> [100%] Built target gflags_nothreads_static
> Install the project...
> -- Install configuration: "RELEASE"
> -- Installing:
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/cmake/gflags/gflags-config.cmake
> -- Installing:
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/cmake/gflags/gflags-config-version.cmake
> -- Installing:
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/cmake/gflags/gflags-targets.cmake
> -- Installing:
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/cmake/gflags/gflags-targets-release.cmake
> -- Installing:
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/bin/gflags_completions.sh
> -- Installing:
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/pkgconfig/gflags.pc
> -- Installing:
> /home/kou/.cmake/packages/gflags/fb801def37c922433975cbfefb3aa08d
> [ 26%] Completed 'gflags_ep'
> [ 55%] Building C object CMakeFiles/brotlienc.dir/enc/literal_cost.c.o
> [ 26%] Built target gflags_ep
> Scanning dependencies of target arrow_gpu_objlib
> [ 26%] Building CXX object
> src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/cuda_arrow_ipc.cc.o
> [ 59%] Building C object CMakeFiles/brotlienc.dir/enc/memory.c.o
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/src/arrow/gpu/cuda_arrow_ipc.cc:26:10:
> fatal error: arrow/ipc/Message_generated.h: No such file or directory
> #include "arrow/ipc/Message_generated.h"
> ^~~
> compilation terminated.
> src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/build.make:62: recipe for
> target 'src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/cuda_arrow_ipc.cc.o'
> failed
> make[2]: ***
> [src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/cuda_arrow_ipc.cc.o] Error 1
> CMakeFiles/Makefile2:2108: recipe for target
> 'src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/all' failed
> make[1]: *** [src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/all] Error 2
> make[1]: *** Waiting for unfinished jobs
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Resolved] (ARROW-1911) Add Graphistry to Arrow JS proof points
[ https://issues.apache.org/jira/browse/ARROW-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-1911. - Resolution: Fixed Fix Version/s: 0.8.0 Issue resolved by pull request 1412 [https://github.com/apache/arrow/pull/1412] > Add Graphistry to Arrow JS proof points > --- > > Key: ARROW-1911 > URL: https://issues.apache.org/jira/browse/ARROW-1911 > Project: Apache Arrow > Issue Type: Improvement >Reporter: Leo Meyerovich > Labels: pull-request-available > Fix For: 0.8.0 > > Original Estimate: 0.5h > Remaining Estimate: 0.5h > > As part of upcoming publicity to the JS project, we wanted to add the > Graphistry enterprise-grade use case to the homepage. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (ARROW-1911) Add Graphistry to Arrow JS proof points
[ https://issues.apache.org/jira/browse/ARROW-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16288192#comment-16288192 ] ASF GitHub Bot commented on ARROW-1911: --- wesm closed pull request #1412: ARROW-1911: [JS] Add Graphistry to Arrow JS proof points URL: https://github.com/apache/arrow/pull/1412 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a foreign pull request (from a fork), the diff is supplied below (as it won't show otherwise due to GitHub magic): diff --git a/README.md b/README.md index 9dda25de9..15a9ffea2 100644 --- a/README.md +++ b/README.md @@ -37,8 +37,9 @@ Arrow is a set of technologies that enable big-data systems to process and move Initial implementations include: - [The Arrow Format](https://github.com/apache/arrow/tree/master/format) - - [Java implementation](https://github.com/apache/arrow/tree/master/java) - [C++ implementation](https://github.com/apache/arrow/tree/master/cpp) + - [Java implementation](https://github.com/apache/arrow/tree/master/java) + - [JavaScript implementation](https://github.com/apache/arrow/tree/master/js) - [Python interface to C++ libraries](https://github.com/apache/arrow/tree/master/python) Arrow is an [Apache Software Foundation](www.apache.org) project. Learn more at @@ -110,4 +111,4 @@ Thank you in advance for your contributions! [1]: mailto:dev-subscr...@arrow.apache.org [2]: https://github.com/apache/arrow/tree/master/format [3]: https://issues.apache.org/jira/browse/ARROW -[4]: https://github.com/apache/arrow \ No newline at end of file +[4]: https://github.com/apache/arrow diff --git a/js/DEVELOP.md b/js/DEVELOP.md index 9f586e1b3..1dd999a9e 100644 --- a/js/DEVELOP.md +++ b/js/DEVELOP.md @@ -17,6 +17,30 @@ under the License. --> +# Getting Involved +Even if you do not plan to contribute to Apache Arrow itself or Arrow +integrations in other projects, we'd be happy to have you involved: + +* Join the mailing list: send an email to + [dev-subscr...@arrow.apache.org][1]. Share your ideas and use cases for the + project. +* [Follow our activity on JIRA][3] +* [Learn the format][2] +* Contribute code to one of the reference implementations + +We prefer to receive contributions in the form of GitHub pull requests. Please send pull requests against the [github.com/apache/arrow][4] repository. + +If you are looking for some ideas on what to contribute, check out the [JIRA +issues][3] for the Apache Arrow project. Comment on the issue and/or contact +[d...@arrow.apache.org](http://mail-archives.apache.org/mod_mbox/arrow-dev/) +with your questions and ideas. + +If you’d like to report a bug but don’t have time to fix it, you can still post +it on JIRA, or email the mailing list +[d...@arrow.apache.org](http://mail-archives.apache.org/mod_mbox/arrow-dev/) + + + # The npm scripts * `npm run clean` - cleans targets diff --git a/js/README.md b/js/README.md index 9b1753f68..e58d335cd 100644 --- a/js/README.md +++ b/js/README.md @@ -22,7 +22,7 @@ [](https://travis-ci.org/apache/arrow) [](https://coveralls.io/github/apache/arrow) -Arrow is a set of technologies that enable big-data systems to process and transfer data quickly. +Arrow is a set of technologies that enable big data systems to process and transfer data quickly. ## install [apache-arrow from npm](https://www.npmjs.com/package/apache-arrow) @@ -32,14 +32,9 @@ Arrow is a set of technologies that enable big-data systems to process and trans # Powering Columnar In-Memory Analytics -Apache Arrow is a columnar memory layout specification for encoding vectors and table-like containers of flat and nested data. The Arrow spec aligns columnar data in memory to minimize cache misses and take advantage of the latest SIMD (Single input multiple data) and GPU operations on modern processors. +[Apache Arrow](https://github.com/apache/arrow) is a columnar memory layout specification for encoding vectors and table-like containers of flat and nested data. The Arrow spec aligns columnar data in memory to minimize cache misses and take advantage of the latest SIMD (Single input multiple data) and GPU operations on modern processors. -Apache Arrow is the emerging standard for large in-memory columnar data ([Spark](https://spark.apache.org/), [Pandas](http://wesmckinney.com/blog/pandas-and-apache-arrow/), [Drill](https://drill.apache.org/), ...). By standardizing on a common binary interchange format, big data systems can reduce the costs and friction associated with cross-system communication. - -# Related Projects - -* [GoAI](http://gpuopenanalytics.com/) -- Arrow-powered GPU analytics -*
[jira] [Commented] (ARROW-1914) [C++] make -j may fail to build with -DARROW_GPU=on
[
https://issues.apache.org/jira/browse/ARROW-1914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16288181#comment-16288181
]
ASF GitHub Bot commented on ARROW-1914:
---
xhochy commented on issue #1414: ARROW-1914: [C++] Fix build dependency for GPU
support build
URL: https://github.com/apache/arrow/pull/1414#issuecomment-351176824
Note that when using `ninja` instead of `make` these things are actually
spotted much earlier as the dependency resolver is a bit more strict (although
it is still non-deterministic in this case). Due to not having any CUDA enabled
device, I have never built the GPU support, thus my ninja workflow was not
triggered here :)
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> [C++] make -j may fail to build with -DARROW_GPU=on
> ---
>
> Key: ARROW-1914
> URL: https://issues.apache.org/jira/browse/ARROW-1914
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Reporter: Kouhei Sutou
>Assignee: Kouhei Sutou
>Priority: Minor
> Labels: pull-request-available
> Fix For: 0.9.0
>
>
> Here is a error log:
> {code}
> [100%] Built target gflags_nothreads_static
> Install the project...
> -- Install configuration: "RELEASE"
> -- Installing:
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/cmake/gflags/gflags-config.cmake
> -- Installing:
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/cmake/gflags/gflags-config-version.cmake
> -- Installing:
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/cmake/gflags/gflags-targets.cmake
> -- Installing:
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/cmake/gflags/gflags-targets-release.cmake
> -- Installing:
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/bin/gflags_completions.sh
> -- Installing:
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/pkgconfig/gflags.pc
> -- Installing:
> /home/kou/.cmake/packages/gflags/fb801def37c922433975cbfefb3aa08d
> [ 26%] Completed 'gflags_ep'
> [ 55%] Building C object CMakeFiles/brotlienc.dir/enc/literal_cost.c.o
> [ 26%] Built target gflags_ep
> Scanning dependencies of target arrow_gpu_objlib
> [ 26%] Building CXX object
> src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/cuda_arrow_ipc.cc.o
> [ 59%] Building C object CMakeFiles/brotlienc.dir/enc/memory.c.o
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/src/arrow/gpu/cuda_arrow_ipc.cc:26:10:
> fatal error: arrow/ipc/Message_generated.h: No such file or directory
> #include "arrow/ipc/Message_generated.h"
> ^~~
> compilation terminated.
> src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/build.make:62: recipe for
> target 'src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/cuda_arrow_ipc.cc.o'
> failed
> make[2]: ***
> [src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/cuda_arrow_ipc.cc.o] Error 1
> CMakeFiles/Makefile2:2108: recipe for target
> 'src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/all' failed
> make[1]: *** [src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/all] Error 2
> make[1]: *** Waiting for unfinished jobs
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (ARROW-1911) Add Graphistry to Arrow JS proof points
[ https://issues.apache.org/jira/browse/ARROW-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16288058#comment-16288058 ] ASF GitHub Bot commented on ARROW-1911: --- julianhyde commented on a change in pull request #1412: ARROW-1911: [JS] Add Graphistry to Arrow JS proof points URL: https://github.com/apache/arrow/pull/1412#discussion_r156459663 ## File path: js/README.md ## @@ -203,6 +197,28 @@ The JS community is a diverse group with a varied list of target environments an If you think we missed a compilation target and it's a blocker for adoption, please open an issue. +# Community + +Full list of broader Apache Arrow [committers](https://arrow.apache.org/committers/) and [projects & organizations](https://github.com/apache/arrow/blob/master/site/powered_by.md). + +## Committers + +* Brian Hulette, CCRI +* Paul Taylor, Graphistry, Inc. + +## Open Source Projects + +* [Apache Arrow](https://arrow.apache.org) -- Parent project for Powering Columnar In-Memory Analytics, including affiliated open source projects +* [rxjs-mapd](https://github.com/graphistry/rxjs-mapd) -- A MapD Core node-driver that returns query results as Arrow columns + + + +## Companies & Organizations + +* [CCRi](http://www.ccri.com/) -- Commonwealth Computer Research Inc, or CCRi, is a Central Virginia based data science and software engineering company Review comment: @lmeyerov Less hype, more informative, works for me; thanks! This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Add Graphistry to Arrow JS proof points > --- > > Key: ARROW-1911 > URL: https://issues.apache.org/jira/browse/ARROW-1911 > Project: Apache Arrow > Issue Type: Improvement >Reporter: Leo Meyerovich > Labels: pull-request-available > Original Estimate: 0.5h > Remaining Estimate: 0.5h > > As part of upcoming publicity to the JS project, we wanted to add the > Graphistry enterprise-grade use case to the homepage. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (ARROW-1914) [C++] make -j may fail to build with -DARROW_GPU=on
[
https://issues.apache.org/jira/browse/ARROW-1914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16287562#comment-16287562
]
ASF GitHub Bot commented on ARROW-1914:
---
kou opened a new pull request #1414: ARROW-1914: [C++] Fix build dependency for
GPU support build
URL: https://github.com/apache/arrow/pull/1414
"make -j" may cause build error:
[100%] Built target gflags_nothreads_static
Install the project...
-- Install configuration: "RELEASE"
-- Installing:
/tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/cmake/gflags/gflags-config.cmake
-- Installing:
/tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/cmake/gflags/gflags-config-version.cmake
-- Installing:
/tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/cmake/gflags/gflags-targets.cmake
-- Installing:
/tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/cmake/gflags/gflags-targets-release.cmake
-- Installing:
/tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/bin/gflags_completions.sh
-- Installing:
/tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/pkgconfig/gflags.pc
-- Installing:
/home/kou/.cmake/packages/gflags/fb801def37c922433975cbfefb3aa08d
[ 26%] Completed 'gflags_ep'
[ 55%] Building C object CMakeFiles/brotlienc.dir/enc/literal_cost.c.o
[ 26%] Built target gflags_ep
Scanning dependencies of target arrow_gpu_objlib
[ 26%] Building CXX object
src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/cuda_arrow_ipc.cc.o
[ 59%] Building C object CMakeFiles/brotlienc.dir/enc/memory.c.o
/tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/src/arrow/gpu/cuda_arrow_ipc.cc:26:10:
fatal error: arrow/ipc/Message_generated.h: No such file or directory
#include "arrow/ipc/Message_generated.h"
^~~
compilation terminated.
src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/build.make:62: recipe for
target 'src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/cuda_arrow_ipc.cc.o'
failed
make[2]: ***
[src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/cuda_arrow_ipc.cc.o] Error 1
CMakeFiles/Makefile2:2108: recipe for target
'src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/all' failed
make[1]: *** [src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/all] Error 2
make[1]: *** Waiting for unfinished jobs
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> [C++] make -j may fail to build with -DARROW_GPU=on
> ---
>
> Key: ARROW-1914
> URL: https://issues.apache.org/jira/browse/ARROW-1914
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Reporter: Kouhei Sutou
>Assignee: Kouhei Sutou
>Priority: Minor
> Labels: pull-request-available
> Fix For: 0.9.0
>
>
> Here is a error log:
> {code}
> [100%] Built target gflags_nothreads_static
> Install the project...
> -- Install configuration: "RELEASE"
> -- Installing:
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/cmake/gflags/gflags-config.cmake
> -- Installing:
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/cmake/gflags/gflags-config-version.cmake
> -- Installing:
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/cmake/gflags/gflags-targets.cmake
> -- Installing:
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/cmake/gflags/gflags-targets-release.cmake
> -- Installing:
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/bin/gflags_completions.sh
> -- Installing:
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/pkgconfig/gflags.pc
> -- Installing:
> /home/kou/.cmake/packages/gflags/fb801def37c922433975cbfefb3aa08d
> [ 26%] Completed 'gflags_ep'
> [ 55%] Building C object CMakeFiles/brotlienc.dir/enc/literal_cost.c.o
> [ 26%] Built target gflags_ep
> Scanning dependencies of target arrow_gpu_objlib
> [ 26%] Building CXX object
> src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/cuda_arrow_ipc.cc.o
> [ 59%] Building C object CMakeFiles/brotlienc.dir/enc/memory.c.o
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/src/arrow/gpu/cuda_arrow_ipc.cc:26:10:
> fatal error:
[jira] [Updated] (ARROW-1914) [C++] make -j may fail to build with -DARROW_GPU=on
[
https://issues.apache.org/jira/browse/ARROW-1914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated ARROW-1914:
--
Labels: pull-request-available (was: )
> [C++] make -j may fail to build with -DARROW_GPU=on
> ---
>
> Key: ARROW-1914
> URL: https://issues.apache.org/jira/browse/ARROW-1914
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
>Reporter: Kouhei Sutou
>Assignee: Kouhei Sutou
>Priority: Minor
> Labels: pull-request-available
> Fix For: 0.9.0
>
>
> Here is a error log:
> {code}
> [100%] Built target gflags_nothreads_static
> Install the project...
> -- Install configuration: "RELEASE"
> -- Installing:
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/cmake/gflags/gflags-config.cmake
> -- Installing:
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/cmake/gflags/gflags-config-version.cmake
> -- Installing:
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/cmake/gflags/gflags-targets.cmake
> -- Installing:
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/cmake/gflags/gflags-targets-release.cmake
> -- Installing:
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/bin/gflags_completions.sh
> -- Installing:
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/pkgconfig/gflags.pc
> -- Installing:
> /home/kou/.cmake/packages/gflags/fb801def37c922433975cbfefb3aa08d
> [ 26%] Completed 'gflags_ep'
> [ 55%] Building C object CMakeFiles/brotlienc.dir/enc/literal_cost.c.o
> [ 26%] Built target gflags_ep
> Scanning dependencies of target arrow_gpu_objlib
> [ 26%] Building CXX object
> src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/cuda_arrow_ipc.cc.o
> [ 59%] Building C object CMakeFiles/brotlienc.dir/enc/memory.c.o
> /tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/src/arrow/gpu/cuda_arrow_ipc.cc:26:10:
> fatal error: arrow/ipc/Message_generated.h: No such file or directory
> #include "arrow/ipc/Message_generated.h"
> ^~~
> compilation terminated.
> src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/build.make:62: recipe for
> target 'src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/cuda_arrow_ipc.cc.o'
> failed
> make[2]: ***
> [src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/cuda_arrow_ipc.cc.o] Error 1
> CMakeFiles/Makefile2:2108: recipe for target
> 'src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/all' failed
> make[1]: *** [src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/all] Error 2
> make[1]: *** Waiting for unfinished jobs
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Created] (ARROW-1914) [C++] make -j may fail to build with -DARROW_GPU=on
Kouhei Sutou created ARROW-1914:
---
Summary: [C++] make -j may fail to build with -DARROW_GPU=on
Key: ARROW-1914
URL: https://issues.apache.org/jira/browse/ARROW-1914
Project: Apache Arrow
Issue Type: Bug
Components: C++
Reporter: Kouhei Sutou
Assignee: Kouhei Sutou
Priority: Minor
Fix For: 0.9.0
Here is a error log:
{code}
[100%] Built target gflags_nothreads_static
Install the project...
-- Install configuration: "RELEASE"
-- Installing:
/tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/cmake/gflags/gflags-config.cmake
-- Installing:
/tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/cmake/gflags/gflags-config-version.cmake
-- Installing:
/tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/cmake/gflags/gflags-targets.cmake
-- Installing:
/tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/cmake/gflags/gflags-targets-release.cmake
-- Installing:
/tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/bin/gflags_completions.sh
-- Installing:
/tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/build/gflags_ep-prefix/src/gflags_ep/lib/pkgconfig/gflags.pc
-- Installing: /home/kou/.cmake/packages/gflags/fb801def37c922433975cbfefb3aa08d
[ 26%] Completed 'gflags_ep'
[ 55%] Building C object CMakeFiles/brotlienc.dir/enc/literal_cost.c.o
[ 26%] Built target gflags_ep
Scanning dependencies of target arrow_gpu_objlib
[ 26%] Building CXX object
src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/cuda_arrow_ipc.cc.o
[ 59%] Building C object CMakeFiles/brotlienc.dir/enc/memory.c.o
/tmp/arrow-0.8.0.GLyu7/apache-arrow-0.8.0/cpp/src/arrow/gpu/cuda_arrow_ipc.cc:26:10:
fatal error: arrow/ipc/Message_generated.h: No such file or directory
#include "arrow/ipc/Message_generated.h"
^~~
compilation terminated.
src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/build.make:62: recipe for target
'src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/cuda_arrow_ipc.cc.o' failed
make[2]: ***
[src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/cuda_arrow_ipc.cc.o] Error 1
CMakeFiles/Makefile2:2108: recipe for target
'src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/all' failed
make[1]: *** [src/arrow/gpu/CMakeFiles/arrow_gpu_objlib.dir/all] Error 2
make[1]: *** Waiting for unfinished jobs
{code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (ARROW-1744) [Plasma] Provide TensorFlow operator to read tensors from plasma
[
https://issues.apache.org/jira/browse/ARROW-1744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16287530#comment-16287530
]
ASF GitHub Bot commented on ARROW-1744:
---
holdenk commented on a change in pull request #1379: ARROW-1744: [WIP] Add
plasma tensorflow op
URL: https://github.com/apache/arrow/pull/1379#discussion_r156349402
##
File path: cpp/src/plasma/tf/test.py
##
@@ -0,0 +1,46 @@
+import numpy as np
+import pyarrow as pa
+import pyarrow.plasma as plasma
+import tensorflow as tf
+
+import time
+
+zero_out_module = tf.load_op_library('./plasma_op.so')
+
+client = plasma.connect("/tmp/plasma", "", 64)
Review comment:
Minor comment, but maybe do a mktemp type thing here instead? I know some
folks run tests in parallel on the same machine.
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> [Plasma] Provide TensorFlow operator to read tensors from plasma
>
>
> Key: ARROW-1744
> URL: https://issues.apache.org/jira/browse/ARROW-1744
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Plasma (C++)
>Reporter: Philipp Moritz
>Assignee: Philipp Moritz
> Labels: pull-request-available
> Fix For: 0.9.0
>
>
> see https://www.tensorflow.org/extend/adding_an_op
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (ARROW-1744) [Plasma] Provide TensorFlow operator to read tensors from plasma
[
https://issues.apache.org/jira/browse/ARROW-1744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16287531#comment-16287531
]
ASF GitHub Bot commented on ARROW-1744:
---
holdenk commented on a change in pull request #1379: ARROW-1744: [WIP] Add
plasma tensorflow op
URL: https://github.com/apache/arrow/pull/1379#discussion_r156349604
##
File path: cpp/src/plasma/tf/plasma_op.cc
##
@@ -0,0 +1,70 @@
+#include "tensorflow/core/framework/op.h"
+#include "tensorflow/core/framework/op_kernel.h"
+#include "tensorflow/core/framework/shape_inference.h"
+
+#include "arrow/io/memory.h"
+#include "arrow/ipc/reader.h"
+#include "arrow/tensor.h"
+#include "plasma/client.h"
+
+using namespace tensorflow;
+
+REGISTER_OP("PlasmaData")
+.Input("object_id: string")
+.Output("output: float32")
+.Attr("socket: string");
+
+// TODO(pcm): Make this zero-copy if possible
+
+class PlasmaDataOp : public OpKernel {
+ public:
+ explicit PlasmaDataOp(OpKernelConstruction* context) : OpKernel(context) {
+std::cout << "called constructor" << std::endl;
+std::string socket;
+OP_REQUIRES_OK(context, context->GetAttr("socket", ));
+// Connect to plasma
+ARROW_CHECK_OK(client_.Connect(socket, "", PLASMA_DEFAULT_RELEASE_DELAY));
+std::cout << "constructor finished" << std::endl;
+ }
+
+ void Compute(OpKernelContext* context) override {
+// Grab the input tensor
+const Tensor& input_tensor = context->input(0);
+auto input = input_tensor.flat();
+
+// Get the object
+plasma::ObjectID object_id = plasma::ObjectID::from_binary(input(0));
+plasma::ObjectBuffer object_buffer;
+ARROW_CHECK_OK(client_.Get(_id, 1, -1, _buffer));
+
+// Get the tensor
+std::shared_ptr result;
+arrow::io::BufferReader reader(object_buffer.data,
object_buffer.data_size);
+int64_t offset;
+ARROW_CHECK_OK(reader.Tell());
+ARROW_CHECK_OK(arrow::ipc::ReadTensor(0, , ));
+
+std::cout << "shape is" << result->shape()[0] << " , " <<
result->shape()[1]
+ << std::endl;
+
+// Create an output tensor
+TensorShape shape(result->shape());
+Tensor* output_tensor = NULL;
+OP_REQUIRES_OK(context, context->allocate_output(0, shape,
_tensor));
+auto output_flat = output_tensor->flat();
+
+// Set all but the first element of the output tensor to 0.
Review comment:
Is this comment perhaps about an older version of the code?
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> [Plasma] Provide TensorFlow operator to read tensors from plasma
>
>
> Key: ARROW-1744
> URL: https://issues.apache.org/jira/browse/ARROW-1744
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Plasma (C++)
>Reporter: Philipp Moritz
>Assignee: Philipp Moritz
> Labels: pull-request-available
> Fix For: 0.9.0
>
>
> see https://www.tensorflow.org/extend/adding_an_op
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (ARROW-1910) CPP README Brewfile link incorrect
[
https://issues.apache.org/jira/browse/ARROW-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16287503#comment-16287503
]
ASF GitHub Bot commented on ARROW-1910:
---
lewismc commented on issue #1407: ARROW-1910: [C++] README Brewfile link
incorrect
URL: https://github.com/apache/arrow/pull/1407#issuecomment-351030148
ack thanks @wesm
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> CPP README Brewfile link incorrect
> --
>
> Key: ARROW-1910
> URL: https://issues.apache.org/jira/browse/ARROW-1910
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++, Documentation
> Environment: Arrow master branch (2017-12-10)
>Reporter: Lewis John McGibbney
>Assignee: Lewis John McGibbney
>Priority: Trivial
> Labels: pull-request-available
> Fix For: 0.8.0
>
>
> The cpp README states
> {code}
> brew bundle --file=cpp/Brewfile
> {code}
> There is no such file.
> Files do exist for the following
> {code}
> ./c_glib/Brewfile
> ./python/Brewfile
> {code}
> I assume that this should point to the c_glib directory instead
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (ARROW-1911) Add Graphistry to Arrow JS proof points
[ https://issues.apache.org/jira/browse/ARROW-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16287410#comment-16287410 ] ASF GitHub Bot commented on ARROW-1911: --- lmeyerov commented on issue #1412: ARROW-1911: [JS] Add Graphistry to Arrow JS proof points URL: https://github.com/apache/arrow/pull/1412#issuecomment-351010399 s/supercharged/end-to-end gpu accelerated This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Add Graphistry to Arrow JS proof points > --- > > Key: ARROW-1911 > URL: https://issues.apache.org/jira/browse/ARROW-1911 > Project: Apache Arrow > Issue Type: Improvement >Reporter: Leo Meyerovich > Labels: pull-request-available > Original Estimate: 0.5h > Remaining Estimate: 0.5h > > As part of upcoming publicity to the JS project, we wanted to add the > Graphistry enterprise-grade use case to the homepage. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
