[
https://issues.apache.org/jira/browse/ARROW-1579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16251944#comment-16251944
]
ASF GitHub Bot commented on ARROW-1579:
---------------------------------------
BryanCutler opened a new pull request #1319: [WIP] ARROW-1579: [TESTS] Adding
containerized Spark Integration tests
URL: https://github.com/apache/arrow/pull/1319
This adds configuration files for running containerized integration tests
with Spark for Java and Python. The image is based off of maven with openJDK-8
and will include a copy of Arrow when built on the parent directory to
ARROW_HOME. Running the container will do the following:
1) Install Arrow Java artifacts to m2 repo in container
2) Checkout current Spark master branch
3) Update Spark POM to use the installed version of Arrow and package
4) Run Arrow related Java/Scala Spark tests
5) Run pyarrow related Python Spark tests
Successful completion of the running container will indicate that there are
no breaking changes between current Spark code and the Arrow code
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> Add dockerized test setup to validate Spark integration
> -------------------------------------------------------
>
> Key: ARROW-1579
> URL: https://issues.apache.org/jira/browse/ARROW-1579
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Java - Vectors
> Reporter: Wes McKinney
> Assignee: Bryan Cutler
> Labels: pull-request-available
>
> cc [~bryanc] -- the goal of this will be to validate master-to-master to
> catch any regressions in the Spark integration
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
