[GitHub] spark issue #16221: [SPARKR][PYSPARK] Fix R source package name to match Spa...

2016-12-08 Thread felixcheung
Github user felixcheung commented on the issue:

https://github.com/apache/spark/pull/16221
  
I tested a source package with a different version in filename vs 
DESCRIPTION and it seems to be working fine.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #16221: [SPARKR][PYSPARK] Fix R source package name to match Spa...

2016-12-08 Thread shivaram
Github user shivaram commented on the issue:

https://github.com/apache/spark/pull/16221
  
FYI the pip issue is fixed as you can see in the nightly build at 
http://people.apache.org/~pwendell/spark-nightly/spark-branch-2.1-bin/spark-2.1.1-SNAPSHOT-2016_12_08_18_31-ef5646b-bin/
 -- 
```
spark-2.1.1-SNAPSHOT-bin-hadoop2.7.tgz  2016-12-09 02:52187M
```

Further the SparkR build was successful [1] but we are right now missing a 
line to copy the source archive with FTP - I am sending a PR for that

[1] 
https://amplab.cs.berkeley.edu/jenkins/view/Spark%20Packaging/job/spark-branch-2.1-package/7/console


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #16221: [SPARKR][PYSPARK] Fix R source package name to match Spa...

2016-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/16221
  
Merged build finished. Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #16221: [SPARKR][PYSPARK] Fix R source package name to match Spa...

2016-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/16221
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69897/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #16221: [SPARKR][PYSPARK] Fix R source package name to match Spa...

2016-12-08 Thread SparkQA
Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/16221
  
**[Test build #69897 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69897/consoleFull)**
 for PR 16221 at commit 
[`9b97765`](https://github.com/apache/spark/commit/9b977651bdd85659fb6ab9d00e26ee0bb6ddbb52).
 * This patch passes all tests.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #16221: [SPARKR][PYSPARK] Fix R source package name to match Spa...

2016-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/16221
  
Test FAILed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69896/
Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #16221: [SPARKR][PYSPARK] Fix R source package name to match Spa...

2016-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/16221
  
Merged build finished. Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #16221: [SPARKR][PYSPARK] Fix R source package name to match Spa...

2016-12-08 Thread SparkQA
Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/16221
  
**[Test build #69896 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69896/consoleFull)**
 for PR 16221 at commit 
[`74d779b`](https://github.com/apache/spark/commit/74d779b8bdee8c6ad4aba69c051a3f9c87fecd3c).
 * This patch **fails Spark unit tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #16221: [SPARKR][PYSPARK] Fix R source package name to match Spa...

2016-12-08 Thread shivaram
Github user shivaram commented on the issue:

https://github.com/apache/spark/pull/16221
  
Thanks @holdenk - I'm going to merge this as this script isn't tested by 
Jenkins. I will manually test this by triggering a nightly build in `branch-2.1`


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #16221: [SPARKR][PYSPARK] Fix R source package name to match Spa...

2016-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/16221
  
Test FAILed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69890/
Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #16221: [SPARKR][PYSPARK] Fix R source package name to match Spa...

2016-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/16221
  
Merged build finished. Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #16221: [SPARKR][PYSPARK] Fix R source package name to match Spa...

2016-12-08 Thread SparkQA
Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/16221
  
**[Test build #69890 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69890/consoleFull)**
 for PR 16221 at commit 
[`c15916a`](https://github.com/apache/spark/commit/c15916aebd8e3991f45d244e298c0362785a1e81).
 * This patch **fails PySpark unit tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #16221: [SPARKR][PYSPARK] Fix R source package name to match Spa...

2016-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/16221
  
Merged build finished. Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #16221: [SPARKR][PYSPARK] Fix R source package name to match Spa...

2016-12-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/16221
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69889/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #16221: [SPARKR][PYSPARK] Fix R source package name to match Spa...

2016-12-08 Thread SparkQA
Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/16221
  
**[Test build #69889 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69889/consoleFull)**
 for PR 16221 at commit 
[`8a349f8`](https://github.com/apache/spark/commit/8a349f8bfb557e1b001412a083dc7eefd6e8b073).
 * This patch passes all tests.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #16221: [SPARKR][PYSPARK] Fix R source package name to match Spa...

2016-12-08 Thread holdenk
Github user holdenk commented on the issue:

https://github.com/apache/spark/pull/16221
  
Indeed that is the expected behavior, otherwise the user would have to
install Spark regularly  as well which would make it less useful.

On Fri, Dec 9, 2016 at 9:25 AM Shivaram Venkataraman <
notificati...@github.com> wrote:

> @holdenk  this seems to work in my machine in
> that the ./python/dist/pyspark-2.1.1.dev0.tar.gz was removed from
> spark-2.1.1-SNAPSHOT-bin-hadoop-2.6.tgz that I built using the command[1].
>
>
> One more question for you: Is it expected that the Spark dependency JARs
> are a part of the pip installable package ? i.e. when I look at the
> contents of say pyspark-2.1.0+hadoop2.7.tar.gz from [2], I find that it 
has
> all the Spark dependencies in pyspark-2.1.0+hadoop2.7/deps/jars/. I just
> wanted to check if that was the expected behavior
>
>
> [1] ./dev/make-distribution.sh --name "hadoop-2.6" --tgz --pip --r
> -Phadoop-2.6 -Psparkr -Phive -Phive-thriftserver -Pyarn -Pmesos
>
>
>
>
> —
> You are receiving this because you were mentioned.
> Reply to this email directly, view it on GitHub
> , or 
mute
> the thread
> 

> .
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #16221: [SPARKR][PYSPARK] Fix R source package name to match Spa...

2016-12-08 Thread shivaram
Github user shivaram commented on the issue:

https://github.com/apache/spark/pull/16221
  
@holdenk this seems to work in my machine in that the 
`./python/dist/pyspark-2.1.1.dev0.tar.gz` was removed from 
`spark-2.1.1-SNAPSHOT-bin-hadoop-2.6.tgz` that I built using the command[1].

One more question for you: Is it expected that the Spark dependency JARs 
are a part of the pip installable package ? i.e. when I look at the contents of 
say pyspark-2.1.0+hadoop2.7.tar.gz from [2], I find that it has all the Spark 
dependencies in `pyspark-2.1.0+hadoop2.7/deps/jars/`. I just wanted to check if 
that was the expected behavior

[1] `./dev/make-distribution.sh --name "hadoop-2.6" --tgz --pip --r 
-Phadoop-2.6 -Psparkr -Phive -Phive-thriftserver -Pyarn -Pmesos` 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #16221: [SPARKR][PYSPARK] Fix R source package name to match Spa...

2016-12-08 Thread SparkQA
Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/16221
  
**[Test build #69897 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69897/consoleFull)**
 for PR 16221 at commit 
[`9b97765`](https://github.com/apache/spark/commit/9b977651bdd85659fb6ab9d00e26ee0bb6ddbb52).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #16221: [SPARKR][PYSPARK] Fix R source package name to match Spa...

2016-12-08 Thread SparkQA
Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/16221
  
**[Test build #69896 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69896/consoleFull)**
 for PR 16221 at commit 
[`74d779b`](https://github.com/apache/spark/commit/74d779b8bdee8c6ad4aba69c051a3f9c87fecd3c).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org