?????? [VOTE] Release Apache Spark 1.5.2 (RC2)

[Ricky]

quot;Ricky"<494165...@qq.com>; 
: "Denny Lee"<denny.g@gmail.com>; "Mark 
Hamstra"<m...@clearstorydata.com>; "Reynold Xin"<r...@databricks.com>; 
"dev@spark.apache.org"<dev@spark.apache.org>; 
: Re: [VOTE] Release Apache Spark 1.5.2 (RC2)



Looks like you are building a module without install-ing other
modules. That won't work in general in Maven. Also, it looks like you
are building a snapshot, not the release we are talking about.

On Mon, Nov 9, 2015 at 3:28 AM,  <494165...@qq.com> wrote:
>
> build spark-streaming-mqtt_2.10 failed!
>
> nohup mvn -X -Pyarn -Phadoop-2.4 -Dhadoop.version=2.4.0 -Phive
> -Phive-thriftserver -DskipTests clean package -rf :spark-streaming-mqtt_2.10
> &
>
> [DEBUG] org.scala-tools.testing:test-interface:jar:0.5:test
> [DEBUG] org.apache.activemq:activemq-core:jar:5.7.0:test
> [DEBUG] org.apache.geronimo.specs:geronimo-jms_1.1_spec:jar:1.1.1:test
> [DEBUG] org.apache.activemq:kahadb:jar:5.7.0:test
> [DEBUG] org.apache.activemq.protobuf:activemq-protobuf:jar:1.1:test
> [DEBUG] org.fusesource.mqtt-client:mqtt-client:jar:1.3:test
> [DEBUG] org.fusesource.hawtdispatch:hawtdispatch-transport:jar:1.11:test
> [DEBUG] org.fusesource.hawtdispatch:hawtdispatch:jar:1.11:test
> [DEBUG] org.fusesource.hawtbuf:hawtbuf:jar:1.9:test
> [DEBUG]
> org.apache.geronimo.specs:geronimo-j2ee-management_1.1_spec:jar:1.0.1:test
> [DEBUG] org.springframework:spring-context:jar:3.0.7.RELEASE:test
> [DEBUG] org.springframework:spring-aop:jar:3.0.7.RELEASE:test
> [DEBUG] aopalliance:aopalliance:jar:1.0:test
> [DEBUG] org.springframework:spring-beans:jar:3.0.7.RELEASE:test
> [DEBUG] org.springframework:spring-core:jar:3.0.7.RELEASE:test
> [DEBUG] commons-logging:commons-logging:jar:1.1.1:test
> [DEBUG] org.springframework:spring-expression:jar:3.0.7.RELEASE:test
> [DEBUG] org.springframework:spring-asm:jar:3.0.7.RELEASE:test
> [DEBUG] org.jasypt:jasypt:jar:1.9.0:test
> [DEBUG] org.spark-project.spark:unused:jar:1.0.0:compile
> [DEBUG] org.scalatest:scalatest_2.10:jar:2.2.1:test
> [DEBUG] org.scala-lang:scala-reflect:jar:2.10.4:provided
> [INFO]
> 
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Spark Project External MQTT  FAILURE [ 2.403
> s]
> [INFO] Spark Project External MQTT Assembly ... SKIPPED
> [INFO] Spark Project External ZeroMQ .. SKIPPED
> [INFO] Spark Project External Kafka ... SKIPPED
> [INFO] Spark Project Examples . SKIPPED
> [INFO] Spark Project External Kafka Assembly .. SKIPPED
> [INFO]
> 
> [INFO] BUILD FAILURE
> [INFO]
> 
> [INFO] Total time: 4.471 s
> [INFO] Finished at: 2015-11-09T11:10:57+08:00
> [INFO] Final Memory: 31M/173M
> [INFO]
> 
> [WARNING] The requested profile "hive" could not be activated because it
> does not exist.
> [ERROR] Failed to execute goal on project spark-streaming-mqtt_2.10: Could
> not resolve dependencies for project
> org.apache.spark:spark-streaming-mqtt_2.10:jar:1.5.0-SNAPSHOT: The following
> artifacts could not be resolved:
> org.apache.spark:spark-streaming_2.10:jar:1.5.0-SNAPSHOT,
> org.apache.spark:spark-core_2.10:jar:1.5.0-SNAPSHOT,
> org.apache.spark:spark-core_2.10:jar:tests:1.5.0-SNAPSHOT,
> org.apache.spark:spark-launcher_2.10:jar:1.5.0-SNAPSHOT,
> org.apache.spark:spark-network-common_2.10:jar:1.5.0-SNAPSHOT,
> org.eclipse.paho:org.eclipse.paho.client.mqttv3:jar:1.0.1: Failure to find
> org.apache.spark:spark-streaming_2.10:jar:1.5.0-20150818.023902-334 in
> http://maven.cnsuning.com/content/groups/public/ was cached in the local
> repository, resolution will not be reattempted until the update interval of
> suning_maven_repo has elapsed or updates are forced -> [Help 1]
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
> goal on project spark-streaming-mqtt_2.10: Could not resolve dependencies
> for project org.apache.spark:spark-streaming-mqtt_2.10:jar:1.5.0-SNAPSHOT:
> The following artifacts could not be resolved:
> org.apache.spark:spark-streaming_2.10:jar:1.5.0-SNAPSHOT,
> org.apache.spark:spark-core_2.10:jar:1.5.0-SNAPSHOT,
> org.apache.spark:spark-core_2.10:jar:tests:1.5.0-SNAPSHOT,
> org.apache.spark:spark-launcher_2.10:jar:1.5.0-SNAPSHOT,
> org.apache.spark:spark-network-common_2.10:jar:1.5.0-SNAPSHOT,
> org.eclipse.paho:org.eclipse.paho.client.mqttv3:jar:1.0.1: Failure to find
> org.apache.spark:spark-streaming_2.10:jar:1.5.0-20150818.023902-334 in
> http://maven.cnsuning.com/content/groups/public/ was cached in the local
> repository, resolution will not be reattempted until the update interval of
> suning_maven_repo has elapsed or updates are forced
> iPhone
>
>

?????? [VOTE] Release Apache Spark 1.5.2 (RC2)

[Ricky]

thank for your help,do as you said,the problem is firewall issues,when changing 
to  maven default repo (http://repo1.maven.org) from  http://maven.oschina.net, 
spark-streaming-mqtt_2.10 module  compiled Successfully.



--

Best Regards 











 




--  --
??: "";<494165...@qq.com>;
: 2015??11??9??(??) 10:57
??: "Sean Owen"<so...@cloudera.com>; "Ted Yu"<yuzhih...@gmail.com>; 
"Krishna Sankar"<ksanka...@gmail.com>; 
: "Denny Lee"<denny.g@gmail.com>; "Mark 
Hamstra"<m...@clearstorydata.com>; "Reynold Xin"<r...@databricks.com>; 
"dev@spark.apache.org"<dev@spark.apache.org>; 
: ?? [VOTE] Release Apache Spark 1.5.2 (RC2)



Now I try the spark-1.5.2-rc2.zip from githup ,the result also has  errors .


[root@ouyangshourui spark-1.5.2-rc2]# pwd
/SparkCode/spark-1.5.2-rc2
[root@ouyangshourui spark-1.5.2-rc2]# nohup   mvn -Pyarn -Phadoop-2.4 
-Dhadoop.version=2.4.0 -Phive -Phive-thriftserver -DskipTests clean package &



The error log as following:


[INFO] Building jar: 
/SparkCode/spark-1.5.2-rc2/external/flume-assembly/target/spark-streaming-flume-assembly_2.10-1.5.2-test-sources.jar
[INFO] 
[INFO] 
[INFO] Building Spark Project External MQTT 1.5.2
[INFO] 
Downloading: 
http://maven.oschina.net/content/groups/public/org/eclipse/paho/org.eclipse.paho.client.mqttv3/1.0.1/org.eclipse.paho.client.mqttv3-1.0.1.pom
[WARNING] The POM for org.eclipse.paho:org.eclipse.paho.client.mqttv3:jar:1.0.1 
is missing, no dependency information available
Downloading: 
http://maven.oschina.net/content/groups/public/org/eclipse/paho/org.eclipse.paho.client.mqttv3/1.0.1/org.eclipse.paho.client.mqttv3-1.0.1.jar
[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Spark Project Parent POM ... SUCCESS [ 13.576 s]
[INFO] Spark Project Launcher . SUCCESS [ 19.966 s]
[INFO] Spark Project Networking ... SUCCESS [ 11.279 s]
[INFO] Spark Project Shuffle Streaming Service  SUCCESS [  5.353 s]
[INFO] Spark Project Unsafe ... SUCCESS [ 20.199 s]
[INFO] Spark Project Core . SUCCESS [04:18 min]
[INFO] Spark Project Bagel  SUCCESS [ 27.070 s]
[INFO] Spark Project GraphX ... SUCCESS [01:09 min]
[INFO] Spark Project Streaming  SUCCESS [01:57 min]
[INFO] Spark Project Catalyst . SUCCESS [02:21 min]
[INFO] Spark Project SQL .. SUCCESS [02:50 min]
[INFO] Spark Project ML Library ... SUCCESS [03:01 min]
[INFO] Spark Project Tools  SUCCESS [ 13.731 s]
[INFO] Spark Project Hive . SUCCESS [02:06 min]
[INFO] Spark Project REPL . SUCCESS [ 42.023 s]
[INFO] Spark Project YARN . SUCCESS [ 56.501 s]
[INFO] Spark Project Hive Thrift Server ... SUCCESS [ 53.986 s]
[INFO] Spark Project Assembly . SUCCESS [01:58 min]
[INFO] Spark Project External Twitter . SUCCESS [ 18.626 s]
[INFO] Spark Project External Flume Sink .. SUCCESS [ 34.569 s]
[INFO] Spark Project External Flume ... SUCCESS [ 29.643 s]
[INFO] Spark Project External Flume Assembly .. SUCCESS [  4.430 s]
[INFO] Spark Project External MQTT  FAILURE [  5.822 s]
[INFO] Spark Project External MQTT Assembly ... SKIPPED
[INFO] Spark Project External ZeroMQ .. SKIPPED
[INFO] Spark Project External Kafka ... SKIPPED
[INFO] Spark Project Examples . SKIPPED
[INFO] Spark Project External Kafka Assembly .. SKIPPED
[INFO] Spark Project YARN Shuffle Service . SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 25:41 min
[INFO] Finished at: 2015-11-09T09:45:27-05:00
[INFO] Final Memory: 73M/1041M
[INFO] 
[ERROR] Failed to execute goal on project spark-streaming-mqtt_2.10: Could not 
resolve dependencies for project 
org.apache.spark:spark-streaming-mqtt_2.10:jar:1.5.2: Could not find artifact 
org.ecli

Re: [VOTE] Release Apache Spark 1.5.2 (RC2)

[Sean McNamara]

+1

Sean


On Nov 3, 2015, at 4:28 PM, Reynold Xin 
> wrote:

Please vote on releasing the following candidate as Apache Spark version 1.5.2. 
The vote is open until Sat Nov 7, 2015 at 00:00 UTC and passes if a majority of 
at least 3 +1 PMC votes are cast.

[ ] +1 Release this package as Apache Spark 1.5.2
[ ] -1 Do not release this package because ...


The release fixes 59 known issues in Spark 1.5.1, listed here:
http://s.apache.org/spark-1.5.2

The tag to be voted on is v1.5.2-rc2:
https://github.com/apache/spark/releases/tag/v1.5.2-rc2

The release files, including signatures, digests, etc. can be found at:
http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-bin/

Release artifacts are signed with the following key:
https://people.apache.org/keys/committer/pwendell.asc

The staging repository for this release can be found at:
- as version 1.5.2-rc2: 
https://repository.apache.org/content/repositories/orgapachespark-1153
- as version 1.5.2: 
https://repository.apache.org/content/repositories/orgapachespark-1152

The documentation corresponding to this release can be found at:
http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-docs/


===
How can I help test this release?
===
If you are a Spark user, you can help us test this release by taking an 
existing Spark workload and running on this release candidate, then reporting 
any regressions.


What justifies a -1 vote for this release?

-1 vote should occur for regressions from Spark 1.5.1. Bugs already present in 
1.5.1 will not block this release.

Re: [VOTE] Release Apache Spark 1.5.2 (RC2)

[Ted Yu]

>
>
> ---------- 原始邮件 --
> *发件人:* Denny Lee <denny.g@gmail.com>
> *发送时间:* 2015年11月8日 08:36
> *收件人:* Mark Hamstra <m...@clearstorydata.com>, Reynold Xin <
> r...@databricks.com>
> *抄送:* dev@spark.apache.org <dev@spark.apache.org>
> *主题:* Re: [VOTE] Release Apache Spark 1.5.2 (RC2)
>
> +1
>
>
> On Sat, Nov 7, 2015 at 12:01 PM Mark Hamstra <m...@clearstorydata.com>
> wrote:
>
>> +1
>>
>> On Tue, Nov 3, 2015 at 3:22 PM, Reynold Xin <r...@databricks.com> wrote:
>>
>>> Please vote on releasing the following candidate as Apache Spark version
>>> 1.5.2. The vote is open until Sat Nov 7, 2015 at 00:00 UTC and passes if a
>>> majority of at least 3 +1 PMC votes are cast.
>>>
>>> [ ] +1 Release this package as Apache Spark 1.5.2
>>> [ ] -1 Do not release this package because ...
>>>
>>>
>>> The release fixes 59 known issues in Spark 1.5.1, listed here:
>>> http://s.apache.org/spark-1.5.2
>>>
>>> The tag to be voted on is v1.5.2-rc2:
>>> https://github.com/apache/spark/releases/tag/v1.5.2-rc2
>>>
>>> The release files, including signatures, digests, etc. can be found at:
>>> http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-bin/
>>>
>>> Release artifacts are signed with the following key:
>>> https://people.apache.org/keys/committer/pwendell.asc
>>>
>>> The staging repository for this release can be found at:
>>> - as version 1.5.2-rc2:
>>> https://repository.apache.org/content/repositories/orgapachespark-1153
>>> - as version 1.5.2:
>>> https://repository.apache.org/content/repositories/orgapachespark-1152
>>>
>>> The documentation corresponding to this release can be found at:
>>> http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-docs/
>>>
>>>
>>> ===
>>> How can I help test this release?
>>> ===
>>> If you are a Spark user, you can help us test this release by taking an
>>> existing Spark workload and running on this release candidate, then
>>> reporting any regressions.
>>>
>>> 
>>> What justifies a -1 vote for this release?
>>> 
>>> -1 vote should occur for regressions from Spark 1.5.1. Bugs already
>>> present in 1.5.1 will not block this release.
>>>
>>>
>>>

??????[VOTE] Release Apache Spark 1.5.2 (RC2)

[????]

build spark-streaming-mqtt_2.10 failed!


nohup mvn -X -Pyarn -Phadoop-2.4 -Dhadoop.version=2.4.0 -Phive 
-Phive-thriftserver -DskipTests clean package -rf :spark-streaming-mqtt_2.10 & 

[DEBUG] org.scala-tools.testing:test-interface:jar:0.5:test 
[DEBUG] org.apache.activemq:activemq-core:jar:5.7.0:test 
[DEBUG] org.apache.geronimo.specs:geronimo-jms_1.1_spec:jar:1.1.1:test 
[DEBUG] org.apache.activemq:kahadb:jar:5.7.0:test 
[DEBUG] org.apache.activemq.protobuf:activemq-protobuf:jar:1.1:test 
[DEBUG] org.fusesource.mqtt-client:mqtt-client:jar:1.3:test 
[DEBUG] org.fusesource.hawtdispatch:hawtdispatch-transport:jar:1.11:test 
[DEBUG] org.fusesource.hawtdispatch:hawtdispatch:jar:1.11:test 
[DEBUG] org.fusesource.hawtbuf:hawtbuf:jar:1.9:test 
[DEBUG] 
org.apache.geronimo.specs:geronimo-j2ee-management_1.1_spec:jar:1.0.1:test 
[DEBUG] org.springframework:spring-context:jar:3.0.7.RELEASE:test 
[DEBUG] org.springframework:spring-aop:jar:3.0.7.RELEASE:test 
[DEBUG] aopalliance:aopalliance:jar:1.0:test 
[DEBUG] org.springframework:spring-beans:jar:3.0.7.RELEASE:test 
[DEBUG] org.springframework:spring-core:jar:3.0.7.RELEASE:test 
[DEBUG] commons-logging:commons-logging:jar:1.1.1:test 
[DEBUG] org.springframework:spring-expression:jar:3.0.7.RELEASE:test 
[DEBUG] org.springframework:spring-asm:jar:3.0.7.RELEASE:test 
[DEBUG] org.jasypt:jasypt:jar:1.9.0:test 
[DEBUG] org.spark-project.spark:unused:jar:1.0.0:compile 
[DEBUG] org.scalatest:scalatest_2.10:jar:2.2.1:test
[DEBUG] org.scala-lang:scala-reflect:jar:2.10.4:provided 
[INFO]  
[INFO] Reactor Summary: 
[INFO] 
[INFO] Spark Project External MQTT  FAILURE [ 2.403 s] 
[INFO] Spark Project External MQTT Assembly ... SKIPPED 
[INFO] Spark Project External ZeroMQ .. SKIPPED 
[INFO] Spark Project External Kafka ... SKIPPED 
[INFO] Spark Project Examples . SKIPPED 
[INFO] Spark Project External Kafka Assembly .. SKIPPED 
[INFO]  
[INFO] BUILD FAILURE 
[INFO]  
[INFO] Total time: 4.471 s 
[INFO] Finished at: 2015-11-09T11:10:57+08:00 
[INFO] Final Memory: 31M/173M 
[INFO]  
[WARNING] The requested profile "hive" could not be activated because it does 
not exist. 
[ERROR] Failed to execute goal on project spark-streaming-mqtt_2.10: Could not 
resolve dependencies for project 
org.apache.spark:spark-streaming-mqtt_2.10:jar:1.5.0-SNAPSHOT: The following 
artifacts could not be resolved: 
org.apache.spark:spark-streaming_2.10:jar:1.5.0-SNAPSHOT, 
org.apache.spark:spark-core_2.10:jar:1.5.0-SNAPSHOT, 
org.apache.spark:spark-core_2.10:jar:tests:1.5.0-SNAPSHOT, 
org.apache.spark:spark-launcher_2.10:jar:1.5.0-SNAPSHOT, 
org.apache.spark:spark-network-common_2.10:jar:1.5.0-SNAPSHOT, 
org.eclipse.paho:org.eclipse.paho.client.mqttv3:jar:1.0.1: Failure to find 
org.apache.spark:spark-streaming_2.10:jar:1.5.0-20150818.023902-334 in 
http://maven.cnsuning.com/content/groups/public/ was cached in the local 
repository, resolution will not be reattempted until the update interval of 
suning_maven_repo has elapsed or updates are forced -> [Help 1] 
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal 
on project spark-streaming-mqtt_2.10: Could not resolve dependencies for 
project org.apache.spark:spark-streaming-mqtt_2.10:jar:1.5.0-SNAPSHOT: The 
following artifacts could not be resolved: 
org.apache.spark:spark-streaming_2.10:jar:1.5.0-SNAPSHOT, 
org.apache.spark:spark-core_2.10:jar:1.5.0-SNAPSHOT, 
org.apache.spark:spark-core_2.10:jar:tests:1.5.0-SNAPSHOT, 
org.apache.spark:spark-launcher_2.10:jar:1.5.0-SNAPSHOT, 
org.apache.spark:spark-network-common_2.10:jar:1.5.0-SNAPSHOT, 
org.eclipse.paho:org.eclipse.paho.client.mqttv3:jar:1.0.1: Failure to find 
org.apache.spark:spark-streaming_2.10:jar:1.5.0-20150818.023902-334 in 
http://maven.cnsuning.com/content/groups/public/ was cached in the local 
repository, resolution will not be reattempted until the update interval of 
suning_maven_repo has elapsed or updates are forced
iPhone

--  --
??: Denny Lee <denny.g@gmail.com>
: 2015??11??8?? 08:36
??: Mark Hamstra <m...@clearstorydata.com>, Reynold Xin 
<r...@databricks.com>
: dev@spark.apache.org <dev@spark.apache.org>
????: Re: [VOTE] Release Apache Spark 1.5.2 (RC2)



+1




On Sat, Nov 7, 2015 at 12:01 PM Mark Hamstra <m...@clearstorydata.com> wrote:

+1



On Tue, Nov 3, 2015 at 3:22 PM, Reynold Xin <r...@databricks.com> wrote:


Please vote on releasing the following candidate as Apache Spark version 1.5.2. 
The vote is open until 

Re: [VOTE] Release Apache Spark 1.5.2 (RC2)

[Ted Yu]

+1

On Sat, Nov 7, 2015 at 4:35 PM, Denny Lee  wrote:

> +1
>
>
> On Sat, Nov 7, 2015 at 12:01 PM Mark Hamstra 
> wrote:
>
>> +1
>>
>> On Tue, Nov 3, 2015 at 3:22 PM, Reynold Xin  wrote:
>>
>>> Please vote on releasing the following candidate as Apache Spark version
>>> 1.5.2. The vote is open until Sat Nov 7, 2015 at 00:00 UTC and passes if a
>>> majority of at least 3 +1 PMC votes are cast.
>>>
>>> [ ] +1 Release this package as Apache Spark 1.5.2
>>> [ ] -1 Do not release this package because ...
>>>
>>>
>>> The release fixes 59 known issues in Spark 1.5.1, listed here:
>>> http://s.apache.org/spark-1.5.2
>>>
>>> The tag to be voted on is v1.5.2-rc2:
>>> https://github.com/apache/spark/releases/tag/v1.5.2-rc2
>>>
>>> The release files, including signatures, digests, etc. can be found at:
>>> http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-bin/
>>>
>>> Release artifacts are signed with the following key:
>>> https://people.apache.org/keys/committer/pwendell.asc
>>>
>>> The staging repository for this release can be found at:
>>> - as version 1.5.2-rc2:
>>> https://repository.apache.org/content/repositories/orgapachespark-1153
>>> - as version 1.5.2:
>>> https://repository.apache.org/content/repositories/orgapachespark-1152
>>>
>>> The documentation corresponding to this release can be found at:
>>> http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-docs/
>>>
>>>
>>> ===
>>> How can I help test this release?
>>> ===
>>> If you are a Spark user, you can help us test this release by taking an
>>> existing Spark workload and running on this release candidate, then
>>> reporting any regressions.
>>>
>>> 
>>> What justifies a -1 vote for this release?
>>> 
>>> -1 vote should occur for regressions from Spark 1.5.1. Bugs already
>>> present in 1.5.1 will not block this release.
>>>
>>>
>>>

Re: [VOTE] Release Apache Spark 1.5.2 (RC2)

[Krishna Sankar]

.5.0-SNAPSHOT,
>> org.apache.spark:spark-core_2.10:jar:tests:1.5.0-SNAPSHOT,
>> org.apache.spark:spark-launcher_2.10:jar:1.5.0-SNAPSHOT,
>> org.apache.spark:spark-network-common_2.10:jar:1.5.0-SNAPSHOT,
>> org.eclipse.paho:org.eclipse.paho.client.mqttv3:jar:1.0.1: Failure to find
>> org.apache.spark:spark-streaming_2.10:jar:1.5.0-20150818.023902-334 in
>> http://maven.cnsuning.com/content/groups/public/ was cached in the local
>> repository, resolution will not be reattempted until the update interval of
>> suning_maven_repo has elapsed or updates are forced
>> 发自我的iPhone
>>
>>
>> -- 原始邮件 --
>> *发件人:* Denny Lee <denny.g@gmail.com>
>> *发送时间:* 2015年11月8日 08:36
>> *收件人:* Mark Hamstra <m...@clearstorydata.com>, Reynold Xin <
>> r...@databricks.com>
>> *抄送:* dev@spark.apache.org <dev@spark.apache.org>
>> *主题:* Re: [VOTE] Release Apache Spark 1.5.2 (RC2)
>>
>> +1
>>
>>
>> On Sat, Nov 7, 2015 at 12:01 PM Mark Hamstra <m...@clearstorydata.com>
>> wrote:
>>
>>> +1
>>>
>>> On Tue, Nov 3, 2015 at 3:22 PM, Reynold Xin <r...@databricks.com> wrote:
>>>
>>>> Please vote on releasing the following candidate as Apache Spark
>>>> version 1.5.2. The vote is open until Sat Nov 7, 2015 at 00:00 UTC and
>>>> passes if a majority of at least 3 +1 PMC votes are cast.
>>>>
>>>> [ ] +1 Release this package as Apache Spark 1.5.2
>>>> [ ] -1 Do not release this package because ...
>>>>
>>>>
>>>> The release fixes 59 known issues in Spark 1.5.1, listed here:
>>>> http://s.apache.org/spark-1.5.2
>>>>
>>>> The tag to be voted on is v1.5.2-rc2:
>>>> https://github.com/apache/spark/releases/tag/v1.5.2-rc2
>>>>
>>>> The release files, including signatures, digests, etc. can be found at:
>>>> http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-bin/
>>>>
>>>> Release artifacts are signed with the following key:
>>>> https://people.apache.org/keys/committer/pwendell.asc
>>>>
>>>> The staging repository for this release can be found at:
>>>> - as version 1.5.2-rc2:
>>>> https://repository.apache.org/content/repositories/orgapachespark-1153
>>>> - as version 1.5.2:
>>>> https://repository.apache.org/content/repositories/orgapachespark-1152
>>>>
>>>> The documentation corresponding to this release can be found at:
>>>> http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-docs/
>>>>
>>>>
>>>> ===
>>>> How can I help test this release?
>>>> ===
>>>> If you are a Spark user, you can help us test this release by taking an
>>>> existing Spark workload and running on this release candidate, then
>>>> reporting any regressions.
>>>>
>>>> 
>>>> What justifies a -1 vote for this release?
>>>> 
>>>> -1 vote should occur for regressions from Spark 1.5.1. Bugs already
>>>> present in 1.5.1 will not block this release.
>>>>
>>>>
>>>>
>

Re: [VOTE] Release Apache Spark 1.5.2 (RC2)

[Sean Owen]

Looks like you are building a module without install-ing other
modules. That won't work in general in Maven. Also, it looks like you
are building a snapshot, not the release we are talking about.

On Mon, Nov 9, 2015 at 3:28 AM, 欧锐 <494165...@qq.com> wrote:
>
> build spark-streaming-mqtt_2.10 failed!
>
> nohup mvn -X -Pyarn -Phadoop-2.4 -Dhadoop.version=2.4.0 -Phive
> -Phive-thriftserver -DskipTests clean package -rf :spark-streaming-mqtt_2.10
> &
>
> [DEBUG] org.scala-tools.testing:test-interface:jar:0.5:test
> [DEBUG] org.apache.activemq:activemq-core:jar:5.7.0:test
> [DEBUG] org.apache.geronimo.specs:geronimo-jms_1.1_spec:jar:1.1.1:test
> [DEBUG] org.apache.activemq:kahadb:jar:5.7.0:test
> [DEBUG] org.apache.activemq.protobuf:activemq-protobuf:jar:1.1:test
> [DEBUG] org.fusesource.mqtt-client:mqtt-client:jar:1.3:test
> [DEBUG] org.fusesource.hawtdispatch:hawtdispatch-transport:jar:1.11:test
> [DEBUG] org.fusesource.hawtdispatch:hawtdispatch:jar:1.11:test
> [DEBUG] org.fusesource.hawtbuf:hawtbuf:jar:1.9:test
> [DEBUG]
> org.apache.geronimo.specs:geronimo-j2ee-management_1.1_spec:jar:1.0.1:test
> [DEBUG] org.springframework:spring-context:jar:3.0.7.RELEASE:test
> [DEBUG] org.springframework:spring-aop:jar:3.0.7.RELEASE:test
> [DEBUG] aopalliance:aopalliance:jar:1.0:test
> [DEBUG] org.springframework:spring-beans:jar:3.0.7.RELEASE:test
> [DEBUG] org.springframework:spring-core:jar:3.0.7.RELEASE:test
> [DEBUG] commons-logging:commons-logging:jar:1.1.1:test
> [DEBUG] org.springframework:spring-expression:jar:3.0.7.RELEASE:test
> [DEBUG] org.springframework:spring-asm:jar:3.0.7.RELEASE:test
> [DEBUG] org.jasypt:jasypt:jar:1.9.0:test
> [DEBUG] org.spark-project.spark:unused:jar:1.0.0:compile
> [DEBUG] org.scalatest:scalatest_2.10:jar:2.2.1:test
> [DEBUG] org.scala-lang:scala-reflect:jar:2.10.4:provided
> [INFO]
> 
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Spark Project External MQTT  FAILURE [ 2.403
> s]
> [INFO] Spark Project External MQTT Assembly ... SKIPPED
> [INFO] Spark Project External ZeroMQ .. SKIPPED
> [INFO] Spark Project External Kafka ... SKIPPED
> [INFO] Spark Project Examples . SKIPPED
> [INFO] Spark Project External Kafka Assembly .. SKIPPED
> [INFO]
> 
> [INFO] BUILD FAILURE
> [INFO]
> 
> [INFO] Total time: 4.471 s
> [INFO] Finished at: 2015-11-09T11:10:57+08:00
> [INFO] Final Memory: 31M/173M
> [INFO]
> 
> [WARNING] The requested profile "hive" could not be activated because it
> does not exist.
> [ERROR] Failed to execute goal on project spark-streaming-mqtt_2.10: Could
> not resolve dependencies for project
> org.apache.spark:spark-streaming-mqtt_2.10:jar:1.5.0-SNAPSHOT: The following
> artifacts could not be resolved:
> org.apache.spark:spark-streaming_2.10:jar:1.5.0-SNAPSHOT,
> org.apache.spark:spark-core_2.10:jar:1.5.0-SNAPSHOT,
> org.apache.spark:spark-core_2.10:jar:tests:1.5.0-SNAPSHOT,
> org.apache.spark:spark-launcher_2.10:jar:1.5.0-SNAPSHOT,
> org.apache.spark:spark-network-common_2.10:jar:1.5.0-SNAPSHOT,
> org.eclipse.paho:org.eclipse.paho.client.mqttv3:jar:1.0.1: Failure to find
> org.apache.spark:spark-streaming_2.10:jar:1.5.0-20150818.023902-334 in
> http://maven.cnsuning.com/content/groups/public/ was cached in the local
> repository, resolution will not be reattempted until the update interval of
> suning_maven_repo has elapsed or updates are forced -> [Help 1]
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
> goal on project spark-streaming-mqtt_2.10: Could not resolve dependencies
> for project org.apache.spark:spark-streaming-mqtt_2.10:jar:1.5.0-SNAPSHOT:
> The following artifacts could not be resolved:
> org.apache.spark:spark-streaming_2.10:jar:1.5.0-SNAPSHOT,
> org.apache.spark:spark-core_2.10:jar:1.5.0-SNAPSHOT,
> org.apache.spark:spark-core_2.10:jar:tests:1.5.0-SNAPSHOT,
> org.apache.spark:spark-launcher_2.10:jar:1.5.0-SNAPSHOT,
> org.apache.spark:spark-network-common_2.10:jar:1.5.0-SNAPSHOT,
> org.eclipse.paho:org.eclipse.paho.client.mqttv3:jar:1.0.1: Failure to find
> org.apache.spark:spark-streaming_2.10:jar:1.5.0-20150818.023902-334 in
> http://maven.cnsuning.com/content/groups/public/ was cached in the local
> repository, resolution will not be reattempted until the update interval of
> suning_maven_repo has elapsed or updates are forced
> 发自我的iPhone
>
>

-
To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
For additional commands, e-mail: dev-h...@spark.apache.org

Re: [VOTE] Release Apache Spark 1.5.2 (RC2)

[Reynold Xin]

Thanks everybody for voting. I'm going to close the vote now. The vote
passes with 14 +1 votes and no -1 vote. I will work on packaging this asap.

+1:
Jean-Baptiste Onofré
Egor Pahomov
Luc Bourlier
Tom Graves*
Chester Chen
Michael Armbrust*
Krishna Sankar
Robin East
Reynold Xin*
Joseph Bradley
Mark Hamstra
Denny Lee
Ted Yu
Sean McNamara

-0:
Nicholas Chammas (spark-ec2 issue)

-1:
none



On Tue, Nov 3, 2015 at 3:22 PM, Reynold Xin  wrote:

> Please vote on releasing the following candidate as Apache Spark version
> 1.5.2. The vote is open until Sat Nov 7, 2015 at 00:00 UTC and passes if a
> majority of at least 3 +1 PMC votes are cast.
>
> [ ] +1 Release this package as Apache Spark 1.5.2
> [ ] -1 Do not release this package because ...
>
>
> The release fixes 59 known issues in Spark 1.5.1, listed here:
> http://s.apache.org/spark-1.5.2
>
> The tag to be voted on is v1.5.2-rc2:
> https://github.com/apache/spark/releases/tag/v1.5.2-rc2
>
> The release files, including signatures, digests, etc. can be found at:
> http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-bin/
>
> Release artifacts are signed with the following key:
> https://people.apache.org/keys/committer/pwendell.asc
>
> The staging repository for this release can be found at:
> - as version 1.5.2-rc2:
> https://repository.apache.org/content/repositories/orgapachespark-1153
> - as version 1.5.2:
> https://repository.apache.org/content/repositories/orgapachespark-1152
>
> The documentation corresponding to this release can be found at:
> http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-docs/
>
>
> ===
> How can I help test this release?
> ===
> If you are a Spark user, you can help us test this release by taking an
> existing Spark workload and running on this release candidate, then
> reporting any regressions.
>
> 
> What justifies a -1 vote for this release?
> 
> -1 vote should occur for regressions from Spark 1.5.1. Bugs already
> present in 1.5.1 will not block this release.
>
>
>

Re: [VOTE] Release Apache Spark 1.5.2 (RC2)

[Joseph Bradley]

+1 tested on OS X

On Sat, Nov 7, 2015 at 10:25 AM, Reynold Xin  wrote:

> +1 myself too
>
> On Sat, Nov 7, 2015 at 12:01 AM, Robin East 
> wrote:
>
>> +1
>> Mac OS X 10.10.5 Yosemite
>>
>> mvn clean package -DskipTests (13min)
>>
>> Basic graph tests
>>   Load graph using edgeListFile...SUCCESS
>>   Run PageRank...SUCCESS
>> Connected Components tests
>>   Kaggle social circles competition...SUCCESS
>> Minimum Spanning Tree Algorithm
>>   Run basic Minimum Spanning Tree algorithmSUCCESS
>>   Run Minimum Spanning Tree taxonomy creation...SUCCESS
>>
>>
>> ---
>> Robin East
>> *Spark GraphX in Action* Michael Malak and Robin East
>> Manning Publications Co.
>> http://www.manning.com/books/spark-graphx-in-action
>>
>>
>>
>>
>>
>> On 6 Nov 2015, at 17:27, Chester Chen  wrote:
>>
>> +1
>> Test against CDH5.4.2 with hadoop 2.6.0 version using yesterday's code,
>> build locally.
>>
>> Regression running in Yarn Cluster mode against few internal ML (
>> logistic regression, linear regression, random forest and statistic
>> summary) as well Mlib KMeans. all seems to work fine.
>>
>> Chester
>>
>>
>> On Tue, Nov 3, 2015 at 3:22 PM, Reynold Xin  wrote:
>>
>>> Please vote on releasing the following candidate as Apache Spark version
>>> 1.5.2. The vote is open until Sat Nov 7, 2015 at 00:00 UTC and passes if a
>>> majority of at least 3 +1 PMC votes are cast.
>>>
>>> [ ] +1 Release this package as Apache Spark 1.5.2
>>> [ ] -1 Do not release this package because ...
>>>
>>>
>>> The release fixes 59 known issues in Spark 1.5.1, listed here:
>>> http://s.apache.org/spark-1.5.2
>>>
>>> The tag to be voted on is v1.5.2-rc2:
>>> https://github.com/apache/spark/releases/tag/v1.5.2-rc2
>>>
>>> The release files, including signatures, digests, etc. can be found at:
>>> http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-bin/
>>>
>>> Release artifacts are signed with the following key:
>>> https://people.apache.org/keys/committer/pwendell.asc
>>>
>>> The staging repository for this release can be found at:
>>> - as version 1.5.2-rc2:
>>> https://repository.apache.org/content/repositories/orgapachespark-1153
>>> - as version 1.5.2:
>>> https://repository.apache.org/content/repositories/orgapachespark-1152
>>>
>>> The documentation corresponding to this release can be found at:
>>> http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-docs/
>>>
>>>
>>> ===
>>> How can I help test this release?
>>> ===
>>> If you are a Spark user, you can help us test this release by taking an
>>> existing Spark workload and running on this release candidate, then
>>> reporting any regressions.
>>>
>>> 
>>> What justifies a -1 vote for this release?
>>> 
>>> -1 vote should occur for regressions from Spark 1.5.1. Bugs already
>>> present in 1.5.1 will not block this release.
>>>
>>>
>>>
>>
>>
>

Re: [VOTE] Release Apache Spark 1.5.2 (RC2)

[Mark Hamstra]

+1

On Tue, Nov 3, 2015 at 3:22 PM, Reynold Xin  wrote:

> Please vote on releasing the following candidate as Apache Spark version
> 1.5.2. The vote is open until Sat Nov 7, 2015 at 00:00 UTC and passes if a
> majority of at least 3 +1 PMC votes are cast.
>
> [ ] +1 Release this package as Apache Spark 1.5.2
> [ ] -1 Do not release this package because ...
>
>
> The release fixes 59 known issues in Spark 1.5.1, listed here:
> http://s.apache.org/spark-1.5.2
>
> The tag to be voted on is v1.5.2-rc2:
> https://github.com/apache/spark/releases/tag/v1.5.2-rc2
>
> The release files, including signatures, digests, etc. can be found at:
> http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-bin/
>
> Release artifacts are signed with the following key:
> https://people.apache.org/keys/committer/pwendell.asc
>
> The staging repository for this release can be found at:
> - as version 1.5.2-rc2:
> https://repository.apache.org/content/repositories/orgapachespark-1153
> - as version 1.5.2:
> https://repository.apache.org/content/repositories/orgapachespark-1152
>
> The documentation corresponding to this release can be found at:
> http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-docs/
>
>
> ===
> How can I help test this release?
> ===
> If you are a Spark user, you can help us test this release by taking an
> existing Spark workload and running on this release candidate, then
> reporting any regressions.
>
> 
> What justifies a -1 vote for this release?
> 
> -1 vote should occur for regressions from Spark 1.5.1. Bugs already
> present in 1.5.1 will not block this release.
>
>
>

Re: [VOTE] Release Apache Spark 1.5.2 (RC2)

[Reynold Xin]

+1 myself too

On Sat, Nov 7, 2015 at 12:01 AM, Robin East  wrote:

> +1
> Mac OS X 10.10.5 Yosemite
>
> mvn clean package -DskipTests (13min)
>
> Basic graph tests
>   Load graph using edgeListFile...SUCCESS
>   Run PageRank...SUCCESS
> Connected Components tests
>   Kaggle social circles competition...SUCCESS
> Minimum Spanning Tree Algorithm
>   Run basic Minimum Spanning Tree algorithmSUCCESS
>   Run Minimum Spanning Tree taxonomy creation...SUCCESS
>
>
> ---
> Robin East
> *Spark GraphX in Action* Michael Malak and Robin East
> Manning Publications Co.
> http://www.manning.com/books/spark-graphx-in-action
>
>
>
>
>
> On 6 Nov 2015, at 17:27, Chester Chen  wrote:
>
> +1
> Test against CDH5.4.2 with hadoop 2.6.0 version using yesterday's code,
> build locally.
>
> Regression running in Yarn Cluster mode against few internal ML ( logistic
> regression, linear regression, random forest and statistic summary) as well
> Mlib KMeans. all seems to work fine.
>
> Chester
>
>
> On Tue, Nov 3, 2015 at 3:22 PM, Reynold Xin  wrote:
>
>> Please vote on releasing the following candidate as Apache Spark version
>> 1.5.2. The vote is open until Sat Nov 7, 2015 at 00:00 UTC and passes if a
>> majority of at least 3 +1 PMC votes are cast.
>>
>> [ ] +1 Release this package as Apache Spark 1.5.2
>> [ ] -1 Do not release this package because ...
>>
>>
>> The release fixes 59 known issues in Spark 1.5.1, listed here:
>> http://s.apache.org/spark-1.5.2
>>
>> The tag to be voted on is v1.5.2-rc2:
>> https://github.com/apache/spark/releases/tag/v1.5.2-rc2
>>
>> The release files, including signatures, digests, etc. can be found at:
>> http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-bin/
>>
>> Release artifacts are signed with the following key:
>> https://people.apache.org/keys/committer/pwendell.asc
>>
>> The staging repository for this release can be found at:
>> - as version 1.5.2-rc2:
>> https://repository.apache.org/content/repositories/orgapachespark-1153
>> - as version 1.5.2:
>> https://repository.apache.org/content/repositories/orgapachespark-1152
>>
>> The documentation corresponding to this release can be found at:
>> http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-docs/
>>
>>
>> ===
>> How can I help test this release?
>> ===
>> If you are a Spark user, you can help us test this release by taking an
>> existing Spark workload and running on this release candidate, then
>> reporting any regressions.
>>
>> 
>> What justifies a -1 vote for this release?
>> 
>> -1 vote should occur for regressions from Spark 1.5.1. Bugs already
>> present in 1.5.1 will not block this release.
>>
>>
>>
>
>

Re: [VOTE] Release Apache Spark 1.5.2 (RC2)

[Denny Lee]

+1


On Sat, Nov 7, 2015 at 12:01 PM Mark Hamstra 
wrote:

> +1
>
> On Tue, Nov 3, 2015 at 3:22 PM, Reynold Xin  wrote:
>
>> Please vote on releasing the following candidate as Apache Spark version
>> 1.5.2. The vote is open until Sat Nov 7, 2015 at 00:00 UTC and passes if a
>> majority of at least 3 +1 PMC votes are cast.
>>
>> [ ] +1 Release this package as Apache Spark 1.5.2
>> [ ] -1 Do not release this package because ...
>>
>>
>> The release fixes 59 known issues in Spark 1.5.1, listed here:
>> http://s.apache.org/spark-1.5.2
>>
>> The tag to be voted on is v1.5.2-rc2:
>> https://github.com/apache/spark/releases/tag/v1.5.2-rc2
>>
>> The release files, including signatures, digests, etc. can be found at:
>> http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-bin/
>>
>> Release artifacts are signed with the following key:
>> https://people.apache.org/keys/committer/pwendell.asc
>>
>> The staging repository for this release can be found at:
>> - as version 1.5.2-rc2:
>> https://repository.apache.org/content/repositories/orgapachespark-1153
>> - as version 1.5.2:
>> https://repository.apache.org/content/repositories/orgapachespark-1152
>>
>> The documentation corresponding to this release can be found at:
>> http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-docs/
>>
>>
>> ===
>> How can I help test this release?
>> ===
>> If you are a Spark user, you can help us test this release by taking an
>> existing Spark workload and running on this release candidate, then
>> reporting any regressions.
>>
>> 
>> What justifies a -1 vote for this release?
>> 
>> -1 vote should occur for regressions from Spark 1.5.1. Bugs already
>> present in 1.5.1 will not block this release.
>>
>>
>>

Re: [VOTE] Release Apache Spark 1.5.2 (RC2)

[Krishna Sankar]

+1 (non-binding, of course) (Hope I made it in time. ~T-20 !)

1. Compiled OSX 10.10 (Yosemite) OK Total time: 25:52 min
 mvn clean package -Pyarn -Phadoop-2.6 -DskipTests
2. Tested pyspark, mllib (iPython 4.0, FYI, notebook install is separate
“conda install ipython” and then “conda install jupyter”)
2.0 Spark version is 1.5.2.
2.1. statistics (min,max,mean,Pearson,Spearman) OK
2.2. Linear/Ridge/Laso Regression OK
2.3. Decision Tree, Naive Bayes OK
2.4. KMeans OK
   Center And Scale OK
2.5. RDD operations OK
  State of the Union Texts - MapReduce, Filter,sortByKey (word count)
2.6. Recommendation (Movielens medium dataset ~1 M ratings) OK
   Model evaluation/optimization (rank, numIter, lambda) with itertools
OK
3. Scala - MLlib
3.1. statistics (min,max,mean,Pearson,Spearman) OK
3.2. LinearRegressionWithSGD OK
3.3. Decision Tree OK
3.4. KMeans OK
3.5. Recommendation (Movielens medium dataset ~1 M ratings) OK
3.6. saveAsParquetFile OK
3.7. Read and verify the 4.3 save(above) - sqlContext.parquetFile,
registerTempTable, sql OK
3.8. result = sqlContext.sql("SELECT
OrderDetails.OrderID,ShipCountry,UnitPrice,Qty,Discount FROM Orders INNER
JOIN OrderDetails ON Orders.OrderID = OrderDetails.OrderID") OK
4.0. Spark SQL from Python OK
4.1. result = sqlContext.sql("SELECT * from people WHERE State = 'WA'") OK
5.0. Packages
5.1. com.databricks.spark.csv - read/write OK (--packages
com.databricks:spark-csv_2.10:1.2.0)
6.0. DataFrames
6.1. cast,dtypes OK
6.2. groupBy,avg,crosstab,corr,isNull,na.drop OK
6.3. All joins,sql,set operations,udf OK
Cheers


On Tue, Nov 3, 2015 at 3:22 PM, Reynold Xin  wrote:

> Please vote on releasing the following candidate as Apache Spark version
> 1.5.2. The vote is open until Sat Nov 7, 2015 at 00:00 UTC and passes if a
> majority of at least 3 +1 PMC votes are cast.
>
> [ ] +1 Release this package as Apache Spark 1.5.2
> [ ] -1 Do not release this package because ...
>
>
> The release fixes 59 known issues in Spark 1.5.1, listed here:
> http://s.apache.org/spark-1.5.2
>
> The tag to be voted on is v1.5.2-rc2:
> https://github.com/apache/spark/releases/tag/v1.5.2-rc2
>
> The release files, including signatures, digests, etc. can be found at:
> http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-bin/
>
> Release artifacts are signed with the following key:
> https://people.apache.org/keys/committer/pwendell.asc
>
> The staging repository for this release can be found at:
> - as version 1.5.2-rc2:
> https://repository.apache.org/content/repositories/orgapachespark-1153
> - as version 1.5.2:
> https://repository.apache.org/content/repositories/orgapachespark-1152
>
> The documentation corresponding to this release can be found at:
> http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-docs/
>
>
> ===
> How can I help test this release?
> ===
> If you are a Spark user, you can help us test this release by taking an
> existing Spark workload and running on this release candidate, then
> reporting any regressions.
>
> 
> What justifies a -1 vote for this release?
> 
> -1 vote should occur for regressions from Spark 1.5.1. Bugs already
> present in 1.5.1 will not block this release.
>
>
>

Re: [VOTE] Release Apache Spark 1.5.2 (RC2)

[Luc Bourlier]

+1 (non binding)

Tested the integration with Mesos in the different configurations.

Luc

Le jeu. 5 nov. 2015 à 21:02, Nicholas Chammas 
a écrit :

> -0
>
> The spark-ec2 version is still set to 1.5.1
> .
>
> Nick
>
> On Wed, Nov 4, 2015 at 8:20 PM Egor Pahomov 
> wrote:
>
>> +1
>>
>> Things, which our infrastructure use and I checked:
>>
>> Dynamic allocation
>> Spark ODBC server
>> Reading json
>> Writing parquet
>> SQL quires (hive context)
>> Running on CDH
>>
>>
>> 2015-11-04 9:03 GMT-08:00 Sean Owen :
>>
>>> As usual the signatures and licenses and so on look fine. I continue
>>> to get the same test failures on Ubuntu in Java 7/8:
>>>
>>> - Unpersisting HttpBroadcast on executors only in distributed mode ***
>>> FAILED ***
>>>
>>> But I continue to assume that's specific to tests and/or Ubuntu and/or
>>> the build profile, since I don't see any evidence of this in other
>>> builds on Jenkins. It's not a change from previous behavior, though it
>>> doesn't always happen either.
>>>
>>> On Tue, Nov 3, 2015 at 11:22 PM, Reynold Xin 
>>> wrote:
>>> > Please vote on releasing the following candidate as Apache Spark
>>> version
>>> > 1.5.2. The vote is open until Sat Nov 7, 2015 at 00:00 UTC and passes
>>> if a
>>> > majority of at least 3 +1 PMC votes are cast.
>>> >
>>> > [ ] +1 Release this package as Apache Spark 1.5.2
>>> > [ ] -1 Do not release this package because ...
>>> >
>>> >
>>> > The release fixes 59 known issues in Spark 1.5.1, listed here:
>>> > http://s.apache.org/spark-1.5.2
>>> >
>>> > The tag to be voted on is v1.5.2-rc2:
>>> > https://github.com/apache/spark/releases/tag/v1.5.2-rc2
>>> >
>>> > The release files, including signatures, digests, etc. can be found at:
>>> > http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-bin/
>>> >
>>> > Release artifacts are signed with the following key:
>>> > https://people.apache.org/keys/committer/pwendell.asc
>>> >
>>> > The staging repository for this release can be found at:
>>> > - as version 1.5.2-rc2:
>>> > https://repository.apache.org/content/repositories/orgapachespark-1153
>>> > - as version 1.5.2:
>>> > https://repository.apache.org/content/repositories/orgapachespark-1152
>>> >
>>> > The documentation corresponding to this release can be found at:
>>> >
>>> http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-docs/
>>> >
>>> >
>>> > ===
>>> > How can I help test this release?
>>> > ===
>>> > If you are a Spark user, you can help us test this release by taking an
>>> > existing Spark workload and running on this release candidate, then
>>> > reporting any regressions.
>>> >
>>> > 
>>> > What justifies a -1 vote for this release?
>>> > 
>>> > -1 vote should occur for regressions from Spark 1.5.1. Bugs already
>>> present
>>> > in 1.5.1 will not block this release.
>>> >
>>> >
>>>
>>> -
>>> To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
>>> For additional commands, e-mail: dev-h...@spark.apache.org
>>>
>>>
>>
>>
>> --
>>
>> *Sincerely yoursEgor Pakhomov, *
>>
>> *AnchorFree*
>>
>>

Re: [VOTE] Release Apache Spark 1.5.2 (RC2)

[Tom Graves]

 While running our regression tests I found 
https://issues.apache.org/jira/browse/SPARK-11555.  It is a break in backwards 
compatibility but its using the old spark-class and --num-workers interface 
which I hope no one is still using.  
I'm a +0 as it doesn't seem super critical but I hate to break backwards 
compatibility unless we explicitly decide to.

Tom 


 On Thursday, November 5, 2015 2:02 PM, Nicholas Chammas 
 wrote:
   

 -0
The spark-ec2 version is still set to 1.5.1.
Nick
On Wed, Nov 4, 2015 at 8:20 PM Egor Pahomov  wrote:

+1 
Things, which our infrastructure use and I checked:
Dynamic allocationSpark ODBC serverReading jsonWriting parquetSQL quires (hive 
context)Running on CDH 

2015-11-04 9:03 GMT-08:00 Sean Owen :

As usual the signatures and licenses and so on look fine. I continue
to get the same test failures on Ubuntu in Java 7/8:

- Unpersisting HttpBroadcast on executors only in distributed mode ***
FAILED ***

But I continue to assume that's specific to tests and/or Ubuntu and/or
the build profile, since I don't see any evidence of this in other
builds on Jenkins. It's not a change from previous behavior, though it
doesn't always happen either.

On Tue, Nov 3, 2015 at 11:22 PM, Reynold Xin  wrote:
> Please vote on releasing the following candidate as Apache Spark version
> 1.5.2. The vote is open until Sat Nov 7, 2015 at 00:00 UTC and passes if a
> majority of at least 3 +1 PMC votes are cast.
>
> [ ] +1 Release this package as Apache Spark 1.5.2
> [ ] -1 Do not release this package because ...
>
>
> The release fixes 59 known issues in Spark 1.5.1, listed here:
> http://s.apache.org/spark-1.5.2
>
> The tag to be voted on is v1.5.2-rc2:
> https://github.com/apache/spark/releases/tag/v1.5.2-rc2
>
> The release files, including signatures, digests, etc. can be found at:
> http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-bin/
>
> Release artifacts are signed with the following key:
> https://people.apache.org/keys/committer/pwendell.asc
>
> The staging repository for this release can be found at:
> - as version 1.5.2-rc2:
> https://repository.apache.org/content/repositories/orgapachespark-1153
> - as version 1.5.2:
> https://repository.apache.org/content/repositories/orgapachespark-1152
>
> The documentation corresponding to this release can be found at:
> http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-docs/
>
>
> ===
> How can I help test this release?
> ===
> If you are a Spark user, you can help us test this release by taking an
> existing Spark workload and running on this release candidate, then
> reporting any regressions.
>
> 
> What justifies a -1 vote for this release?
> 
> -1 vote should occur for regressions from Spark 1.5.1. Bugs already present
> in 1.5.1 will not block this release.
>
>

-
To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
For additional commands, e-mail: dev-h...@spark.apache.org





-- 
Sincerely yours
Egor Pakhomov, AnchorFree




  

Re: [VOTE] Release Apache Spark 1.5.2 (RC2)

[Chester Chen]

+1
Test against CDH5.4.2 with hadoop 2.6.0 version using yesterday's code,
build locally.

Regression running in Yarn Cluster mode against few internal ML ( logistic
regression, linear regression, random forest and statistic summary) as well
Mlib KMeans. all seems to work fine.

Chester


On Tue, Nov 3, 2015 at 3:22 PM, Reynold Xin  wrote:

> Please vote on releasing the following candidate as Apache Spark version
> 1.5.2. The vote is open until Sat Nov 7, 2015 at 00:00 UTC and passes if a
> majority of at least 3 +1 PMC votes are cast.
>
> [ ] +1 Release this package as Apache Spark 1.5.2
> [ ] -1 Do not release this package because ...
>
>
> The release fixes 59 known issues in Spark 1.5.1, listed here:
> http://s.apache.org/spark-1.5.2
>
> The tag to be voted on is v1.5.2-rc2:
> https://github.com/apache/spark/releases/tag/v1.5.2-rc2
>
> The release files, including signatures, digests, etc. can be found at:
> http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-bin/
>
> Release artifacts are signed with the following key:
> https://people.apache.org/keys/committer/pwendell.asc
>
> The staging repository for this release can be found at:
> - as version 1.5.2-rc2:
> https://repository.apache.org/content/repositories/orgapachespark-1153
> - as version 1.5.2:
> https://repository.apache.org/content/repositories/orgapachespark-1152
>
> The documentation corresponding to this release can be found at:
> http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-docs/
>
>
> ===
> How can I help test this release?
> ===
> If you are a Spark user, you can help us test this release by taking an
> existing Spark workload and running on this release candidate, then
> reporting any regressions.
>
> 
> What justifies a -1 vote for this release?
> 
> -1 vote should occur for regressions from Spark 1.5.1. Bugs already
> present in 1.5.1 will not block this release.
>
>
>

Re: [VOTE] Release Apache Spark 1.5.2 (RC2)

[Michael Armbrust]

+1

On Fri, Nov 6, 2015 at 9:27 AM, Chester Chen  wrote:

> +1
> Test against CDH5.4.2 with hadoop 2.6.0 version using yesterday's code,
> build locally.
>
> Regression running in Yarn Cluster mode against few internal ML ( logistic
> regression, linear regression, random forest and statistic summary) as well
> Mlib KMeans. all seems to work fine.
>
> Chester
>
>
> On Tue, Nov 3, 2015 at 3:22 PM, Reynold Xin  wrote:
>
>> Please vote on releasing the following candidate as Apache Spark version
>> 1.5.2. The vote is open until Sat Nov 7, 2015 at 00:00 UTC and passes if a
>> majority of at least 3 +1 PMC votes are cast.
>>
>> [ ] +1 Release this package as Apache Spark 1.5.2
>> [ ] -1 Do not release this package because ...
>>
>>
>> The release fixes 59 known issues in Spark 1.5.1, listed here:
>> http://s.apache.org/spark-1.5.2
>>
>> The tag to be voted on is v1.5.2-rc2:
>> https://github.com/apache/spark/releases/tag/v1.5.2-rc2
>>
>> The release files, including signatures, digests, etc. can be found at:
>> http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-bin/
>>
>> Release artifacts are signed with the following key:
>> https://people.apache.org/keys/committer/pwendell.asc
>>
>> The staging repository for this release can be found at:
>> - as version 1.5.2-rc2:
>> https://repository.apache.org/content/repositories/orgapachespark-1153
>> - as version 1.5.2:
>> https://repository.apache.org/content/repositories/orgapachespark-1152
>>
>> The documentation corresponding to this release can be found at:
>> http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-docs/
>>
>>
>> ===
>> How can I help test this release?
>> ===
>> If you are a Spark user, you can help us test this release by taking an
>> existing Spark workload and running on this release candidate, then
>> reporting any regressions.
>>
>> 
>> What justifies a -1 vote for this release?
>> 
>> -1 vote should occur for regressions from Spark 1.5.1. Bugs already
>> present in 1.5.1 will not block this release.
>>
>>
>>
>

Re: [VOTE] Release Apache Spark 1.5.2 (RC2)

[Sean Owen]

Hm, if I read that right, looks like --num-executors doesn't work at
all on YARN unless dynamic allocation is on? the fix is easy, but
sounds like it could be a Blocker.

On Fri, Nov 6, 2015 at 2:51 PM, Tom Graves  wrote:
>  While running our regression tests I found
> https://issues.apache.org/jira/browse/SPARK-11555.  It is a break in
> backwards compatibility but its using the old spark-class and --num-workers
> interface which I hope no one is still using.
>
> I'm a +0 as it doesn't seem super critical but I hate to break backwards
> compatibility unless we explicitly decide to.
>
>
> Tom
>

-
To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
For additional commands, e-mail: dev-h...@spark.apache.org

Re: [VOTE] Release Apache Spark 1.5.2 (RC2)

[Marcelo Vanzin]

The way I read Tom's report, it just affects a long-deprecated command
line option (--num-workers). I wouldn't block the release for it.

On Fri, Nov 6, 2015 at 12:10 PM, Sean Owen  wrote:
> Hm, if I read that right, looks like --num-executors doesn't work at
> all on YARN unless dynamic allocation is on? the fix is easy, but
> sounds like it could be a Blocker.
>
> On Fri, Nov 6, 2015 at 2:51 PM, Tom Graves  wrote:
>>  While running our regression tests I found
>> https://issues.apache.org/jira/browse/SPARK-11555.  It is a break in
>> backwards compatibility but its using the old spark-class and --num-workers
>> interface which I hope no one is still using.
>>
>> I'm a +0 as it doesn't seem super critical but I hate to break backwards
>> compatibility unless we explicitly decide to.
>>
>>
>> Tom
>>
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
> For additional commands, e-mail: dev-h...@spark.apache.org
>



-- 
Marcelo

-
To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
For additional commands, e-mail: dev-h...@spark.apache.org

Re: [VOTE] Release Apache Spark 1.5.2 (RC2)

[Tom Graves]

Its either --num-workers or --num-executors when using the spark-class 
interface directly.  If you use spark-submit with --num-executors it ends up 
setting spark.executor.instances which works around the issue.
Tom 


 On Friday, November 6, 2015 2:14 PM, Marcelo Vanzin  
wrote:
   

 The way I read Tom's report, it just affects a long-deprecated command
line option (--num-workers). I wouldn't block the release for it.

On Fri, Nov 6, 2015 at 12:10 PM, Sean Owen  wrote:
> Hm, if I read that right, looks like --num-executors doesn't work at
> all on YARN unless dynamic allocation is on? the fix is easy, but
> sounds like it could be a Blocker.
>
> On Fri, Nov 6, 2015 at 2:51 PM, Tom Graves  wrote:
>>  While running our regression tests I found
>> https://issues.apache.org/jira/browse/SPARK-11555.  It is a break in
>> backwards compatibility but its using the old spark-class and --num-workers
>> interface which I hope no one is still using.
>>
>> I'm a +0 as it doesn't seem super critical but I hate to break backwards
>> compatibility unless we explicitly decide to.
>>
>>
>> Tom
>>
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
> For additional commands, e-mail: dev-h...@spark.apache.org
>



-- 
Marcelo

-
To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
For additional commands, e-mail: dev-h...@spark.apache.org



  

Re: [VOTE] Release Apache Spark 1.5.2 (RC2)

[Nicholas Chammas]

-0

The spark-ec2 version is still set to 1.5.1
.

Nick

On Wed, Nov 4, 2015 at 8:20 PM Egor Pahomov  wrote:

> +1
>
> Things, which our infrastructure use and I checked:
>
> Dynamic allocation
> Spark ODBC server
> Reading json
> Writing parquet
> SQL quires (hive context)
> Running on CDH
>
>
> 2015-11-04 9:03 GMT-08:00 Sean Owen :
>
>> As usual the signatures and licenses and so on look fine. I continue
>> to get the same test failures on Ubuntu in Java 7/8:
>>
>> - Unpersisting HttpBroadcast on executors only in distributed mode ***
>> FAILED ***
>>
>> But I continue to assume that's specific to tests and/or Ubuntu and/or
>> the build profile, since I don't see any evidence of this in other
>> builds on Jenkins. It's not a change from previous behavior, though it
>> doesn't always happen either.
>>
>> On Tue, Nov 3, 2015 at 11:22 PM, Reynold Xin  wrote:
>> > Please vote on releasing the following candidate as Apache Spark version
>> > 1.5.2. The vote is open until Sat Nov 7, 2015 at 00:00 UTC and passes
>> if a
>> > majority of at least 3 +1 PMC votes are cast.
>> >
>> > [ ] +1 Release this package as Apache Spark 1.5.2
>> > [ ] -1 Do not release this package because ...
>> >
>> >
>> > The release fixes 59 known issues in Spark 1.5.1, listed here:
>> > http://s.apache.org/spark-1.5.2
>> >
>> > The tag to be voted on is v1.5.2-rc2:
>> > https://github.com/apache/spark/releases/tag/v1.5.2-rc2
>> >
>> > The release files, including signatures, digests, etc. can be found at:
>> > http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-bin/
>> >
>> > Release artifacts are signed with the following key:
>> > https://people.apache.org/keys/committer/pwendell.asc
>> >
>> > The staging repository for this release can be found at:
>> > - as version 1.5.2-rc2:
>> > https://repository.apache.org/content/repositories/orgapachespark-1153
>> > - as version 1.5.2:
>> > https://repository.apache.org/content/repositories/orgapachespark-1152
>> >
>> > The documentation corresponding to this release can be found at:
>> > http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-docs/
>> >
>> >
>> > ===
>> > How can I help test this release?
>> > ===
>> > If you are a Spark user, you can help us test this release by taking an
>> > existing Spark workload and running on this release candidate, then
>> > reporting any regressions.
>> >
>> > 
>> > What justifies a -1 vote for this release?
>> > 
>> > -1 vote should occur for regressions from Spark 1.5.1. Bugs already
>> present
>> > in 1.5.1 will not block this release.
>> >
>> >
>>
>> -
>> To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
>> For additional commands, e-mail: dev-h...@spark.apache.org
>>
>>
>
>
> --
>
> *Sincerely yoursEgor Pakhomov, *
>
> *AnchorFree*
>
>

Re: [VOTE] Release Apache Spark 1.5.2 (RC2)

[Egor Pahomov]

+1

Things, which our infrastructure use and I checked:

Dynamic allocation
Spark ODBC server
Reading json
Writing parquet
SQL quires (hive context)
Running on CDH


2015-11-04 9:03 GMT-08:00 Sean Owen :

> As usual the signatures and licenses and so on look fine. I continue
> to get the same test failures on Ubuntu in Java 7/8:
>
> - Unpersisting HttpBroadcast on executors only in distributed mode ***
> FAILED ***
>
> But I continue to assume that's specific to tests and/or Ubuntu and/or
> the build profile, since I don't see any evidence of this in other
> builds on Jenkins. It's not a change from previous behavior, though it
> doesn't always happen either.
>
> On Tue, Nov 3, 2015 at 11:22 PM, Reynold Xin  wrote:
> > Please vote on releasing the following candidate as Apache Spark version
> > 1.5.2. The vote is open until Sat Nov 7, 2015 at 00:00 UTC and passes if
> a
> > majority of at least 3 +1 PMC votes are cast.
> >
> > [ ] +1 Release this package as Apache Spark 1.5.2
> > [ ] -1 Do not release this package because ...
> >
> >
> > The release fixes 59 known issues in Spark 1.5.1, listed here:
> > http://s.apache.org/spark-1.5.2
> >
> > The tag to be voted on is v1.5.2-rc2:
> > https://github.com/apache/spark/releases/tag/v1.5.2-rc2
> >
> > The release files, including signatures, digests, etc. can be found at:
> > http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-bin/
> >
> > Release artifacts are signed with the following key:
> > https://people.apache.org/keys/committer/pwendell.asc
> >
> > The staging repository for this release can be found at:
> > - as version 1.5.2-rc2:
> > https://repository.apache.org/content/repositories/orgapachespark-1153
> > - as version 1.5.2:
> > https://repository.apache.org/content/repositories/orgapachespark-1152
> >
> > The documentation corresponding to this release can be found at:
> > http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-docs/
> >
> >
> > ===
> > How can I help test this release?
> > ===
> > If you are a Spark user, you can help us test this release by taking an
> > existing Spark workload and running on this release candidate, then
> > reporting any regressions.
> >
> > 
> > What justifies a -1 vote for this release?
> > 
> > -1 vote should occur for regressions from Spark 1.5.1. Bugs already
> present
> > in 1.5.1 will not block this release.
> >
> >
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
> For additional commands, e-mail: dev-h...@spark.apache.org
>
>


-- 

*Sincerely yoursEgor Pakhomov, *

*AnchorFree*

Re: [VOTE] Release Apache Spark 1.5.2 (RC2)

[Jean-Baptiste Onofré]

+1 (non binding)

Just tested with some snippets on my side.

Regards
JB

On 11/04/2015 12:22 AM, Reynold Xin wrote:

Please vote on releasing the following candidate as Apache Spark version
1.5.2. The vote is open until Sat Nov 7, 2015 at 00:00 UTC and passes if
a majority of at least 3 +1 PMC votes are cast.

[ ] +1 Release this package as Apache Spark 1.5.2
[ ] -1 Do not release this package because ...


The release fixes 59 known issues in Spark 1.5.1, listed here:
http://s.apache.org/spark-1.5.2

The tag to be voted on is v1.5.2-rc2:
https://github.com/apache/spark/releases/tag/v1.5.2-rc2

The release files, including signatures, digests, etc. can be found at:
http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-bin/

Release artifacts are signed with the following key:
https://people.apache.org/keys/committer/pwendell.asc

The staging repository for this release can be found at:
- as version 1.5.2-rc2:
https://repository.apache.org/content/repositories/orgapachespark-1153
- as version 1.5.2:
https://repository.apache.org/content/repositories/orgapachespark-1152

The documentation corresponding to this release can be found at:
http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-docs/


===
How can I help test this release?
===
If you are a Spark user, you can help us test this release by taking an
existing Spark workload and running on this release candidate, then
reporting any regressions.


What justifies a -1 vote for this release?

-1 vote should occur for regressions from Spark 1.5.1. Bugs already
present in 1.5.1 will not block this release.




--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com

-
To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
For additional commands, e-mail: dev-h...@spark.apache.org

[VOTE] Release Apache Spark 1.5.2 (RC2)

[Reynold Xin]

Please vote on releasing the following candidate as Apache Spark version
1.5.2. The vote is open until Sat Nov 7, 2015 at 00:00 UTC and passes if a
majority of at least 3 +1 PMC votes are cast.

[ ] +1 Release this package as Apache Spark 1.5.2
[ ] -1 Do not release this package because ...


The release fixes 59 known issues in Spark 1.5.1, listed here:
http://s.apache.org/spark-1.5.2

The tag to be voted on is v1.5.2-rc2:
https://github.com/apache/spark/releases/tag/v1.5.2-rc2

The release files, including signatures, digests, etc. can be found at:
http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-bin/

Release artifacts are signed with the following key:
https://people.apache.org/keys/committer/pwendell.asc

The staging repository for this release can be found at:
- as version 1.5.2-rc2:
https://repository.apache.org/content/repositories/orgapachespark-1153
- as version 1.5.2:
https://repository.apache.org/content/repositories/orgapachespark-1152

The documentation corresponding to this release can be found at:
http://people.apache.org/~pwendell/spark-releases/spark-1.5.2-rc2-docs/


===
How can I help test this release?
===
If you are a Spark user, you can help us test this release by taking an
existing Spark workload and running on this release candidate, then
reporting any regressions.


What justifies a -1 vote for this release?

-1 vote should occur for regressions from Spark 1.5.1. Bugs already present
in 1.5.1 will not block this release.