[
https://issues.apache.org/jira/browse/BIGTOP-1648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14312728#comment-14312728
]
jay vyas edited comment on BIGTOP-1648 at 2/9/15 8:10 PM:
----------------------------------------------------------
(UPDATE) thanks young woo. +1 .. builds cleanly, although I didn't test a
live spark deploy with it, im sure we will get around to that quite soon!
- we need to update puppet recipes to reflect this.
- init-hdfs.sh is deprecated, so changes also should go in init-hcfs.json as
well, even though its good to have updates in init-hdfs.sh as well for current
bigtop (which still uses it).
- code looks solid, tested
[~warwithin] Can you create a follow up jira which guides us with regard to how
the new puppet recipes shall work with the details above (i.e. the hdfs setup
steps, the order of rpm dependencies to specify in the puppet manifest, etc).
Then, I will promptly commit this patch.
{noformat}
home/apache/Development/bigtop-jayunit100/build/spark/rpm/RPMS/noarch/spark-core-1.2.0-1.fc20.noarch.rpm
home/apache/Development/bigtop-jayunit100/build/spark/rpm/RPMS/noarch/spark-master-1.2.0-1.fc20.noarch.rpm
home/apache/Development/bigtop-jayunit100/build/spark/rpm/RPMS/noarch/spark-worker-1.2.0-1.fc20.noarch.rpm
home/apache/Development/bigtop-jayunit100/build/spark/rpm/RPMS/noarch/spark-python-1.2.0-1.fc20.noarch.rpm
home/apache/Development/bigtop-jayunit100/build/spark/rpm/RPMS/noarch/spark-history-server-1.2.0-1.fc20.noarch.rpm
home/apache/Development/bigtop-jayunit100/build/spark/rpm/RPMS/noarch/spark-thriftserver-1.2.0-1.fc20.noarch.rpm
{noformat}
was (Author: jayunit100):
thanks young woo.
- we need to update puppet recipes to reflect this.
- init-hdfs.sh is deprecated, so changes also should go in init-hcfs.json
- code looks solid, testing it now... will let you know if it works !
> Update to Spark 1x to Spark 1.2
> -------------------------------
>
> Key: BIGTOP-1648
> URL: https://issues.apache.org/jira/browse/BIGTOP-1648
> Project: Bigtop
> Issue Type: Task
> Components: spark
> Affects Versions: 0.8.0
> Reporter: jay vyas
> Assignee: YoungWoo Kim
> Fix For: 0.9.0
>
> Attachments: BIGTOP-1648.1.patch, BIGTOP-1648.2.patch
>
>
> Time to update spark ? Looks like 1.2 is out. I don't see much value in
> lagging behind . Tons of improvements in 1.2, for pyspark, machine
> learning, and performance
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
