[
https://issues.apache.org/jira/browse/BIGTOP-1648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14312728#comment-14312728
]
jay vyas edited comment on BIGTOP-1648 at 2/9/15 8:11 PM:
----------------------------------------------------------
(UPDATE) thanks young woo. +1 .. builds cleanly, although I didn't test a
live spark deploy with it, im sure we will get around to that quite soon!
- we need to update puppet recipes to reflect this.
- init-hdfs.sh is deprecated, so changes also should go in init-hcfs.json as
well, even though its good to have updates in init-hdfs.sh as well for current
bigtop (which still uses it).
- code looks solid, tested
[~warwithin] before i commit, *Can you create a follow up jira* which guides
us with regard to how the new puppet recipes shall work with the details above
(i.e. the hdfs setup steps, the order of rpm dependencies to specify in the
puppet manifest, etc).
*Then, I will promptly commit this patch.* and we can go on to finishing off
1.2 integration into the puppet recipes.
{noformat}
home/apache/Development/bigtop-jayunit100/build/spark/rpm/RPMS/noarch/spark-core-1.2.0-1.fc20.noarch.rpm
home/apache/Development/bigtop-jayunit100/build/spark/rpm/RPMS/noarch/spark-master-1.2.0-1.fc20.noarch.rpm
home/apache/Development/bigtop-jayunit100/build/spark/rpm/RPMS/noarch/spark-worker-1.2.0-1.fc20.noarch.rpm
home/apache/Development/bigtop-jayunit100/build/spark/rpm/RPMS/noarch/spark-python-1.2.0-1.fc20.noarch.rpm
home/apache/Development/bigtop-jayunit100/build/spark/rpm/RPMS/noarch/spark-history-server-1.2.0-1.fc20.noarch.rpm
home/apache/Development/bigtop-jayunit100/build/spark/rpm/RPMS/noarch/spark-thriftserver-1.2.0-1.fc20.noarch.rpm
{noformat}
was (Author: jayunit100):
(UPDATE) thanks young woo. +1 .. builds cleanly, although I didn't test a
live spark deploy with it, im sure we will get around to that quite soon!
- we need to update puppet recipes to reflect this.
- init-hdfs.sh is deprecated, so changes also should go in init-hcfs.json as
well, even though its good to have updates in init-hdfs.sh as well for current
bigtop (which still uses it).
- code looks solid, tested
[~warwithin] Can you create a follow up jira which guides us with regard to how
the new puppet recipes shall work with the details above (i.e. the hdfs setup
steps, the order of rpm dependencies to specify in the puppet manifest, etc).
*Then, I will promptly commit this patch.* and we can go on to finishing off
1.2 integration into the puppet recipes.
{noformat}
home/apache/Development/bigtop-jayunit100/build/spark/rpm/RPMS/noarch/spark-core-1.2.0-1.fc20.noarch.rpm
home/apache/Development/bigtop-jayunit100/build/spark/rpm/RPMS/noarch/spark-master-1.2.0-1.fc20.noarch.rpm
home/apache/Development/bigtop-jayunit100/build/spark/rpm/RPMS/noarch/spark-worker-1.2.0-1.fc20.noarch.rpm
home/apache/Development/bigtop-jayunit100/build/spark/rpm/RPMS/noarch/spark-python-1.2.0-1.fc20.noarch.rpm
home/apache/Development/bigtop-jayunit100/build/spark/rpm/RPMS/noarch/spark-history-server-1.2.0-1.fc20.noarch.rpm
home/apache/Development/bigtop-jayunit100/build/spark/rpm/RPMS/noarch/spark-thriftserver-1.2.0-1.fc20.noarch.rpm
{noformat}
> Update to Spark 1x to Spark 1.2
> -------------------------------
>
> Key: BIGTOP-1648
> URL: https://issues.apache.org/jira/browse/BIGTOP-1648
> Project: Bigtop
> Issue Type: Task
> Components: spark
> Affects Versions: 0.8.0
> Reporter: jay vyas
> Assignee: YoungWoo Kim
> Fix For: 0.9.0
>
> Attachments: BIGTOP-1648.1.patch, BIGTOP-1648.2.patch
>
>
> Time to update spark ? Looks like 1.2 is out. I don't see much value in
> lagging behind . Tons of improvements in 1.2, for pyspark, machine
> learning, and performance
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
