Re: Spark2 with YARN

2018-05-25 Thread Miller, Clifford
<clifford.mil...@phoenix-opsgroup.com> >> <clifford.mil...@phoenix-opsgroup.com> >> Reply: user@predictionio.apache.org <user@predictionio.apache.org> >> <user@predictionio.apache.org> >> Date: May 24, 2018 at 4:16:58 PM >> To: user@predictionio.ap

Re: Spark2 with YARN

2018-05-24 Thread Jeff Zhang
edictionio.apache.org> > Date: May 24, 2018 at 4:16:58 PM > To: user@predictionio.apache.org <user@predictionio.apache.org> > <user@predictionio.apache.org> > Subject: Spark2 with YARN > > I've setup a cluster using Hortonworks HDP with Ambari all runni

Re: Spark2 with YARN

2018-05-24 Thread Pat Ferrel
Reply: user@predictionio.apache.org <user@predictionio.apache.org> <user@predictionio.apache.org> Date: May 24, 2018 at 4:16:58 PM To: user@predictionio.apache.org <user@predictionio.apache.org> <user@predictionio.apache.org> Subject: Spark2 with YARN I've setup a cluster using Hortonwork

Spark2 with YARN

2018-05-24 Thread Miller, Clifford
I've setup a cluster using Hortonworks HDP with Ambari all running in AWS. I then created a separate EC2 instance and installed PIO 0.12.1, hadoop, elasticsearch, hbase, and spark2. I copied the configurations from the HDP cluster and then pio-start-all. The pio-start-all completes successfully