Re: Missing output partition file in S3

2016-09-16 Thread Tracy Li
Sent from my iPhone > On Sep 15, 2016, at 1:37 PM, Chen, Kevin wrote: > > Hi, > > Has any one encountered an issue of missing output partition file in S3 ? My > spark job writes output to a S3 location. Occasionally, I noticed one > partition file is missing. As a

Rest API for spark

2016-02-10 Thread Tracy Li
Hi Spark Experts, I am new for spark and we have requirements to support spark job, jar, sql etc(submit, manage). So far I did not find any rest API bundled by spark. there have some third party lib already supported: https://github.com/spark-jobserver/spark-jobserver I want to confirm, is

Re: Rest API for spark

2016-02-10 Thread Tracy Li
ubmission+REST+API > > On Wed, Feb 10, 2016 at 3:37 PM, Tracy Li <tibcotr...@gmail.com> wrote: > >> Hi Spark Experts, >> >> I am new for spark and we have requirements to support spark job, jar, >> sql etc(submit, manage). >> >> So far I did not f