Re: Re: Can we redirect Spark shuffle spill data to HDFS or Alluxio?

@tendcloud.com From: Sun Rui Date: 2016-08-24 22:17 To: Saisai Shao CC: tony@tendcloud.com; user Subject: Re: Can we redirect Spark shuffle spill data to HDFS or Alluxio? Yes, I also tried FUSE before, it is not stable and I don’t recommend it On Aug 24, 2016, at 22:15, Saisai Shao wrote

Can we redirect Spark shuffle spill data to HDFS or Alluxio?

data to HDFS? Or if we introduce alluxio in our system, can the shuffled data write to alluxio? Thanks and Regards, 阎志涛(Tony) 北京腾云天下科技有限公司 邮箱：tony@tendcloud.com 电话：13911815695 微信

Re: Re: Is there a way to submit spark job to your by YARN REST API?

邮箱：tony@tendcloud.com 电话：13911815695 微信： zhitao_yan QQ ： 4707059 地址：北京市东城区东直门外大街39号院2号楼航空服务大厦602室 邮编：100027 TalkingData.com - 让数据说话

Is there a way to submit spark job to your by YARN REST API?

Spark API which can support that? If no, is there any third party solutions for that? Thanks and Regards, 阎志涛(Tony) 北京腾云天下科技有限公司 邮箱：tony@tendcloud.com 电话：13911815695 微信： zhitao_yan QQ