https://hadoop.apache.org/docs/r2.7.1/api/org/apache/hadoop/fs/FileUtil.html#fullyDelete(java.io.File)
On Tue, Jul 26, 2016 at 12:09 PM, Divya Gehlot <divya.htco...@gmail.com>
wrote:
> Resending to right list
> ---------- Forwarded message ----------
> From: "Divya Gehlot" <divya.htco...@gmail.com>
> Date: Jul 26, 2016 6:51 PM
> Subject: FileUtil.fullyDelete does ?
> To: "user @spark" <u...@spark.apache.org>
> Cc:
>
> Hi,
> When I am doing the using theFileUtil.copymerge function
>
> val file = "/tmp/primaryTypes.csv"
>
> FileUtil.fullyDelete(new File(file))
>
> val destinationFile= "/tmp/singlePrimaryTypes.csv"
>
> FileUtil.fullyDelete(new File(destinationFile))
>
> val counts = partitions.
>
> reduceByKey {case (x,y) => x + y}.
>
> sortBy {case (key, value) => -value}.
>
> map { case (key, value) => Array(key, value).mkString(",") }
>
> counts.saveAsTextFile(file)
>
> merge(file, destinationFile)
>
>
> I am wondering here what does FileUtil.fullyDelete(new
> File(destinationFile)) do ?
>
> does it delete the merged file ....If yes,then how will we access the
> merged file ..?
>
>
> Confused here ...
>
>
>
> Thanks,
>
> Divya
>
>
>
