Re: Converting binary files

2018-01-02 Thread Lalwani, Jayesh
: Christopher Piggott <cpigg...@gmail.com> Date: Saturday, December 30, 2017 at 3:45 PM To: "user@spark.apache.org" <user@spark.apache.org> Subject: Converting binary files I have been searching for examples, but not finding exactly what I need. I am looking for the paradi

Converting binary files

2017-12-30 Thread Christopher Piggott
I have been searching for examples, but not finding exactly what I need. I am looking for the paradigm for using spark 2.2 to convert a bunch of binary files into a bunch of different binary files. I'm starting with: val files = spark.sparkContext.binaryFiles("hdfs://1.2.3.4/input") then