just to clarify are you talking about databricks csv package. $SPARK_HOME/bin/spark-shell --packages com.databricks:spark-csv_2.11:1.3.0
Where are these zipped files? Are they copied to a staging directory in hdfs? HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* http://talebzadehmich.wordpress.com On 30 March 2016 at 15:17, Benjamin Kim <bbuil...@gmail.com> wrote: > I have a quick question. I have downloaded multiple zipped files from S3 > and unzipped each one of them into strings. The next step is to parse using > a CSV parser. I want to know if there is a way to easily use the spark csv > package for this? > > Thanks, > Ben > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
