Sandish Kumar HN has uploaded a new change for review.
http://gerrit.cloudera.org:8080/7420
Change subject: kudu-spark-tools: Spark tool for Import & Export
different format of files such as parquet,avro,csv in and to from kudu tables
example: Import: spark-submit --class
org.apache.kudu.spark.tools.ImportExportFiles --master local[*]
kudu-spark-tools/ta
......................................................................
kudu-spark-tools:
Spark tool for Import & Export different format of files such as
parquet,avro,csv in and to from kudu tables
example:
Import:
spark-submit --class
org.apache.kudu.spark.tools.ImportExportFiles --master local[*]
kudu-spark-tools/target/kudu-spark-tools-1.5.0-SNAPSHOT.jar --operation=import
--format=parquet --master-addrs=<hostname>:7051 --path=/data/orders_parquet
--table-name=orders3
Export:
spark-submit --class
org.apache.kudu.spark.tools.ImportExportFiles --master local[*]
kudu-spark-tools/target/kudu-spark-tools-1.5.0-SNAPSHOT.jar --operation=export
--format=parquet --master-addrs=<hostname>:7051 --path=/data/orders_parquet
--table-name=orders3 --columns="order_id,order_date"
kudu-client-tools:
mapreduced base export to csv and import parquet files.
Change-Id: I2d5aa336ac57c309680fe45b61be302e643f291b
---
A
java/kudu-client-tools/src/main/java/org/apache/kudu/mapreduce/tools/ExportCsv.java
A
java/kudu-client-tools/src/main/java/org/apache/kudu/mapreduce/tools/ExportCsvMapper.java
A
java/kudu-client-tools/src/main/java/org/apache/kudu/mapreduce/tools/ImportParquet.java
A
java/kudu-client-tools/src/main/java/org/apache/kudu/mapreduce/tools/ImportParquetMapper.java
A
java/kudu-client-tools/src/main/java/org/apache/kudu/mapreduce/tools/ParquetReadSupport.java
A
java/kudu-spark-tools/src/main/scala/org/apache/kudu/spark/tools/ImportExportFiles.scala
6 files changed, 658 insertions(+), 0 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/20/7420/1
--
To view, visit http://gerrit.cloudera.org:8080/7420
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-MessageType: newchange
Gerrit-Change-Id: I2d5aa336ac57c309680fe45b61be302e643f291b
Gerrit-PatchSet: 1
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-Owner: Sandish Kumar HN <[email protected]>
