Littlestar created SPARK-6151:
---------------------------------
Summary: schemaRDD to parquetfile with saveAsParquetFile control
the HDFS block size
Key: SPARK-6151
URL: https://issues.apache.org/jira/browse/SPARK-6151
Project: Spark
Issue Type: Improvement
Affects Versions: 1.2.1
Reporter: Littlestar
Priority: Trivial
How schemaRDD to parquetfile with saveAsParquetFile control the HDFS block
size. may be Configuration need.
related question by others.
http://apache-spark-user-list.1001560.n3.nabble.com/HDFS-block-size-for-parquet-output-tt21183.html
http://qnalist.com/questions/5054892/spark-sql-parquet-and-impala
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
