[jira] [Updated] (SPARK-5109) Loading multiple parquet files into a single SchemaRDD
[ https://issues.apache.org/jira/browse/SPARK-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5109: - Assignee: Michael Armbrust > Loading multiple parquet files into a single SchemaRDD > -- > > Key: SPARK-5109 > URL: https://issues.apache.org/jira/browse/SPARK-5109 > Project: Spark > Issue Type: New Feature > Components: SQL >Reporter: Sam Steingold >Assignee: Michael Armbrust > Fix For: 1.5.0 > > > {{[SQLContext.parquetFile(String)|http://spark.apache.org/docs/1.2.0/api/java/org/apache/spark/sql/SQLContext.html#parquetFile%28java.lang.String%29]}} > accepts a comma-separated list of files to load. > This feature prevents files with commas in its name (a rare use case, > admittedly), it is also an _extremely_ unusual feature. > This feature should be deprecated and new methods > {code} > SQLContext.parquetFile(String[]) > SQLContext.parquetFile(List) > {code} > should be added instead. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-5109) Loading multiple parquet files into a single SchemaRDD
[ https://issues.apache.org/jira/browse/SPARK-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5109: - Component/s: SQL > Loading multiple parquet files into a single SchemaRDD > -- > > Key: SPARK-5109 > URL: https://issues.apache.org/jira/browse/SPARK-5109 > Project: Spark > Issue Type: New Feature > Components: SQL >Reporter: Sam Steingold > > {{[SQLContext.parquetFile(String)|http://spark.apache.org/docs/1.2.0/api/java/org/apache/spark/sql/SQLContext.html#parquetFile%28java.lang.String%29]}} > accepts a comma-separated list of files to load. > This feature prevents files with commas in its name (a rare use case, > admittedly), it is also an _extremely_ unusual feature. > This feature should be deprecated and new methods > {code} > SQLContext.parquetFile(String[]) > SQLContext.parquetFile(List) > {code} > should be added instead. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-5109) Loading multiple parquet files into a single SchemaRDD
[ https://issues.apache.org/jira/browse/SPARK-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Steingold updated SPARK-5109: - Summary: Loading multiple parquet files into a single SchemaRDD (was: Loading multiple parquet files into a single SQL table) > Loading multiple parquet files into a single SchemaRDD > -- > > Key: SPARK-5109 > URL: https://issues.apache.org/jira/browse/SPARK-5109 > Project: Spark > Issue Type: New Feature >Reporter: Sam Steingold > > {{[SQLContext.parquetFile(String)|http://spark.apache.org/docs/1.2.0/api/java/org/apache/spark/sql/SQLContext.html#parquetFile%28java.lang.String%29]}} > accepts a comma-separated list of files to load. > This feature prevents files with commas in its name (a rare use case, > admittedly), it is also an _extremely_ unusual feature. > This feature should be deprecated and new methods > {code} > SQLContext.parquetFile(String[]) > SQLContext.parquetFile(List) > {code} > should be added instead. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org