Github user peterableda commented on the pull request:
https://github.com/apache/spark/pull/11312#issuecomment-189619833
Conceptually this is how Hive works:
Create a simple Hive table definition for a `test` table for the location
`/data/`
```
CREATE EXTERNAL TABLE test (a string, b string)
PARTITIONED BY (timestamp STRING)
ROW FORMAT DELIMITED
FIELDS TERMINATED BY ','
STORED AS TEXTFILE
LOCATION '/data/';
```
Create a file in the `/data/timestamp=1455894364000/` partition folder with
the following content
```
this,is
test,data
```
When you try to query this hive table `select * from test` you will get the
following data
```
1455894364000,this,is
1455894364000,test,data
```
My problem is that currently you can't create the partitions above because
of that fixed dash between the prefix and the timestamp.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
