alamb opened a new pull request #9936:
URL: https://github.com/apache/arrow/pull/9936
# Rationale
Running the query `CREATE EXTERNAL TABLE .. (c TIMESTAMP)` today in
DataFusion will result in a data type pf "Date64" which means that anything
more specific than the date will be ignored.
This leads to strange behavior such as
```shell
echo "Jorge,2018-12-13T12:12:10.011" >> /tmp/foo.csv
echo "Andrew,2018-11-13T17:11:10.011" > /tmp/foo.csv
cargo run -p datafusion --bin datafusion-cli
Finished dev [unoptimized + debuginfo] target(s) in 0.23s
Running `target/debug/datafusion-cli`
> CREATE EXTERNAL TABLE t(a varchar, b TIMESTAMP)
STORED AS CSV
LOCATION '/tmp/foo.csv';
0 rows in set. Query took 0 seconds.
> select * from t;
+--------+------------+
| a | b |
+--------+------------+
| Andrew | 2018-11-13 |
| Jorge | 2018-12-13 |
+--------+------------+
```
(note that the Time part is chopped off)
# Changes
This PR changes the default mapping from SQL type `TIMESTAMP`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
