krishna-prasad-s opened a new issue, #7564:
URL: https://github.com/apache/arrow-datafusion/issues/7564
### Describe the bug
I'm trying to read an pre-existing delta table (using delta-rs as the
TableProvider) .
when I do `self.ctx.read_table(table).unwrap();` I get a dataframe where a
timestamp field is `data_type: Timestamp(Microsecond, None)`.
Now I collect recordbatches by `df.collect().await;` here when I inspect the
schema of a record batch I see that the datatype for the field has changed to
`data_type: Timestamp(Nanosecond, None)`
When I use the DeltaTable writer (from delta.rs) its comparing doing a diff
of the arrow schema's between the table and the recordbatch and this shows a
mistmatch. the only difference was this and the write fails.
### To Reproduce
1. Create an deltatable (not using datafusion)
2. open it using deltafusion and collect the dataframe
3. compare the schema between the delta table and record bactch.
4
### Expected behavior
The recordbatch schema should be `data_type: Timestamp(Microsecond, None)`.
### Additional context
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
