kyle-mccarthy commented on issue #6155:
URL:
https://github.com/apache/arrow-datafusion/issues/6155#issuecomment-1530734850
@Weijun-H can you confirm that you ran the this, rather than the working
one? I am using the latest release so it should reproduce.
```rust
let ctx = SessionContext::new();
let df = ctx
.sql(
r#"
WITH cte AS (
SELECT now() AS dt
)
SELECT now() - cte.dt FROM cte
"#,
)
.await
.unwrap();
```
Also @alamb I think that you are right. I did take a look at solving this
and hoped that it would be as simple as providing an [inverse for this match
arm](https://github.com/apache/arrow-datafusion/blob/6e8f91b41a6ec6a2680357b95b2489d87af33571/datafusion/physical-expr/src/expressions/datetime.rs#L120-L122),
but I think some amount of refactoring may be required.
Currently, all the temporal compute related functions ([^1] [^2] [^3] [^4])
in the physical-expr crate expect LHS to be an array and the RHS to be a
scalar. AFAIK, this makes sense for every operation expect for when both the
LHS and RHS data types are timestamps (since it doesn't make sense to try and
subtract timestamps from intervals).
My initial inclination is to create an enum (TemporalValue) that has
variants for the ArrayRef and ScalarValue and then update all the logic to
accept the TemporalValue enum. Using an enum instead would require a decent
amount of changes to the binary.rs and kernal_arrows.rs files in the
expressions module.
Is there a better way to do this? It looks like most compute related thing
expect that the LHS is the array and that the RHS is the scalar. I figure that
this is because most math operations where order matter can be rewritten?
[^1]:
https://github.com/apache/arrow-datafusion/blob/6e8f91b41a6ec6a2680357b95b2489d87af33571/datafusion/physical-expr/src/expressions/binary.rs#L1331-L1335
[^2]:
https://github.com/apache/arrow-datafusion/blob/6e8f91b41a6ec6a2680357b95b2489d87af33571/datafusion/physical-expr/src/expressions/binary/kernels_arrow.rs#L316-L319
[^3]:
https://github.com/apache/arrow-datafusion/blob/6e8f91b41a6ec6a2680357b95b2489d87af33571/datafusion/physical-expr/src/expressions/binary/kernels_arrow.rs#L381-L384
[^4]:
https://github.com/apache/arrow-datafusion/blob/6e8f91b41a6ec6a2680357b95b2489d87af33571/datafusion/physical-expr/src/expressions/binary.rs#L1348
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
