donghekang opened a new issue, #13268: URL: https://github.com/apache/arrow/issues/13268
Hi all, I am trying to execute an example Substrait plan in Arrow. The example plan is shown as the following. We define a filter operator to compare an attribute with one constant value 1. The operator uses the `gt` function defined in https://github.com/substrait-io/substrait/blob/main/extensions/functions_comparison.yaml. However, it looks like Arrow does not implement the first-class functions defined in Substrait. Arrow reports **Uri 'https://github.com/substrait-io/substrait/blob/main/extensions/functions_comparison.yaml' not found in registry** when I execute the plan. I use the Arrow release-8.0.0. I am curious how to describe the `gt` funciton in the Substrait message that can be consumed by Arrow. Thanks in advance! > { > "extensionUris": [ > { > "extensionUriAnchor": 7, > "uri": "https://github.com/substrait-io/substrait/blob/main/extensions/functions_comparison.yaml"; > } > ], > "extensions": [ > { > "extensionFunction": { > "extensionUriReference": 7, > "functionAnchor": 42, > "name": "gt" > } > } > ], > "relations": [ > { > "rel": { > "filter": { > "input": { > "read": { > "baseSchema": { > "names": [ > "i", > "b" > ], > "struct": { > "types": [ > { > "i64": {} > }, > { > "bool": {} > } > ] > } > }, > "localFiles": { > "items": [ > { > "uriFile": "file:///home/daniel/20220512-arrow-substrait-example/example.parquet", > "format": "FILE_FORMAT_PARQUET" > } > ] > } > } > }, > "condition": { > "scalarFunction": { > "functionReference": 42, > "args": [ > { > "selection": { > "directReference": { > "structField": {} > }, > "rootReference": {} > } > }, > { > "literal": { > "i64": "1" > } > } > ], > "outputType": { > "bool": { > "nullability": "NULLABILITY_REQUIRED" > } > } > } > } > } > } > } > ] > } -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
