andygrove commented on issue #326:
URL:
https://github.com/apache/arrow-datafusion-python/issues/326#issuecomment-1512174837
Thanks for reporting the issue @djouallah.
@jdye64 It looks like this is caused by the recently added substrait
support.
I don't know if I am understanding this correctly, but it looks like pip
needs to install from source so that it can run the protobuf generator? I tried
installing cargo and then running the pip install, only yo have it fail on
building substrait.
Perhaps we need to make substrait an optional feature and disable it by
default?
```
error: failed to run custom build command for `substrait v0.7.3`
Caused by:
process didn't exit successfully:
`/tmp/pip-install-n_xze057/datafusion_ef3a5d084481447fa83b8d0bc8c34835/target/release/build/substrait-271e99487088f84f/build-script-build`
(exit status: 1)
--- stdout
cargo:rerun-if-env-changed=FORCE_REBUILD
cargo:rerun-if-changed=.git/modules/substrait/HEAD
cargo:rerun-if-changed=substrait
cargo:rerun-if-changed=substrait/text/simple_extensions_schema.yaml
cargo:rerun-if-changed=substrait/proto/substrait/plan.proto
cargo:rerun-if-changed=substrait/proto/substrait/type.proto
cargo:rerun-if-changed=substrait/proto/substrait/capabilities.proto
cargo:rerun-if-changed=substrait/proto/substrait/function.proto
cargo:rerun-if-changed=substrait/proto/substrait/algebra.proto
cargo:rerun-if-changed=substrait/proto/substrait/extensions/extensions.proto
cargo:rerun-if-changed=substrait/proto/substrait/extended_expression.proto
cargo:rerun-if-changed=substrait/proto/substrait/type_expressions.proto
cargo:rerun-if-changed=substrait/proto/substrait/parameterized_types.proto
--- stderr
Error: Custom { kind: Other, error: "protoc failed:
google/protobuf/any.proto: File not
found.\nsubstrait/extensions/extensions.proto: Import
\"google/protobuf/any.proto\" was not found or had
errors.\nsubstrait/extensions/extensions.proto:77:3: \"google.protobuf.Any\" is
not defined.\nsubstrait/extensions/extensions.proto:80:3:
\"google.protobuf.Any\" is not defined.\ngoogle/protobuf/empty.proto: File not
found.\nsubstrait/type.proto: Import \"google/protobuf/empty.proto\" was not
found or had errors.\nsubstrait/type.proto:192:7: \"google.protobuf.Empty\" is
not defined.\nsubstrait/algebra.proto: Import \"google/protobuf/any.proto\" was
not found or had errors.\nsubstrait/algebra.proto: Import
\"substrait/extensions/extensions.proto\" was not found or had
errors.\nsubstrait/algebra.proto: Import \"substrait/type.proto\" was not found
or had errors.\nsubstrait/algebra.proto:46:7:
\"substrait.extensions.AdvancedExtension\" is not
defined.\nsubstrait/algebra.proto:52:7: \"substr
ait.extensions.AdvancedExtension\" is not
defined.\nsubstrait/algebra.proto:40:5:
\"substrait.extensions.AdvancedExtension\" is not
defined.\nsubstrait/algebra.proto:25:3:
\"substrait.extensions.AdvancedExtension\" is not
defined.\nsubstrait/algebra.proto:78:5:
\"substrait.extensions.AdvancedExtension\" is not
defined.\nsubstrait/algebra.proto:89:5: \"google.protobuf.Any\" is not
defined.\nsubstrait/algebra.proto:140:9: \"google.protobuf.Any\" is not
defined.\nsubstrait/algebra.proto:95:5:
\"substrait.extensions.AdvancedExtension\" is not
defined.\nsubstrait/algebra.proto:60:3: \"NamedStruct\" is not
defined.\nsubstrait/algebra.proto:64:3:
\"substrait.extensions.AdvancedExtension\" is not
defined.\nsubstrait/algebra.proto:152:3:
\"substrait.extensions.AdvancedExtension\" is not
defined.\nsubstrait/algebra.proto:178:3:
\"substrait.extensions.AdvancedExtension\" is not
defined.\nsubstrait/algebra.proto:187:3:
\"substrait.extensions.AdvancedExtension\" is not defined.\nsubstrait/algebr
a.proto:198:3: \"substrait.extensions.AdvancedExtension\" is not
defined.\nsubstrait/algebra.proto:214:3:
\"substrait.extensions.AdvancedExtension\" is not
defined.\nsubstrait/algebra.proto:236:3:
\"substrait.extensions.AdvancedExtension\" is not
defined.\nsubstrait/algebra.proto:244:3:
\"substrait.extensions.AdvancedExtension\" is not
defined.\nsubstrait/algebra.proto:254:3:
\"substrait.extensions.AdvancedExtension\" is not
defined.\nsubstrait/algebra.proto:271:3: \"google.protobuf.Any\" is not
defined.\nsubstrait/algebra.proto:277:3: \"google.protobuf.Any\" is not
defined.\nsubstrait/algebra.proto:284:3: \"google.protobuf.Any\" is not
defined.\nsubstrait/algebra.proto:338:7: \"google.protobuf.Any\" is not
defined.\nsubstrait/algebra.proto:303:3:
\"substrait.extensions.AdvancedExtension\" is not
defined.\nsubstrait/algebra.proto:380:3:
\"substrait.extensions.AdvancedExtension\" is not
defined.\nsubstrait/algebra.proto:386:3: \"google.protobuf.Any\" is not
defined.\nsubstrait/algebr
a.proto:397:3: \"NamedStruct\" is not defined.\nsubstrait/algebra.proto:447:3:
\"NamedStruct\" is not defined.\nsubstrait/algebra.proto:510:3:
\"substrait.extensions.AdvancedExtension\" is not
defined.\nsubstrait/algebra.proto:537:3:
\"substrait.extensions.AdvancedExtension\" is not
defined.\nsubstrait/algebra.proto:544:5: \"Type\" is not
defined.\nsubstrait/algebra.proto:696:16: \"Type.Parameter\" is not
defined.\nsubstrait/algebra.proto:700:7: \"google.protobuf.Any\" is not
defined.\nsubstrait/algebra.proto:627:7: \"Type\" is not
defined.\nsubstrait/algebra.proto:629:7: \"Type.List\" is not
defined.\nsubstrait/algebra.proto:630:7: \"Type.Map\" is not
defined.\nsubstrait/algebra.proto:772:5: \"Type\" is not
defined.\nsubstrait/algebra.proto:806:5: \"Type\" is not
defined.\nsubstrait/algebra.proto:905:5: \"Type\" is not
defined.\nsubstrait/algebra.proto:943:5: \"Type\" is not
defined.\nsubstrait/algebra.proto:1258:3: \"Type\" is not
defined.\nsubstrait/plan.proto: Import \"substrait
/algebra.proto\" was not found or had errors.\nsubstrait/plan.proto: Import
\"substrait/extensions/extensions.proto\" was not found or had
errors.\nsubstrait/plan.proto:18:5: \"Rel\" is not
defined.\nsubstrait/plan.proto:20:5: \"RelRoot\" is not
defined.\nsubstrait/plan.proto:32:12:
\"substrait.extensions.SimpleExtensionURI\" is not
defined.\nsubstrait/plan.proto:35:12:
\"substrait.extensions.SimpleExtensionDeclaration\" is not
defined.\nsubstrait/plan.proto:41:3: \"substrait.extensions.AdvancedExtension\"
is not defined.\n" }
warning: build failed, waiting for other jobs to finish...
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
