RE: IVY-1576 still exist in 2.5.2
On 2023/12/13 17:30:55 Austin Zhang wrote: >kfjhgmnvboekkfjhgmnvbeorewroerewroeiroeri >kkfjhgmnvbeoewrewrewrikgjmvnbeoierwerier > I came across this issue when I tried to add > org.tensorflow:tensorflow-core-platform-gpu:0.5.0 through `spark-submit > --packages`. > I found out that ivy resolves and fetches all jars with classifiers but > skip the one without. > Way to reproduce it. >kkfjhgvnbeoiewriweroiituyfhgmvnbeirweorweireowreroieroeri > java -jar apache-ivy-2.5.2/ivy-2.5.2.jar -dependency "org.tensorflow" > "tensorflow-core-platform-gpu" "0.5.0" -retrieve > "ivy/[organization]_[artifact]-[revision](-[classifier]).[ext]" -confs > "runtime" -debug >kkfjhgmvnbeworwerweriewroifjhgmvnbeeirewori > files in ivy folder are: > com.google.protobuf_protobuf-java-3.19.4.jar > org.bytedeco_javacpp-1.5.8-windows-x86_64.jar > org.bytedeco_javacpp-1.5.8-linux-x86_64.jar > org.tensorflow_tensorflow-core-api-0.5.0-linux-x86_64-gpu.jar > org.tensorflow_tensorflow-core-api-0.5.0-windows-x86_64-gpu.jar > org.tensorflow_ndarray-0.4.0.jar >kfjhgmnbeeowriewrewroifkgjhmnvbeoiro > Both org.bytedeco_javacpp-1.5.8.jar and > org.tensorflow_tensorflow-core-api-0.5.0.jar > are missing. >kkfjhgmvnbewreowrwerifoikgjhmvnbeoweirewir > pom file > https://repo1.maven.org/maven2/org/tensorflow/tensorflow-core-platform-gpu/0.5.0/tensorflow-core-platform-gpu-0.5.0.pom >jhfgvnbeoiwerewreroifjhgmvnbeoewirfofuygtjhvmnb > Any suggestions? >jfhgmvnbewoerewrewrigkhvmnb > Yunhui Zhang >ieriituyjfgmnvbeiueruytjfhgnvb
Re: IVY-1576 still exist in 2.5.2
On 2024-01-07, Austin Zhang wrote: > So I think the tips for folks bumping into this issue is to clean the ivy > cache. Yes, absolutely. I'll try to carve out some time to update the Ivy release notes for 2.5.2 to reflect this. This seems to be true for all issues involving POM parsing errors. Ivy will not overwrite existing ivy.xml files in the cache, so you are stuck with whatever an earlier version has created. Stefan - To unsubscribe, e-mail: dev-unsubscr...@ant.apache.org For additional commands, e-mail: dev-h...@ant.apache.org
Re: IVY-1576 still exist in 2.5.2
Thanks Stefan, After removing ~/.ivy2, I successfully downloaded org.tensorflow_tensorflow-core-api-0.5.0.jar and org.bytedeco_javacpp-1.5.8.jar. But as you mentioned, if I download using 2.5.1 previously, then even If I upgrade to 2.5.2, it still won't download them. So I think the tips for folks bumping into this issue is to clean the ivy cache. Thanks again for helping out Austin On Sun, Jan 7, 2024 at 5:37 AM Stefan Bodewig wrote: > On 2023-12-13, Austin Zhang wrote: > > > java -jar apache-ivy-2.5.2/ivy-2.5.2.jar -dependency "org.tensorflow" > > "tensorflow-core-platform-gpu" "0.5.0" -retrieve > > "ivy/[organization]_[artifact]-[revision](-[classifier]).[ext]" -confs > > "runtime" -debug > > > files in ivy folder are: > > com.google.protobuf_protobuf-java-3.19.4.jar > > org.bytedeco_javacpp-1.5.8-windows-x86_64.jar > > org.bytedeco_javacpp-1.5.8-linux-x86_64.jar > > org.tensorflow_tensorflow-core-api-0.5.0-linux-x86_64-gpu.jar > > org.tensorflow_tensorflow-core-api-0.5.0-windows-x86_64-gpu.jar > > org.tensorflow_ndarray-0.4.0.jar > > > Both org.bytedeco_javacpp-1.5.8.jar and > > org.tensorflow_tensorflow-core-api-0.5.0.jar > > are missing. > > Running this with a freshly downloaded ivy-2.5.2.jar results in > > $ ls ivy > com.google.protobuf_protobuf-java-3.19.4.jar > org.bytedeco_javacpp-1.5.8.jar > org.bytedeco_javacpp-1.5.8-linux-x86_64.jar > org.bytedeco_javacpp-1.5.8-windows-x86_64.jar > org.tensorflow_ndarray-0.4.0.jar > org.tensorflow_tensorflow-core-api-0.5.0.jar > org.tensorflow_tensorflow-core-api-0.5.0-linux-x86_64-gpu.jar > org.tensorflow_tensorflow-core-api-0.5.0-windows-x86_64-gpu.jar > > for me. It seems as if I do get the expected results. > > If you have tried to download things with an earlier version of Ivy > before you may be using cached ivy descriptors created from the Maven > POMs with the older version. > > I don't think you are hitting IVY-1576 - which is not the only bug in > translating POMs. In 2.5.2 we fixed IVY-1642 (which looks more like the > problem you have) which in turn is a more complete fix of IVY-1580. > > Please remove your cached artifacts of everythng and try again with Ivy > 2.5.2. > > Stefan > > - > To unsubscribe, e-mail: dev-unsubscr...@ant.apache.org > For additional commands, e-mail: dev-h...@ant.apache.org > >
Re: IVY-1576 still exist in 2.5.2
On 2023-12-13, Austin Zhang wrote: > java -jar apache-ivy-2.5.2/ivy-2.5.2.jar -dependency "org.tensorflow" > "tensorflow-core-platform-gpu" "0.5.0" -retrieve > "ivy/[organization]_[artifact]-[revision](-[classifier]).[ext]" -confs > "runtime" -debug > files in ivy folder are: > com.google.protobuf_protobuf-java-3.19.4.jar > org.bytedeco_javacpp-1.5.8-windows-x86_64.jar > org.bytedeco_javacpp-1.5.8-linux-x86_64.jar > org.tensorflow_tensorflow-core-api-0.5.0-linux-x86_64-gpu.jar > org.tensorflow_tensorflow-core-api-0.5.0-windows-x86_64-gpu.jar > org.tensorflow_ndarray-0.4.0.jar > Both org.bytedeco_javacpp-1.5.8.jar and > org.tensorflow_tensorflow-core-api-0.5.0.jar > are missing. Running this with a freshly downloaded ivy-2.5.2.jar results in $ ls ivy com.google.protobuf_protobuf-java-3.19.4.jar org.bytedeco_javacpp-1.5.8.jar org.bytedeco_javacpp-1.5.8-linux-x86_64.jar org.bytedeco_javacpp-1.5.8-windows-x86_64.jar org.tensorflow_ndarray-0.4.0.jar org.tensorflow_tensorflow-core-api-0.5.0.jar org.tensorflow_tensorflow-core-api-0.5.0-linux-x86_64-gpu.jar org.tensorflow_tensorflow-core-api-0.5.0-windows-x86_64-gpu.jar for me. It seems as if I do get the expected results. If you have tried to download things with an earlier version of Ivy before you may be using cached ivy descriptors created from the Maven POMs with the older version. I don't think you are hitting IVY-1576 - which is not the only bug in translating POMs. In 2.5.2 we fixed IVY-1642 (which looks more like the problem you have) which in turn is a more complete fix of IVY-1580. Please remove your cached artifacts of everythng and try again with Ivy 2.5.2. Stefan - To unsubscribe, e-mail: dev-unsubscr...@ant.apache.org For additional commands, e-mail: dev-h...@ant.apache.org
