[ https://issues.apache.org/jira/browse/PIO-91?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16036848#comment-16036848 ]
ASF GitHub Bot commented on PIO-91: ----------------------------------- GitHub user shimamoto opened a pull request: https://github.com/apache/incubator-predictionio/pull/389 [PIO-91] Fixed hadoop-hdfs artifact missing error I made a mistake when I reviewed dependencies. Basically, the problem is due to unavailability of the hadoop-hdfs jars. You can merge this pull request into a Git repository by running: $ git pull https://github.com/shimamoto/incubator-predictionio pio-91_hadoop-hdfs-missing Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-predictionio/pull/389.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #389 ---- commit f60af2c4dd5d4656ccab189b5590a9dc451ffb27 Author: shimamoto <shimam...@apache.org> Date: 2017-06-05T11:55:45Z [PIO-91] Fixed hadoop-hdfs artifact missing error. ---- > hadoop-hdfs artifact missing when creating binary version of PredictionIO > ------------------------------------------------------------------------- > > Key: PIO-91 > URL: https://issues.apache.org/jira/browse/PIO-91 > Project: PredictionIO > Issue Type: Bug > Components: Build > Affects Versions: 0.11.0-incubating > Environment: Spark: 1.6.3 for Hadoop 2.6 > Hadoop: 2.6.5 > Elasticsearch: 1.7.3 > Hbase: 1.2.5 > Scala: 2.10.6 > Reporter: Stephan Volkeri > Assignee: Takako Shimamoto > > I tried to upgrade from Version 0.10.0-incubating to 0.11.0-incubating. > After I created the binary version with: > ./make-distribution.sh -Dscala.version=2.10.5 -Dspark.version=1.6.3 > -Delasticsearch.version=1.7.5 > I copied the config files from my 0.10.0-incubating conf folder. > During the test with "pio status" I got following error: > 2017-05-31 13:08:46,819 ERROR org.apache.predictionio.data.storage.Storage$ > [main] - Error initializing storage client for source HDFS > java.io.IOException: No FileSystem for scheme: hdfs > at > org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2586) > at > org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2593) > at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:91) > at > org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2632) > at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2614) > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:370) > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:169) > at > org.apache.predictionio.data.storage.hdfs.StorageClient.<init>(StorageClient.scala:32) > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) > at java.lang.reflect.Constructor.newInstance(Constructor.java:423) > at > org.apache.predictionio.data.storage.Storage$.getClient(Storage.scala:223) > at > org.apache.predictionio.data.storage.Storage$.org$apache$predictionio$data$storage$Storage$$updateS2CM(Storage.scala:254) > at > org.apache.predictionio.data.storage.Storage$$anonfun$sourcesToClientMeta$1.apply(Storage.scala:215) > at > org.apache.predictionio.data.storage.Storage$$anonfun$sourcesToClientMeta$1.apply(Storage.scala:215) > at > scala.collection.mutable.MapLike$class.getOrElseUpdate(MapLike.scala:189) > at scala.collection.mutable.AbstractMap.getOrElseUpdate(Map.scala:91) > at > org.apache.predictionio.data.storage.Storage$.sourcesToClientMeta(Storage.scala:215) > at > org.apache.predictionio.data.storage.Storage$.getDataObject(Storage.scala:284) > at > org.apache.predictionio.data.storage.Storage$.getDataObjectFromRepo(Storage.scala:269) > at > org.apache.predictionio.data.storage.Storage$.getModelDataModels(Storage.scala:411) > at > org.apache.predictionio.data.storage.Storage$.verifyAllDataObjects(Storage.scala:350) > at > org.apache.predictionio.tools.commands.Management$.status(Management.scala:156) > at org.apache.predictionio.tools.console.Pio$.status(Pio.scala:144) > at > org.apache.predictionio.tools.console.Console$$anonfun$main$1.apply(Console.scala:663) > at > org.apache.predictionio.tools.console.Console$$anonfun$main$1.apply(Console.scala:611) > at scala.Option.map(Option.scala:145) > at > org.apache.predictionio.tools.console.Console$.main(Console.scala:611) > at org.apache.predictionio.tools.console.Console.main(Console.scala) > 2017-05-31 13:08:46,826 ERROR > org.apache.predictionio.tools.commands.Management$ [main] - Unable to connect > to all storage backends successfully. -- This message was sent by Atlassian JIRA (v6.3.15#6346)