fhalde opened a new issue, #946: URL: https://github.com/apache/incubator-uniffle/issues/946
### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) ### Search before asking - [X] I have searched in the [issues](https://github.com/apache/incubator-uniffle/issues?q=is%3Aissue) and found no similar issues. ### Describe the bug I was trying out uniffle locally and we face the following error when starting the shuffle server ``` [ERROR] 2023-06-12 16:32:19,896 main ShuffleServer <init> - Errors on initializing shuffle server. org.apache.uniffle.common.exception.RssException: Initialize 1 local storage(s) failed, specified local storage paths size: 1, the conf of rss.server.localstorage.initialize.max.fail.number size: 0 at org.apache.uniffle.server.storage.LocalStorageManager.<init>(LocalStorageManager.java:147) at org.apache.uniffle.server.storage.StorageManagerFactory.createStorageManager(StorageManagerFactory.java:36) at org.apache.uniffle.server.ShuffleServer.initialization(ShuffleServer.java:222) at org.apache.uniffle.server.ShuffleServer.<init>(ShuffleServer.java:103) at org.apache.uniffle.server.ShuffleServer.main(ShuffleServer.java:121) ``` uniffle was built using ``` ./build_distribution.sh --spark3-profile 'spark3.3' ``` jvm used: 1.8 coordinator.conf ``` rss.rpc.server.port 19999 rss.jetty.http.port 19998 rss.coordinator.server.heartbeat.timeout 30000 rss.coordinator.app.expired 60000 rss.coordinator.shuffle.nodes.max 13 ``` server.conf ``` rss.rpc.server.port 19989 rss.jetty.http.port 19988 rss.storage.basePath /tmp rss.storage.type MEMORY_LOCALFILE rss.coordinator.quorum 127.0.0.1:19999 rss.server.buffer.capacity 2gb rss.server.read.buffer.capacity 2gb rss.server.flush.thread.alive 5 rss.server.flush.threadPool.size 10 rss.server.disk.capacity -1 ``` rss-env.sh ``` set -o pipefail set -o nounset # exit the script if you try to use an uninitialised variable set -o errexit # exit the script if any statement returns a non-true return value JAVA_HOME=<java path> HADOOP_HOME=/tmp/hadoop-3.3.5 XMX_SIZE="1g" # Shuffle Server JVM XMX size RSS_IP=127.0.0.1 ``` ### Affects Version(s) master ### Uniffle Server Log Output ```logtalk [INFO] 2023-06-12 16:32:19,729 main ShuffleServer main - Start to init shuffle server using config /Users/faiz.halde/dev/nu/nucli/incubator-uniffle/rss-0.8.0-SNAPSHOT/conf/server.conf [INFO] 2023-06-12 16:32:19,738 main RssUtils getPropertiesFromFile - Load config from /Users/faiz.halde/dev/nu/nucli/incubator-uniffle/rss-0.8.0-SNAPSHOT/conf/server.conf [INFO] 2023-06-12 16:32:19,780 main ShuffleServer registerMetrics - Register metrics [INFO] 2023-06-12 16:32:19,805 main ShuffleServer registerMetrics - Add metrics servlet [ERROR] 2023-06-12 16:32:19,896 main ShuffleServer <init> - Errors on initializing shuffle server. org.apache.uniffle.common.exception.RssException: Initialize 1 local storage(s) failed, specified local storage paths size: 1, the conf of rss.server.localstorage.initialize.max.fail.number size: 0 at org.apache.uniffle.server.storage.LocalStorageManager.<init>(LocalStorageManager.java:147) at org.apache.uniffle.server.storage.StorageManagerFactory.createStorageManager(StorageManagerFactory.java:36) at org.apache.uniffle.server.ShuffleServer.initialization(ShuffleServer.java:222) at org.apache.uniffle.server.ShuffleServer.<init>(ShuffleServer.java:103) at org.apache.uniffle.server.ShuffleServer.main(ShuffleServer.java:121) ``` ### Uniffle Engine Log Output _No response_ ### Uniffle Server Configurations ```yaml rss.rpc.server.port 19989 rss.jetty.http.port 19988 rss.storage.basePath /tmp rss.storage.type MEMORY_LOCALFILE rss.coordinator.quorum 127.0.0.1:19999 rss.server.buffer.capacity 2gb rss.server.read.buffer.capacity 2gb rss.server.flush.thread.alive 5 rss.server.flush.threadPool.size 10 rss.server.disk.capacity -1 ``` ### Uniffle Engine Configurations _No response_ ### Additional context _No response_ ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
