Hi, I'm facing similar problem
According to: http://tachyon-project.org/Running-Spark-on-Tachyon.html in order to allow tachyon client to connect to tachyon master in HA mode you need to pass 2 system properties: -Dtachyon.zookeeper.address=zookeeperHost1:2181,zookeeperHost2:2181 -Dtachyon.usezookeeper=true Previously I was doing it with SPARK_JAVA_OPTS I am trying in such a way: spark-defaults.conf: ... spark.executor.extraJavaOptions -Dtachyon.max.columns=10000 -Dtachyon.usezookeeper=true -Dtachyon.zookeeper.address=hadoop-zoo-1:2181,hadoop-zoo-2:2181,hadoop-zoo-3:2181 ... However I am getting exception that connection string is not set (the zk string) 14/06/11 06:32:15 INFO : initialize(tachyon-ft://hadoop-ha-1:19998/tmp/users.txt, Configuration: core-default.xml, core-site.xml, mapred-default.xml, mapred-site.xml, yarn-default.xml, yarn-site.xml, hdfs-default.xml, hdfs-site.xml). Connecting to Tachyon: tachyon-ft://hadoop-ha-1:19998/tmp/users.txt 14/06/11 06:32:15 INFO : Trying to connect master @ hadoop-ha-1/15.253.91.167:19998 14/06/11 06:32:15 WARN : tachyon.home is not set. Using /mnt/tachyon_default_home as the default value. Exception in thread "main" java.lang.NullPointerException: connectionString cannot be null at com.google.common.base.Preconditions.checkNotNull(Preconditions.java:208) at org.apache.curator.ensemble.fixed.FixedEnsembleProvider.<init>(FixedEnsembleProvider.java:39) at org.apache.curator.framework.CuratorFrameworkFactory$Builder.connectString(CuratorFrameworkFactory.java:176) at org.apache.curator.framework.CuratorFrameworkFactory.newClient(CuratorFrameworkFactory.java:91) at org.apache.curator.framework.CuratorFrameworkFactory.newClient(CuratorFrameworkFactory.java:76) at tachyon.LeaderInquireClient.<init>(LeaderInquireClient.java:48) at tachyon.LeaderInquireClient.getClient(LeaderInquireClient.java:57) at tachyon.master.MasterClient.getMasterAddress(MasterClient.java:96) Any help appreciated, it's really blocker for me. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/little-confused-about-SPARK-JAVA-OPTS-alternatives-tp5798p7383.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
