Subject: Re: CheckpointRDD has different number of partitions than
original RDD
Few things that would be helpful.
1. Environment settings - you can find them on the environment tab in the
Spark application UI
2. Are you setting the HDFS configuration correctly in your Spark program
Few things that would be helpful.
1. Environment settings - you can find them on the environment tab in the
Spark application UI
2. Are you setting the HDFS configuration correctly in your Spark program?
For example, can you write a HDFS file from a Spark program (say
spark-shell) to your HDFS
: CheckpointRDD has different number of partitions than original RDD
Few things that would be helpful.
1. Environment settings - you can find them on the environment tab in the Spark
application UI
2. Are you setting the HDFS configuration correctly in your Spark program? For
example, can you write