The problem happens when writting (reading works fine)
We use just RDD and HDFS, no other things.
Spark 1.6.1 version.
`Claster A` - CDH 5.7.1
`Cluster B` - vanilla hadoop 2.6.5
`Cluster C` - CDH 5.8.0
On 13 October 2016 at 13:06, ayan guha <guha.a...@gmail.com> wrote:
> And a little more details on Spark version, hadoop version and
> distribution would also help...
> On Thu, Oct 13, 2016 at 9:05 PM, ayan guha <guha.a...@gmail.com> wrote:
>> I think one point you need to mention is your target - HDFS, Hive or
>> Hbase (or something else) and which end points are used.
>> On Thu, Oct 13, 2016 at 8:50 PM, dbolshak <bolshakov.de...@gmail.com>
>>> Hello community,
>>> We've a challenge and no ideas how to solve it.
>>> The problem,
>>> Say we have the following environment:
>>> 1. `cluster A`, the cluster does not use kerberos and we use it as a
>>> of data, important thing is - we don't manage this cluster.
>>> 2. `cluster B`, small cluster where our spark application is running and
>>> performing some logic. (we manage this cluster and it does not have
>>> 3. `cluster C`, the cluster uses kerberos and we use it to keep results
>>> our spark application, we manage this cluster
>>> Our requrements and conditions that are not mentioned yet:
>>> 1. All clusters are in a single data center, but in the different
>>> 2. We cannot turn on kerberos on `cluster A`
>>> 3. We cannot turn off kerberos on `cluster C`
>>> 4. We can turn on/off kerberos on `cluster B`, currently it's turned off.
>>> 5. Spark app is built on top of RDD and does not depend on spark-sql.
>>> Does anybody know how to write data using RDD api to remote cluster
>>> which is
>>> running with Kerberos?
>>> //with Best Regards
>>> --Denis Bolshakov
>>> e-mail: bolshakov.de...@gmail.com
>>> View this message in context: http://apache-spark-user-list.
>>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>> To unsubscribe e-mail: user-unsubscr...@spark.apache.org
>> Best Regards,
>> Ayan Guha
> Best Regards,
> Ayan Guha
//with Best Regards