[
https://issues.apache.org/jira/browse/SPARK-28245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16879776#comment-16879776
]
Hyukjin Kwon commented on SPARK-28245:
--------------------------------------
BTW, [[email protected]] can you attach full stack trace?
> Problem to recognize Kubernetes cluster address from Scala
> ----------------------------------------------------------
>
> Key: SPARK-28245
> URL: https://issues.apache.org/jira/browse/SPARK-28245
> Project: Spark
> Issue Type: Bug
> Components: Kubernetes
> Affects Versions: 2.4.0
> Reporter: Alberto Andreotti
> Priority: Major
> Attachments: image-2019-07-05-11-45-21-609.png
>
>
> This works in PySpark,
> {code}
> from pyspark.sql import SparkSession
> spark = SparkSession.builder \
> .master('k8s://https://kubernetes.default') \
> {code}
> But in Scala,
> {code}
> val spark = SparkSession.builder()
> .master("k8s://https://kubernetes.default";)
> {code}
> I get the following exception,
> {code}
> Caused by: org.apache.spark.SparkException: Could not parse Master URL:
> 'k8s://https://kubernetes.default'
> {code}
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
