[ 
https://issues.apache.org/jira/browse/SPARK-20600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jacek Laskowski updated SPARK-20600:
------------------------------------
    Description: 
Executing the following batch query gives the default stringified *internal JVM 
representation* of {{KafkaRelation}} in web UI (under Details for Query), i.e. 
http://localhost:4040/SQL/execution/?id=3 (<-- change the {{id}}). See the 
attachment.

{code}
spark.
  read.
  format("kafka").
  option("subscribe", "topic1").
  option("kafka.bootstrap.servers", "localhost:9092").
  load.
  show
{code}


  was:
Executing the following batch query gives the default stringified/internal name 
of {{KafkaRelation}} in web UI (under Details for Query), i.e. 
http://localhost:4040/SQL/execution/?id=3 (<-- change the {{id}}). See the 
attachment.

{code}
spark.
  read.
  format("kafka").
  option("subscribe", "topic1").
  option("kafka.bootstrap.servers", "localhost:9092").
  load.
  select('value cast "string").
  write.
  csv("fromkafka.csv")
{code}



> KafkaRelation should be pretty printed in web UI (Details for Query)
> --------------------------------------------------------------------
>
>                 Key: SPARK-20600
>                 URL: https://issues.apache.org/jira/browse/SPARK-20600
>             Project: Spark
>          Issue Type: Improvement
>          Components: Structured Streaming
>    Affects Versions: 2.2.0
>            Reporter: Jacek Laskowski
>            Assignee: Jacek Laskowski
>            Priority: Trivial
>             Fix For: 2.2.0
>
>         Attachments: kafka-source-scan-webui.png
>
>
> Executing the following batch query gives the default stringified *internal 
> JVM representation* of {{KafkaRelation}} in web UI (under Details for Query), 
> i.e. http://localhost:4040/SQL/execution/?id=3 (<-- change the {{id}}). See 
> the attachment.
> {code}
> spark.
>   read.
>   format("kafka").
>   option("subscribe", "topic1").
>   option("kafka.bootstrap.servers", "localhost:9092").
>   load.
>   show
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to