[jira] [Commented] (SPARK-26385) YARN - Spark Stateful Structured streaming HDFS_DELEGATION_TOKEN not found in cache

[ https://issues.apache.org/jira/browse/SPARK-26385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16728145#comment-16728145 ] Hyukjin Kwon commented on SPARK-26385: -- Mind adding the code you ran? It's also better to iterate

[jira] [Commented] (SPARK-26383) NPE when use DataFrameReader.jdbc with wrong URL

[ https://issues.apache.org/jira/browse/SPARK-26383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16728146#comment-16728146 ] Hyukjin Kwon commented on SPARK-26383: -- Yea, can you open a PR to fix the error message? > NPE

[jira] [Resolved] (SPARK-26419) spark metric source

[ https://issues.apache.org/jira/browse/SPARK-26419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Si Chen resolved SPARK-26419. - Resolution: Invalid > spark metric source > --- > > Key: SPARK-26419 >

[jira] [Updated] (SPARK-26407) For an external non-partitioned table, if add a directory named with k=v to the table path, select result will be wrong

[ https://issues.apache.org/jira/browse/SPARK-26407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bao Yunz updated SPARK-26407: - Description: Scenario 1 Create an external non-partitioned table, in which location directory has a

[jira] [Commented] (SPARK-26407) For an external non-partitioned table, if add a directory named with k=v to the table path, select result will be wrong

[ https://issues.apache.org/jira/browse/SPARK-26407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16728142#comment-16728142 ] Hyukjin Kwon commented on SPARK-26407: -- Why don't you just avoid the directory names like part=1 or

[jira] [Commented] (SPARK-26406) Add option to skip rows when reading csv files

[ https://issues.apache.org/jira/browse/SPARK-26406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16728143#comment-16728143 ] Hyukjin Kwon commented on SPARK-26406: -- Spark allow RDD operations. You can also read it as text,

[jira] [Comment Edited] (SPARK-26358) Spark deployed mode question

[ https://issues.apache.org/jira/browse/SPARK-26358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722121#comment-16722121 ] Hyukjin Kwon edited comment on SPARK-26358 at 12/24/18 5:10 AM: Hm, can

[jira] [Resolved] (SPARK-14023) Make exceptions consistent regarding fields and columns

[ https://issues.apache.org/jira/browse/SPARK-14023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-14023. --- Resolution: Fixed Assignee: Sean Owen (was: Rekha Joshi) Fix Version/s:

[jira] [Commented] (SPARK-26413) SPIP: RDD Arrow Support in Spark Core and PySpark

[ https://issues.apache.org/jira/browse/SPARK-26413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16728136#comment-16728136 ] Hyukjin Kwon commented on SPARK-26413: -- I was thinking if it's better if we expose simply, for

[jira] [Commented] (SPARK-26408) java.util.NoSuchElementException: None.get at scala.None$.get(Option.scala:347)

[ https://issues.apache.org/jira/browse/SPARK-26408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16728140#comment-16728140 ] Hyukjin Kwon commented on SPARK-26408: -- Yes, it doesn't looks like Spark's problem. >

[jira] [Resolved] (SPARK-26396) Kafka consumer cache overflow since 2.4.x

[ https://issues.apache.org/jira/browse/SPARK-26396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26396. -- Resolution: Invalid > Kafka consumer cache overflow since 2.4.x >

[jira] [Resolved] (SPARK-26406) Add option to skip rows when reading csv files

[ https://issues.apache.org/jira/browse/SPARK-26406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26406. -- Resolution: Won't Fix I won't fix this although I get the usecase and problem. Spark's being

[jira] [Created] (SPARK-26432) Getting NoSuchMethodException while trying to obtain token from Hbase 2.1 service

Sujith created SPARK-26432: -- Summary: Getting NoSuchMethodException while trying to obtain token from Hbase 2.1 service Key: SPARK-26432 URL: https://issues.apache.org/jira/browse/SPARK-26432 Project: Spark

[jira] [Updated] (SPARK-26432) Getting NoSuchMethodException while trying to obtain token from Hbase 2.1 service

[ https://issues.apache.org/jira/browse/SPARK-26432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sujith updated SPARK-26432: --- Description: Getting NoSuchMethodException :

[jira] [Commented] (SPARK-26419) spark metric source

[ https://issues.apache.org/jira/browse/SPARK-26419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16728125#comment-16728125 ] Hyukjin Kwon commented on SPARK-26419: -- Please avoid to set a Critical+ which is usually reserved

[jira] [Assigned] (SPARK-26431) Update availableSlots by availableCpus for barrier taskset

[ https://issues.apache.org/jira/browse/SPARK-26431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26431: Assignee: (was: Apache Spark) > Update availableSlots by availableCpus for barrier

[jira] [Assigned] (SPARK-26431) Update availableSlots by availableCpus for barrier taskset

[ https://issues.apache.org/jira/browse/SPARK-26431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26431: Assignee: Apache Spark > Update availableSlots by availableCpus for barrier taskset >

[jira] [Created] (SPARK-26431) Update availableSlots by availableCpus for barrier taskset

wuyi created SPARK-26431: Summary: Update availableSlots by availableCpus for barrier taskset Key: SPARK-26431 URL: https://issues.apache.org/jira/browse/SPARK-26431 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-26432) Getting NoSuchMethodException while trying to obtain token from Hbase 2.1 service

[ https://issues.apache.org/jira/browse/SPARK-26432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sujith updated SPARK-26432: --- Attachment: hbase-dep-obtaintok.png > Getting NoSuchMethodException while trying to obtain token from Hbase

[jira] [Commented] (SPARK-23693) SQL function uuid()

[ https://issues.apache.org/jira/browse/SPARK-23693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16728078#comment-16728078 ] Reynold Xin commented on SPARK-23693: - [~tashoyan] the issue with calling uuid directly is that it

[jira] [Commented] (SPARK-26405) OOM

[ https://issues.apache.org/jira/browse/SPARK-26405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16728122#comment-16728122 ] Hyukjin Kwon commented on SPARK-26405: -- BTW, please don't report a JIRA with the title like OOM. I

[jira] [Resolved] (SPARK-26405) OOM

[ https://issues.apache.org/jira/browse/SPARK-26405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26405. -- Resolution: Invalid > OOM > --- > > Key: SPARK-26405 > URL:

[jira] [Updated] (SPARK-26432) Getting NoSuchMethodException while trying to obtain token from Hbase 2.1 service

[ https://issues.apache.org/jira/browse/SPARK-26432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sujith updated SPARK-26432: --- Description: Getting NoSuchMethodException :

[jira] [Commented] (SPARK-24374) SPIP: Support Barrier Execution Mode in Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16728020#comment-16728020 ] Debasish Das commented on SPARK-24374: -- Hi [~mengxr] with barrier mode available is it not possible

[jira] [Comment Edited] (SPARK-26432) Not able to connect Hbase 2.1 service Getting NoSuchMethodException while trying to obtain token from Hbase 2.1 service.

[ https://issues.apache.org/jira/browse/SPARK-26432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16728014#comment-16728014 ] Sujith edited comment on SPARK-26432 at 12/23/18 5:49 PM: -- This is mainly

[jira] [Commented] (SPARK-26432) Getting NoSuchMethodException while trying to obtain token from Hbase 2.1 service

[ https://issues.apache.org/jira/browse/SPARK-26432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16728014#comment-16728014 ] Sujith commented on SPARK-26432: This is mainly happening because in spark uses  a deprecated hbase api 

[jira] [Updated] (SPARK-26419) spark metric source

[ https://issues.apache.org/jira/browse/SPARK-26419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-26419: - Priority: Major (was: Blocker) > spark metric source > --- > >

[jira] [Commented] (SPARK-26413) SPIP: RDD Arrow Support in Spark Core and PySpark

[ https://issues.apache.org/jira/browse/SPARK-26413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16728135#comment-16728135 ] Hyukjin Kwon commented on SPARK-26413: -- For clarification, Arrow column vector APIs are exposed

[jira] [Comment Edited] (SPARK-26432) Not able to connect Hbase 2.1 service Getting NoSuchMethodException while trying to obtain token from Hbase 2.1 service.

[ https://issues.apache.org/jira/browse/SPARK-26432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16728014#comment-16728014 ] Sujith edited comment on SPARK-26432 at 12/23/18 5:48 PM: -- This is mainly

[jira] [Commented] (SPARK-26432) Getting NoSuchMethodException while trying to obtain token from Hbase 2.1 service

[ https://issues.apache.org/jira/browse/SPARK-26432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16728015#comment-16728015 ] Sujith commented on SPARK-26432: cc [~cloud_fan]  [~vanzin] > Getting NoSuchMethodException while

[jira] [Updated] (SPARK-26432) Not able to connect Hbase 2.1 service Getting NoSuchMethodException while trying to obtain token from Hbase 2.1 service.

[ https://issues.apache.org/jira/browse/SPARK-26432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sujith updated SPARK-26432: --- Summary: Not able to connect Hbase 2.1 service Getting NoSuchMethodException while trying to obtain token

[jira] [Updated] (SPARK-26432) Not able to connect Hbase 2.1 service Getting NoSuchMethodException while trying to obtain token from Hbase 2.1 service.

[ https://issues.apache.org/jira/browse/SPARK-26432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sujith updated SPARK-26432: --- Description: Getting NoSuchMethodException :

[jira] [Commented] (SPARK-26432) Not able to connect Hbase 2.1 service Getting NoSuchMethodException while trying to obtain token from Hbase 2.1 service.

[ https://issues.apache.org/jira/browse/SPARK-26432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16728121#comment-16728121 ] Dongjoon Hyun commented on SPARK-26432: --- Thank you for reporting, [~S71955]. If you update the