[jira] [Updated] (SPARK-26522) Auth secret error in RBackendAuthHandler

2019-01-02 Thread Euijun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Euijun updated SPARK-26522: --- Description: Hi expert, I try to use livy to connect sparkR backend. This is related to

[jira] [Created] (SPARK-26523) Getting this error while reading from kinesis :- Could not read until the end sequence number of the range: SequenceNumberRange

2019-01-02 Thread CHIRAG YADAV (JIRA)
CHIRAG YADAV created SPARK-26523: Summary: Getting this error while reading from kinesis :- Could not read until the end sequence number of the range: SequenceNumberRange Key: SPARK-26523 URL:

[jira] [Updated] (SPARK-26522) Auth secret error in RBackendAuthHandler

2019-01-02 Thread Euijun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Euijun updated SPARK-26522: --- Shepherd: Apache Spark Labels: newbie (was: ) > Auth secret error in RBackendAuthHandler >

[jira] [Updated] (SPARK-26522) Auth secret error in RBackendAuthHandler

2019-01-02 Thread Euijun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Euijun updated SPARK-26522: --- Affects Version/s: (was: 3.0.0) 2.3.1 Priority: Minor (was: Major)

[jira] [Created] (SPARK-26522) CLONE - Add configurable auth secret source in k8s backend

2019-01-02 Thread Euijun (JIRA)
Euijun created SPARK-26522: -- Summary: CLONE - Add configurable auth secret source in k8s backend Key: SPARK-26522 URL: https://issues.apache.org/jira/browse/SPARK-26522 Project: Spark Issue Type:

[jira] [Commented] (SPARK-26519) spark sql CHANGE COLUMN not working

2019-01-02 Thread suman gorantla (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732714#comment-16732714 ] suman gorantla commented on SPARK-26519: Dear Hyun, Below command was successfully working in

[jira] [Commented] (SPARK-26437) Decimal data becomes bigint to query, unable to query

2019-01-02 Thread zengxl (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732701#comment-16732701 ] zengxl commented on SPARK-26437: Thanks [~dongjoon] > Decimal data becomes bigint to query, unable to

[jira] [Commented] (SPARK-26521) Sparksql cannot modify the field name of a table

2019-01-02 Thread zengxl (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732698#comment-16732698 ] zengxl commented on SPARK-26521: ok,thank you [~dongjoon] > Sparksql cannot modify the field name of a

[jira] [Updated] (SPARK-26512) Spark 2.4.0 is not working with Hadoop 2.8.3 in windows 10?

2019-01-02 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26512: -- Flags: (was: Important) > Spark 2.4.0 is not working with Hadoop 2.8.3 in windows 10? >

[jira] [Resolved] (SPARK-26521) Sparksql cannot modify the field name of a table

2019-01-02 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-26521. --- Resolution: Duplicate Hi, [~zengxl]. Thank you for reporting, but this duplicates

[jira] [Closed] (SPARK-26521) Sparksql cannot modify the field name of a table

2019-01-02 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-26521. - > Sparksql cannot modify the field name of a table >

[jira] [Commented] (SPARK-22951) count() after dropDuplicates() on emptyDataFrame returns incorrect value

2019-01-02 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732659#comment-16732659 ] Dongjoon Hyun commented on SPARK-22951: --- Hi, [~feng...@databricks.com] and [~lian cheng]. Since

[jira] [Updated] (SPARK-22951) count() after dropDuplicates() on emptyDataFrame returns incorrect value

2019-01-02 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-22951: -- Target Version/s: 2.3.0, 2.2.3 (was: 2.3.0) > count() after dropDuplicates() on

[jira] [Resolved] (SPARK-26019) pyspark/accumulators.py: "TypeError: object of type 'NoneType' has no len()" in authenticate_and_accum_updates()

2019-01-02 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26019. -- Resolution: Fixed Issue resolved by pull request 23337

[jira] [Assigned] (SPARK-26019) pyspark/accumulators.py: "TypeError: object of type 'NoneType' has no len()" in authenticate_and_accum_updates()

2019-01-02 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-26019: Assignee: Imran Rashid > pyspark/accumulators.py: "TypeError: object of type 'NoneType'

[jira] [Updated] (SPARK-26019) pyspark/accumulators.py: "TypeError: object of type 'NoneType' has no len()" in authenticate_and_accum_updates()

2019-01-02 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-26019: - Fix Version/s: 2.4.1 2.3.3 > pyspark/accumulators.py: "TypeError: object of

[jira] [Resolved] (SPARK-26403) DataFrame pivot using array column fails with "Unsupported literal type class"

2019-01-02 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26403. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23349

[jira] [Assigned] (SPARK-26403) DataFrame pivot using array column fails with "Unsupported literal type class"

2019-01-02 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-26403: Assignee: Hyukjin Kwon > DataFrame pivot using array column fails with "Unsupported

[jira] [Updated] (SPARK-25591) PySpark Accumulators with multiple PythonUDFs

2019-01-02 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-25591: - Fix Version/s: 2.3.3 2.2.3 > PySpark Accumulators with multiple PythonUDFs >

[jira] [Updated] (SPARK-25591) PySpark Accumulators with multiple PythonUDFs

2019-01-02 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25591: -- Target Version/s: 2.4.0, 2.2.3, 2.3.3 (was: 2.4.0) > PySpark Accumulators with multiple

[jira] [Updated] (SPARK-26457) Show hadoop configurations in HistoryServer environment tab

2019-01-02 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-26457: Priority: Minor (was: Major) > Show hadoop configurations in HistoryServer environment tab >

[jira] [Resolved] (SPARK-26516) zeppelin with spark on mesos: environment variable setting

2019-01-02 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved SPARK-26516. - Resolution: Invalid > zeppelin with spark on mesos: environment variable setting >

[jira] [Updated] (SPARK-26513) Trigger GC on executor node idle

2019-01-02 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-26513: Fix Version/s: (was: 3.0.0) > Trigger GC on executor node idle >

[jira] [Commented] (SPARK-26516) zeppelin with spark on mesos: environment variable setting

2019-01-02 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732587#comment-16732587 ] Saisai Shao commented on SPARK-26516: - Questions should go to user@spark mail list. Also if this is

[jira] [Commented] (SPARK-25591) PySpark Accumulators with multiple PythonUDFs

2019-01-02 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732574#comment-16732574 ] Hyukjin Kwon commented on SPARK-25591: -- +1 > PySpark Accumulators with multiple PythonUDFs >

[jira] [Commented] (SPARK-25591) PySpark Accumulators with multiple PythonUDFs

2019-01-02 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732573#comment-16732573 ] Dongjoon Hyun commented on SPARK-25591: --- Thank you for confirming, [~viirya]. Yes. Please make two

[jira] [Commented] (SPARK-25591) PySpark Accumulators with multiple PythonUDFs

2019-01-02 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732569#comment-16732569 ] Liang-Chi Hsieh commented on SPARK-25591: - I can make backport PRs if you need. [~dongjoon] >

[jira] [Commented] (SPARK-25591) PySpark Accumulators with multiple PythonUDFs

2019-01-02 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732567#comment-16732567 ] Liang-Chi Hsieh commented on SPARK-25591: - This is bug fixing, so I think it makes sense to

[jira] [Updated] (SPARK-26521) Sparksql cannot modify the field name of a table

2019-01-02 Thread zengxl (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengxl updated SPARK-26521: --- Environment: (was:  alter table tmp.testchange change column i m string; *Error in query: ALTER TABLE

[jira] [Updated] (SPARK-26521) Sparksql cannot modify the field name of a table

2019-01-02 Thread zengxl (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengxl updated SPARK-26521: --- Description: When i alter table info use sparksql,throw excepiton    alter table tmp.testchange change

[jira] [Created] (SPARK-26521) Sparksql cannot modify the field name of a table

2019-01-02 Thread zengxl (JIRA)
zengxl created SPARK-26521: -- Summary: Sparksql cannot modify the field name of a table Key: SPARK-26521 URL: https://issues.apache.org/jira/browse/SPARK-26521 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-25591) PySpark Accumulators with multiple PythonUDFs

2019-01-02 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732556#comment-16732556 ] Dongjoon Hyun commented on SPARK-25591: --- Hi, [~viirya], [~hyukjin.kwon]. This is only in

[jira] [Assigned] (SPARK-23980) Resilient Spark driver on Kubernetes

2019-01-02 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-23980: -- Assignee: (was: Marcelo Vanzin) > Resilient Spark driver on Kubernetes >

[jira] [Assigned] (SPARK-23980) Resilient Spark driver on Kubernetes

2019-01-02 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-23980: -- Assignee: Marcelo Vanzin > Resilient Spark driver on Kubernetes >

[jira] [Resolved] (SPARK-26441) Add kind configuration of driver pod

2019-01-02 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-26441. Resolution: Duplicate > Add kind configuration of driver pod >

[jira] [Updated] (SPARK-26519) spark sql CHANGE COLUMN not working

2019-01-02 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26519: -- Flags: (was: Important) > spark sql CHANGE COLUMN not working >

[jira] [Updated] (SPARK-26519) spark sql CHANGE COLUMN not working

2019-01-02 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26519: -- Component/s: (was: Spark Submit) (was: Spark Shell)

[jira] [Commented] (SPARK-26519) spark sql CHANGE COLUMN not working

2019-01-02 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732528#comment-16732528 ] Dongjoon Hyun commented on SPARK-26519: --- Hi, [~sumanGorantla]. It's not a bug, isn't it? Please

[jira] [Updated] (SPARK-23525) ALTER TABLE CHANGE COLUMN COMMENT doesn't work for external hive table

2019-01-02 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23525: -- Summary: ALTER TABLE CHANGE COLUMN COMMENT doesn't work for external hive table (was: ALTER

[jira] [Assigned] (SPARK-26277) WholeStageCodegen metrics should be tested with whole-stage codegen enabled

2019-01-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26277: - Assignee: Chenxiao Mao > WholeStageCodegen metrics should be tested with whole-stage codegen

[jira] [Resolved] (SPARK-26277) WholeStageCodegen metrics should be tested with whole-stage codegen enabled

2019-01-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26277. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23224

[jira] [Commented] (SPARK-26502) Get rid of hiveResultString() in QueryExecution

2019-01-02 Thread Mark Hamstra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732435#comment-16732435 ] Mark Hamstra commented on SPARK-26502: -- Don't lose track of this comment:

[jira] [Assigned] (SPARK-26520) data source V2 API refactoring (micro-batch read)

2019-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26520: Assignee: Apache Spark (was: Wenchen Fan) > data source V2 API refactoring (micro-batch

[jira] [Assigned] (SPARK-26520) data source V2 API refactoring (micro-batch read)

2019-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26520: Assignee: Wenchen Fan (was: Apache Spark) > data source V2 API refactoring (micro-batch

[jira] [Created] (SPARK-26520) data source V2 API refactoring (micro-batch read)

2019-01-02 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-26520: --- Summary: data source V2 API refactoring (micro-batch read) Key: SPARK-26520 URL: https://issues.apache.org/jira/browse/SPARK-26520 Project: Spark Issue Type:

[jira] [Updated] (SPARK-26519) spark sql CHANGE COLUMN not working

2019-01-02 Thread suman gorantla (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] suman gorantla updated SPARK-26519: --- Description: Dear Team, with spark sql I am unable to change the newly added column()

[jira] [Updated] (SPARK-26519) spark sql CHANGE COLUMN not working

2019-01-02 Thread suman gorantla (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] suman gorantla updated SPARK-26519: --- Attachment: sparksql error.PNG > spark sql CHANGE COLUMN not working >

[jira] [Created] (SPARK-26519) spark sql CHANGE COLUMN not working

2019-01-02 Thread suman gorantla (JIRA)
suman gorantla created SPARK-26519: -- Summary: spark sql CHANGE COLUMN not working Key: SPARK-26519 URL: https://issues.apache.org/jira/browse/SPARK-26519 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-2984) FileNotFoundException on _temporary directory

2019-01-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732388#comment-16732388 ] Steve Loughran commented on SPARK-2984: --- Gaurav, if this has returned in a 2.x version against

[jira] [Commented] (SPARK-24603) Typo in comments

2019-01-02 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732340#comment-16732340 ] Dongjoon Hyun commented on SPARK-24603: --- I removed 2.2.2 and added 2.2.3 since this wasn't

[jira] [Updated] (SPARK-24603) Typo in comments

2019-01-02 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-24603: -- Fix Version/s: 2.2.3 > Typo in comments > > > Key:

[jira] [Updated] (SPARK-24603) Typo in comments

2019-01-02 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-24603: -- Fix Version/s: (was: 2.2.2) > Typo in comments > > >

[jira] [Commented] (SPARK-25253) Refactor pyspark connection & authentication

2019-01-02 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732329#comment-16732329 ] Dongjoon Hyun commented on SPARK-25253: --- I added `2.2.3` at the fix versions because `branch-2.2`

[jira] [Updated] (SPARK-25253) Refactor pyspark connection & authentication

2019-01-02 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25253: -- Fix Version/s: 2.2.3 > Refactor pyspark connection & authentication >

[jira] [Commented] (SPARK-26432) Not able to connect Hbase 2.1 service Getting NoSuchMethodException while trying to obtain token from Hbase 2.1 service.

2019-01-02 Thread Sujith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732299#comment-16732299 ] Sujith commented on SPARK-26432: Test description is been updated. let me know for any suggestions or

[jira] [Updated] (SPARK-26432) Not able to connect Hbase 2.1 service Getting NoSuchMethodException while trying to obtain token from Hbase 2.1 service.

2019-01-02 Thread Sujith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sujith updated SPARK-26432: --- Description: Getting NoSuchMethodException :

[jira] [Assigned] (SPARK-26432) Not able to connect Hbase 2.1 service Getting NoSuchMethodException while trying to obtain token from Hbase 2.1 service.

2019-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26432: Assignee: Apache Spark > Not able to connect Hbase 2.1 service Getting

[jira] [Comment Edited] (SPARK-26432) Not able to connect Hbase 2.1 service Getting NoSuchMethodException while trying to obtain token from Hbase 2.1 service.

2019-01-02 Thread Sujith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732281#comment-16732281 ] Sujith edited comment on SPARK-26432 at 1/2/19 6:27 PM: sorry for the late

[jira] [Commented] (SPARK-26432) Not able to connect Hbase 2.1 service Getting NoSuchMethodException while trying to obtain token from Hbase 2.1 service.

2019-01-02 Thread Sujith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732281#comment-16732281 ] Sujith commented on SPARK-26432: sorry for the late response due to holidays :), raised a PR please let

[jira] [Assigned] (SPARK-26432) Not able to connect Hbase 2.1 service Getting NoSuchMethodException while trying to obtain token from Hbase 2.1 service.

2019-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26432: Assignee: (was: Apache Spark) > Not able to connect Hbase 2.1 service Getting

[jira] [Resolved] (SPARK-26507) Fix core tests for Java 11

2019-01-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26507. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23419

[jira] [Created] (SPARK-26518) UI Application Info Race Condition Can Throw NoSuchElement

2019-01-02 Thread Russell Spitzer (JIRA)
Russell Spitzer created SPARK-26518: --- Summary: UI Application Info Race Condition Can Throw NoSuchElement Key: SPARK-26518 URL: https://issues.apache.org/jira/browse/SPARK-26518 Project: Spark

[jira] [Assigned] (SPARK-26489) Use ConfigEntry for hardcoded configs for python/r categories.

2019-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26489: Assignee: (was: Apache Spark) > Use ConfigEntry for hardcoded configs for python/r

[jira] [Assigned] (SPARK-26489) Use ConfigEntry for hardcoded configs for python/r categories.

2019-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26489: Assignee: Apache Spark > Use ConfigEntry for hardcoded configs for python/r categories.

[jira] [Commented] (SPARK-26454) While creating new UDF with JAR though UDF is created successfully, it throws IllegegalArgument Exception

2019-01-02 Thread Udbhav Agrawal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732005#comment-16732005 ] Udbhav Agrawal commented on SPARK-26454: okay i will work on that and raise the PR. > While

[jira] [Commented] (SPARK-26511) java.lang.ClassCastException error when loading Spark MLlib model from parquet file

2019-01-02 Thread Amy Koh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16731996#comment-16731996 ] Amy Koh commented on SPARK-26511: - Thanks [~viirya]. I do indeed have a slightly modified format of the

[jira] [Commented] (SPARK-26454) While creating new UDF with JAR though UDF is created successfully, it throws IllegegalArgument Exception

2019-01-02 Thread Sujith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732002#comment-16732002 ] Sujith commented on SPARK-26454: I think [~hyukjin.kwon]  idea is better and simple, we can reduce level

[jira] [Comment Edited] (SPARK-26454) While creating new UDF with JAR though UDF is created successfully, it throws IllegegalArgument Exception

2019-01-02 Thread Udbhav Agrawal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16731769#comment-16731769 ] Udbhav Agrawal edited comment on SPARK-26454 at 1/2/19 12:15 PM: - CC

[jira] [Commented] (SPARK-26454) While creating new UDF with JAR though UDF is created successfully, it throws IllegegalArgument Exception

2019-01-02 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16731983#comment-16731983 ] Hyukjin Kwon commented on SPARK-26454: -- Thing is, we shouldn't introduce behaviour change when we

[jira] [Comment Edited] (SPARK-26454) While creating new UDF with JAR though UDF is created successfully, it throws IllegegalArgument Exception

2019-01-02 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16731983#comment-16731983 ] Hyukjin Kwon edited comment on SPARK-26454 at 1/2/19 11:54 AM: --- Thing is,

[jira] [Comment Edited] (SPARK-26454) While creating new UDF with JAR though UDF is created successfully, it throws IllegegalArgument Exception

2019-01-02 Thread Udbhav Agrawal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16731974#comment-16731974 ] Udbhav Agrawal edited comment on SPARK-26454 at 1/2/19 11:26 AM: -

[jira] [Commented] (SPARK-26454) While creating new UDF with JAR though UDF is created successfully, it throws IllegegalArgument Exception

2019-01-02 Thread Udbhav Agrawal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16731974#comment-16731974 ] Udbhav Agrawal commented on SPARK-26454:

[jira] [Commented] (SPARK-26454) While creating new UDF with JAR though UDF is created successfully, it throws IllegegalArgument Exception

2019-01-02 Thread Udbhav Agrawal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16731967#comment-16731967 ] Udbhav Agrawal commented on SPARK-26454:

[jira] [Issue Comment Deleted] (SPARK-26454) While creating new UDF with JAR though UDF is created successfully, it throws IllegegalArgument Exception

2019-01-02 Thread Udbhav Agrawal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udbhav Agrawal updated SPARK-26454: --- Comment: was deleted (was:

[jira] [Commented] (SPARK-26462) Use ConfigEntry for hardcoded configs for execution categories.

2019-01-02 Thread Takuya Ueshin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16731953#comment-16731953 ] Takuya Ueshin commented on SPARK-26462: --- [~pralabhkumar] Sure. Please feel free to create the pull

[jira] [Updated] (SPARK-26454) While creating new UDF with JAR though UDF is created successfully, it throws IllegegalArgument Exception

2019-01-02 Thread Udbhav Agrawal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udbhav Agrawal updated SPARK-26454: --- Summary: While creating new UDF with JAR though UDF is created successfully, it throws

[jira] [Updated] (SPARK-26454) while creating new UDF with JAR though UDF is created successfully

2019-01-02 Thread Udbhav Agrawal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udbhav Agrawal updated SPARK-26454: --- Description: 【Test step】: 1.launch spark-shell 2. set role admin; 3. create new function

[jira] [Assigned] (SPARK-26517) Avoid duplicate test in ParquetSchemaPruningSuite

2019-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26517: Assignee: (was: Apache Spark) > Avoid duplicate test in ParquetSchemaPruningSuite >

[jira] [Assigned] (SPARK-26517) Avoid duplicate test in ParquetSchemaPruningSuite

2019-01-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26517: Assignee: Apache Spark > Avoid duplicate test in ParquetSchemaPruningSuite >

[jira] [Created] (SPARK-26517) Avoid duplicate test in ParquetSchemaPruningSuite

2019-01-02 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-26517: --- Summary: Avoid duplicate test in ParquetSchemaPruningSuite Key: SPARK-26517 URL: https://issues.apache.org/jira/browse/SPARK-26517 Project: Spark

[jira] [Commented] (SPARK-18805) InternalMapWithStateDStream make java.lang.StackOverflowError

2019-01-02 Thread Joost Verdoorn (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16731924#comment-16731924 ] Joost Verdoorn commented on SPARK-18805: This issue occurs relatively often within our

[jira] [Commented] (SPARK-26454) IllegegalArgument Exception is Thrown while creating new UDF with JAR

2019-01-02 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16731902#comment-16731902 ] Hyukjin Kwon commented on SPARK-26454: -- Can you fix the Jira title and description? it sounds like

[jira] [Updated] (SPARK-26454) IllegegalArgument Exception is Thrown while creating new UDF with JAR

2019-01-02 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-26454: - Priority: Trivial (was: Major) > IllegegalArgument Exception is Thrown while creating new UDF

[jira] [Commented] (SPARK-26454) IllegegalArgument Exception is Thrown while creating new UDF with JAR

2019-01-02 Thread Udbhav Agrawal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16731856#comment-16731856 ] Udbhav Agrawal commented on SPARK-26454: [~hyukjin.kwon] Yes code is working fine but showing

[jira] [Commented] (SPARK-26462) Use ConfigEntry for hardcoded configs for execution categories.

2019-01-02 Thread pralabhkumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16731862#comment-16731862 ] pralabhkumar commented on SPARK-26462: -- [~ueshin]  I can work on this . Please let me know if its

[jira] [Created] (SPARK-26516) zeppelin with spark on mesos: environment variable setting

2019-01-02 Thread Yui Hirasawa (JIRA)
Yui Hirasawa created SPARK-26516: Summary: zeppelin with spark on mesos: environment variable setting Key: SPARK-26516 URL: https://issues.apache.org/jira/browse/SPARK-26516 Project: Spark

[jira] [Commented] (SPARK-26454) IllegegalArgument Exception is Thrown while creating new UDF with JAR

2019-01-02 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16731818#comment-16731818 ] Hyukjin Kwon commented on SPARK-26454: -- Which Spark version do you use? Looks line number is

[jira] [Updated] (SPARK-26516) zeppelin with spark on mesos: environment variable setting

2019-01-02 Thread Yui Hirasawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yui Hirasawa updated SPARK-26516: - Issue Type: Question (was: IT Help) > zeppelin with spark on mesos: environment variable