[jira] [Resolved] (SPARK-25710) range should report metrics correctly

2018-10-12 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-25710. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22698

[jira] [Resolved] (SPARK-25714) Null Handling in the Optimizer rule BooleanSimplification

2018-10-12 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25714. - Resolution: Fixed Fix Version/s: 2.4.0 2.3.3 Target Version/s:

[jira] [Updated] (SPARK-25723) dataset.show() , scala.MatchError: 23.25 (of class java.lang.Double)

2018-10-12 Thread huanghuai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huanghuai updated SPARK-25723: -- Environment: local mode Description: {color:#33}*spark.read()*{color}

[jira] [Updated] (SPARK-25722) Support a backtick character in column names

2018-10-12 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25722: -- Description: Among built-in data sources, `avro` and `orc` doesn't allow `backtick` in

[jira] [Updated] (SPARK-25722) Support a backtick character in column names

2018-10-12 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25722: -- Description: Among built-in data sources, `avro` and `orc` doesn't allow `backtick` in

[jira] [Created] (SPARK-25723) dataset.show() , scala.MatchError: 23.25 (of class java.lang.Double)

2018-10-12 Thread huanghuai (JIRA)
huanghuai created SPARK-25723: - Summary: dataset.show() , scala.MatchError: 23.25 (of class java.lang.Double) Key: SPARK-25723 URL: https://issues.apache.org/jira/browse/SPARK-25723 Project: Spark

[jira] [Updated] (SPARK-25722) Support a backtick character in column names

2018-10-12 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25722: -- Priority: Minor (was: Major) > Support a backtick character in column names >

[jira] [Updated] (SPARK-25722) Support a backtick character in column names

2018-10-12 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25722: -- Issue Type: Improvement (was: Bug) > Support a backtick character in column names >

[jira] [Created] (SPARK-25722) Support a backtick character in column names

2018-10-12 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-25722: - Summary: Support a backtick character in column names Key: SPARK-25722 URL: https://issues.apache.org/jira/browse/SPARK-25722 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-20327) Add CLI support for YARN custom resources, like GPUs

2018-10-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-20327. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 20761

[jira] [Assigned] (SPARK-20327) Add CLI support for YARN custom resources, like GPUs

2018-10-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-20327: -- Assignee: Szilard Nemeth > Add CLI support for YARN custom resources, like GPUs >

[jira] [Assigned] (SPARK-19287) JavaPairRDD flatMapValues requires function returning Iterable, not Iterator

2018-10-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-19287: - Assignee: Sean Owen > JavaPairRDD flatMapValues requires function returning Iterable, not

[jira] [Resolved] (SPARK-19287) JavaPairRDD flatMapValues requires function returning Iterable, not Iterator

2018-10-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19287. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22690

[jira] [Updated] (SPARK-25721) maxRate configuration not being used in Kinesis receiver

2018-10-12 Thread Zhaobo Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaobo Yu updated SPARK-25721: -- Description: In the onStart() function of KinesisReceiver class, the  KinesisClientLibConfiguration

[jira] [Updated] (SPARK-25721) maxRate configuration not being used in Kinesis receiver

2018-10-12 Thread Zhaobo Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaobo Yu updated SPARK-25721: -- Description: In the onStart() function of KinesisReceiver class, the  KinesisClientLibConfiguration

[jira] [Assigned] (SPARK-25664) Refactor JoinBenchmark to use main method

2018-10-12 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-25664: - Assignee: Yuming Wang > Refactor JoinBenchmark to use main method >

[jira] [Resolved] (SPARK-25664) Refactor JoinBenchmark to use main method

2018-10-12 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25664. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22661

[jira] [Updated] (SPARK-25721) maxRate configuration not being used in Kinesis receiver

2018-10-12 Thread Zhaobo Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaobo Yu updated SPARK-25721: -- Attachment: rate_violation.png > maxRate configuration not being used in Kinesis receiver >

[jira] [Updated] (SPARK-25721) maxRate configuration not being used in Kinesis receiver

2018-10-12 Thread Zhaobo Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaobo Yu updated SPARK-25721: -- Description: In the onStart() function of KinesisReceiver class, the  KinesisClientLibConfiguration

[jira] [Updated] (SPARK-25721) maxRate configuration not being used in Kinesis receiver

2018-10-12 Thread Zhaobo Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaobo Yu updated SPARK-25721: -- Attachment: Screenshot from 2018-10-12 14-51-29.png > maxRate configuration not being used in Kinesis

[jira] [Created] (SPARK-25721) maxRate configuration not being used in Kinesis receiver

2018-10-12 Thread Zhaobo Yu (JIRA)
Zhaobo Yu created SPARK-25721: - Summary: maxRate configuration not being used in Kinesis receiver Key: SPARK-25721 URL: https://issues.apache.org/jira/browse/SPARK-25721 Project: Spark Issue

[jira] [Updated] (SPARK-25721) maxRate configuration not being used in Kinesis receiver

2018-10-12 Thread Zhaobo Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaobo Yu updated SPARK-25721: -- Description: In the onStart() function of KinesisReceiver class, the  KinesisClientLibConfiguration

[jira] [Updated] (SPARK-25721) maxRate configuration not being used in Kinesis receiver

2018-10-12 Thread Zhaobo Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaobo Yu updated SPARK-25721: -- Attachment: (was: Screenshot from 2018-10-12 14-51-29.png) > maxRate configuration not being used

[jira] [Comment Edited] (SPARK-21896) Stack Overflow when window function nested inside aggregate function

2018-10-12 Thread Vincent Grosbois (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16648450#comment-16648450 ] Vincent Grosbois edited comment on SPARK-21896 at 10/12/18 9:23 PM:

[jira] [Commented] (SPARK-21896) Stack Overflow when window function nested inside aggregate function

2018-10-12 Thread Vincent Grosbois (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16648450#comment-16648450 ] Vincent Grosbois commented on SPARK-21896: -- Hello! Is there anyway this can be backported in

[jira] [Commented] (SPARK-24347) df.alias() in python API should not clear metadata by default

2018-10-12 Thread Axel Magnuson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16648441#comment-16648441 ] Axel Magnuson commented on SPARK-24347: --- Okay.  Fair enough.  Officially retracting my interest ;)

[jira] [Commented] (SPARK-25694) URL.setURLStreamHandlerFactory causing incompatible HttpURLConnection issue

2018-10-12 Thread Bo Yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16648432#comment-16648432 ] Bo Yang commented on SPARK-25694: - Got it, thanks [~hyukjin.kwon] for the suggestion! >

[jira] [Created] (SPARK-25720) Support auto refresh page for the WEBUI

2018-10-12 Thread ABHISHEK KUMAR GUPTA (JIRA)
ABHISHEK KUMAR GUPTA created SPARK-25720: Summary: Support auto refresh page for the WEBUI Key: SPARK-25720 URL: https://issues.apache.org/jira/browse/SPARK-25720 Project: Spark

[jira] [Commented] (SPARK-25720) Support auto refresh page for the WEBUI

2018-10-12 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16648410#comment-16648410 ] shahid commented on SPARK-25720: I am working on it. > Support auto refresh page for the WEBUI >

[jira] [Resolved] (SPARK-25660) Impossible to use the backward slash as the CSV fields delimiter

2018-10-12 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25660. - Resolution: Fixed Assignee: Maxim Gekk Fix Version/s: 2.4.0 > Impossible to use the

[jira] [Resolved] (SPARK-25697) When zstd compression enabled in progress application is throwing Error in UI

2018-10-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25697. --- Resolution: Fixed Assignee: shahid Fix Version/s: 2.4.1 Resolved by 

[jira] [Commented] (SPARK-18278) SPIP: Support native submission of spark jobs to a kubernetes cluster

2018-10-12 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16648208#comment-16648208 ] Matt Cheah commented on SPARK-18278: [~liushaohui] a significantly large prerequisite for dynamic

[jira] [Resolved] (SPARK-25712) Improve usage message of start-master.sh and start-slave.sh

2018-10-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25712. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22700

[jira] [Assigned] (SPARK-25712) Improve usage message of start-master.sh and start-slave.sh

2018-10-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25712: - Assignee: Gengliang Wang > Improve usage message of start-master.sh and start-slave.sh >

[jira] [Resolved] (SPARK-25685) Allow running tests in Jenkins in enterprise Git repository

2018-10-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25685. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22678

[jira] [Assigned] (SPARK-25685) Allow running tests in Jenkins in enterprise Git repository

2018-10-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25685: - Assignee: Lantao Jin > Allow running tests in Jenkins in enterprise Git repository >

[jira] [Assigned] (SPARK-25662) Refactor DataSourceReadBenchmark to use main method

2018-10-12 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-25662: --- Assignee: Peter Toth > Refactor DataSourceReadBenchmark to use main method >

[jira] [Resolved] (SPARK-21241) Add intercept to StreamingLinearRegressionWithSGD

2018-10-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21241. --- Resolution: Won't Fix > Add intercept to StreamingLinearRegressionWithSGD >

[jira] [Assigned] (SPARK-25670) Speed up JsonExpressionsSuite

2018-10-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25670: - Assignee: Maxim Gekk > Speed up JsonExpressionsSuite > - > >

[jira] [Resolved] (SPARK-25670) Speed up JsonExpressionsSuite

2018-10-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25670. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22657

[jira] [Assigned] (SPARK-25567) [Spark Job History] Table listing in SQL Tab not display Sort Icon

2018-10-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25567: - Assignee: shahid > [Spark Job History] Table listing in SQL Tab not display Sort Icon >

[jira] [Resolved] (SPARK-25567) [Spark Job History] Table listing in SQL Tab not display Sort Icon

2018-10-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25567. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22645

[jira] [Resolved] (SPARK-25566) [Spark Job History] SQL UI Page does not support Pagination

2018-10-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25566. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22645

[jira] [Assigned] (SPARK-25566) [Spark Job History] SQL UI Page does not support Pagination

2018-10-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25566: - Assignee: shahid > [Spark Job History] SQL UI Page does not support Pagination >

[jira] [Assigned] (SPARK-21809) Change Stage Page to use datatables to support sorting columns and searching

2018-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21809: Assignee: Apache Spark > Change Stage Page to use datatables to support sorting columns

[jira] [Assigned] (SPARK-21809) Change Stage Page to use datatables to support sorting columns and searching

2018-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21809: Assignee: (was: Apache Spark) > Change Stage Page to use datatables to support

[jira] [Reopened] (SPARK-21809) Change Stage Page to use datatables to support sorting columns and searching

2018-10-12 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reopened SPARK-21809: --- > Change Stage Page to use datatables to support sorting columns and searching >

[jira] [Created] (SPARK-25719) Search functionality in datatables in stages page should search over formatted data rather than the raw data

2018-10-12 Thread Parth Gandhi (JIRA)
Parth Gandhi created SPARK-25719: Summary: Search functionality in datatables in stages page should search over formatted data rather than the raw data Key: SPARK-25719 URL:

[jira] [Assigned] (SPARK-25718) Detect recursive reference in Avro schema and throw exception

2018-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25718: Assignee: Apache Spark > Detect recursive reference in Avro schema and throw exception >

[jira] [Commented] (SPARK-25718) Detect recursive reference in Avro schema and throw exception

2018-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16648021#comment-16648021 ] Apache Spark commented on SPARK-25718: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-25718) Detect recursive reference in Avro schema and throw exception

2018-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16648022#comment-16648022 ] Apache Spark commented on SPARK-25718: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-25718) Detect recursive reference in Avro schema and throw exception

2018-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25718: Assignee: (was: Apache Spark) > Detect recursive reference in Avro schema and throw

[jira] [Created] (SPARK-25718) Detect recursive reference in Avro schema and throw exception

2018-10-12 Thread Gengliang Wang (JIRA)
Gengliang Wang created SPARK-25718: -- Summary: Detect recursive reference in Avro schema and throw exception Key: SPARK-25718 URL: https://issues.apache.org/jira/browse/SPARK-25718 Project: Spark

[jira] [Commented] (SPARK-24225) Support closing AutoClosable objects in MemoryStore so Broadcast Variables can be released properly

2018-10-12 Thread Doug Rohrer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16648009#comment-16648009 ] Doug Rohrer commented on SPARK-24225: - Sorry this has dropped off my radar for so long - work + life

[jira] [Commented] (SPARK-10816) EventTime based sessionization

2018-10-12 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16647923#comment-16647923 ] Jungtaek Lim commented on SPARK-10816: -- Btw, I've just rebuilt with Baidu's updated patch and reran

[jira] [Commented] (SPARK-20236) Overwrite a partitioned data source table should only overwrite related partitions

2018-10-12 Thread Deepanker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16647916#comment-16647916 ] Deepanker commented on SPARK-20236: --- Hi [~cloud_fan], 1.) Dataset resultantDataset = 2.)

[jira] [Commented] (SPARK-21402) Java encoders - switch fields on collectAsList

2018-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16647839#comment-16647839 ] Apache Spark commented on SPARK-21402: -- User 'vofque' has created a pull request for this issue:

[jira] [Commented] (SPARK-21402) Java encoders - switch fields on collectAsList

2018-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16647838#comment-16647838 ] Apache Spark commented on SPARK-21402: -- User 'vofque' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21402) Java encoders - switch fields on collectAsList

2018-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21402: Assignee: Apache Spark > Java encoders - switch fields on collectAsList >

[jira] [Assigned] (SPARK-21402) Java encoders - switch fields on collectAsList

2018-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21402: Assignee: (was: Apache Spark) > Java encoders - switch fields on collectAsList >

[jira] [Commented] (SPARK-10816) EventTime based sessionization

2018-10-12 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16647816#comment-16647816 ] Jungtaek Lim commented on SPARK-10816: -- I'd add my thought about the approach 2. It would work best

[jira] [Comment Edited] (SPARK-24751) [k8s] Relaunch failed executor pods

2018-10-12 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16647757#comment-16647757 ] Stavros Kontopoulos edited comment on SPARK-24751 at 10/12/18 10:37 AM:

[jira] [Comment Edited] (SPARK-24751) [k8s] Relaunch failed executor pods

2018-10-12 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16647757#comment-16647757 ] Stavros Kontopoulos edited comment on SPARK-24751 at 10/12/18 10:37 AM:

[jira] [Comment Edited] (SPARK-24751) [k8s] Relaunch failed executor pods

2018-10-12 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16647757#comment-16647757 ] Stavros Kontopoulos edited comment on SPARK-24751 at 10/12/18 10:36 AM:

[jira] [Commented] (SPARK-24751) [k8s] Relaunch failed executor pods

2018-10-12 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16647757#comment-16647757 ] Stavros Kontopoulos commented on SPARK-24751: - If an executor dies (eg. killing it) the

[jira] [Comment Edited] (SPARK-24751) [k8s] Relaunch failed executor pods

2018-10-12 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16647757#comment-16647757 ] Stavros Kontopoulos edited comment on SPARK-24751 at 10/12/18 10:36 AM:

[jira] [Assigned] (SPARK-25717) Insert overwrite a recreated external and partitioned table may result in incorrect query results

2018-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25717: Assignee: Apache Spark > Insert overwrite a recreated external and partitioned table may

[jira] [Assigned] (SPARK-25717) Insert overwrite a recreated external and partitioned table may result in incorrect query results

2018-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25717: Assignee: (was: Apache Spark) > Insert overwrite a recreated external and

[jira] [Commented] (SPARK-25717) Insert overwrite a recreated external and partitioned table may result in incorrect query results

2018-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16647726#comment-16647726 ] Apache Spark commented on SPARK-25717: -- User 'fjh100456' has created a pull request for this issue:

[jira] [Updated] (SPARK-25717) Insert overwrite a recreated external and partitioned table may result in incorrect query results

2018-10-12 Thread Jinhua Fu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinhua Fu updated SPARK-25717: -- Description: Consider the following scenario: {code:java} spark.range(100).createTempView("temp") (0

[jira] [Created] (SPARK-25717) Insert overwrite a recreated external and partitioned table may result in incorrect query results

2018-10-12 Thread Jinhua Fu (JIRA)
Jinhua Fu created SPARK-25717: - Summary: Insert overwrite a recreated external and partitioned table may result in incorrect query results Key: SPARK-25717 URL: https://issues.apache.org/jira/browse/SPARK-25717

[jira] [Resolved] (SPARK-25708) HAVING without GROUP BY means global aggregate

2018-10-12 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25708. - Resolution: Fixed Fix Version/s: 2.4.0 > HAVING without GROUP BY means global aggregate >

[jira] [Commented] (SPARK-25061) Spark SQL Thrift Server fails to not pick up hiveconf passing parameter

2018-10-12 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16647537#comment-16647537 ] Yuming Wang commented on SPARK-25061: - Cloud you try to set it by: {code:sh} --conf