[jira] [Reopened] (SPARK-22600) Fix 64kb limit for deeply nested expressions under wholestage codegen

[ https://issues.apache.org/jira/browse/SPARK-22600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reopened SPARK-22600: - > Fix 64kb limit for deeply nested expressions under wholestage codegen >

[jira] [Comment Edited] (SPARK-22600) Fix 64kb limit for deeply nested expressions under wholestage codegen

[ https://issues.apache.org/jira/browse/SPARK-22600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16290423#comment-16290423 ] Liang-Chi Hsieh edited comment on SPARK-22600 at 12/14/17 6:59 AM: --- The

[jira] [Commented] (SPARK-22600) Fix 64kb limit for deeply nested expressions under wholestage codegen

[ https://issues.apache.org/jira/browse/SPARK-22600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16290423#comment-16290423 ] Liang-Chi Hsieh commented on SPARK-22600: - The current approach proposes a new contract that

[jira] [Updated] (SPARK-22779) ConfigEntry's default value should actually be a value

[ https://issues.apache.org/jira/browse/SPARK-22779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22779: Fix Version/s: 2.3.0 Component/s: (was: Spark Core) SQL > ConfigEntry's

[jira] [Resolved] (SPARK-22779) ConfigEntry's default value should actually be a value

[ https://issues.apache.org/jira/browse/SPARK-22779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22779. - Resolution: Fixed Assignee: Marcelo Vanzin (was: Reynold Xin) > ConfigEntry's default value

[jira] [Resolved] (SPARK-22732) Add DataSourceV2 streaming APIs

[ https://issues.apache.org/jira/browse/SPARK-22732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-22732. -- Resolution: Fixed Assignee: Jose Torres Fix Version/s: 2.3.0 > Add

[jira] [Resolved] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-3181. Resolution: Fixed Fix Version/s: 2.3.0 > Add Robust Regression Algorithm with Huber

[jira] [Commented] (SPARK-22776) Increase default value of spark.sql.codegen.maxFields

[ https://issues.apache.org/jira/browse/SPARK-22776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16290351#comment-16290351 ] Kazuaki Ishizaki commented on SPARK-22776: -- Wait for re-merging SPARK-22600 > Increase default

[jira] [Updated] (SPARK-22781) Support creating streaming dataset with ORC files

[ https://issues.apache.org/jira/browse/SPARK-22781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-22781: -- Summary: Support creating streaming dataset with ORC files (was: Support creating streaming

[jira] [Assigned] (SPARK-22781) Support creating streaming dataset with ORC file format

[ https://issues.apache.org/jira/browse/SPARK-22781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22781: Assignee: Apache Spark > Support creating streaming dataset with ORC file format >

[jira] [Assigned] (SPARK-22781) Support creating streaming dataset with ORC file format

[ https://issues.apache.org/jira/browse/SPARK-22781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22781: Assignee: (was: Apache Spark) > Support creating streaming dataset with ORC file

[jira] [Created] (SPARK-22781) Support creating streaming dataset with ORC file format

Dongjoon Hyun created SPARK-22781: - Summary: Support creating streaming dataset with ORC file format Key: SPARK-22781 URL: https://issues.apache.org/jira/browse/SPARK-22781 Project: Spark

[jira] [Commented] (SPARK-22779) ConfigEntry's default value should actually be a value

[ https://issues.apache.org/jira/browse/SPARK-22779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16290259#comment-16290259 ] Apache Spark commented on SPARK-22779: -- User 'vanzin' has created a pull request for this issue:

[jira] [Updated] (SPARK-21417) Detect transitive join conditions via expressions

[ https://issues.apache.org/jira/browse/SPARK-21417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21417: -- Fix Version/s: (was: 2.3.0) > Detect transitive join conditions via expressions >

[jira] [Commented] (SPARK-22771) SQL concat for binary

[ https://issues.apache.org/jira/browse/SPARK-22771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16290174#comment-16290174 ] Takeshi Yamamuro commented on SPARK-22771: -- ok, I'll take > SQL concat for binary >

[jira] [Commented] (SPARK-7721) Generate test coverage report from Python

[ https://issues.apache.org/jira/browse/SPARK-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16290175#comment-16290175 ] Hyukjin Kwon commented on SPARK-7721: - Sure, I didn't mean to rush and start to proceed without

[jira] [Created] (SPARK-22780) make insert commands have real children to fix UI issues

Wenchen Fan created SPARK-22780: --- Summary: make insert commands have real children to fix UI issues Key: SPARK-22780 URL: https://issues.apache.org/jira/browse/SPARK-22780 Project: Spark Issue

[jira] [Updated] (SPARK-22716) Avoid the creation of mutable states in addReferenceObj

[ https://issues.apache.org/jira/browse/SPARK-22716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22716: Parent Issue: SPARK-22692 (was: SPARK-22510) > Avoid the creation of mutable states in addReferenceObj >

[jira] [Updated] (SPARK-22776) Increase default value of spark.sql.codegen.maxFields

[ https://issues.apache.org/jira/browse/SPARK-22776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22776: Issue Type: Sub-task (was: Improvement) Parent: SPARK-22510 > Increase default value of

[jira] [Commented] (SPARK-22771) SQL concat for binary

[ https://issues.apache.org/jira/browse/SPARK-22771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16290160#comment-16290160 ] Xiao Li commented on SPARK-22771: - This looks reasonable. We should fix it. > SQL concat for binary >

[jira] [Commented] (SPARK-22359) Improve the test coverage of window functions

[ https://issues.apache.org/jira/browse/SPARK-22359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16290159#comment-16290159 ] Xiao Li commented on SPARK-22359: -

[jira] [Updated] (SPARK-22747) Shorten lifetime of global variables used in HashAggregateExec

[ https://issues.apache.org/jira/browse/SPARK-22747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22747: Issue Type: Sub-task (was: Improvement) Parent: SPARK-22510 > Shorten lifetime of global

[jira] [Updated] (SPARK-22716) Avoid the creation of mutable states in addReferenceObj

[ https://issues.apache.org/jira/browse/SPARK-22716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22716: Issue Type: Sub-task (was: Improvement) Parent: SPARK-22510 > Avoid the creation of mutable

[jira] [Updated] (SPARK-22669) Avoid unnecessary function calls in code generation

[ https://issues.apache.org/jira/browse/SPARK-22669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22669: Issue Type: Sub-task (was: Bug) Parent: SPARK-22510 > Avoid unnecessary function calls in code

[jira] [Commented] (SPARK-22752) FileNotFoundException while reading from Kafka

[ https://issues.apache.org/jira/browse/SPARK-22752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16290150#comment-16290150 ] Shixiong Zhu commented on SPARK-22752: -- What's your code? You probably hit SPARK-21977 >

[jira] [Updated] (SPARK-22772) elt should use splitExpressionsWithCurrentInputs to split expression codes

[ https://issues.apache.org/jira/browse/SPARK-22772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22772: Issue Type: Sub-task (was: Bug) Parent: SPARK-22510 > elt should use

[jira] [Commented] (SPARK-7721) Generate test coverage report from Python

[ https://issues.apache.org/jira/browse/SPARK-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16290134#comment-16290134 ] Reynold Xin commented on SPARK-7721: We definitely don't need to do it in one-go, but with all the

[jira] [Commented] (SPARK-22771) SQL concat for binary

[ https://issues.apache.org/jira/browse/SPARK-22771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16290101#comment-16290101 ] Takeshi Yamamuro commented on SPARK-22771: -- [~smilegator] It's worth fixing this? > SQL concat

[jira] [Updated] (SPARK-22600) Fix 64kb limit for deeply nested expressions under wholestage codegen

[ https://issues.apache.org/jira/browse/SPARK-22600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22600: Issue Type: Sub-task (was: Bug) Parent: SPARK-22510 > Fix 64kb limit for deeply nested

[jira] [Resolved] (SPARK-21870) Split codegen'd aggregation code into small functions for the HotSpot

[ https://issues.apache.org/jira/browse/SPARK-21870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21870. - Resolution: Duplicate > Split codegen'd aggregation code into small functions for the HotSpot >

[jira] [Resolved] (SPARK-22756) Run SparkR tests if hive_thriftserver module has code changes

[ https://issues.apache.org/jira/browse/SPARK-22756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-22756. -- Resolution: Not A Problem Hey [~smilegator], let me leave this resolved based on what we

[jira] [Assigned] (SPARK-22779) ConfigEntry's default value should actually be a value

[ https://issues.apache.org/jira/browse/SPARK-22779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22779: Assignee: Reynold Xin (was: Apache Spark) > ConfigEntry's default value should actually

[jira] [Commented] (SPARK-22779) ConfigEntry's default value should actually be a value

[ https://issues.apache.org/jira/browse/SPARK-22779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16290054#comment-16290054 ] Apache Spark commented on SPARK-22779: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22779) ConfigEntry's default value should actually be a value

[ https://issues.apache.org/jira/browse/SPARK-22779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22779: Assignee: Apache Spark (was: Reynold Xin) > ConfigEntry's default value should actually

[jira] [Updated] (SPARK-22496) beeline display operation log

[ https://issues.apache.org/jira/browse/SPARK-22496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-22496: - Fix Version/s: (was: 2.3.0) > beeline display operation log > -

[jira] [Reopened] (SPARK-22496) beeline display operation log

[ https://issues.apache.org/jira/browse/SPARK-22496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-22496: -- > beeline display operation log > - > > Key:

[jira] [Created] (SPARK-22779) ConfigEntry's default value should actually be a value

Reynold Xin created SPARK-22779: --- Summary: ConfigEntry's default value should actually be a value Key: SPARK-22779 URL: https://issues.apache.org/jira/browse/SPARK-22779 Project: Spark Issue

[jira] [Assigned] (SPARK-22764) Flaky test: SparkContextSuite "Cancelling stages/jobs with custom reasons"

[ https://issues.apache.org/jira/browse/SPARK-22764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-22764: Assignee: Marcelo Vanzin > Flaky test: SparkContextSuite "Cancelling stages/jobs with

[jira] [Resolved] (SPARK-22764) Flaky test: SparkContextSuite "Cancelling stages/jobs with custom reasons"

[ https://issues.apache.org/jira/browse/SPARK-22764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-22764. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19956

[jira] [Resolved] (SPARK-22772) elt should use splitExpressionsWithCurrentInputs to split expression codes

[ https://issues.apache.org/jira/browse/SPARK-22772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22772. - Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 2.3.0 > elt should use

[jira] [Commented] (SPARK-22647) Docker files for image creation

[ https://issues.apache.org/jira/browse/SPARK-22647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289988#comment-16289988 ] Erik Erlandson commented on SPARK-22647: I'd like to propose migrating our images onto centos,

[jira] [Comment Edited] (SPARK-22359) Improve the test coverage of window functions

[ https://issues.apache.org/jira/browse/SPARK-22359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289965#comment-16289965 ] Gabor Somogyi edited comment on SPARK-22359 at 12/13/17 9:42 PM: - OK

[jira] [Commented] (SPARK-22359) Improve the test coverage of window functions

[ https://issues.apache.org/jira/browse/SPARK-22359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289965#comment-16289965 ] Gabor Somogyi commented on SPARK-22359: --- OK, then I'll jump on Frames. > Improve the test coverage

[jira] [Assigned] (SPARK-22574) Wrong request causing Spark Dispatcher going inactive

[ https://issues.apache.org/jira/browse/SPARK-22574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-22574: -- Assignee: German Schiavon Matteo > Wrong request causing Spark Dispatcher going

[jira] [Resolved] (SPARK-22574) Wrong request causing Spark Dispatcher going inactive

[ https://issues.apache.org/jira/browse/SPARK-22574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-22574. Resolution: Fixed Fix Version/s: 2.3.0 2.2.2 Issue resolved by

[jira] [Commented] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289923#comment-16289923 ] Apache Spark commented on SPARK-22778: -- User 'liyinan926' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22778: Assignee: Apache Spark > Kubernetes scheduler at master failing to run applications

[jira] [Assigned] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22778: Assignee: (was: Apache Spark) > Kubernetes scheduler at master failing to run

[jira] [Assigned] (SPARK-21417) Detect transitive join conditions via expressions

[ https://issues.apache.org/jira/browse/SPARK-21417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21417: Assignee: Anton Okolnychyi (was: Apache Spark) > Detect transitive join conditions via

[jira] [Assigned] (SPARK-21417) Detect transitive join conditions via expressions

[ https://issues.apache.org/jira/browse/SPARK-21417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21417: Assignee: Apache Spark (was: Anton Okolnychyi) > Detect transitive join conditions via

[jira] [Commented] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289907#comment-16289907 ] Yinan Li commented on SPARK-22778: -- Just verified that the fix worked. I'm gonna send a PR soon. >

[jira] [Reopened] (SPARK-21417) Detect transitive join conditions via expressions

[ https://issues.apache.org/jira/browse/SPARK-21417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-21417: - > Detect transitive join conditions via expressions > - > >

[jira] [Resolved] (SPARK-21417) Detect transitive join conditions via expressions

[ https://issues.apache.org/jira/browse/SPARK-21417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21417. - Resolution: Not A Problem > Detect transitive join conditions via expressions >

[jira] [Reopened] (SPARK-21417) Detect transitive join conditions via expressions

[ https://issues.apache.org/jira/browse/SPARK-21417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-21417: - > Detect transitive join conditions via expressions > - > >

[jira] [Commented] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289881#comment-16289881 ] Anirudh Ramanathan commented on SPARK-22778: Excellent - thanks for the quick debug Matt. Now

[jira] [Commented] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289876#comment-16289876 ] Yinan Li commented on SPARK-22778: -- Ah, yes, the PR missed that. OK, I'm gonna give that a try and

[jira] [Commented] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289875#comment-16289875 ] Matt Cheah commented on SPARK-22778: And then notice we don't even have a {{resources}} directory on

[jira] [Commented] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289871#comment-16289871 ] Matt Cheah commented on SPARK-22778: I see the problem. We're missing the {{META-INF.services}} file

[jira] [Comment Edited] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289868#comment-16289868 ] Anirudh Ramanathan edited comment on SPARK-22778 at 12/13/17 8:41 PM:

[jira] [Commented] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289868#comment-16289868 ] Anirudh Ramanathan commented on SPARK-22778: I've verified that the image contains the right

[jira] [Updated] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Cheah updated SPARK-22778: --- Priority: Critical (was: Major) > Kubernetes scheduler at master failing to run applications

[jira] [Comment Edited] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289836#comment-16289836 ] Matt Cheah edited comment on SPARK-22778 at 12/13/17 8:28 PM: -- The

[jira] [Commented] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289836#comment-16289836 ] Matt Cheah commented on SPARK-22778: The `canCreate` method for `KubernetesClusterManager` should

[jira] [Comment Edited] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289822#comment-16289822 ] Yinan Li edited comment on SPARK-22778 at 12/13/17 8:24 PM: Just some

[jira] [Commented] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289822#comment-16289822 ] Yinan Li commented on SPARK-22778: -- Just some background on this. The validation and parsing of k8s

[jira] [Comment Edited] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289818#comment-16289818 ] Anirudh Ramanathan edited comment on SPARK-22778 at 12/13/17 8:23 PM:

[jira] [Commented] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289818#comment-16289818 ] Anirudh Ramanathan commented on SPARK-22778: I submitted it as `k8s://https://xx.yy.zz.ww` to

[jira] [Commented] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289815#comment-16289815 ] Matt Cheah commented on SPARK-22778: Think that URI should be 'k8s://https://xx.yy.zz.ww' - notice

[jira] [Updated] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan updated SPARK-22778: --- Description: Building images based on master and deploying Spark PI results in the

[jira] [Commented] (SPARK-22778) Kubernetes scheduler at master failing tests

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289808#comment-16289808 ] Anirudh Ramanathan commented on SPARK-22778: [~mcheah] [~kimoonkim] [~ifilonenko] PTAL >

[jira] [Updated] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully.

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan updated SPARK-22778: --- Summary: Kubernetes scheduler at master failing to run applications successfully.

[jira] [Updated] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan updated SPARK-22778: --- Summary: Kubernetes scheduler at master failing to run applications successfully

[jira] [Created] (SPARK-22778) Kubernetes scheduler at master failing tests

Anirudh Ramanathan created SPARK-22778: -- Summary: Kubernetes scheduler at master failing tests Key: SPARK-22778 URL: https://issues.apache.org/jira/browse/SPARK-22778 Project: Spark

[jira] [Comment Edited] (SPARK-22360) Add unit test for Window Specifications

[ https://issues.apache.org/jira/browse/SPARK-22360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289803#comment-16289803 ] Sandor Murakozi edited comment on SPARK-22360 at 12/13/17 8:09 PM: --- I

[jira] [Commented] (SPARK-22647) Docker files for image creation

[ https://issues.apache.org/jira/browse/SPARK-22647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289805#comment-16289805 ] Anirudh Ramanathan commented on SPARK-22647: [~mcheah] [~erikerlandson] PTAL > Docker files

[jira] [Commented] (SPARK-22360) Add unit test for Window Specifications

[ https://issues.apache.org/jira/browse/SPARK-22360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289803#comment-16289803 ] Sandor Murakozi commented on SPARK-22360: - I just did a quick check of the existing test cases to

[jira] [Comment Edited] (SPARK-22360) Add unit test for Window Specifications

[ https://issues.apache.org/jira/browse/SPARK-22360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289803#comment-16289803 ] Sandor Murakozi edited comment on SPARK-22360 at 12/13/17 8:08 PM: --- I

[jira] [Updated] (SPARK-22777) Docker container built for Kubernetes doesn't allow running entrypoint.sh

[ https://issues.apache.org/jira/browse/SPARK-22777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan updated SPARK-22777: --- Description: Default docker images built thrown an error when trying to run on a

[jira] [Updated] (SPARK-22777) Docker container built for Kubernetes doesn't allow running entrypoint.sh

[ https://issues.apache.org/jira/browse/SPARK-22777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan updated SPARK-22777: --- Description: Default docker images built thrown an error when trying to run on a

[jira] [Updated] (SPARK-22777) Docker container built for Kubernetes doesn't allow running entrypoint.sh

[ https://issues.apache.org/jira/browse/SPARK-22777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan updated SPARK-22777: --- Description: Default docker images built thrown an error when trying to run on a

[jira] [Updated] (SPARK-22777) Docker container built for Kubernetes doesn't allow running entrypoint.sh

[ https://issues.apache.org/jira/browse/SPARK-22777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan updated SPARK-22777: --- Description: Default docker images built thrown an error when trying to run on a

[jira] [Comment Edited] (SPARK-22777) Docker container built for Kubernetes doesn't allow running entrypoint.sh

[ https://issues.apache.org/jira/browse/SPARK-22777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289795#comment-16289795 ] Anirudh Ramanathan edited comment on SPARK-22777 at 12/13/17 8:02 PM:

[jira] [Updated] (SPARK-22777) Docker container built for Kubernetes doesn't allow running entrypoint.sh

[ https://issues.apache.org/jira/browse/SPARK-22777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan updated SPARK-22777: --- [~liyinan926] [~ssuchter] > Docker container built for Kubernetes doesn't allow running

[jira] [Created] (SPARK-22777) Docker container built for Kubernetes doesn't allow running entrypoint.sh

Anirudh Ramanathan created SPARK-22777: -- Summary: Docker container built for Kubernetes doesn't allow running entrypoint.sh Key: SPARK-22777 URL: https://issues.apache.org/jira/browse/SPARK-22777

[jira] [Commented] (SPARK-22765) Create a new executor allocation scheme based on that of MR

[ https://issues.apache.org/jira/browse/SPARK-22765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289793#comment-16289793 ] Thomas Graves commented on SPARK-22765: --- ok so before you do anything else I would suggest trying

[jira] [Commented] (SPARK-22359) Improve the test coverage of window functions

[ https://issues.apache.org/jira/browse/SPARK-22359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289792#comment-16289792 ] Sandor Murakozi commented on SPARK-22359: - I'm glad that you join [~gsomogyi]. Do you have any

[jira] [Assigned] (SPARK-22754) Check spark.executor.heartbeatInterval setting in case of ExecutorLost

[ https://issues.apache.org/jira/browse/SPARK-22754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-22754: -- Assignee: zhoukang > Check spark.executor.heartbeatInterval setting in case of

[jira] [Resolved] (SPARK-22754) Check spark.executor.heartbeatInterval setting in case of ExecutorLost

[ https://issues.apache.org/jira/browse/SPARK-22754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-22754. Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19942

[jira] [Created] (SPARK-22776) Increase default value of spark.sql.codegen.maxFields

Kazuaki Ishizaki created SPARK-22776: Summary: Increase default value of spark.sql.codegen.maxFields Key: SPARK-22776 URL: https://issues.apache.org/jira/browse/SPARK-22776 Project: Spark

[jira] [Commented] (SPARK-22765) Create a new executor allocation scheme based on that of MR

[ https://issues.apache.org/jira/browse/SPARK-22765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289726#comment-16289726 ] Xuefu Zhang commented on SPARK-22765: - Yes, we are using Hive on Spark. Our Spark version is 1.6.1,

[jira] [Commented] (SPARK-22765) Create a new executor allocation scheme based on that of MR

[ https://issues.apache.org/jira/browse/SPARK-22765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289700#comment-16289700 ] Thomas Graves commented on SPARK-22765: --- ok so its basically they idle timeout during DAG computing

[jira] [Commented] (SPARK-22683) DynamicAllocation wastes resources by allocating containers that will barely be used

[ https://issues.apache.org/jira/browse/SPARK-22683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289689#comment-16289689 ] Xuefu Zhang commented on SPARK-22683: - [~tgraves], I can speak on our use case, where same queries

[jira] [Comment Edited] (SPARK-22765) Create a new executor allocation scheme based on that of MR

[ https://issues.apache.org/jira/browse/SPARK-22765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289676#comment-16289676 ] Xuefu Zhang edited comment on SPARK-22765 at 12/13/17 6:30 PM: --- Hi

[jira] [Updated] (SPARK-18278) SPIP: Support native submission of spark jobs to a kubernetes cluster

[ https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yinan Li updated SPARK-18278: - Component/s: Kubernetes > SPIP: Support native submission of spark jobs to a kubernetes cluster >

[jira] [Commented] (SPARK-22765) Create a new executor allocation scheme based on that of MR

[ https://issues.apache.org/jira/browse/SPARK-22765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289676#comment-16289676 ] Xuefu Zhang commented on SPARK-22765: - Hi [~tgraves], Thanks for your input. In our busy, heavily

[jira] [Commented] (SPARK-22683) DynamicAllocation wastes resources by allocating containers that will barely be used

[ https://issues.apache.org/jira/browse/SPARK-22683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289656#comment-16289656 ] Thomas Graves commented on SPARK-22683: --- I am also curious, when you are comparing spark to MR

[jira] [Commented] (SPARK-22683) DynamicAllocation wastes resources by allocating containers that will barely be used

[ https://issues.apache.org/jira/browse/SPARK-22683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289614#comment-16289614 ] Thomas Graves commented on SPARK-22683: --- So the issue brought up here seems to be resource waste vs

[jira] [Commented] (SPARK-22765) Create a new executor allocation scheme based on that of MR

[ https://issues.apache.org/jira/browse/SPARK-22765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289613#comment-16289613 ] Thomas Graves commented on SPARK-22765: --- why doesn't idle timeout very small < 5 seconds work? If

[jira] [Assigned] (SPARK-22774) Add compilation check for generated code in TPCDSQuerySuite

[ https://issues.apache.org/jira/browse/SPARK-22774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22774: Assignee: Apache Spark > Add compilation check for generated code in TPCDSQuerySuite >

[jira] [Assigned] (SPARK-22774) Add compilation check for generated code in TPCDSQuerySuite

[ https://issues.apache.org/jira/browse/SPARK-22774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22774: Assignee: (was: Apache Spark) > Add compilation check for generated code in

  1   2   >