[jira] [Commented] (SPARK-16951) Alternative implementation of NOT IN to Anti-join

[ https://issues.apache.org/jira/browse/SPARK-16951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413753#comment-15413753 ] Nattavut Sutyanyong commented on SPARK-16951: - Thanks, @hvanhovelll, for the VLDB paper. It

[jira] [Commented] (SPARK-10601) Spark SQL - Support for MINUS

[ https://issues.apache.org/jira/browse/SPARK-10601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413729#comment-15413729 ] Dongjoon Hyun commented on SPARK-10601: --- Hi, [~rlgarris]. For this one, you can use `EXCEPT

[jira] [Commented] (SPARK-16978) exception (java.lang.VerifyError) is thrown while submiting jar in standalone cluster

[ https://issues.apache.org/jira/browse/SPARK-16978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413686#comment-15413686 ] Sean Owen commented on SPARK-16978: --- Yes, but the error is coming from the operation of this third

[jira] [Commented] (SPARK-16978) exception (java.lang.VerifyError) is thrown while submiting jar in standalone cluster

[ https://issues.apache.org/jira/browse/SPARK-16978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413682#comment-15413682 ] Eran Mizrahi commented on SPARK-16978: -- btw, i am able to run the jar as a standalone jar, not

[jira] [Commented] (SPARK-16978) exception (java.lang.VerifyError) is thrown while submiting jar in standalone cluster

[ https://issues.apache.org/jira/browse/SPARK-16978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413677#comment-15413677 ] Eran Mizrahi commented on SPARK-16978: -- i use Spark-RabbitMQ as a connector for spark stream. I

[jira] [Commented] (SPARK-16978) exception (java.lang.VerifyError) is thrown while submiting jar in standalone cluster

[ https://issues.apache.org/jira/browse/SPARK-16978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413661#comment-15413661 ] Sean Owen commented on SPARK-16978: --- I think this error is coming from an external project. There isn't

[jira] [Updated] (SPARK-16978) exception (java.lang.VerifyError) is thrown while submiting jar in standalone cluster

[ https://issues.apache.org/jira/browse/SPARK-16978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eran Mizrahi updated SPARK-16978: - Summary: exception (java.lang.VerifyError) is thrown while submiting jar in standalone cluster

[jira] [Updated] (SPARK-16978) exception (java.lang.VerifyError) is thrown while trying to submit jar in standalone cluster

[ https://issues.apache.org/jira/browse/SPARK-16978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eran Mizrahi updated SPARK-16978: - Description: The following exception was shown in the cluster log: 16/08/09 17:24:54 ERROR

[jira] [Created] (SPARK-16978) exception (java.lang.VerifyError) is thrown while trying to submit jar in standalone cluster

Eran Mizrahi created SPARK-16978: Summary: exception (java.lang.VerifyError) is thrown while trying to submit jar in standalone cluster Key: SPARK-16978 URL: https://issues.apache.org/jira/browse/SPARK-16978

[jira] [Commented] (SPARK-10078) Vector-free L-BFGS

[ https://issues.apache.org/jira/browse/SPARK-10078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413623#comment-15413623 ] Yanbo Liang commented on SPARK-10078: - I posted the design document which is still WIP here. Please

[jira] [Updated] (SPARK-10078) Vector-free L-BFGS

[ https://issues.apache.org/jira/browse/SPARK-10078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-10078: Description: This is to implement a scalable version of vector-free L-BFGS

[jira] [Commented] (SPARK-16976) KCore implementation

[ https://issues.apache.org/jira/browse/SPARK-16976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413463#comment-15413463 ] Sean Owen commented on SPARK-16976: --- Yes, same principle applies though. I am not sure this is

[jira] [Commented] (SPARK-16977) start spark-shell with yarn mode error

[ https://issues.apache.org/jira/browse/SPARK-16977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413462#comment-15413462 ] Sean Owen commented on SPARK-16977: --- [~shijinkui] this isn't actually the error. Something went wrong

[jira] [Commented] (SPARK-16976) KCore implementation

[ https://issues.apache.org/jira/browse/SPARK-16976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413461#comment-15413461 ] Ohad Raviv commented on SPARK-16976: well, it's not for MLlib but for GraphX and seems very much in

[jira] [Created] (SPARK-16977) start spark-shell with yarn mode error

shijinkui created SPARK-16977: - Summary: start spark-shell with yarn mode error Key: SPARK-16977 URL: https://issues.apache.org/jira/browse/SPARK-16977 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-14559) Netty RPC didn't check channel is active before sending message

[ https://issues.apache.org/jira/browse/SPARK-14559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413408#comment-15413408 ] shijinkui commented on SPARK-14559: --- spark: 2.0.0 yarn: 1.7.2 yarn log error: 2016-08-09 19:31:22,061

[jira] [Assigned] (SPARK-16976) KCore implementation

[ https://issues.apache.org/jira/browse/SPARK-16976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16976: Assignee: Apache Spark > KCore implementation > > >

[jira] [Commented] (SPARK-16976) KCore implementation

[ https://issues.apache.org/jira/browse/SPARK-16976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413400#comment-15413400 ] Apache Spark commented on SPARK-16976: -- User 'uzadude' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16976) KCore implementation

[ https://issues.apache.org/jira/browse/SPARK-16976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16976: Assignee: (was: Apache Spark) > KCore implementation > > >

[jira] [Commented] (SPARK-16976) KCore implementation

[ https://issues.apache.org/jira/browse/SPARK-16976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413398#comment-15413398 ] Sean Owen commented on SPARK-16976: --- I doubt this would go in directly. Have a look at

[jira] [Created] (SPARK-16976) KCore implementation

Ohad Raviv created SPARK-16976: -- Summary: KCore implementation Key: SPARK-16976 URL: https://issues.apache.org/jira/browse/SPARK-16976 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-16975) Spark-2.0.0 unable to infer schema for parquet data written by Spark-1.6.2

[ https://issues.apache.org/jira/browse/SPARK-16975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuai Lin updated SPARK-16975: -- Labels: parquet (was: ) > Spark-2.0.0 unable to infer schema for parquet data written by Spark-1.6.2

[jira] [Created] (SPARK-16975) Spark-2.0.0 unable to infer schema for parquet data written by Spark-1.6.2

immerrr again created SPARK-16975: - Summary: Spark-2.0.0 unable to infer schema for parquet data written by Spark-1.6.2 Key: SPARK-16975 URL: https://issues.apache.org/jira/browse/SPARK-16975

[jira] [Commented] (SPARK-16974) Handle redelivery of message in MQTT structured streaming source.

[ https://issues.apache.org/jira/browse/SPARK-16974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413382#comment-15413382 ] Sean Owen commented on SPARK-16974: --- This code moved out of Spark a while ago. Are you looking for

[jira] [Closed] (SPARK-16974) Handle redelivery of message in MQTT structured streaming source.

[ https://issues.apache.org/jira/browse/SPARK-16974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma closed SPARK-16974. --- Resolution: Invalid Created in error, was supposed to create it in Bahir project. > Handle

[jira] [Created] (SPARK-16974) Handle redelivery of message in MQTT structured streaming source.

Prashant Sharma created SPARK-16974: --- Summary: Handle redelivery of message in MQTT structured streaming source. Key: SPARK-16974 URL: https://issues.apache.org/jira/browse/SPARK-16974 Project:

[jira] [Commented] (SPARK-16886) StructuredNetworkWordCount code comment incorrectly refers to DataFrame instead of Dataset

[ https://issues.apache.org/jira/browse/SPARK-16886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413373#comment-15413373 ] Apache Spark commented on SPARK-16886: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Updated] (SPARK-16934) Improve LogisticCostFun to avoid redundant serialization

[ https://issues.apache.org/jira/browse/SPARK-16934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16934: -- Summary: Improve LogisticCostFun to avoid redundant serialization (was: Improve LogisticCostFun to

[jira] [Resolved] (SPARK-16933) AFTAggregator in AFTSurvivalRegression serializes unnecessary data

[ https://issues.apache.org/jira/browse/SPARK-16933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-16933. - Resolution: Fixed Fix Version/s: 2.1.0 Target Version/s: 2.1.0 > AFTAggregator

[jira] [Assigned] (SPARK-16933) AFTAggregator in AFTSurvivalRegression serializes unnecessary data

[ https://issues.apache.org/jira/browse/SPARK-16933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang reassigned SPARK-16933: --- Assignee: Yanbo Liang > AFTAggregator in AFTSurvivalRegression serializes unnecessary data

[jira] [Resolved] (SPARK-16964) Remove private[sql] and private[spark] from sql.execution package

[ https://issues.apache.org/jira/browse/SPARK-16964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-16964. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14554

[jira] [Assigned] (SPARK-16973) remove the buffer offsets in ImperativeAggregate

[ https://issues.apache.org/jira/browse/SPARK-16973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16973: Assignee: Apache Spark (was: Wenchen Fan) > remove the buffer offsets in

[jira] [Commented] (SPARK-16973) remove the buffer offsets in ImperativeAggregate

[ https://issues.apache.org/jira/browse/SPARK-16973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413338#comment-15413338 ] Apache Spark commented on SPARK-16973: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16973) remove the buffer offsets in ImperativeAggregate

[ https://issues.apache.org/jira/browse/SPARK-16973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16973: Assignee: Wenchen Fan (was: Apache Spark) > remove the buffer offsets in

[jira] [Created] (SPARK-16973) remove the buffer offsets in ImperativeAggregate

Wenchen Fan created SPARK-16973: --- Summary: remove the buffer offsets in ImperativeAggregate Key: SPARK-16973 URL: https://issues.apache.org/jira/browse/SPARK-16973 Project: Spark Issue Type:

[jira] [Updated] (SPARK-16927) Mesos Cluster Dispatcher default properties

[ https://issues.apache.org/jira/browse/SPARK-16927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16927: -- Assignee: Michael Gummelt Priority: Minor (was: Major) > Mesos Cluster Dispatcher default

[jira] [Comment Edited] (SPARK-16896) Loading csv with duplicate column names

[ https://issues.apache.org/jira/browse/SPARK-16896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413310#comment-15413310 ] Hyukjin Kwon edited comment on SPARK-16896 at 8/9/16 9:57 AM: -- [~nlauchande]

[jira] [Updated] (SPARK-16923) Mesos cluster scheduler duplicates config vars by setting them in the environment and as --conf

[ https://issues.apache.org/jira/browse/SPARK-16923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16923: -- Assignee: Michael Gummelt Priority: Minor (was: Major) > Mesos cluster scheduler duplicates

[jira] [Commented] (SPARK-16896) Loading csv with duplicate column names

[ https://issues.apache.org/jira/browse/SPARK-16896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413310#comment-15413310 ] Hyukjin Kwon commented on SPARK-16896: -- [~nlauchande] Just FYI, actual codes that need to be

[jira] [Updated] (SPARK-16941) SparkSQLOperationManager should use synchronized Map to store SessionHandle

[ https://issues.apache.org/jira/browse/SPARK-16941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16941: -- Summary: SparkSQLOperationManager should use synchronized Map to store SessionHandle (was:

[jira] [Resolved] (SPARK-16809) Link Mesos Dispatcher and History Server

[ https://issues.apache.org/jira/browse/SPARK-16809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16809. --- Resolution: Fixed Fix Version/s: 2.1.0 Resolved by https://github.com/apache/spark/pull/14414

[jira] [Updated] (SPARK-16809) Link Mesos Dispatcher and History Server

[ https://issues.apache.org/jira/browse/SPARK-16809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16809: -- Assignee: Michael Gummelt > Link Mesos Dispatcher and History Server >

[jira] [Updated] (SPARK-16809) Link Mesos Dispatcher and History Server

[ https://issues.apache.org/jira/browse/SPARK-16809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16809: -- Priority: Minor (was: Major) > Link Mesos Dispatcher and History Server >

[jira] [Commented] (SPARK-16896) Loading csv with duplicate column names

[ https://issues.apache.org/jira/browse/SPARK-16896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413302#comment-15413302 ] Natu Lauchande commented on SPARK-16896: Cool. So i am assuming that the entry point for the

[jira] [Comment Edited] (SPARK-16896) Loading csv with duplicate column names

[ https://issues.apache.org/jira/browse/SPARK-16896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413271#comment-15413271 ] Hyukjin Kwon edited comment on SPARK-16896 at 8/9/16 9:47 AM: -- [~srowen] Oh,

[jira] [Assigned] (SPARK-16972) Move DriverEndpoint out of CoarseGrainedSchedulerBackend

[ https://issues.apache.org/jira/browse/SPARK-16972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16972: Assignee: Apache Spark > Move DriverEndpoint out of CoarseGrainedSchedulerBackend >

[jira] [Assigned] (SPARK-16972) Move DriverEndpoint out of CoarseGrainedSchedulerBackend

[ https://issues.apache.org/jira/browse/SPARK-16972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16972: Assignee: (was: Apache Spark) > Move DriverEndpoint out of

[jira] [Commented] (SPARK-16972) Move DriverEndpoint out of CoarseGrainedSchedulerBackend

[ https://issues.apache.org/jira/browse/SPARK-16972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413276#comment-15413276 ] Apache Spark commented on SPARK-16972: -- User 'lshmouse' has created a pull request for this issue:

[jira] [Commented] (SPARK-16896) Loading csv with duplicate column names

[ https://issues.apache.org/jira/browse/SPARK-16896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413271#comment-15413271 ] Hyukjin Kwon commented on SPARK-16896: -- Sean, If my understanding is correct, we have tried to

[jira] [Created] (SPARK-16972) Move DriverEndpoint out of CoarseGrainedSchedulerBackend

Liu Shaohui created SPARK-16972: --- Summary: Move DriverEndpoint out of CoarseGrainedSchedulerBackend Key: SPARK-16972 URL: https://issues.apache.org/jira/browse/SPARK-16972 Project: Spark Issue

[jira] [Commented] (SPARK-16971) Strip trailing zeros for decimals when using show() API in Dataset

[ https://issues.apache.org/jira/browse/SPARK-16971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413236#comment-15413236 ] Apache Spark commented on SPARK-16971: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-16971) Strip trailing zeros for decimals when using show() API in Dataset

[ https://issues.apache.org/jira/browse/SPARK-16971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16971: Assignee: Apache Spark > Strip trailing zeros for decimals when using show() API in

[jira] [Assigned] (SPARK-16971) Strip trailing zeros for decimals when using show() API in Dataset

[ https://issues.apache.org/jira/browse/SPARK-16971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16971: Assignee: (was: Apache Spark) > Strip trailing zeros for decimals when using show()

[jira] [Created] (SPARK-16971) Strip trailing zeros for decimals when using show() API in Dataset

Hyukjin Kwon created SPARK-16971: Summary: Strip trailing zeros for decimals when using show() API in Dataset Key: SPARK-16971 URL: https://issues.apache.org/jira/browse/SPARK-16971 Project: Spark

[jira] [Commented] (SPARK-16896) Loading csv with duplicate column names

[ https://issues.apache.org/jira/browse/SPARK-16896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413218#comment-15413218 ] Sean Owen commented on SPARK-16896: --- No, the code is in Spark now. > Loading csv with duplicate

[jira] [Updated] (SPARK-16940) `checkAnswer` should raise `TestFailedException` for wrong results

[ https://issues.apache.org/jira/browse/SPARK-16940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16940: -- Assignee: Dongjoon Hyun > `checkAnswer` should raise `TestFailedException` for wrong results >

[jira] [Resolved] (SPARK-16940) `checkAnswer` should raise `TestFailedException` for wrong results

[ https://issues.apache.org/jira/browse/SPARK-16940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16940. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14528

[jira] [Issue Comment Deleted] (SPARK-16896) Loading csv with duplicate column names

[ https://issues.apache.org/jira/browse/SPARK-16896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Natu Lauchande updated SPARK-16896: --- Comment: was deleted (was: Quick confirmation needed : this change needs to happen in the

[jira] [Commented] (SPARK-16896) Loading csv with duplicate column names

[ https://issues.apache.org/jira/browse/SPARK-16896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413211#comment-15413211 ] Natu Lauchande commented on SPARK-16896: Quick confirmation needed : this change needs to happen

[jira] [Resolved] (SPARK-16522) [MESOS] Spark application throws exception on exit

[ https://issues.apache.org/jira/browse/SPARK-16522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16522. --- Resolution: Fixed Assignee: Sun Rui Fix Version/s: 2.1.0 Resolved by

[jira] [Commented] (SPARK-16896) Loading csv with duplicate column names

[ https://issues.apache.org/jira/browse/SPARK-16896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413210#comment-15413210 ] Natu Lauchande commented on SPARK-16896: Quick confirmation needed : this change needs to happen

[jira] [Assigned] (SPARK-16606) Misleading warning for SparkContext.getOrCreate "WARN SparkContext: Use an existing SparkContext, some configuration may not take effect."

[ https://issues.apache.org/jira/browse/SPARK-16606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-16606: - Assignee: Sean Owen > Misleading warning for SparkContext.getOrCreate "WARN SparkContext: Use

[jira] [Resolved] (SPARK-16606) Misleading warning for SparkContext.getOrCreate "WARN SparkContext: Use an existing SparkContext, some configuration may not take effect."

[ https://issues.apache.org/jira/browse/SPARK-16606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16606. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14533

[jira] [Commented] (SPARK-16966) App Name is a randomUUID even when "spark.app.name" exists

[ https://issues.apache.org/jira/browse/SPARK-16966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413201#comment-15413201 ] Saisai Shao commented on SPARK-16966: - Yes, agreed. A better way is to handle this app name thing in

[jira] [Commented] (SPARK-16970) [spark2.0] spark2.0 doesn't catch the java exception thrown by reflect function in sql statement which causes the job abort

[ https://issues.apache.org/jira/browse/SPARK-16970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413170#comment-15413170 ] Sean Owen commented on SPARK-16970: --- This is an app error though. What behavior are you expecting? >

[jira] [Commented] (SPARK-16966) App Name is a randomUUID even when "spark.app.name" exists

[ https://issues.apache.org/jira/browse/SPARK-16966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413167#comment-15413167 ] Sean Owen commented on SPARK-16966: --- Hm, but SparkKMeans and other examples do call appName(). Even

[jira] [Commented] (SPARK-16968) Allow to add additional options when creating a new table in DF's JDBC writer.

[ https://issues.apache.org/jira/browse/SPARK-16968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413161#comment-15413161 ] Jie Huang commented on SPARK-16968: --- Yes. we can have some workaround to solve the problem. E.g.,

[jira] [Created] (SPARK-16970) [spark2.0] spark2.0 doesn't catch the java exception thrown by reflect function in sql statement which causes the job abort

marymwu created SPARK-16970: --- Summary: [spark2.0] spark2.0 doesn't catch the java exception thrown by reflect function in sql statement which causes the job abort Key: SPARK-16970 URL:

[jira] [Assigned] (SPARK-16968) Allow to add additional options when creating a new table in DF's JDBC writer.

[ https://issues.apache.org/jira/browse/SPARK-16968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16968: Assignee: (was: Apache Spark) > Allow to add additional options when creating a new

[jira] [Commented] (SPARK-16951) Alternative implementation of NOT IN to Anti-join

[ https://issues.apache.org/jira/browse/SPARK-16951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413153#comment-15413153 ] Herman van Hovell commented on SPARK-16951: --- Case 1 is a result of an optimizer bug. Apparently

[jira] [Assigned] (SPARK-16968) Allow to add additional options when creating a new table in DF's JDBC writer.

[ https://issues.apache.org/jira/browse/SPARK-16968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16968: Assignee: Apache Spark > Allow to add additional options when creating a new table in

[jira] [Commented] (SPARK-16968) Allow to add additional options when creating a new table in DF's JDBC writer.

[ https://issues.apache.org/jira/browse/SPARK-16968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413151#comment-15413151 ] Apache Spark commented on SPARK-16968: -- User 'GraceH' has created a pull request for this issue:

[jira] [Created] (SPARK-16969) GBTClassifier needs a raw prediction column

Vladimir Feinberg created SPARK-16969: - Summary: GBTClassifier needs a raw prediction column Key: SPARK-16969 URL: https://issues.apache.org/jira/browse/SPARK-16969 Project: Spark Issue

[jira] [Updated] (SPARK-16968) Allow to add additional options when creating a new table in DF's JDBC writer.

[ https://issues.apache.org/jira/browse/SPARK-16968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16968: -- Priority: Minor (was: Major) This is bordering on out of scope for Spark, but may still have some

[jira] [Commented] (SPARK-16508) Fix documentation warnings found by R CMD check

[ https://issues.apache.org/jira/browse/SPARK-16508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413077#comment-15413077 ] Apache Spark commented on SPARK-16508: -- User 'junyangq' has created a pull request for this issue:

[jira] [Created] (SPARK-16968) Allow to add additional options when creating a new table in DF's JDBC writer.

Jie Huang created SPARK-16968: - Summary: Allow to add additional options when creating a new table in DF's JDBC writer. Key: SPARK-16968 URL: https://issues.apache.org/jira/browse/SPARK-16968 Project:

[jira] [Commented] (SPARK-16709) Task with commit failed will retry infinite when speculation set to true

[ https://issues.apache.org/jira/browse/SPARK-16709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413065#comment-15413065 ] Apache Spark commented on SPARK-16709: -- User 'shenh062326' has created a pull request for this

[jira] [Assigned] (SPARK-16709) Task with commit failed will retry infinite when speculation set to true

[ https://issues.apache.org/jira/browse/SPARK-16709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16709: Assignee: Apache Spark > Task with commit failed will retry infinite when speculation set

[jira] [Assigned] (SPARK-16709) Task with commit failed will retry infinite when speculation set to true

[ https://issues.apache.org/jira/browse/SPARK-16709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16709: Assignee: (was: Apache Spark) > Task with commit failed will retry infinite when

[jira] [Assigned] (SPARK-16966) App Name is a randomUUID even when "spark.app.name" exists

[ https://issues.apache.org/jira/browse/SPARK-16966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16966: Assignee: Apache Spark > App Name is a randomUUID even when "spark.app.name" exists >

[jira] [Assigned] (SPARK-16966) App Name is a randomUUID even when "spark.app.name" exists

[ https://issues.apache.org/jira/browse/SPARK-16966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16966: Assignee: (was: Apache Spark) > App Name is a randomUUID even when "spark.app.name"

[jira] [Created] (SPARK-16967) Collect Mesos support code into a module/profile

Sean Owen created SPARK-16967: - Summary: Collect Mesos support code into a module/profile Key: SPARK-16967 URL: https://issues.apache.org/jira/browse/SPARK-16967 Project: Spark Issue Type: Task

[jira] [Commented] (SPARK-16966) App Name is a randomUUID even when "spark.app.name" exists

[ https://issues.apache.org/jira/browse/SPARK-16966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413059#comment-15413059 ] Apache Spark commented on SPARK-16966: -- User 'Sherry302' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16966) App Name is a randomUUID even when "spark.app.name" exists

[ https://issues.apache.org/jira/browse/SPARK-16966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16966: Assignee: (was: Apache Spark) > App Name is a randomUUID even when "spark.app.name"

[jira] [Commented] (SPARK-12909) Spark on Mesos accessing Secured HDFS w/Kerberos

[ https://issues.apache.org/jira/browse/SPARK-12909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413058#comment-15413058 ] Sean Owen commented on SPARK-12909: --- As we look at more significant features you want to add to

[jira] [Assigned] (SPARK-16966) App Name is a randomUUID even when "spark.app.name" exists

[ https://issues.apache.org/jira/browse/SPARK-16966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16966: Assignee: Apache Spark > App Name is a randomUUID even when "spark.app.name" exists >

[jira] [Commented] (SPARK-6235) Address various 2G limits

[ https://issues.apache.org/jira/browse/SPARK-6235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413055#comment-15413055 ] Sean Owen commented on SPARK-6235: -- I think the short answer is, it's very hard. I am not sure it's

[jira] [Commented] (SPARK-16962) Unsafe accesses (Platform.getLong()) not supported on unaligned boundaries in SPARC/Solaris

[ https://issues.apache.org/jira/browse/SPARK-16962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413043#comment-15413043 ] Sean Owen commented on SPARK-16962: --- I doubt SPARC would be considered supported for reasons like this,

[jira] [Commented] (SPARK-16896) Loading csv with duplicate column names

[ https://issues.apache.org/jira/browse/SPARK-16896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413038#comment-15413038 ] Hyukjin Kwon commented on SPARK-16896: -- I don't mind if you go ahead (I was looking at this problem

[jira] [Created] (SPARK-16966) App Name is a randomUUID even when "spark.app.name" exists

Weiqing Yang created SPARK-16966: Summary: App Name is a randomUUID even when "spark.app.name" exists Key: SPARK-16966 URL: https://issues.apache.org/jira/browse/SPARK-16966 Project: Spark

[jira] [Commented] (SPARK-16896) Loading csv with duplicate column names

[ https://issues.apache.org/jira/browse/SPARK-16896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413007#comment-15413007 ] Natu Lauchande commented on SPARK-16896: I wonder if anyone is tackling this issue. I want to get

<    1   2