[jira] [Resolved] (SPARK-25390) data source V2 API refactoring

2019-10-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-25390. - Fix Version/s: 3.0.0 Assignee: Wenchen Fan Resolution: Fixed > data source V2

[jira] [Assigned] (SPARK-29373) DataSourceV2: Commands should not submit a spark job.

2019-10-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29373: --- Assignee: Terry Kim > DataSourceV2: Commands should not submit a spark job. >

[jira] [Resolved] (SPARK-29373) DataSourceV2: Commands should not submit a spark job.

2019-10-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29373. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26048

[jira] [Resolved] (SPARK-29401) Replace ambiguous varargs call parallelize(Array) with parallelize(Seq)

2019-10-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29401. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26062

[jira] [Resolved] (SPARK-29392) Remove use of deprecated symbol literal " 'name " syntax in favor Symbol("name")

2019-10-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29392. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26061

[jira] [Created] (SPARK-29403) Uses Arrow R 0.14.1 in AppVeyor for now

2019-10-08 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-29403: Summary: Uses Arrow R 0.14.1 in AppVeyor for now Key: SPARK-29403 URL: https://issues.apache.org/jira/browse/SPARK-29403 Project: Spark Issue Type: Test

[jira] [Resolved] (SPARK-28797) Document DROP FUNCTION statement in SQL Reference.

2019-10-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-28797. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25553

[jira] [Updated] (SPARK-28797) Document DROP FUNCTION statement in SQL Reference.

2019-10-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-28797: - Priority: Minor (was: Major) > Document DROP FUNCTION statement in SQL Reference. >

[jira] [Assigned] (SPARK-28797) Document DROP FUNCTION statement in SQL Reference.

2019-10-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-28797: Assignee: Sandeep Katta > Document DROP FUNCTION statement in SQL Reference. >

[jira] [Resolved] (SPARK-28502) Error with struct conversion while using pandas_udf

2019-10-08 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved SPARK-28502. -- Fix Version/s: 3.0.0 Resolution: Fixed This was fixed once support for StructType was

[jira] [Commented] (SPARK-28502) Error with struct conversion while using pandas_udf

2019-10-08 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947272#comment-16947272 ] Bryan Cutler commented on SPARK-28502: -- I'm closing this since it is working in master and will

[jira] [Commented] (SPARK-29402) Add tests for grouped map pandas_udf using window

2019-10-08 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947266#comment-16947266 ] Bryan Cutler commented on SPARK-29402: -- This is related to SPARK-28502 that using grouped map

[jira] [Created] (SPARK-29402) Add tests for grouped map pandas_udf using window

2019-10-08 Thread Bryan Cutler (Jira)
Bryan Cutler created SPARK-29402: Summary: Add tests for grouped map pandas_udf using window Key: SPARK-29402 URL: https://issues.apache.org/jira/browse/SPARK-29402 Project: Spark Issue

[jira] [Updated] (SPARK-29368) Port interval.sql

2019-10-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29368: -- Component/s: Tests > Port interval.sql > - > > Key:

[jira] [Commented] (SPARK-29382) Support the `INTERVAL` type by Parquet datasource

2019-10-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947234#comment-16947234 ] Dongjoon Hyun commented on SPARK-29382: --- Since this is not a Parquet specific format. Could you

[jira] [Created] (SPARK-29401) Replace ambiguous varargs call parallelize(Array) with parallelize(Seq)

2019-10-08 Thread Sean R. Owen (Jira)
Sean R. Owen created SPARK-29401: Summary: Replace ambiguous varargs call parallelize(Array) with parallelize(Seq) Key: SPARK-29401 URL: https://issues.apache.org/jira/browse/SPARK-29401 Project:

[jira] [Assigned] (SPARK-29392) Remove use of deprecated symbol literal " 'name " syntax in favor Symbol("name")

2019-10-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-29392: Assignee: Sean R. Owen > Remove use of deprecated symbol literal " 'name " syntax in

[jira] [Updated] (SPARK-29400) Improve PrometheusResource to use labels

2019-10-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29400: -- Priority: Minor (was: Major) > Improve PrometheusResource to use labels >

[jira] [Created] (SPARK-29400) Improve PrometheusResource to use labels

2019-10-08 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-29400: - Summary: Improve PrometheusResource to use labels Key: SPARK-29400 URL: https://issues.apache.org/jira/browse/SPARK-29400 Project: Spark Issue Type:

[jira] [Commented] (SPARK-22256) Introduce spark.mesos.driver.memoryOverhead

2019-10-08 Thread David McWhorter (Jira)
[ https://issues.apache.org/jira/browse/SPARK-22256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947177#comment-16947177 ] David McWhorter commented on SPARK-22256: - I created this pull request

[jira] [Commented] (SPARK-29381) Add 'private' _XXXParams classes for classification & regression

2019-10-08 Thread Huaxin Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947171#comment-16947171 ] Huaxin Gao commented on SPARK-29381: Yes. I am happy to work on this. [~podongfeng] > Add 'private'

[jira] [Created] (SPARK-29399) Remove old ExecutorPlugin API (or wrap it using new API)

2019-10-08 Thread Marcelo Masiero Vanzin (Jira)
Marcelo Masiero Vanzin created SPARK-29399: -- Summary: Remove old ExecutorPlugin API (or wrap it using new API) Key: SPARK-29399 URL: https://issues.apache.org/jira/browse/SPARK-29399 Project:

[jira] [Created] (SPARK-29398) Allow RPC endpoints to use dedicated thread pools

2019-10-08 Thread Marcelo Masiero Vanzin (Jira)
Marcelo Masiero Vanzin created SPARK-29398: -- Summary: Allow RPC endpoints to use dedicated thread pools Key: SPARK-29398 URL: https://issues.apache.org/jira/browse/SPARK-29398 Project: Spark

[jira] [Created] (SPARK-29397) Create new plugin interface for driver and executor plugins

2019-10-08 Thread Marcelo Masiero Vanzin (Jira)
Marcelo Masiero Vanzin created SPARK-29397: -- Summary: Create new plugin interface for driver and executor plugins Key: SPARK-29397 URL: https://issues.apache.org/jira/browse/SPARK-29397

[jira] [Created] (SPARK-29396) Extend Spark plugin interface to driver

2019-10-08 Thread Marcelo Masiero Vanzin (Jira)
Marcelo Masiero Vanzin created SPARK-29396: -- Summary: Extend Spark plugin interface to driver Key: SPARK-29396 URL: https://issues.apache.org/jira/browse/SPARK-29396 Project: Spark

[jira] [Updated] (SPARK-29337) How to Cache Table and Pin it in Memory and should not Spill to Disk on Thrift Server

2019-10-08 Thread Srini E (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srini E updated SPARK-29337: Labels: Question stack-overflow (was: ) > How to Cache Table and Pin it in Memory and should not Spill

[jira] [Reopened] (SPARK-29337) How to Cache Table and Pin it in Memory and should not Spill to Disk on Thrift Server

2019-10-08 Thread Srini E (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srini E reopened SPARK-29337: - Openned and labelled it to Stackoverflow and Question > How to Cache Table and Pin it in Memory and should

[jira] [Reopened] (SPARK-29335) Cost Based Optimizer stats are not used while evaluating query plans in Spark Sql

2019-10-08 Thread Srini E (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srini E reopened SPARK-29335: - Updated the Label to Question and Stack ovefflow > Cost Based Optimizer stats are not used while

[jira] [Updated] (SPARK-29335) Cost Based Optimizer stats are not used while evaluating query plans in Spark Sql

2019-10-08 Thread Srini E (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srini E updated SPARK-29335: Labels: Question stack-overflow (was: ) > Cost Based Optimizer stats are not used while evaluating query

[jira] [Assigned] (SPARK-28917) Jobs can hang because of race of RDD.dependencies

2019-10-08 Thread Marcelo Masiero Vanzin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin reassigned SPARK-28917: -- Assignee: Imran Rashid > Jobs can hang because of race of

[jira] [Resolved] (SPARK-28917) Jobs can hang because of race of RDD.dependencies

2019-10-08 Thread Marcelo Masiero Vanzin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin resolved SPARK-28917. Fix Version/s: 3.0.0 2.4.5 Resolution: Fixed

[jira] [Updated] (SPARK-29370) Interval strings without explicit unit markings

2019-10-08 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-29370: --- Description: In PostgreSQL, Quantities of days, hours, minutes, and seconds can be specified

[jira] [Created] (SPARK-29395) Precision of the interval type

2019-10-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29395: -- Summary: Precision of the interval type Key: SPARK-29395 URL: https://issues.apache.org/jira/browse/SPARK-29395 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-29394) Support ISO 8601 format for intervals

2019-10-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29394: -- Summary: Support ISO 8601 format for intervals Key: SPARK-29394 URL: https://issues.apache.org/jira/browse/SPARK-29394 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-29393) Add the make_interval() function

2019-10-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29393: -- Summary: Add the make_interval() function Key: SPARK-29393 URL: https://issues.apache.org/jira/browse/SPARK-29393 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-29212) Add common classes without using JVM backend

2019-10-08 Thread Huaxin Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947042#comment-16947042 ] Huaxin Gao commented on SPARK-29212: +1 for Sean's comment. > Add common classes without using JVM

[jira] [Created] (SPARK-29392) Remove use of deprecated symbol literal " 'name " syntax in favor Symbol("name")

2019-10-08 Thread Sean R. Owen (Jira)
Sean R. Owen created SPARK-29392: Summary: Remove use of deprecated symbol literal " 'name " syntax in favor Symbol("name") Key: SPARK-29392 URL: https://issues.apache.org/jira/browse/SPARK-29392

[jira] [Commented] (SPARK-19609) Broadcast joins should pushdown join constraints as Filter to the larger relation

2019-10-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-19609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947019#comment-16947019 ] Hyukjin Kwon commented on SPARK-19609: -- It was resolved as incomplete as it indicates EOL release

[jira] [Commented] (SPARK-19609) Broadcast joins should pushdown join constraints as Filter to the larger relation

2019-10-08 Thread Nick Dimiduk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-19609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947001#comment-16947001 ] Nick Dimiduk commented on SPARK-19609: -- Hi [~hyukjin.kwon], mind adding a comment as to why this

[jira] [Assigned] (SPARK-29336) The implementation of QuantileSummaries.merge does not guarantee that the relativeError will be respected

2019-10-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-29336: Assignee: Guilherme Souza > The implementation of QuantileSummaries.merge does not

[jira] [Resolved] (SPARK-29336) The implementation of QuantileSummaries.merge does not guarantee that the relativeError will be respected

2019-10-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-29336. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26029

[jira] [Updated] (SPARK-29335) Cost Based Optimizer stats are not used while evaluating query plans in Spark Sql

2019-10-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-29335: - Description: We are trying to leverage CBO for getting better plan results for few critical

[jira] [Resolved] (SPARK-29335) Cost Based Optimizer stats are not used while evaluating query plans in Spark Sql

2019-10-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29335. -- Resolution: Invalid Questions should go to mailing list or stackoverflow. You could have a

[jira] [Commented] (SPARK-29356) Stopping Spark doesn't shut down all network connections

2019-10-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946810#comment-16946810 ] Hyukjin Kwon commented on SPARK-29356: -- Can you post a reproducer or at least some warn/error

[jira] [Resolved] (SPARK-29358) Make unionByName optionally fill missing columns with nulls

2019-10-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29358. -- Resolution: Won't Fix > Make unionByName optionally fill missing columns with nulls >

[jira] [Commented] (SPARK-29358) Make unionByName optionally fill missing columns with nulls

2019-10-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946809#comment-16946809 ] Hyukjin Kwon commented on SPARK-29358: -- Given that workaround is pretty easy, I wouldn't need the

[jira] [Updated] (SPARK-29372) Codegen grows beyond 64 KB for more columns in case of SupportsScanColumnarBatch

2019-10-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-29372: - Priority: Major (was: Critical) > Codegen grows beyond 64 KB for more columns in case of >

[jira] [Commented] (SPARK-29212) Add common classes without using JVM backend

2019-10-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946784#comment-16946784 ] Sean R. Owen commented on SPARK-29212: -- I don't have a strong opinion on it. I'd make it all

[jira] [Assigned] (SPARK-24640) size(null) returns null

2019-10-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-24640: Assignee: Maxim Gekk > size(null) returns null > > >

[jira] [Resolved] (SPARK-24640) size(null) returns null

2019-10-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24640. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26051

[jira] [Created] (SPARK-29391) Default year-month units

2019-10-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29391: -- Summary: Default year-month units Key: SPARK-29391 URL: https://issues.apache.org/jira/browse/SPARK-29391 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-29390) Add the justify_days(), justify_hours() and justify_interval() functions

2019-10-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29390: -- Summary: Add the justify_days(), justify_hours() and justify_interval() functions Key: SPARK-29390 URL: https://issues.apache.org/jira/browse/SPARK-29390 Project:

[jira] [Created] (SPARK-29389) Short synonyms of interval units

2019-10-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29389: -- Summary: Short synonyms of interval units Key: SPARK-29389 URL: https://issues.apache.org/jira/browse/SPARK-29389 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-29389) Support synonyms for interval units

2019-10-08 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-29389: --- Summary: Support synonyms for interval units (was: Short synonyms of interval units) > Support

[jira] [Created] (SPARK-29388) Construct intervals from the `millenniums`, `centuries` or `decades` units

2019-10-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29388: -- Summary: Construct intervals from the `millenniums`, `centuries` or `decades` units Key: SPARK-29388 URL: https://issues.apache.org/jira/browse/SPARK-29388 Project:

[jira] [Created] (SPARK-29387) Support `*` and `\` operators for intervals

2019-10-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29387: -- Summary: Support `*` and `\` operators for intervals Key: SPARK-29387 URL: https://issues.apache.org/jira/browse/SPARK-29387 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-29386) Copy data between a file and a table

2019-10-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29386: -- Summary: Copy data between a file and a table Key: SPARK-29386 URL: https://issues.apache.org/jira/browse/SPARK-29386 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-29385) Make `INTERVAL` values comparable

2019-10-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29385: -- Summary: Make `INTERVAL` values comparable Key: SPARK-29385 URL: https://issues.apache.org/jira/browse/SPARK-29385 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-29384) Support `ago` in interval strings

2019-10-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29384: -- Summary: Support `ago` in interval strings Key: SPARK-29384 URL: https://issues.apache.org/jira/browse/SPARK-29384 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-29383) Support the optional prefix `@` in interval strings

2019-10-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29383: -- Summary: Support the optional prefix `@` in interval strings Key: SPARK-29383 URL: https://issues.apache.org/jira/browse/SPARK-29383 Project: Spark Issue Type:

[jira] [Created] (SPARK-29382) Support the `INTERVAL` type by Parquet datasource

2019-10-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29382: -- Summary: Support the `INTERVAL` type by Parquet datasource Key: SPARK-29382 URL: https://issues.apache.org/jira/browse/SPARK-29382 Project: Spark Issue Type:

[jira] [Reopened] (SPARK-9636) Treat $SPARK_HOME as write-only

2019-10-08 Thread Philipp Angerer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-9636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Philipp Angerer reopened SPARK-9636: This is not fixed and there was no reason given why it was closed, so I’ll reopen it. >

[jira] [Issue Comment Deleted] (SPARK-29379) SHOW FUNCTIONS don't show '!=', '<>' , 'between', 'case'

2019-10-08 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29379: -- Comment: was deleted (was: Don't need to add new expression class. If we just add code in

[jira] [Commented] (SPARK-29222) Flaky test: pyspark.mllib.tests.test_streaming_algorithms.StreamingLinearRegressionWithTests.test_parameter_convergence

2019-10-08 Thread huangtianhua (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946609#comment-16946609 ] huangtianhua commented on SPARK-29222: -- The tests specified in -SPARK-29205- failed every time when

[jira] [Created] (SPARK-29381) Add 'private' _XXXParams classes for classification & regression

2019-10-08 Thread zhengruifeng (Jira)
zhengruifeng created SPARK-29381: Summary: Add 'private' _XXXParams classes for classification & regression Key: SPARK-29381 URL: https://issues.apache.org/jira/browse/SPARK-29381 Project: Spark

[jira] [Created] (SPARK-29380) RFormula avoid repeated 'first' jobs to get vector size

2019-10-08 Thread zhengruifeng (Jira)
zhengruifeng created SPARK-29380: Summary: RFormula avoid repeated 'first' jobs to get vector size Key: SPARK-29380 URL: https://issues.apache.org/jira/browse/SPARK-29380 Project: Spark

[jira] [Reopened] (SPARK-24640) size(null) returns null

2019-10-08 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk reopened SPARK-24640: > size(null) returns null > > > Key: SPARK-24640 >

[jira] [Commented] (SPARK-29212) Add common classes without using JVM backend

2019-10-08 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946583#comment-16946583 ] zhengruifeng commented on SPARK-29212: -- [~zero323]  ??we should remove Java specific mixins, if

[jira] [Assigned] (SPARK-29269) Pyspark ALSModel support getters/setters

2019-10-08 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reassigned SPARK-29269: Assignee: Huaxin Gao > Pyspark ALSModel support getters/setters >

[jira] [Issue Comment Deleted] (SPARK-29269) Pyspark ALSModel support getters/setters

2019-10-08 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-29269: - Comment: was deleted (was: It seems that I do not have the permission to assign a tickect: ```

[jira] [Resolved] (SPARK-29366) Subqueries created for DPP are not printed in EXPLAIN FORMATTED

2019-10-08 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-29366. - Fix Version/s: 3.0.0 Assignee: Dilip Biswal Resolution: Fixed > Subqueries created for

[jira] [Commented] (SPARK-29379) SHOW FUNCTIONS don't show '!=', '<>' , 'between', 'case'

2019-10-08 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946526#comment-16946526 ] angerszhu commented on SPARK-29379: --- Don't need to add new expression class. If we just add code in

[jira] [Commented] (SPARK-29269) Pyspark ALSModel support getters/setters

2019-10-08 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946524#comment-16946524 ] zhengruifeng commented on SPARK-29269: -- It seems that I do not have the permission to assign a

[jira] [Comment Edited] (SPARK-24640) size(null) returns null

2019-10-08 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946503#comment-16946503 ] Maxim Gekk edited comment on SPARK-24640 at 10/8/19 6:11 AM: - As far as I

[jira] [Resolved] (SPARK-29269) Pyspark ALSModel support getters/setters

2019-10-08 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-29269. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25947