[jira] [Commented] (SPARK-21615) Fix broken redirect in collaborative filtering docs to databricks training repo

[ https://issues.apache.org/jira/browse/SPARK-21615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112022#comment-16112022 ] Ayush Singh commented on SPARK-21615: - [~hyukjin.kwon] That's me, is there any way to link my git

[jira] [Commented] (SPARK-21034) Filter not getting pushed down the groupBy clause when first() or last() aggregate function is used

[ https://issues.apache.org/jira/browse/SPARK-21034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111454#comment-16111454 ] Andrew Ray commented on SPARK-21034: Yes a=1 is the filter to be pushed down. It is not pushed

[jira] [Assigned] (SPARK-21584) Update R method for summary to call new implementation

[ https://issues.apache.org/jira/browse/SPARK-21584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-21584: Assignee: Andrew Ray > Update R method for summary to call new implementation >

[jira] [Commented] (SPARK-21583) Create a ColumnarBatch with ArrowColumnVectors for row based iteration

[ https://issues.apache.org/jira/browse/SPARK-21583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111579#comment-16111579 ] Hyukjin Kwon commented on SPARK-21583: -- User 'BryanCutler' has created a pull request for this

[jira] [Commented] (SPARK-21254) History UI: Taking over 1 minute for initial page display

[ https://issues.apache.org/jira/browse/SPARK-21254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111576#comment-16111576 ] Hyukjin Kwon commented on SPARK-21254: -- User '2ooom' has created a pull request for this issue:

[jira] [Commented] (SPARK-20433) Update jackson-databind to 2.6.7.1

[ https://issues.apache.org/jira/browse/SPARK-20433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111580#comment-16111580 ] Hyukjin Kwon commented on SPARK-20433: -- User 'ash211' has created a pull request for this issue:

[jira] [Commented] (SPARK-21574) set hive.exec.max.dynamic.partitions lose effect

[ https://issues.apache.org/jira/browse/SPARK-21574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111573#comment-16111573 ] Hyukjin Kwon commented on SPARK-21574: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-8288) ScalaReflection should also try apply methods defined in companion objects when inferring schema from a Product type

[ https://issues.apache.org/jira/browse/SPARK-8288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111572#comment-16111572 ] Hyukjin Kwon commented on SPARK-8288: - User 'drewrobb' has created a pull request for this issue:

[jira] [Commented] (SPARK-20963) Support column aliases for aliased relation in FROM clause

[ https://issues.apache.org/jira/browse/SPARK-20963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111574#comment-16111574 ] Hyukjin Kwon commented on SPARK-20963: -- User 'maropu' has created a pull request for this issue:

[jira] [Commented] (SPARK-21580) There's a bug with `Group by ordinal`

[ https://issues.apache.org/jira/browse/SPARK-21580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111575#comment-16111575 ] Hyukjin Kwon commented on SPARK-21580: -- User '10110346' has created a pull request for this issue:

[jira] [Commented] (SPARK-21584) Update R method for summary to call new implementation

[ https://issues.apache.org/jira/browse/SPARK-21584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111578#comment-16111578 ] Hyukjin Kwon commented on SPARK-21584: -- User 'aray' has created a pull request for this issue:

[jira] [Commented] (SPARK-21559) Remove Mesos fine-grained mode

[ https://issues.apache.org/jira/browse/SPARK-21559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111577#comment-16111577 ] Hyukjin Kwon commented on SPARK-21559: -- User 'skonto' has created a pull request for this issue:

[jira] [Commented] (SPARK-20086) issue with pyspark 2.1.0 window function

[ https://issues.apache.org/jira/browse/SPARK-20086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111838#comment-16111838 ] Jacky Shen commented on SPARK-20086: will there be a fix for 2.1.0? Regards, Jacky > issue with

[jira] [Commented] (SPARK-14712) spark.ml LogisticRegressionModel.toString should summarize model

[ https://issues.apache.org/jira/browse/SPARK-14712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112003#comment-16112003 ] Bravo Zhang commented on SPARK-14712: - User 'bravo-zhang' has created a pull request for this issue:

[jira] [Commented] (SPARK-21615) Fix broken redirect in collaborative filtering docs to databricks training repo

[ https://issues.apache.org/jira/browse/SPARK-21615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112026#comment-16112026 ] Hyukjin Kwon commented on SPARK-21615: -- It should have been done automatically but there looks a

[jira] [Created] (SPARK-21617) ALTER TABLE...ADD COLUMNS creates invalid metadata in Hive metastore for DS tables

Marcelo Vanzin created SPARK-21617: -- Summary: ALTER TABLE...ADD COLUMNS creates invalid metadata in Hive metastore for DS tables Key: SPARK-21617 URL: https://issues.apache.org/jira/browse/SPARK-21617

[jira] [Created] (SPARK-21618) http(s) not accepted in spark-submit jar uri

Ben Mayne created SPARK-21618: - Summary: http(s) not accepted in spark-submit jar uri Key: SPARK-21618 URL: https://issues.apache.org/jira/browse/SPARK-21618 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-21542) Helper functions for custom Python Persistence

[ https://issues.apache.org/jira/browse/SPARK-21542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-21542: -- Shepherd: Joseph K. Bradley > Helper functions for custom Python Persistence >

[jira] [Updated] (SPARK-21607) Can dropTempView function add a param like dropTempView(viewName: String, dropSelfOnly: Boolean)

[ https://issues.apache.org/jira/browse/SPARK-21607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ant_nebula updated SPARK-21607: --- Description: AS SPARK-19765, from version 2.1.1, UNCACHE TABLE also un-cache all cached plans that

[jira] [Updated] (SPARK-21606) HiveServer2/HiveThriftServer2 catches OOMs on request threads

[ https://issues.apache.org/jira/browse/SPARK-21606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zuotingbing updated SPARK-21606: Description: Refer to Hive, ThriftCLIService methods such as ExecuteStatement are apparently

[jira] [Commented] (SPARK-650) Add a "setup hook" API for running initialization code on each executor

[ https://issues.apache.org/jira/browse/SPARK-650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110506#comment-16110506 ] Sean Owen commented on SPARK-650: - Are you looking for an example of how it works? something like this, for

[jira] [Updated] (SPARK-21606) HiveServer2/HiveThriftServer2 catches OOMs on request threads

[ https://issues.apache.org/jira/browse/SPARK-21606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zuotingbing updated SPARK-21606: Description: Refer to Hive, ThriftCLIService methods such as ExecuteStatement are apparently

[jira] [Updated] (SPARK-21609) In the Master ui add "log directory" display, is conducive to users to quickly find the log directory path.

[ https://issues.apache.org/jira/browse/SPARK-21609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-21609: --- Component/s: (was: Documentation) Web UI > In the Master ui add "log

[jira] [Updated] (SPARK-21607) Can dropTempView function add a param like dropTempView(viewName: String, dropSelfOnly: Boolean)

[ https://issues.apache.org/jira/browse/SPARK-21607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ant_nebula updated SPARK-21607: --- Attachment: spark stream scene.png > Can dropTempView function add a param like

[jira] [Commented] (SPARK-21567) Dataset with Tuple of type alias throws error

[ https://issues.apache.org/jira/browse/SPARK-21567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110432#comment-16110432 ] Liang-Chi Hsieh commented on SPARK-21567: - [~kretes] I've made a mistake when trying to solve

[jira] [Created] (SPARK-21608) Window rangeBetween() API should allow literal boundary

Jiang Xingbo created SPARK-21608: Summary: Window rangeBetween() API should allow literal boundary Key: SPARK-21608 URL: https://issues.apache.org/jira/browse/SPARK-21608 Project: Spark

[jira] [Created] (SPARK-21606) HiveServer2/HiveThriftServer2 catches OOMs on request threads

zuotingbing created SPARK-21606: --- Summary: HiveServer2/HiveThriftServer2 catches OOMs on request threads Key: SPARK-21606 URL: https://issues.apache.org/jira/browse/SPARK-21606 Project: Spark

[jira] [Created] (SPARK-21607) Can dropTempView function add a param like dropTempView(viewName: String, dropSelfOnly: Boolean)

ant_nebula created SPARK-21607: -- Summary: Can dropTempView function add a param like dropTempView(viewName: String, dropSelfOnly: Boolean) Key: SPARK-21607 URL: https://issues.apache.org/jira/browse/SPARK-21607

[jira] [Created] (SPARK-21609) In the Master ui add "log directory" display, is conducive to users to quickly find the log directory path.

guoxiaolongzte created SPARK-21609: -- Summary: In the Master ui add "log directory" display, is conducive to users to quickly find the log directory path. Key: SPARK-21609 URL:

[jira] [Updated] (SPARK-21601) Modify the JDK version of the Maven compilation

[ https://issues.apache.org/jira/browse/SPARK-21601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21601: -- Affects Version/s: (was: 2.2.0) 2.3.0 Target Version/s: (was: 2.2.0)

[jira] [Commented] (SPARK-21616) SparkR 2.3.0 migration guide, release note

[ https://issues.apache.org/jira/browse/SPARK-21616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111483#comment-16111483 ] Felix Cheung commented on SPARK-21616: -- SPARK-21584 > SparkR 2.3.0 migration guide, release note >

[jira] [Commented] (SPARK-21584) Update R method for summary to call new implementation

[ https://issues.apache.org/jira/browse/SPARK-21584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111485#comment-16111485 ] Felix Cheung commented on SPARK-21584: -- https://github.com/apache/spark/pull/18786 > Update R

[jira] [Commented] (SPARK-21567) Dataset with Tuple of type alias throws error

[ https://issues.apache.org/jira/browse/SPARK-21567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111597#comment-16111597 ] Hyukjin Kwon commented on SPARK-21567: -- User 'viirya' has created a pull request for this issue:

[jira] [Commented] (SPARK-18535) Redact sensitive information from Spark logs and UI

[ https://issues.apache.org/jira/browse/SPARK-18535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111589#comment-16111589 ] Hyukjin Kwon commented on SPARK-18535: -- User 'dmvieira' has created a pull request for this issue:

[jira] [Commented] (SPARK-19634) Feature parity for descriptive statistics in MLlib

[ https://issues.apache.org/jira/browse/SPARK-19634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111585#comment-16111585 ] Hyukjin Kwon commented on SPARK-19634: -- User 'WeichenXu123' has created a pull request for this

[jira] [Commented] (SPARK-21330) Bad partitioning does not allow to read a JDBC table with extreme values on the partition column

[ https://issues.apache.org/jira/browse/SPARK-21330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111587#comment-16111587 ] Hyukjin Kwon commented on SPARK-21330: -- User 'aray' has created a pull request for this issue:

[jira] [Commented] (SPARK-19112) add codec for ZStandard

[ https://issues.apache.org/jira/browse/SPARK-19112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111593#comment-16111593 ] Hyukjin Kwon commented on SPARK-19112: -- User 'sitalkedia' has created a pull request for this issue:

[jira] [Commented] (SPARK-21570) File __spark_libs__XXX.zip does not exist on networked file system w/ yarn

[ https://issues.apache.org/jira/browse/SPARK-21570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111701#comment-16111701 ] Albert Chu commented on SPARK-21570: My setup is unique. The primary unique part is when configuring

[jira] [Resolved] (SPARK-21546) dropDuplicates with watermark yields RuntimeException due to binding failure

[ https://issues.apache.org/jira/browse/SPARK-21546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-21546. -- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 2.3.0

[jira] [Updated] (SPARK-21616) SparkR 2.3.0 migration guide, release note

[ https://issues.apache.org/jira/browse/SPARK-21616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21616: - Summary: SparkR 2.3.0 migration guide, release note (was: CLONE - SparkR 2.2.0 migration guide,

[jira] [Created] (SPARK-21616) CLONE - SparkR 2.2.0 migration guide, release note

Felix Cheung created SPARK-21616: Summary: CLONE - SparkR 2.2.0 migration guide, release note Key: SPARK-21616 URL: https://issues.apache.org/jira/browse/SPARK-21616 Project: Spark Issue

[jira] [Updated] (SPARK-21616) SparkR 2.3.0 migration guide, release note

[ https://issues.apache.org/jira/browse/SPARK-21616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21616: - Target Version/s: 2.3.0 (was: 2.2.0, 2.3.0) > SparkR 2.3.0 migration guide, release note >

[jira] [Commented] (SPARK-18278) Support native submission of spark jobs to a kubernetes cluster

[ https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111546#comment-16111546 ] Anirudh Ramanathan commented on SPARK-18278: FYI: sandflee's question was addressed in

[jira] [Commented] (SPARK-21571) Spark history server leaves incomplete or unreadable history files around forever.

[ https://issues.apache.org/jira/browse/SPARK-21571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111584#comment-16111584 ] Hyukjin Kwon commented on SPARK-21571: -- User 'ericvandenbergfb' has created a pull request for this

[jira] [Commented] (SPARK-10878) Race condition when resolving Maven coordinates via Ivy

[ https://issues.apache.org/jira/browse/SPARK-10878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111588#comment-16111588 ] Hyukjin Kwon commented on SPARK-10878: -- User 'Victsm' has created a pull request for this issue:

[jira] [Commented] (SPARK-21596) Audit the places calling HDFSMetadataLog.get

[ https://issues.apache.org/jira/browse/SPARK-21596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111586#comment-16111586 ] Hyukjin Kwon commented on SPARK-21596: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Commented] (SPARK-21587) Filter pushdown for EventTime Watermark Operator

[ https://issues.apache.org/jira/browse/SPARK-21587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111582#comment-16111582 ] Hyukjin Kwon commented on SPARK-21587: -- User 'joseph-torres' has created a pull request for this

[jira] [Commented] (SPARK-19720) Redact sensitive information from SparkSubmit console output

[ https://issues.apache.org/jira/browse/SPARK-19720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111591#comment-16111591 ] Hyukjin Kwon commented on SPARK-19720: -- User 'dmvieira' has created a pull request for this issue:

[jira] [Updated] (SPARK-18278) SPIP: Support native submission of spark jobs to a kubernetes cluster

[ https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan updated SPARK-18278: --- Summary: SPIP: Support native submission of spark jobs to a kubernetes cluster

[jira] [Commented] (SPARK-21603) The wholestage codegen will be much slower then wholestage codegen is closed when the function is too long

[ https://issues.apache.org/jira/browse/SPARK-21603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111596#comment-16111596 ] Hyukjin Kwon commented on SPARK-21603: -- User 'eatoncys' has created a pull request for this issue:

[jira] [Commented] (SPARK-21599) Collecting column statistics for datasource tables may fail with java.util.NoSuchElementException

[ https://issues.apache.org/jira/browse/SPARK-21599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111592#comment-16111592 ] Hyukjin Kwon commented on SPARK-21599: -- User 'dilipbiswal' has created a pull request for this

[jira] [Commented] (SPARK-21608) Window rangeBetween() API should allow literal boundary

[ https://issues.apache.org/jira/browse/SPARK-21608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111599#comment-16111599 ] Hyukjin Kwon commented on SPARK-21608: -- User 'jiangxb1987' has created a pull request for this

[jira] [Commented] (SPARK-9221) Support IntervalType in Range Frame

[ https://issues.apache.org/jira/browse/SPARK-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111600#comment-16111600 ] Hyukjin Kwon commented on SPARK-9221: - User 'jiangxb1987' has created a pull request for this issue:

[jira] [Commented] (SPARK-21546) dropDuplicates with watermark yields RuntimeException due to binding failure

[ https://issues.apache.org/jira/browse/SPARK-21546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111607#comment-16111607 ] Hyukjin Kwon commented on SPARK-21546: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Commented] (SPARK-21110) Structs should be usable in inequality filters

[ https://issues.apache.org/jira/browse/SPARK-21110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111603#comment-16111603 ] Hyukjin Kwon commented on SPARK-21110: -- User 'aray' has created a pull request for this issue:

[jira] [Commented] (SPARK-14932) Allow DataFrame.replace() to replace values with None

[ https://issues.apache.org/jira/browse/SPARK-14932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111605#comment-16111605 ] Hyukjin Kwon commented on SPARK-14932: -- User 'bravo-zhang' has created a pull request for this

[jira] [Commented] (SPARK-20713) Speculative task that got CommitDenied exception shows up as failed

[ https://issues.apache.org/jira/browse/SPARK-20713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111604#comment-16111604 ] Hyukjin Kwon commented on SPARK-20713: -- User 'nlyu' has created a pull request for this issue:

[jira] [Commented] (SPARK-21615) Fix broken redirect in collaborative filtering docs to databricks training repo

[ https://issues.apache.org/jira/browse/SPARK-21615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111606#comment-16111606 ] Hyukjin Kwon commented on SPARK-21615: -- User 'singhay' has created a pull request for this issue:

[jira] [Commented] (SPARK-21612) Allow unicode strings in __getitem__ of StructType

[ https://issues.apache.org/jira/browse/SPARK-21612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111601#comment-16111601 ] Hyukjin Kwon commented on SPARK-21612: -- User 'rik-coenders' has created a pull request for this

[jira] [Commented] (SPARK-21565) aggregate query fails with watermark on eventTime but works with watermark on timestamp column generated by current_timestamp

[ https://issues.apache.org/jira/browse/SPARK-21565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111451#comment-16111451 ] Shixiong Zhu commented on SPARK-21565: -- Thanks for reporting it. I can reproduce the error in a unit

[jira] [Commented] (SPARK-21306) OneVsRest Conceals Columns That May Be Relevant To Underlying Classifier

[ https://issues.apache.org/jira/browse/SPARK-21306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111569#comment-16111569 ] Hyukjin Kwon commented on SPARK-21306: -- User 'facaiy' has created a pull request for this issue:

[jira] [Commented] (SPARK-20679) Let ML ALS recommend for a subset of users/items

[ https://issues.apache.org/jira/browse/SPARK-20679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111562#comment-16111562 ] Hyukjin Kwon commented on SPARK-20679: -- User 'MLnick' has created a pull request for this issue:

[jira] [Commented] (SPARK-21485) API Documentation for Spark SQL functions

[ https://issues.apache.org/jira/browse/SPARK-21485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111563#comment-16111563 ] Hyukjin Kwon commented on SPARK-21485: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-21566) Python method for summary

[ https://issues.apache.org/jira/browse/SPARK-21566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111567#comment-16111567 ] Hyukjin Kwon commented on SPARK-21566: -- User 'aray' has created a pull request for this issue:

[jira] [Commented] (SPARK-21551) pyspark's collect fails when getaddrinfo is too slow

[ https://issues.apache.org/jira/browse/SPARK-21551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111564#comment-16111564 ] Hyukjin Kwon commented on SPARK-21551: -- User 'peay' has created a pull request for this issue:

[jira] [Commented] (SPARK-19720) Redact sensitive information from SparkSubmit console output

[ https://issues.apache.org/jira/browse/SPARK-19720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111571#comment-16111571 ] Hyukjin Kwon commented on SPARK-19720: -- User 'dmvieira' has created a pull request for this issue:

[jira] [Commented] (SPARK-21560) Add hold mode for the LiveListenerBus

[ https://issues.apache.org/jira/browse/SPARK-21560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111566#comment-16111566 ] Hyukjin Kwon commented on SPARK-21560: -- User 'xuanyuanking' has created a pull request for this

[jira] [Commented] (SPARK-21552) Add decimal type support to ArrowWriter.

[ https://issues.apache.org/jira/browse/SPARK-21552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111565#comment-16111565 ] Hyukjin Kwon commented on SPARK-21552: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-21306) OneVsRest Conceals Columns That May Be Relevant To Underlying Classifier

[ https://issues.apache.org/jira/browse/SPARK-21306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111570#comment-16111570 ] Hyukjin Kwon commented on SPARK-21306: -- User 'facaiy' has created a pull request for this issue:

[jira] [Commented] (SPARK-20990) Multi-line support for JSON

[ https://issues.apache.org/jira/browse/SPARK-20990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111553#comment-16111553 ] Hyukjin Kwon commented on SPARK-20990: -- User 'mgaido91' has created a pull request for this issue:

[jira] [Commented] (SPARK-21590) Structured Streaming window start time should support negative values to adjust time zone

[ https://issues.apache.org/jira/browse/SPARK-21590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111460#comment-16111460 ] Burak Yavuz commented on SPARK-21590: - There are tests to make sure it supports "negative" timestamps

[jira] [Commented] (SPARK-21590) Structured Streaming window start time should support negative values to adjust time zone

[ https://issues.apache.org/jira/browse/SPARK-21590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111458#comment-16111458 ] Burak Yavuz commented on SPARK-21590: - Does it output incorrect results if you provide `+16 hours`

[jira] [Commented] (SPARK-21070) Pick up cloudpickle upgrades from cloudpickle python module

[ https://issues.apache.org/jira/browse/SPARK-21070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111558#comment-16111558 ] Hyukjin Kwon commented on SPARK-21070: -- User 'holdenk' has created a pull request for this issue:

[jira] [Commented] (SPARK-20822) Generate code to get value from CachedBatchColumnVector in ColumnarBatch

[ https://issues.apache.org/jira/browse/SPARK-20822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111561#comment-16111561 ] Hyukjin Kwon commented on SPARK-20822: -- User 'kiszk' has created a pull request for this issue:

[jira] [Commented] (SPARK-21535) Reduce memory requirement for CrossValidator and TrainValidationSplit

[ https://issues.apache.org/jira/browse/SPARK-21535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111556#comment-16111556 ] Hyukjin Kwon commented on SPARK-21535: -- User 'hhbyyh' has created a pull request for this issue:

[jira] [Commented] (SPARK-21481) Add indexOf method in ml.feature.HashingTF similar to mllib.feature.HashingTF

[ https://issues.apache.org/jira/browse/SPARK-21481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111559#comment-16111559 ] Hyukjin Kwon commented on SPARK-21481: -- User 'facaiy' has created a pull request for this issue:

[jira] [Commented] (SPARK-20396) groupBy().apply() with pandas udf in pyspark

[ https://issues.apache.org/jira/browse/SPARK-20396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111554#comment-16111554 ] Hyukjin Kwon commented on SPARK-20396: -- User 'icexelloss' has created a pull request for this issue:

[jira] [Commented] (SPARK-21544) Test jar of some module should not install or deploy twice

[ https://issues.apache.org/jira/browse/SPARK-21544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111560#comment-16111560 ] Hyukjin Kwon commented on SPARK-21544: -- User 'caneGuy' has created a pull request for this issue:

[jira] [Commented] (SPARK-21590) Structured Streaming window start time should support negative values to adjust time zone

[ https://issues.apache.org/jira/browse/SPARK-21590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111467#comment-16111467 ] Shixiong Zhu commented on SPARK-21590: -- [~brkyvz] Yeah, some people may process data before 1970. I

[jira] [Updated] (SPARK-21616) SparkR 2.3.0 migration guide, release note

[ https://issues.apache.org/jira/browse/SPARK-21616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21616: - Fix Version/s: (was: 2.2.0) > SparkR 2.3.0 migration guide, release note >

[jira] [Updated] (SPARK-21616) SparkR 2.3.0 migration guide, release note

[ https://issues.apache.org/jira/browse/SPARK-21616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21616: - Description: >From looking at changes since 2.2.0, this/these should be documented in the

[jira] [Updated] (SPARK-21616) SparkR 2.3.0 migration guide, release note

[ https://issues.apache.org/jira/browse/SPARK-21616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21616: - Affects Version/s: (was: 2.2.0) 2.3.0 > SparkR 2.3.0 migration guide,

[jira] [Resolved] (SPARK-21490) SparkLauncher may fail to redirect streams

[ https://issues.apache.org/jira/browse/SPARK-21490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-21490. Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 2.3.0 >

[jira] [Comment Edited] (SPARK-18278) Support native submission of spark jobs to a kubernetes cluster

[ https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111546#comment-16111546 ] Anirudh Ramanathan edited comment on SPARK-18278 at 8/2/17 7:11 PM:

[jira] [Commented] (SPARK-13669) Job will always fail in the external shuffle service unavailable situation

[ https://issues.apache.org/jira/browse/SPARK-13669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111548#comment-16111548 ] Imran Rashid commented on SPARK-13669: -- Since I dragged my feet about the usefulness of this feature

[jira] [Resolved] (SPARK-21334) Fix metrics for external shuffle service

[ https://issues.apache.org/jira/browse/SPARK-21334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21334. --- Resolution: Not A Problem > Fix metrics for external shuffle service >

[jira] [Commented] (SPARK-21570) File __spark_libs__XXX.zip does not exist on networked file system w/ yarn

[ https://issues.apache.org/jira/browse/SPARK-21570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110617#comment-16110617 ] Saisai Shao commented on SPARK-21570: - This __spark_libs_xxx.zip is created by Spark on yarn to zip

[jira] [Created] (SPARK-21613) Wrong unix_timestamp when parsing Dates

Florentino Sainz created SPARK-21613: Summary: Wrong unix_timestamp when parsing Dates Key: SPARK-21613 URL: https://issues.apache.org/jira/browse/SPARK-21613 Project: Spark Issue Type:

[jira] [Created] (SPARK-21611) Error class name for log in several classes.

zuotingbing created SPARK-21611: --- Summary: Error class name for log in several classes. Key: SPARK-21611 URL: https://issues.apache.org/jira/browse/SPARK-21611 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-21613) Wrong unix_timestamp when parsing Dates

[ https://issues.apache.org/jira/browse/SPARK-21613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Florentino Sainz updated SPARK-21613: - Description: Hi, I'm trying to perform some SQL queries on my database and I'm getting

[jira] [Commented] (SPARK-21609) In the Master ui add "log directory" display, is conducive to users to quickly find the log directory path.

[ https://issues.apache.org/jira/browse/SPARK-21609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110564#comment-16110564 ] guoxiaolongzte commented on SPARK-21609: yes. > In the Master ui add "log directory" display, is

[jira] [Updated] (SPARK-21609) In the Master ui add "log directory" display, is conducive to users to quickly find the log directory path.

[ https://issues.apache.org/jira/browse/SPARK-21609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21609: -- Priority: Minor (was: Major) > In the Master ui add "log directory" display, is conducive to users to

[jira] [Commented] (SPARK-21390) Dataset filter api inconsistency

[ https://issues.apache.org/jira/browse/SPARK-21390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110576#comment-16110576 ] Kazuaki Ishizaki commented on SPARK-21390: -- Thank you very much for pointing out the good JIRA

[jira] [Created] (SPARK-21610) Corrupt records are not handled properly when creating a dataframe from a file

dmtran created SPARK-21610: -- Summary: Corrupt records are not handled properly when creating a dataframe from a file Key: SPARK-21610 URL: https://issues.apache.org/jira/browse/SPARK-21610 Project: Spark

[jira] [Commented] (SPARK-21526) Add support to ML LogisticRegression for setting initial model

[ https://issues.apache.org/jira/browse/SPARK-21526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110591#comment-16110591 ] Hyukjin Kwon commented on SPARK-21526: -- User 'JohnHBrock' has created a pull request for this issue:

[jira] [Commented] (SPARK-21612) Allow unicode strings in __getitem__ of StructType

[ https://issues.apache.org/jira/browse/SPARK-21612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110654#comment-16110654 ] Rik Coenders commented on SPARK-21612: -- I have created a pull request for this issue:

[jira] [Comment Edited] (SPARK-21613) Wrong unix_timestamp when parsing Dates

[ https://issues.apache.org/jira/browse/SPARK-21613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110719#comment-16110719 ] Florentino Sainz edited comment on SPARK-21613 at 8/2/17 11:09 AM: --- One

[jira] [Commented] (SPARK-21609) In the Master ui add "log directory" display, is conducive to users to quickly find the log directory path.

[ https://issues.apache.org/jira/browse/SPARK-21609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110524#comment-16110524 ] panbingkun commented on SPARK-21609: standalone？ > In the Master ui add "log directory" display, is

[jira] [Resolved] (SPARK-21474) Make number of parallel fetches from a reducer configurable

[ https://issues.apache.org/jira/browse/SPARK-21474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21474. --- Resolution: Won't Fix > Make number of parallel fetches from a reducer configurable >

[jira] [Created] (SPARK-21612) Allow unicode strings in __getitem__ of StructType

Rik Coenders created SPARK-21612: Summary: Allow unicode strings in __getitem__ of StructType Key: SPARK-21612 URL: https://issues.apache.org/jira/browse/SPARK-21612 Project: Spark Issue

  1   2   >