[jira] [Commented] (SPARK-26998) spark.ssl.keyStorePassword in plaintext on 'ps -ef' output of executor processes in Standalone mode

2019-03-05 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784791#comment-16784791 ] t oo commented on SPARK-26998: -- [~gsomogyi] please take it forward. [~kabhwan] truststore

[jira] [Created] (SPARK-27284) Spark Standalone aggregated logs in 1 file per appid (ala yarn -logs -applicationId)

2019-03-26 Thread t oo (JIRA)
t oo created SPARK-27284: Summary: Spark Standalone aggregated logs in 1 file per appid (ala yarn -logs -applicationId) Key: SPARK-27284 URL: https://issues.apache.org/jira/browse/SPARK-27284 Project: Spark

[jira] [Commented] (SPARK-27284) Spark Standalone aggregated logs in 1 file per appid (ala yarn -logs -applicationId)

2019-03-31 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16806462#comment-16806462 ] t oo commented on SPARK-27284: -- [~srowen] in yarn mode if you want all logs for a single sp

[jira] [Created] (SPARK-27429) [SQL] to_timestamp function with additional argument flag that will allow exception if value could not be cast

2019-04-10 Thread t oo (JIRA)
t oo created SPARK-27429: Summary: [SQL] to_timestamp function with additional argument flag that will allow exception if value could not be cast Key: SPARK-27429 URL: https://issues.apache.org/jira/browse/SPARK-27429

[jira] [Commented] (SPARK-25088) Rest Server default & doc updates

2019-04-16 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819764#comment-16819764 ] t oo commented on SPARK-25088: -- why block rest if auth is on? for example i want to be able

[jira] [Created] (SPARK-27491) SPARK REST API - "org.apache.spark.deploy.SparkSubmit --status" returns empty response! therefore Airflow won't integrate with Spark

2019-04-17 Thread t oo (JIRA)
t oo created SPARK-27491: Summary: SPARK REST API - "org.apache.spark.deploy.SparkSubmit --status" returns empty response! therefore Airflow won't integrate with Spark Key: SPARK-27491 URL: https://issues.apache.org/jira/

[jira] [Updated] (SPARK-27491) SPARK REST API - "org.apache.spark.deploy.SparkSubmit --status" returns empty response! therefore Airflow won't integrate with Spark 2.3.x

2019-04-17 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated SPARK-27491: - Summary: SPARK REST API - "org.apache.spark.deploy.SparkSubmit --status" returns empty response! therefore Airfl

[jira] [Commented] (SPARK-27491) SPARK REST API - "org.apache.spark.deploy.SparkSubmit --status" returns empty response! therefore Airflow won't integrate with Spark 2.3.x

2019-04-17 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820211#comment-16820211 ] t oo commented on SPARK-27491: -- cc: [~ash] [~bolke] > SPARK REST API - "org.apache.spark.d

[jira] [Commented] (SPARK-27491) SPARK REST API - "org.apache.spark.deploy.SparkSubmit --status" returns empty response! therefore Airflow won't integrate with Spark 2.3.x

2019-04-17 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820542#comment-16820542 ] t oo commented on SPARK-27491: -- cc: [~skonto] [~mpmolek] [~gschiavon] [~scrapco...@gmail.co

[jira] [Commented] (SPARK-27491) SPARK REST API - "org.apache.spark.deploy.SparkSubmit --status" returns empty response! therefore Airflow won't integrate with Spark 2.3.x

2019-04-25 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16825804#comment-16825804 ] t oo commented on SPARK-27491: -- my current workaround to get airflow to integrate with spar

[jira] [Created] (SPARK-37420) Oracle JDBC - java.lang.ArithmeticException: Decimal precision 49 exceeds max precision 38

2021-11-20 Thread t oo (Jira)
t oo created SPARK-37420: Summary: Oracle JDBC - java.lang.ArithmeticException: Decimal precision 49 exceeds max precision 38 Key: SPARK-37420 URL: https://issues.apache.org/jira/browse/SPARK-37420 Project: S

[jira] [Updated] (SPARK-37420) Oracle JDBC - java.lang.ArithmeticException: Decimal precision 49 exceeds max precision 38

2021-11-20 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated SPARK-37420: - Description: reading oracle jdbc is not working as expected, i thought a simple df show should work.   {code:j

[jira] [Updated] (SPARK-37420) Oracle JDBC - java.lang.ArithmeticException: Decimal precision 49 exceeds max precision 38

2021-11-20 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated SPARK-37420: - Description: reading oracle jdbc is not working as expected, i thought a simple df show should work.   {code:j

[jira] [Created] (SPARK-38883) smaller pyspark install if not using streaming?

2022-04-12 Thread t oo (Jira)
t oo created SPARK-38883: Summary: smaller pyspark install if not using streaming? Key: SPARK-38883 URL: https://issues.apache.org/jira/browse/SPARK-38883 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-35249) to_timestamp can't parse 6 digit microsecond SSSSSS

2021-04-27 Thread t oo (Jira)
t oo created SPARK-35249: Summary: to_timestamp can't parse 6 digit microsecond SS Key: SPARK-35249 URL: https://issues.apache.org/jira/browse/SPARK-35249 Project: Spark Issue Type: Wish

[jira] [Commented] (SPARK-24570) SparkSQL - show schemas/tables in dropdowns of SQL client tools (ie Squirrel SQL, DBVisualizer.etc)

2018-07-04 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16532403#comment-16532403 ] t oo commented on SPARK-24570: -- hive.png shows tables, spark.png does not. Using simba driv

[jira] [Updated] (SPARK-24570) SparkSQL - show schemas/tables in dropdowns of SQL client tools (ie Squirrel SQL, DBVisualizer.etc)

2018-07-04 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated SPARK-24570: - Attachment: hive.png spark.png > SparkSQL - show schemas/tables in dropdowns of SQL client tools

[jira] [Created] (SPARK-24789) SparkThriftServer - support for hive.server2.authentication.ldap.userFilter

2018-07-11 Thread t oo (JIRA)
t oo created SPARK-24789: Summary: SparkThriftServer - support for hive.server2.authentication.ldap.userFilter Key: SPARK-24789 URL: https://issues.apache.org/jira/browse/SPARK-24789 Project: Spark

[jira] [Updated] (SPARK-24701) SparkMaster WebUI allow all appids to be shown in detail on port 4040 rather than different ports per app

2018-07-19 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated SPARK-24701: - Attachment: spark_ports.png > SparkMaster WebUI allow all appids to be shown in detail on port 4040 rather > th

[jira] [Commented] (SPARK-24701) SparkMaster WebUI allow all appids to be shown in detail on port 4040 rather than different ports per app

2018-07-19 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16548920#comment-16548920 ] t oo commented on SPARK-24701: -- [~guoxiaolongzte] - see attached screenshot > SparkMaster

[jira] [Commented] (SPARK-13446) Spark need to support reading data from Hive 2.0.0 metastore

2018-09-05 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16604162#comment-16604162 ] t oo commented on SPARK-13446: -- [~cloud_fan] I am hitting same issue as [~elgalu] :( > Spa

[jira] [Commented] (SPARK-18112) Spark2.x does not support read data from Hive 2.x metastore

2018-09-05 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16604167#comment-16604167 ] t oo commented on SPARK-18112: -- [~hyukjin.kwon] [~srowen] can this ticket be re-opened? Thi

[jira] [Commented] (SPARK-24360) Support Hive 3.0 metastore

2018-09-05 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16604292#comment-16604292 ] t oo commented on SPARK-24360: -- [~dongjoon] Can this be merged to master? Also, can hive3.1

[jira] [Commented] (SPARK-23443) Spark with Glue as external catalog

2018-09-05 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16604331#comment-16604331 ] t oo commented on SPARK-23443: -- [~ameen.tayy...@gmail.com] any luck with the first PR? > S

[jira] [Created] (SPARK-24503) Implement SparkSQL authorization plugin in Apache Ranger

2018-06-09 Thread t oo (JIRA)
t oo created SPARK-24503: Summary: Implement SparkSQL authorization plugin in Apache Ranger Key: SPARK-24503 URL: https://issues.apache.org/jira/browse/SPARK-24503 Project: Spark Issue Type: New Feat

[jira] [Created] (SPARK-24504) Implement SparkSQL authorization plugin in Apache Ranger

2018-06-09 Thread t oo (JIRA)
t oo created SPARK-24504: Summary: Implement SparkSQL authorization plugin in Apache Ranger Key: SPARK-24504 URL: https://issues.apache.org/jira/browse/SPARK-24504 Project: Spark Issue Type: New Feat

[jira] [Created] (SPARK-24506) Spark.ui.filters not applied to /sqlserver/ url

2018-06-09 Thread t oo (JIRA)
t oo created SPARK-24506: Summary: Spark.ui.filters not applied to /sqlserver/ url Key: SPARK-24506 URL: https://issues.apache.org/jira/browse/SPARK-24506 Project: Spark Issue Type: Bug Com

[jira] [Resolved] (SPARK-24504) Implement SparkSQL authorization plugin in Apache Ranger

2018-06-10 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo resolved SPARK-24504. -- Resolution: Duplicate > Implement SparkSQL authorization plugin in Apache Ranger > ---

[jira] [Created] (SPARK-24508) Spark WebUIs [Security] - Inadequate Cache Directive Headers

2018-06-10 Thread t oo (JIRA)
t oo created SPARK-24508: Summary: Spark WebUIs [Security] - Inadequate Cache Directive Headers Key: SPARK-24508 URL: https://issues.apache.org/jira/browse/SPARK-24508 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-24509) Spark WebUI [security] - Web Server Version Disclosure

2018-06-10 Thread t oo (JIRA)
t oo created SPARK-24509: Summary: Spark WebUI [security] - Web Server Version Disclosure Key: SPARK-24509 URL: https://issues.apache.org/jira/browse/SPARK-24509 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-24510) Spark WebUI filters use Basic Authentication [security]

2018-06-10 Thread t oo (JIRA)
t oo created SPARK-24510: Summary: Spark WebUI filters use Basic Authentication [security] Key: SPARK-24510 URL: https://issues.apache.org/jira/browse/SPARK-24510 Project: Spark Issue Type: Improveme

[jira] [Created] (SPARK-24511) Spark WebUI allows Weak TLS Protocols

2018-06-10 Thread t oo (JIRA)
t oo created SPARK-24511: Summary: Spark WebUI allows Weak TLS Protocols Key: SPARK-24511 URL: https://issues.apache.org/jira/browse/SPARK-24511 Project: Spark Issue Type: Bug Components: W

[jira] [Updated] (SPARK-24511) Spark WebUI allows Weak TLS Protocols

2018-06-10 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated SPARK-24511: - Attachment: SSL.PNG > Spark WebUI allows Weak TLS Protocols > - > >

[jira] [Created] (SPARK-24512) SparkSQL ThriftServer port (ie 10015) supports TLSv1.0

2018-06-10 Thread t oo (JIRA)
t oo created SPARK-24512: Summary: SparkSQL ThriftServer port (ie 10015) supports TLSv1.0 Key: SPARK-24512 URL: https://issues.apache.org/jira/browse/SPARK-24512 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-24570) SparkSQL - show schemas/tables in dropdowns of SQL client tools (ie Squirrel SQL, DBVisualizer.etc)

2018-06-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated SPARK-24570: - Attachment: connect-to-sql-db-ssms-locate-table.png > SparkSQL - show schemas/tables in dropdowns of SQL client

[jira] [Created] (SPARK-24570) SparkSQL - show schemas/tables in dropdowns of SQL client tools (ie Squirrel SQL, DBVisualizer.etc)

2018-06-15 Thread t oo (JIRA)
t oo created SPARK-24570: Summary: SparkSQL - show schemas/tables in dropdowns of SQL client tools (ie Squirrel SQL, DBVisualizer.etc) Key: SPARK-24570 URL: https://issues.apache.org/jira/browse/SPARK-24570 P

[jira] [Commented] (SPARK-24570) SparkSQL - show schemas/tables in dropdowns of SQL client tools (ie Squirrel SQL, DBVisualizer.etc)

2018-06-16 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16514771#comment-16514771 ] t oo commented on SPARK-24570: -- [~maropu] - with same sql tool (I have tried several), conn

[jira] [Created] (SPARK-24617) Spark driver not requesting another executor once original executor exits due to 'lost worker'

2018-06-21 Thread t oo (JIRA)
t oo created SPARK-24617: Summary: Spark driver not requesting another executor once original executor exits due to 'lost worker' Key: SPARK-24617 URL: https://issues.apache.org/jira/browse/SPARK-24617 Projec

[jira] [Created] (SPARK-24618) Allow ability to consume driver memory on worker hosts not master (option for clustermode to wait for returncode?)

2018-06-21 Thread t oo (JIRA)
t oo created SPARK-24618: Summary: Allow ability to consume driver memory on worker hosts not master (option for clustermode to wait for returncode?) Key: SPARK-24618 URL: https://issues.apache.org/jira/browse/SPARK-24618

[jira] [Created] (SPARK-24619) DOCO - usage of authenticate.secret between masters/workers not clear

2018-06-21 Thread t oo (JIRA)
t oo created SPARK-24619: Summary: DOCO - usage of authenticate.secret between masters/workers not clear Key: SPARK-24619 URL: https://issues.apache.org/jira/browse/SPARK-24619 Project: Spark Issue

[jira] [Created] (SPARK-24620) [security] Disable 'kill' button next to applications on Spark WebUI

2018-06-21 Thread t oo (JIRA)
t oo created SPARK-24620: Summary: [security] Disable 'kill' button next to applications on Spark WebUI Key: SPARK-24620 URL: https://issues.apache.org/jira/browse/SPARK-24620 Project: Spark Issue T

[jira] [Created] (SPARK-24621) WebUI - application 'name' urls point to IP instead of DNS name

2018-06-21 Thread t oo (JIRA)
t oo created SPARK-24621: Summary: WebUI - application 'name' urls point to IP instead of DNS name Key: SPARK-24621 URL: https://issues.apache.org/jira/browse/SPARK-24621 Project: Spark Issue Type:

[jira] [Updated] (SPARK-24620) [security] Disable 'kill' button next to applications on Spark WebUI

2018-06-21 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated SPARK-24620: - Attachment: (was: spark_master-one-app.png) > [security] Disable 'kill' button next to applications on Spark

[jira] [Updated] (SPARK-24621) WebUI - application 'name' urls point to IP instead of DNS name

2018-06-21 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated SPARK-24621: - Attachment: spark_master-one-app.png > WebUI - application 'name' urls point to IP instead of DNS name > ---

[jira] [Updated] (SPARK-24620) [security] Disable 'kill' button next to applications on Spark WebUI

2018-06-21 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated SPARK-24620: - Attachment: spark_master-one-app.png > [security] Disable 'kill' button next to applications on Spark WebUI > --

[jira] [Updated] (SPARK-24621) WebUI - application 'name' urls point to http instead of https (even when ssl enabled)

2018-06-21 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated SPARK-24621: - Summary: WebUI - application 'name' urls point to http instead of https (even when ssl enabled) (was: WebUI - a

[jira] [Updated] (SPARK-24621) WebUI - application 'name' urls point to http instead of https (even when ssl enabled)

2018-06-21 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated SPARK-24621: - Description: See attached ApplicationID correctly points to DNS url but Name points to IP address Update: I fo

[jira] [Updated] (SPARK-24570) SparkSQL - show schemas/tables in dropdowns of SQL client tools (ie Squirrel SQL, DBVisualizer.etc)

2018-06-25 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated SPARK-24570: - Description: An end-user SQL client tool (ie in the screenshot) can list tables from hiveserver2 and major DBs

[jira] [Updated] (SPARK-24570) SparkSQL - show schemas/tables in dropdowns of SQL client tools (ie Squirrel SQL, DBVisualizer.etc)

2018-06-25 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated SPARK-24570: - Description: An end-user SQL client tool (ie in the screenshot) can list tables from hiveserver2 and major DBs

[jira] [Created] (SPARK-24686) Provide spark distributions for hadoop-2.8 rather than hadoop-2.7 as releases on apache mirrors

2018-06-28 Thread t oo (JIRA)
t oo created SPARK-24686: Summary: Provide spark distributions for hadoop-2.8 rather than hadoop-2.7 as releases on apache mirrors Key: SPARK-24686 URL: https://issues.apache.org/jira/browse/SPARK-24686 Proje

[jira] [Commented] (SPARK-8659) Spark SQL Thrift Server does NOT honour hive.security.authorization.manager=org.apache.hadoop.hive.ql.security.authorization.plugin.sqlstd.SQLStdHiveAuthorizerFactory

2018-06-29 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16527325#comment-16527325 ] t oo commented on SPARK-8659: - _"show_ current _roles" gives an error about sql catalyst pars

[jira] [Commented] (SPARK-16859) History Server storage information is missing

2018-06-29 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528406#comment-16528406 ] t oo commented on SPARK-16859: -- still an issue in spark 2.3.1, storage tab on the SparkHist

[jira] [Commented] (SPARK-23534) Spark run on Hadoop 3.0.0

2018-06-29 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528412#comment-16528412 ] t oo commented on SPARK-23534: -- Should this jira title be renamed to hadoop 3.1? as it look

[jira] [Created] (SPARK-24701) SparkMaster WebUI allow all appids to be shown in detail on port 4040 rather than different ports per app

2018-06-29 Thread t oo (JIRA)
t oo created SPARK-24701: Summary: SparkMaster WebUI allow all appids to be shown in detail on port 4040 rather than different ports per app Key: SPARK-24701 URL: https://issues.apache.org/jira/browse/SPARK-24701

[jira] [Updated] (SPARK-24701) SparkMaster WebUI allow all appids to be shown in detail on port 4040 rather than different ports per app

2018-06-29 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated SPARK-24701: - Labels: master security ui web web-ui (was: ) > SparkMaster WebUI allow all appids to be shown in detail on por

[jira] [Commented] (SPARK-24621) WebUI - application 'name' urls point to http instead of https (even when ssl enabled)

2018-06-29 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528572#comment-16528572 ] t oo commented on SPARK-24621: -- [https://github.com/apache/spark/pull/21514/commits]    [

[jira] [Comment Edited] (SPARK-24621) WebUI - application 'name' urls point to http instead of https (even when ssl enabled)

2018-07-01 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16528572#comment-16528572 ] t oo edited comment on SPARK-24621 at 7/1/18 9:36 AM: -- [https://git

[jira] [Created] (SPARK-24729) Spark - stackoverflow error - org.apache.spark.sql.catalyst.plans.QueryPlan

2018-07-02 Thread t oo (JIRA)
t oo created SPARK-24729: Summary: Spark - stackoverflow error - org.apache.spark.sql.catalyst.plans.QueryPlan Key: SPARK-24729 URL: https://issues.apache.org/jira/browse/SPARK-24729 Project: Spark

[jira] [Commented] (SPARK-8659) Spark SQL Thrift Server does NOT honour hive.security.authorization.manager=org.apache.hadoop.hive.ql.security.authorization.plugin.sqlstd.SQLStdHiveAuthorizerFactory

2019-02-11 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16765481#comment-16765481 ] t oo commented on SPARK-8659: - bump > Spark SQL Thrift Server does NOT honour > hive.securi

[jira] [Commented] (SPARK-22860) Spark workers log ssl passwords passed to the executors

2019-02-11 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16765482#comment-16765482 ] t oo commented on SPARK-22860: -- gentle ping, fix waiting to be committed > Spark workers l

[jira] [Commented] (SPARK-24437) Memory leak in UnsafeHashedRelation

2019-02-11 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16765487#comment-16765487 ] t oo commented on SPARK-24437: -- [~dvogelbacher] any luck on the test? > Memory leak in Uns

[jira] [Commented] (SPARK-26777) SQL worked in 2.3.2 and fails in 2.4.0

2019-02-12 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16766526#comment-16766526 ] t oo commented on SPARK-26777: -- [~yuri.budilov] - can you try in spark-shell instead of pys

[jira] [Commented] (SPARK-23534) Spark run on Hadoop 3.0.0

2019-02-12 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16766577#comment-16766577 ] t oo commented on SPARK-23534: -- time for hadoop 3.2 profile? am curious to know if hadoop3

[jira] [Commented] (SPARK-25998) TorrentBroadcast holds strong reference to broadcast object

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769708#comment-16769708 ] t oo commented on SPARK-25998: -- any chance for a backport to 2.x? > TorrentBroadcast holds

[jira] [Commented] (SPARK-22575) Making Spark Thrift Server clean up its cache

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769710#comment-16769710 ] t oo commented on SPARK-22575: -- gentle ping > Making Spark Thrift Server clean up its cach

[jira] [Commented] (SPARK-26395) Spark Thrift server memory leak

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769704#comment-16769704 ] t oo commented on SPARK-26395: -- just wanted to add that i face same issue in spark 2.3.0 of

[jira] [Commented] (SPARK-26701) spark thrift server driver memory leak

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769715#comment-16769715 ] t oo commented on SPARK-26701: -- i am facing same in 2.3.0 > spark thrift server driver mem

[jira] [Commented] (SPARK-26568) Too many partitions may cause thriftServer frequently Full GC

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769722#comment-16769722 ] t oo commented on SPARK-26568: -- i am facing same issue on spark 2.3 > Too many partitions

[jira] [Commented] (SPARK-25380) Generated plans occupy over 50% of Spark driver memory

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769724#comment-16769724 ] t oo commented on SPARK-25380: -- i am also facing issue on spark2.3 > Generated plans occup

[jira] [Commented] (SPARK-20760) Memory Leak of RDD blocks

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769725#comment-16769725 ] t oo commented on SPARK-20760: -- also facing this issue on 2.3 thrift server standalone mode

[jira] [Commented] (SPARK-26103) OutOfMemory error with large query plans

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769723#comment-16769723 ] t oo commented on SPARK-26103: -- please merge > OutOfMemory error with large query plans >

[jira] [Commented] (SPARK-25224) Improvement of Spark SQL ThriftServer memory management

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769728#comment-16769728 ] t oo commented on SPARK-25224: -- please merge > Improvement of Spark SQL ThriftServer memor

[jira] [Commented] (SPARK-25353) executeTake in SparkPlan could decode rows more than necessary.

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769729#comment-16769729 ] t oo commented on SPARK-25353: -- please merge > executeTake in SparkPlan could decode rows

[jira] [Commented] (SPARK-24786) Executors not being released after all cached data is unpersisted

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769735#comment-16769735 ] t oo commented on SPARK-24786: -- gentle ping > Executors not being released after all cache

[jira] [Commented] (SPARK-23427) spark.sql.autoBroadcastJoinThreshold causing OOM exception in the driver

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769738#comment-16769738 ] t oo commented on SPARK-23427: -- gentle ping > spark.sql.autoBroadcastJoinThreshold causing

[jira] [Commented] (SPARK-22286) OutOfMemoryError caused by memory leak and large serializer batch size in ExternalAppendOnlyMap

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769742#comment-16769742 ] t oo commented on SPARK-22286: -- gentle ping > OutOfMemoryError caused by memory leak and l

[jira] [Commented] (SPARK-10486) Spark intermittently fails to recover from a worker failure (in standalone mode)

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769743#comment-16769743 ] t oo commented on SPARK-10486: -- i face same issue in spark2.3 > Spark intermittently fails

[jira] [Commented] (SPARK-23710) Upgrade built-in Hive to 2.3.4

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769745#comment-16769745 ] t oo commented on SPARK-23710: -- bless [~yumwang] > Upgrade built-in Hive to 2.3.4 > --

[jira] [Commented] (SPARK-25034) possible triple memory consumption in fetchBlockSync()

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769732#comment-16769732 ] t oo commented on SPARK-25034: -- please merge > possible triple memory consumption in fetch

[jira] [Commented] (SPARK-9686) Spark Thrift server doesn't return correct JDBC metadata

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769749#comment-16769749 ] t oo commented on SPARK-9686: - gentle ping > Spark Thrift server doesn't return correct JDBC

[jira] [Commented] (SPARK-19798) Query returns stale results when tables are modified on other sessions

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769750#comment-16769750 ] t oo commented on SPARK-19798: -- gentle ping > Query returns stale results when tables are

[jira] [Commented] (SPARK-25403) Broadcast join is changing to sort merge join , after spark-beeline session restarts.

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769751#comment-16769751 ] t oo commented on SPARK-25403: -- gentle ping > Broadcast join is changing to sort merge joi

[jira] [Commented] (SPARK-24629) thrift server memory leak when beeline connection quits

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769754#comment-16769754 ] t oo commented on SPARK-24629: -- gentle ping > thrift server memory leak when beeline conne

[jira] [Commented] (SPARK-21918) HiveClient shouldn't share Hive object between different thread

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769755#comment-16769755 ] t oo commented on SPARK-21918: -- please don't leave us [~huLiu]  > HiveClient shouldn't sha

[jira] [Commented] (SPARK-20202) Remove references to org.spark-project.hive

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769767#comment-16769767 ] t oo commented on SPARK-20202: -- gentle ping > Remove references to org.spark-project.hive

[jira] [Commented] (SPARK-18673) Dataframes doesn't work on Hadoop 3.x; Hive rejects Hadoop version

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769768#comment-16769768 ] t oo commented on SPARK-18673: -- gentle ping > Dataframes doesn't work on Hadoop 3.x; Hive

[jira] [Commented] (SPARK-24789) SparkThriftServer - support for hive.server2.authentication.ldap.userFilter

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769847#comment-16769847 ] t oo commented on SPARK-24789: -- [~Riza] did u fix? > SparkThriftServer - support for hive.

[jira] [Commented] (SPARK-24621) WebUI - application 'name' urls point to http instead of https (even when ssl enabled)

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769851#comment-16769851 ] t oo commented on SPARK-24621: -- :( > WebUI - application 'name' urls point to http instead

[jira] [Commented] (SPARK-24686) Provide spark distributions for hadoop-2.8 rather than hadoop-2.7 as releases on apache mirrors

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769852#comment-16769852 ] t oo commented on SPARK-24686: -- [~Riza] did u fix? > Provide spark distributions for hadoo

[jira] [Commented] (SPARK-12008) Spark hive security authorization doesn't work as Apache hive's

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769853#comment-16769853 ] t oo commented on SPARK-12008: -- what are folks doing as workaround? > Spark hive security

[jira] [Commented] (SPARK-23576) SparkSQL - Decimal data missing decimal point

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769864#comment-16769864 ] t oo commented on SPARK-23576: -- gentle ping > SparkSQL - Decimal data missing decimal poin

[jira] [Commented] (SPARK-2750) Add Https support for Web UI

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769869#comment-16769869 ] t oo commented on SPARK-2750: - this is not completely fixed - see  https://jira.apache.org/ji

[jira] [Commented] (SPARK-24338) Spark SQL fails to create a Hive table when running in a Apache Sentry-secured Environment

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769871#comment-16769871 ] t oo commented on SPARK-24338: -- gentle ping > Spark SQL fails to create a Hive table when

[jira] [Commented] (SPARK-21074) Parquet files are read fully even though only count() is requested

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769866#comment-16769866 ] t oo commented on SPARK-21074: -- @[~spektom] gentle ping > Parquet files are read fully eve

[jira] [Commented] (SPARK-24010) Select from table needs read access on DB folder when storage based auth is enabled

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769872#comment-16769872 ] t oo commented on SPARK-24010: -- gentle ping > Select from table needs read access on DB fo

[jira] [Commented] (SPARK-11499) Spark History Server UI should respect protocol when doing redirection

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769873#comment-16769873 ] t oo commented on SPARK-11499: -- gentle ping > Spark History Server UI should respect proto

[jira] [Commented] (SPARK-11248) Spark hivethriftserver is using the wrong user to while getting HDFS permissions

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769881#comment-16769881 ] t oo commented on SPARK-11248: -- gentle ping > Spark hivethriftserver is using the wrong us

[jira] [Commented] (SPARK-18665) Spark ThriftServer jobs where are canceled are still “STARTED”

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769884#comment-16769884 ] t oo commented on SPARK-18665: -- gentle ping > Spark ThriftServer jobs where are canceled a

[jira] [Commented] (SPARK-8325) Ability to provide role based row level authorization through Spark SQL

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769877#comment-16769877 ] t oo commented on SPARK-8325: - gentle ping > Ability to provide role based row level authori

[jira] [Commented] (SPARK-8033) spark-sql thriftserver security authorization bugs!

2019-02-15 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769880#comment-16769880 ] t oo commented on SPARK-8033: - [~nilone] did u manage to get RBAC in spark? > spark-sql thri

  1   2   3   >