[jira] [Updated] (SPARK-24327) Verify and normalize a partition column name based on the JDBC resolved schema

[ https://issues.apache.org/jira/browse/SPARK-24327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-24327: - Summary: Verify and normalize a partition column name based on the JDBC resolved schema

[jira] [Commented] (SPARK-24401) Aggreate on Decimal Types does not work

[ https://issues.apache.org/jira/browse/SPARK-24401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16493015#comment-16493015 ] Takeshi Yamamuro commented on SPARK-24401: -- I didn't narrow down and I'm not sure that this is

[jira] [Commented] (SPARK-24399) Reused Exchange is used where it should not be

[ https://issues.apache.org/jira/browse/SPARK-24399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16493121#comment-16493121 ] Takeshi Yamamuro commented on SPARK-24399: -- I checked on master and branch-2.3 and this issue

[jira] [Reopened] (SPARK-24369) A bug when having multiple distinct aggregations

[ https://issues.apache.org/jira/browse/SPARK-24369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro reopened SPARK-24369: -- > A bug when having multiple distinct aggregations >

[jira] [Commented] (SPARK-21024) CSV parse mode handles Univocity parser exceptions

[ https://issues.apache.org/jira/browse/SPARK-21024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16492333#comment-16492333 ] Takeshi Yamamuro commented on SPARK-21024: -- No, feel free to take over if someone has good

[jira] [Comment Edited] (SPARK-24705) Spark.sql.adaptive.enabled=true is enabled and self-join query

[ https://issues.apache.org/jira/browse/SPARK-24705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16529421#comment-16529421 ] Takeshi Yamamuro edited comment on SPARK-24705 at 7/2/18 6:20 AM: -- I

[jira] [Commented] (SPARK-24703) Unable to multiply calender interval with long/int

[ https://issues.apache.org/jira/browse/SPARK-24703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16529456#comment-16529456 ] Takeshi Yamamuro commented on SPARK-24703: -- yea, I've noticed that the SQL standard supports

[jira] [Commented] (SPARK-24705) Spark.sql.adaptive.enabled=true is enabled and self-join query

[ https://issues.apache.org/jira/browse/SPARK-24705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16529421#comment-16529421 ] Takeshi Yamamuro commented on SPARK-24705: -- I checked the master has the same issue. Also, it

[jira] [Commented] (SPARK-24714) AnalysisSuite should use ClassTag to check the runtime instance

[ https://issues.apache.org/jira/browse/SPARK-24714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16529373#comment-16529373 ] Takeshi Yamamuro commented on SPARK-24714: -- You needn't do that; feel free to make a pr for

[jira] [Commented] (SPARK-24708) Document the default spark url of master in standalone is "spark://localhost:7070"

[ https://issues.apache.org/jira/browse/SPARK-24708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16529394#comment-16529394 ] Takeshi Yamamuro commented on SPARK-24708: -- Feel free to make a pr and you can discuss there.

[jira] [Created] (SPARK-24645) Skip parsing when csvColumnPruning enabled and partitions scanned only

Takeshi Yamamuro created SPARK-24645: Summary: Skip parsing when csvColumnPruning enabled and partitions scanned only Key: SPARK-24645 URL: https://issues.apache.org/jira/browse/SPARK-24645

[jira] [Comment Edited] (SPARK-24498) Add JDK compiler for runtime codegen

[ https://issues.apache.org/jira/browse/SPARK-24498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16516917#comment-16516917 ] Takeshi Yamamuro edited comment on SPARK-24498 at 6/19/18 3:12 PM: ---

[jira] [Commented] (SPARK-24681) Cannot create a view from a table when a nested column name contains ':'

[ https://issues.apache.org/jira/browse/SPARK-24681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16530561#comment-16530561 ] Takeshi Yamamuro commented on SPARK-24681: -- ok, I'll look into this. > Cannot create a view

[jira] [Commented] (SPARK-24705) Spark.sql.adaptive.enabled=true is enabled and self-join query

[ https://issues.apache.org/jira/browse/SPARK-24705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16531007#comment-16531007 ] Takeshi Yamamuro commented on SPARK-24705: -- Why don't you turn off

[jira] [Comment Edited] (SPARK-24681) Cannot create a view from a table when a nested column name contains ':'

[ https://issues.apache.org/jira/browse/SPARK-24681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16531016#comment-16531016 ] Takeshi Yamamuro edited comment on SPARK-24681 at 7/3/18 8:37 AM: -- I've

[jira] [Commented] (SPARK-24681) Cannot create a view from a table when a nested column name contains ':'

[ https://issues.apache.org/jira/browse/SPARK-24681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16531016#comment-16531016 ] Takeshi Yamamuro commented on SPARK-24681: -- I've looked over related code andI think we cannot

[jira] [Commented] (SPARK-24727) The cache 100 in CodeGenerator is too small for streaming

[ https://issues.apache.org/jira/browse/SPARK-24727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16531058#comment-16531058 ] Takeshi Yamamuro commented on SPARK-24727: -- Your query in streaming changes every calculation

[jira] [Commented] (SPARK-24729) Spark - stackoverflow error - org.apache.spark.sql.catalyst.plans.QueryPlan

[ https://issues.apache.org/jira/browse/SPARK-24729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16531071#comment-16531071 ] Takeshi Yamamuro commented on SPARK-24729: -- Can you run on v2.3.1? > Spark - stackoverflow

[jira] [Commented] (SPARK-24727) The cache 100 in CodeGenerator is too small for streaming

[ https://issues.apache.org/jira/browse/SPARK-24727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16531144#comment-16531144 ] Takeshi Yamamuro commented on SPARK-24727: -- I see. It makes some sense to me. Any reason to

[jira] [Commented] (SPARK-23798) The CreateArray and ConcatArray should return the default array type when no children provided

[ https://issues.apache.org/jira/browse/SPARK-23798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460329#comment-16460329 ] Takeshi Yamamuro commented on SPARK-23798: -- That pr was to make the behaviour along with the

[jira] [Updated] (SPARK-24119) Add interpreted execution to SortPrefix expression

[ https://issues.apache.org/jira/browse/SPARK-24119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-24119: - Issue Type: Sub-task (was: Task) Parent: SPARK-23580 > Add interpreted

[jira] [Commented] (SPARK-24142) Add interpreted execution to SortPrefix expression

[ https://issues.apache.org/jira/browse/SPARK-24142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460555#comment-16460555 ] Takeshi Yamamuro commented on SPARK-24142: -- I think it is ok as it is, resolved as duplicate. >

[jira] [Commented] (SPARK-21274) Implement EXCEPT ALL and INTERSECT ALL

[ https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16455470#comment-16455470 ] Takeshi Yamamuro commented on SPARK-21274: -- Looks great to me. I checked the queries above

[jira] [Commented] (SPARK-21274) Implement EXCEPT ALL and INTERSECT ALL

[ https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16455716#comment-16455716 ] Takeshi Yamamuro commented on SPARK-21274: -- ok, thanks! IMO it'd be better to make separate two

[jira] [Comment Edited] (SPARK-24702) Unable to cast to calendar interval in spark sql.

[ https://issues.apache.org/jira/browse/SPARK-24702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16531388#comment-16531388 ] Takeshi Yamamuro edited comment on SPARK-24702 at 7/3/18 1:36 PM: -- In

[jira] [Commented] (SPARK-24702) Unable to cast to calendar interval in spark sql.

[ https://issues.apache.org/jira/browse/SPARK-24702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16531388#comment-16531388 ] Takeshi Yamamuro commented on SPARK-24702: -- In postgresql, we can do so; {code} postgres=#

[jira] [Created] (SPARK-22981) Incorrect results of casting Struct to String

Takeshi Yamamuro created SPARK-22981: Summary: Incorrect results of casting Struct to String Key: SPARK-22981 URL: https://issues.apache.org/jira/browse/SPARK-22981 Project: Spark Issue

[jira] [Created] (SPARK-22973) Incorrect results of casting Map to String

Takeshi Yamamuro created SPARK-22973: Summary: Incorrect results of casting Map to String Key: SPARK-22973 URL: https://issues.apache.org/jira/browse/SPARK-22973 Project: Spark Issue

[jira] [Created] (SPARK-23023) Incorrect results of printing Array/Map/Struct in showString

Takeshi Yamamuro created SPARK-23023: Summary: Incorrect results of printing Array/Map/Struct in showString Key: SPARK-23023 URL: https://issues.apache.org/jira/browse/SPARK-23023 Project: Spark

[jira] [Commented] (SPARK-23027) optimizer a simple query using a non-existent data is too slow

[ https://issues.apache.org/jira/browse/SPARK-23027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16321487#comment-16321487 ] Takeshi Yamamuro commented on SPARK-23027: -- You tried v2.1?

[jira] [Commented] (SPARK-21274) Implement EXCEPT ALL and INTERSECT ALL

[ https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16328028#comment-16328028 ] Takeshi Yamamuro commented on SPARK-21274: -- yea, I tried though, I couldn't find a rewriting

[jira] [Comment Edited] (SPARK-21274) Implement EXCEPT ALL and INTERSECT ALL

[ https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16328028#comment-16328028 ] Takeshi Yamamuro edited comment on SPARK-21274 at 1/17/18 12:05 AM:

[jira] [Commented] (SPARK-23167) Update TPCDS queries from v1.4 to v2.7 (latest)

[ https://issues.apache.org/jira/browse/SPARK-23167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1692#comment-1692 ] Takeshi Yamamuro commented on SPARK-23167: -- cc: [~smilegator] > Update TPCDS queries from v1.4

[jira] [Created] (SPARK-23167) Update TPCDS queries from v1.4 to v2.7 (latest)

Takeshi Yamamuro created SPARK-23167: Summary: Update TPCDS queries from v1.4 to v2.7 (latest) Key: SPARK-23167 URL: https://issues.apache.org/jira/browse/SPARK-23167 Project: Spark

[jira] [Comment Edited] (SPARK-19217) Offer easy cast from vector to array

[ https://issues.apache.org/jira/browse/SPARK-19217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1698#comment-1698 ] Takeshi Yamamuro edited comment on SPARK-19217 at 1/21/18 5:32 AM: --- If

[jira] [Commented] (SPARK-19217) Offer easy cast from vector to array

[ https://issues.apache.org/jira/browse/SPARK-19217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1698#comment-1698 ] Takeshi Yamamuro commented on SPARK-19217: -- If it still makes some sense and nobody takes this,

[jira] [Commented] (SPARK-15467) Getting stack overflow when attempting to query a wide Dataset (>200 fields)

[ https://issues.apache.org/jira/browse/SPARK-15467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1694#comment-1694 ] Takeshi Yamamuro commented on SPARK-15467: -- I think this should be fixed in the master (that is,

[jira] [Updated] (SPARK-23168) Hints for fact tables and unique columns

[ https://issues.apache.org/jira/browse/SPARK-23168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-23168: - Environment: (was: We already have fact table and unique column inferences in

[jira] [Commented] (SPARK-23168) Hints for fact tables and unique columns

[ https://issues.apache.org/jira/browse/SPARK-23168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333402#comment-16333402 ] Takeshi Yamamuro commented on SPARK-23168: -- An example code is like:

[jira] [Created] (SPARK-23168) Hints for fact tables and unique columns

Takeshi Yamamuro created SPARK-23168: Summary: Hints for fact tables and unique columns Key: SPARK-23168 URL: https://issues.apache.org/jira/browse/SPARK-23168 Project: Spark Issue Type:

[jira] [Updated] (SPARK-23168) Hints for fact tables and unique columns

[ https://issues.apache.org/jira/browse/SPARK-23168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-23168: - Description: We already have fact table and unique column inferences in

[jira] [Commented] (SPARK-23171) Reduce the time costs of the rule runs that do not change the plans

[ https://issues.apache.org/jira/browse/SPARK-23171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333551#comment-16333551 ] Takeshi Yamamuro commented on SPARK-23171: -- ok, I'll check code based on these metrics. >

[jira] [Commented] (SPARK-23167) Update TPCDS queries from v1.4 to v2.7 (latest)

[ https://issues.apache.org/jira/browse/SPARK-23167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333536#comment-16333536 ] Takeshi Yamamuro commented on SPARK-23167: -- ok, will do. > Update TPCDS queries from v1.4 to

[jira] [Commented] (SPARK-19217) Offer easy cast from vector to array

[ https://issues.apache.org/jira/browse/SPARK-19217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333959#comment-16333959 ] Takeshi Yamamuro commented on SPARK-19217: -- If we can, I think it's the best to reuse `sqlType`,

[jira] [Commented] (SPARK-19217) Offer easy cast from vector to array

[ https://issues.apache.org/jira/browse/SPARK-19217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333987#comment-16333987 ] Takeshi Yamamuro commented on SPARK-19217: -- ok, I'll reconsider this. > Offer easy cast from

[jira] [Commented] (SPARK-23021) AnalysisBarrier should not cut off the explain output for Parsed Logical Plan

[ https://issues.apache.org/jira/browse/SPARK-23021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323822#comment-16323822 ] Takeshi Yamamuro commented on SPARK-23021: -- ok, I'll make a pr that way > AnalysisBarrier

[jira] [Commented] (SPARK-21274) Implement EXCEPT ALL and INTERSECT ALL

[ https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326119#comment-16326119 ] Takeshi Yamamuro commented on SPARK-21274: -- Nobody takes this? If so, I'll do (Probably, this

[jira] [Commented] (SPARK-23021) AnalysisBarrier should not cut off the explain output for Parsed Logical Plan

[ https://issues.apache.org/jira/browse/SPARK-23021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323599#comment-16323599 ] Takeshi Yamamuro commented on SPARK-23021: -- hi, kris, you're working on it? I think we just

[jira] [Created] (SPARK-23054) Incorrect results of casting UserDefinedType to String

Takeshi Yamamuro created SPARK-23054: Summary: Incorrect results of casting UserDefinedType to String Key: SPARK-23054 URL: https://issues.apache.org/jira/browse/SPARK-23054 Project: Spark

[jira] [Commented] (SPARK-23021) AnalysisBarrier should not cut off the explain output for Parsed Logical Plan

[ https://issues.apache.org/jira/browse/SPARK-23021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323623#comment-16323623 ] Takeshi Yamamuro commented on SPARK-23021: -- yea, sure, I have bandwidth to do :)) Is the fix

[jira] [Commented] (SPARK-20425) Support an extended display mode to print a column data per line

[ https://issues.apache.org/jira/browse/SPARK-20425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352271#comment-16352271 ] Takeshi Yamamuro commented on SPARK-20425: -- yea, ok. If nobody takes on this, I'll make a pr. >

[jira] [Created] (SPARK-23264) Support interval values without INTERVAL clauses

Takeshi Yamamuro created SPARK-23264: Summary: Support interval values without INTERVAL clauses Key: SPARK-23264 URL: https://issues.apache.org/jira/browse/SPARK-23264 Project: Spark

[jira] [Commented] (SPARK-22942) Spark Sql UDF throwing NullPointer when adding a filter on a columns that uses that UDF

[ https://issues.apache.org/jira/browse/SPARK-22942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309037#comment-16309037 ] Takeshi Yamamuro commented on SPARK-22942: -- Since spark passes null to udfs in optimizer rules,

[jira] [Created] (SPARK-22937) SQL elt for binary inputs

Takeshi Yamamuro created SPARK-22937: Summary: SQL elt for binary inputs Key: SPARK-22937 URL: https://issues.apache.org/jira/browse/SPARK-22937 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-21687) Spark SQL should set createTime for Hive partition

[ https://issues.apache.org/jira/browse/SPARK-21687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308153#comment-16308153 ] Takeshi Yamamuro commented on SPARK-21687: -- I feel this make some sense (But, this is a not bug,

[jira] [Commented] (SPARK-22553) Drop FROM in nonReserved

[ https://issues.apache.org/jira/browse/SPARK-22553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16307469#comment-16307469 ] Takeshi Yamamuro commented on SPARK-22553: -- Look fine to me > Drop FROM in nonReserved >

[jira] [Commented] (SPARK-22942) Spark Sql UDF throwing NullPointer when adding a filter on a columns that uses that UDF

[ https://issues.apache.org/jira/browse/SPARK-22942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308830#comment-16308830 ] Takeshi Yamamuro commented on SPARK-22942: -- I think you just need NULL checks; {code} val

[jira] [Comment Edited] (SPARK-21687) Spark SQL should set createTime for Hive partition

[ https://issues.apache.org/jira/browse/SPARK-21687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308153#comment-16308153 ] Takeshi Yamamuro edited comment on SPARK-21687 at 1/2/18 10:26 PM: --- I

[jira] [Commented] (SPARK-24498) Add JDK compiler for runtime codegen

[ https://issues.apache.org/jira/browse/SPARK-24498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16516917#comment-16516917 ] Takeshi Yamamuro commented on SPARK-24498: -- Probably, kiszk will make polite code for this (and

[jira] [Commented] (SPARK-24498) Add JDK compiler for runtime codegen

[ https://issues.apache.org/jira/browse/SPARK-24498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520056#comment-16520056 ] Takeshi Yamamuro commented on SPARK-24498: -- The results of my investigation (sf=1 performance

[jira] [Commented] (SPARK-24498) Add JDK compiler for runtime codegen

[ https://issues.apache.org/jira/browse/SPARK-24498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520090#comment-16520090 ] Takeshi Yamamuro commented on SPARK-24498: -- If there are javac options related to performance,

[jira] [Comment Edited] (SPARK-24498) Add JDK compiler for runtime codegen

[ https://issues.apache.org/jira/browse/SPARK-24498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520056#comment-16520056 ] Takeshi Yamamuro edited comment on SPARK-24498 at 6/22/18 6:59 AM: ---

[jira] [Commented] (SPARK-24498) Add JDK compiler for runtime codegen

[ https://issues.apache.org/jira/browse/SPARK-24498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520161#comment-16520161 ] Takeshi Yamamuro commented on SPARK-24498: -- yea, that might be true now. But, I think we need

[jira] [Commented] (SPARK-23742) Filter out redundant AssociationRules

[ https://issues.apache.org/jira/browse/SPARK-23742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566266#comment-16566266 ] Takeshi Yamamuro commented on SPARK-23742: -- Can't we control this case by a new config

[jira] [Commented] (SPARK-25013) JDBC urls with jdbc:mariadb don't work as expected

[ https://issues.apache.org/jira/browse/SPARK-25013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569811#comment-16569811 ] Takeshi Yamamuro commented on SPARK-25013: -- Spark currently doesn't have a dialect for mariadb.

[jira] [Commented] (SPARK-25013) JDBC urls with jdbc:mariadb don't work as expected

[ https://issues.apache.org/jira/browse/SPARK-25013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16574259#comment-16574259 ] Takeshi Yamamuro commented on SPARK-25013: -- yea, we can by registering a new dialect via

[jira] [Commented] (SPARK-25140) Add optional logging to UnsafeProjection.create when it falls back to interpreted mode

[ https://issues.apache.org/jira/browse/SPARK-25140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16583476#comment-16583476 ] Takeshi Yamamuro commented on SPARK-25140: -- I can take this though, is kris not working on

[jira] [Commented] (SPARK-25140) Add optional logging to UnsafeProjection.create when it falls back to interpreted mode

[ https://issues.apache.org/jira/browse/SPARK-25140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16583490#comment-16583490 ] Takeshi Yamamuro commented on SPARK-25140: -- ok! I’ll look into this. > Add optional logging to

[jira] [Comment Edited] (SPARK-25196) Analyze column statistics in cached query

[ https://issues.apache.org/jira/browse/SPARK-25196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589604#comment-16589604 ] Takeshi Yamamuro edited comment on SPARK-25196 at 8/23/18 2:34 PM: ---

[jira] [Comment Edited] (SPARK-25196) Analyze column statistics in cached query

[ https://issues.apache.org/jira/browse/SPARK-25196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589604#comment-16589604 ] Takeshi Yamamuro edited comment on SPARK-25196 at 8/23/18 2:28 AM: ---

[jira] [Commented] (SPARK-25196) Analyze column statistics in cached query

[ https://issues.apache.org/jira/browse/SPARK-25196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589604#comment-16589604 ] Takeshi Yamamuro commented on SPARK-25196: -- yea, sure. So, I'll make a pr after branch-2.4 cut.

[jira] [Commented] (SPARK-25225) Add support for "List"-Type columns

[ https://issues.apache.org/jira/browse/SPARK-25225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592397#comment-16592397 ] Takeshi Yamamuro commented on SPARK-25225: -- I don't understand exactly your secinario though,

[jira] [Commented] (SPARK-25232) Support Full-Text Search in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-25232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592442#comment-16592442 ] Takeshi Yamamuro commented on SPARK-25232: -- RLIKE is not enough? IMO they load data into

[jira] [Commented] (SPARK-25232) Support Full-Text Search in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-25232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592375#comment-16592375 ] Takeshi Yamamuro commented on SPARK-25232: -- The other database-like systems other than mysql

[jira] [Created] (SPARK-25196) Analyze column statistics in cached query

Takeshi Yamamuro created SPARK-25196: Summary: Analyze column statistics in cached query Key: SPARK-25196 URL: https://issues.apache.org/jira/browse/SPARK-25196 Project: Spark Issue

[jira] [Commented] (SPARK-25196) Analyze column statistics in cached query

[ https://issues.apache.org/jira/browse/SPARK-25196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16588830#comment-16588830 ] Takeshi Yamamuro commented on SPARK-25196: -- How about this idea? [~smilegator] [~cloud_fan] >

[jira] [Commented] (SPARK-25121) Support multi-part column name for hint resolution

[ https://issues.apache.org/jira/browse/SPARK-25121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589662#comment-16589662 ] Takeshi Yamamuro commented on SPARK-25121: -- Anybody starts working on this? If no, I could take

[jira] [Commented] (SPARK-24869) SaveIntoDataSourceCommand's input Dataset does not use Cached Data

[ https://issues.apache.org/jira/browse/SPARK-24869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550029#comment-16550029 ] Takeshi Yamamuro commented on SPARK-24869: -- ok > SaveIntoDataSourceCommand's input Dataset

[jira] [Commented] (SPARK-24869) SaveIntoDataSourceCommand's input Dataset does not use Cached Data

[ https://issues.apache.org/jira/browse/SPARK-24869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550738#comment-16550738 ] Takeshi Yamamuro commented on SPARK-24869: -- In the example above, cache() is not called

[jira] [Commented] (SPARK-24849) Convert StructType to DDL string

[ https://issues.apache.org/jira/browse/SPARK-24849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16547906#comment-16547906 ] Takeshi Yamamuro commented on SPARK-24849: -- What is this new func used for? Is this the

[jira] [Commented] (SPARK-24869) SaveIntoDataSourceCommand's input Dataset does not use Cached Data

[ https://issues.apache.org/jira/browse/SPARK-24869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551779#comment-16551779 ] Takeshi Yamamuro commented on SPARK-24869: -- Actually, the cache is correctly used in the case?

[jira] [Comment Edited] (SPARK-21274) Implement EXCEPT ALL and INTERSECT ALL

[ https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551965#comment-16551965 ] Takeshi Yamamuro edited comment on SPARK-21274 at 7/22/18 9:35 AM: ---

[jira] [Commented] (SPARK-21274) Implement EXCEPT ALL and INTERSECT ALL

[ https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551965#comment-16551965 ] Takeshi Yamamuro commented on SPARK-21274: -- ok, thanks! > Implement EXCEPT ALL and INTERSECT

[jira] [Commented] (SPARK-21274) Implement EXCEPT ALL and INTERSECT ALL

[ https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551921#comment-16551921 ] Takeshi Yamamuro commented on SPARK-21274: -- Anybody still working on this? > Implement EXCEPT

[jira] [Commented] (SPARK-18492) GeneratedIterator grows beyond 64 KB

[ https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16552257#comment-16552257 ] Takeshi Yamamuro commented on SPARK-18492: -- [~MDS Tang] You'd be better to describe more about

[jira] [Created] (SPARK-24806) Brush up generated code so that JDK Java compilers can handle it

Takeshi Yamamuro created SPARK-24806: Summary: Brush up generated code so that JDK Java compilers can handle it Key: SPARK-24806 URL: https://issues.apache.org/jira/browse/SPARK-24806 Project:

[jira] [Commented] (SPARK-24869) SaveIntoDataSourceCommand's input Dataset does not use Cached Data

[ https://issues.apache.org/jira/browse/SPARK-24869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16552965#comment-16552965 ] Takeshi Yamamuro commented on SPARK-24869: -- yea, I made the branch just for this test purpose

[jira] [Commented] (SPARK-24906) Enlarge split size for columnar file to ensure the task read enough data

[ https://issues.apache.org/jira/browse/SPARK-24906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16554340#comment-16554340 ] Takeshi Yamamuro commented on SPARK-24906: -- Ah, I see. It make some sense to me. In

[jira] [Updated] (SPARK-24844) spark REST API need to add ipFilter

[ https://issues.apache.org/jira/browse/SPARK-24844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-24844: - Priority: Minor (was: Blocker) > spark REST API need to add ipFilter >

[jira] [Commented] (SPARK-24844) spark REST API need to add ipFilter

[ https://issues.apache.org/jira/browse/SPARK-24844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16547831#comment-16547831 ] Takeshi Yamamuro commented on SPARK-24844: -- 'Blocker' tag in priority is reserved for

[jira] [Commented] (SPARK-25332) Instead of broadcast hash join ,Sort merge join has selected when restart spark-shell/spark-JDBC for hive provider

[ https://issues.apache.org/jira/browse/SPARK-25332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16603761#comment-16603761 ] Takeshi Yamamuro commented on SPARK-25332: -- Probably, you need to describe more about this

[jira] [Updated] (SPARK-25332) Instead of broadcast hash join ,Sort merge join has selected when restart spark-shell/spark-JDBC for hive provider

[ https://issues.apache.org/jira/browse/SPARK-25332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-25332: - Issue Type: Improvement (was: Bug) > Instead of broadcast hash join ,Sort merge join

[jira] [Updated] (SPARK-25358) MutableProjection supports fallback to an interpreted mode

[ https://issues.apache.org/jira/browse/SPARK-25358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-25358: - Issue Type: Sub-task (was: Improvement) Parent: SPARK-23580 >

[jira] [Created] (SPARK-25358) MutableProjection supports fallback to an interpreted mode

Takeshi Yamamuro created SPARK-25358: Summary: MutableProjection supports fallback to an interpreted mode Key: SPARK-25358 URL: https://issues.apache.org/jira/browse/SPARK-25358 Project: Spark

[jira] [Created] (SPARK-25374) SafeProjection supports fallback to an interpreted mode

Takeshi Yamamuro created SPARK-25374: Summary: SafeProjection supports fallback to an interpreted mode Key: SPARK-25374 URL: https://issues.apache.org/jira/browse/SPARK-25374 Project: Spark

[jira] [Commented] (SPARK-25374) SafeProjection supports fallback to an interpreted mode

[ https://issues.apache.org/jira/browse/SPARK-25374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16607837#comment-16607837 ] Takeshi Yamamuro commented on SPARK-25374: -- WIP:

[jira] [Updated] (SPARK-25374) SafeProjection supports fallback to an interpreted mode

[ https://issues.apache.org/jira/browse/SPARK-25374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-25374: - Issue Type: Sub-task (was: Improvement) Parent: SPARK-23580 > SafeProjection

[jira] [Updated] (SPARK-25193) insert overwrite doesn't throw exception when drop old data fails

[ https://issues.apache.org/jira/browse/SPARK-25193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-25193: - Component/s: (was: Spark Core) SQL > insert overwrite doesn't

[jira] [Commented] (SPARK-25193) insert overwrite doesn't throw exception when drop old data fails

[ https://issues.apache.org/jira/browse/SPARK-25193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16597298#comment-16597298 ] Takeshi Yamamuro commented on SPARK-25193: -- I changed the component to SQL and add the link to

[jira] [Updated] (SPARK-25340) Pushes down Sample beneath deterministic Project

[ https://issues.apache.org/jira/browse/SPARK-25340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-25340: - Description: If computations in Project are heavy (e.g., UDFs), it is useful to push

<    3   4   5   6   7   8   9   10   11   12   >