[jira] [Created] (SPARK-4620) Add unpersist in Graph/GraphImpl

2014-11-26 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-4620: --- Summary: Add unpersist in Graph/GraphImpl Key: SPARK-4620 URL: https://issues.apache.org/jira/browse/SPARK-4620 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-4620) Add unpersist in Graph/GraphImpl

2014-11-26 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-4620: Description: Add an IF to uncache both vertices and edges of Graph/GraphImpl. This IF is

[jira] [Created] (SPARK-4633) Support gzip in spark.compression.io.codec

2014-11-26 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-4633: --- Summary: Support gzip in spark.compression.io.codec Key: SPARK-4633 URL: https://issues.apache.org/jira/browse/SPARK-4633 Project: Spark Issue Type:

[jira] [Created] (SPARK-4646) Replace Scala.util.Sorting.quickSort with Sorter(TimSort) in Spark

2014-11-27 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-4646: --- Summary: Replace Scala.util.Sorting.quickSort with Sorter(TimSort) in Spark Key: SPARK-4646 URL: https://issues.apache.org/jira/browse/SPARK-4646 Project:

[jira] [Commented] (SPARK-1987) More memory-efficient graph construction

2014-11-28 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14228136#comment-14228136 ] Takeshi Yamamuro commented on SPARK-1987: - What is the status of this patch? This

[jira] [Commented] (SPARK-1987) More memory-efficient graph construction

2014-11-28 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14228208#comment-14228208 ] Takeshi Yamamuro commented on SPARK-1987: - Thanks for your review! :)) What's the

[jira] [Created] (SPARK-4725) Re-think custom shuffle serializers for vertex messages

2014-12-03 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-4725: --- Summary: Re-think custom shuffle serializers for vertex messages Key: SPARK-4725 URL: https://issues.apache.org/jira/browse/SPARK-4725 Project: Spark

[jira] [Created] (SPARK-4733) Add missing prameter comments in ShuffleDependency

2014-12-03 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-4733: --- Summary: Add missing prameter comments in ShuffleDependency Key: SPARK-4733 URL: https://issues.apache.org/jira/browse/SPARK-4733 Project: Spark Issue

[jira] [Created] (SPARK-4858) Add an option to turn off a progress bar in spark-shell

2014-12-15 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-4858: --- Summary: Add an option to turn off a progress bar in spark-shell Key: SPARK-4858 URL: https://issues.apache.org/jira/browse/SPARK-4858 Project: Spark

[jira] [Created] (SPARK-4917) Add a function to convert into a graph with canonical edges in GraphOps

2014-12-22 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-4917: --- Summary: Add a function to convert into a graph with canonical edges in GraphOps Key: SPARK-4917 URL: https://issues.apache.org/jira/browse/SPARK-4917 Project:

[jira] [Created] (SPARK-4932) Add help comments in Analytics

2014-12-22 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-4932: --- Summary: Add help comments in Analytics Key: SPARK-4932 URL: https://issues.apache.org/jira/browse/SPARK-4932 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-4950) Delete obsolete mapReduceTripelets used in Pregel

2014-12-23 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-4950: --- Summary: Delete obsolete mapReduceTripelets used in Pregel Key: SPARK-4950 URL: https://issues.apache.org/jira/browse/SPARK-4950 Project: Spark Issue

[jira] [Updated] (SPARK-4950) Delete obsolete mapReduceTripelets used in Pregel

2014-12-23 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-4950: Environment: (was: Any reason not to replace the api along with SPARK-3936?) Delete

[jira] [Commented] (SPARK-4950) Delete obsolete mapReduceTripelets used in Pregel

2014-12-23 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257961#comment-14257961 ] Takeshi Yamamuro commented on SPARK-4950: - Any reason not to replace the api along

[jira] [Created] (SPARK-4970) Fix an implicit bug in SparkSubmitSuite

2014-12-25 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-4970: --- Summary: Fix an implicit bug in SparkSubmitSuite Key: SPARK-4970 URL: https://issues.apache.org/jira/browse/SPARK-4970 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-5480) GraphX pageRank: java.lang.ArrayIndexOutOfBoundsException:

2015-02-05 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14307289#comment-14307289 ] Takeshi Yamamuro commented on SPARK-5480: - These codes didn't throw such

[jira] [Created] (SPARK-5623) Replace an obsolete mapReduceTriplets with a new aggregateMessages in GraphSuite

2015-02-05 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-5623: --- Summary: Replace an obsolete mapReduceTriplets with a new aggregateMessages in GraphSuite Key: SPARK-5623 URL: https://issues.apache.org/jira/browse/SPARK-5623

[jira] [Created] (SPARK-5352) Add getPartitionStrategy in Graph

2015-01-21 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-5352: --- Summary: Add getPartitionStrategy in Graph Key: SPARK-5352 URL: https://issues.apache.org/jira/browse/SPARK-5352 Project: Spark Issue Type:

[jira] [Updated] (SPARK-5352) Add getPartitionStrategy in Graph

2015-01-21 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-5352: Description: Graph remembers an applied partition strategy in partitionBy() and returns it

[jira] [Updated] (SPARK-5351) Can't zip RDDs with unequal numbers of partitions in ReplicatedVertexView.upgrade()

2015-01-21 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-5351: Description: If the value of 'spark.default.parallelism' does not match the number of

[jira] [Created] (SPARK-5351) Can't zip RDDs with unequal numbers of partitions in ReplicatedVertexView.upgrade()

2015-01-21 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-5351: --- Summary: Can't zip RDDs with unequal numbers of partitions in ReplicatedVertexView.upgrade() Key: SPARK-5351 URL: https://issues.apache.org/jira/browse/SPARK-5351

[jira] [Updated] (SPARK-5351) Can't zip RDDs with unequal numbers of partitions in ReplicatedVertexView.upgrade()

2015-01-21 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-5351: Description: If the value of 'spark.default.parallelism' does not match the number of

[jira] [Updated] (SPARK-5351) Can't zip RDDs with unequal numbers of partitions in ReplicatedVertexView.upgrade()

2015-01-21 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-5351: Description: If the value of 'spark.default.parallelism' does not match the number of

[jira] [Updated] (SPARK-5351) Can't zip RDDs with unequal numbers of partitions in ReplicatedVertexView.upgrade()

2015-01-21 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-5351: Description: If the value of 'spark.default.parallelism' does not match the number of

[jira] [Created] (SPARK-5883) Add compression scheme in VertexAttributeBlock for shipping vertices to edge partitions

2015-02-18 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-5883: --- Summary: Add compression scheme in VertexAttributeBlock for shipping vertices to edge partitions Key: SPARK-5883 URL: https://issues.apache.org/jira/browse/SPARK-5883

[jira] [Updated] (SPARK-5883) Add compression scheme in VertexAttributeBlock for shipping vertices to edge partitions

2015-02-18 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-5883: Description: The size of shipped data between vertex partitions and edge partitions is one

[jira] [Commented] (SPARK-5854) Implement Personalized PageRank with GraphX

2015-02-16 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14323762#comment-14323762 ] Takeshi Yamamuro commented on SPARK-5854: - Look good, and welcome your PR :)

[jira] [Created] (SPARK-5827) Add missing imports in the example of SQLContext

2015-02-15 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-5827: --- Summary: Add missing imports in the example of SQLContext Key: SPARK-5827 URL: https://issues.apache.org/jira/browse/SPARK-5827 Project: Spark Issue

[jira] [Created] (SPARK-5922) Add diff(other: RDD[VertexId, VD]) in VertexRDD

2015-02-20 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-5922: --- Summary: Add diff(other: RDD[VertexId, VD]) in VertexRDD Key: SPARK-5922 URL: https://issues.apache.org/jira/browse/SPARK-5922 Project: Spark Issue

[jira] [Commented] (SPARK-5790) VertexRDD's won't zip properly for `diff` capability

2015-02-20 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14328778#comment-14328778 ] Takeshi Yamamuro commented on SPARK-5790: - Hi, What's the status of your work? I

[jira] [Created] (SPARK-5882) Add a test for GraphLoader.edgeListFile

2015-02-18 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-5882: --- Summary: Add a test for GraphLoader.edgeListFile Key: SPARK-5882 URL: https://issues.apache.org/jira/browse/SPARK-5882 Project: Spark Issue Type: Test

[jira] [Created] (SPARK-5450) Add APIs to save a graph as a SequenceFile and load it

2015-01-28 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-5450: --- Summary: Add APIs to save a graph as a SequenceFile and load it Key: SPARK-5450 URL: https://issues.apache.org/jira/browse/SPARK-5450 Project: Spark

[jira] [Commented] (SPARK-5790) Add tests for: VertexRDD's won't zip properly for `diff` capability

2015-03-14 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14362232#comment-14362232 ] Takeshi Yamamuro commented on SPARK-5790: - Thanks, If your patch merged, I'll add

[jira] [Commented] (SPARK-4086) Fold-style aggregation for VertexRDD

2015-03-14 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14362192#comment-14362192 ] Takeshi Yamamuro commented on SPARK-4086: - ISTM, VertexRDD has to comply with

[jira] [Created] (SPARK-6357) Add unapply in EdgeContext

2015-03-16 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-6357: --- Summary: Add unapply in EdgeContext Key: SPARK-6357 URL: https://issues.apache.org/jira/browse/SPARK-6357 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-6424) Support user-defined aggregators in AggregateFunction

2015-03-19 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-6424: --- Summary: Support user-defined aggregators in AggregateFunction Key: SPARK-6424 URL: https://issues.apache.org/jira/browse/SPARK-6424 Project: Spark

[jira] [Updated] (SPARK-6424) Support user-defined aggregators in AggregateFunction

2015-03-20 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-6424: Description: Add a new interface to implement user-defined aggregators in

[jira] [Created] (SPARK-6281) Support incremental updates for Graph

2015-03-11 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-6281: --- Summary: Support incremental updates for Graph Key: SPARK-6281 URL: https://issues.apache.org/jira/browse/SPARK-6281 Project: Spark Issue Type: New

[jira] [Commented] (SPARK-6022) GraphX `diff` test incorrectly operating on values (not VertexId's)

2015-03-11 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356452#comment-14356452 ] Takeshi Yamamuro commented on SPARK-6022: - Yeah, ISTM it'd be better to add set

[jira] [Updated] (SPARK-6379) Support a functon to call user-defined functions registered in SQLContext

2015-03-22 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-6379: Description: This is useful for using pre-defined UDFs in SQLContext; val df = Seq((id1,

[jira] [Commented] (SPARK-6022) GraphX `diff` test incorrectly operating on values (not VertexId's)

2015-03-02 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14344699#comment-14344699 ] Takeshi Yamamuro commented on SPARK-6022: - Is the test correct? According to the

[jira] [Commented] (SPARK-5940) Graph Loader: refactor + add more formats

2015-02-25 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14336677#comment-14336677 ] Takeshi Yamamuro commented on SPARK-5940: - I made a quick fix as follows;

[jira] [Commented] (SPARK-5790) VertexRDD's won't zip properly for `diff` capability

2015-02-23 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14334292#comment-14334292 ] Takeshi Yamamuro commented on SPARK-5790: - Thanks for your work :) VertexRDD's

[jira] [Commented] (SPARK-6912) Support MapK,V as a return type in Hive UDF

2015-04-14 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494555#comment-14494555 ] Takeshi Yamamuro commented on SPARK-6912: - After SPARK-6747 resolved, I'll make a

[jira] [Updated] (SPARK-6912) Support MapK,V as a return type in Hive UDF

2015-04-14 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-6912: Description: The current implementation can't handle MapK,V as a return type in Hive UDF.

[jira] [Updated] (SPARK-6912) Support MapK,V as a return type in Hive UDF

2015-04-14 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-6912: Description: The current implementation can't handle MapK,V as a return type in Hive UDF.

[jira] [Updated] (SPARK-6912) Support MapK,V as a return type in Hive UDF

2015-04-14 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-6912: Environment: (was: The current implementation can't handle MapK,V as a return type in

[jira] [Created] (SPARK-6912) Support MapK,V as a return type in Hive UDF

2015-04-14 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-6912: --- Summary: Support MapK,V as a return type in Hive UDF Key: SPARK-6912 URL: https://issues.apache.org/jira/browse/SPARK-6912 Project: Spark Issue Type:

[jira] [Updated] (SPARK-3937) ç

2015-04-16 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-3937: Summary: ç (was: Unsafe memory access inside of Snappy library) ç -

[jira] [Updated] (SPARK-3937) Unsafe memory access inside of Snappy library

2015-04-16 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-3937: Summary: Unsafe memory access inside of Snappy library (was: ç) Unsafe memory access

[jira] [Updated] (SPARK-6747) Support List as a return type in Hive UDF

2015-04-07 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-6747: Summary: Support List as a return type in Hive UDF (was: Support List as a return type in

[jira] [Updated] (SPARK-6747) Support List as a return type in Hive UDF

2015-04-07 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-6747: Description: The current implementation can't handle List as a return type in Hive UDF. We

[jira] [Updated] (SPARK-6747) Support List as a return type in Hive UDF

2015-04-07 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-6747: Description: The current implementation can't handle List as a return type in Hive UDF. We

[jira] [Created] (SPARK-6747) Support List as a return type in Hive UDF

2015-04-07 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-6747: --- Summary: Support List as a return type in Hive UDF Key: SPARK-6747 URL: https://issues.apache.org/jira/browse/SPARK-6747 Project: Spark Issue Type:

[jira] [Commented] (SPARK-3947) [Spark SQL] UDAF Support

2015-04-09 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487278#comment-14487278 ] Takeshi Yamamuro commented on SPARK-3947: - Sorry, but Im not sure about the issue

[jira] [Commented] (SPARK-3947) [Spark SQL] UDAF Support

2015-04-09 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487175#comment-14487175 ] Takeshi Yamamuro commented on SPARK-3947: - See SPARK-4233, we are refactoring the

[jira] [Updated] (SPARK-6912) Support MapK,V as a return type in Hive UDF

2015-06-24 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-6912: Affects Version/s: 1.4.0 Support MapK,V as a return type in Hive UDF

[jira] [Updated] (SPARK-6747) Support List as a return type in Hive UDF

2015-06-24 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-6747: Affects Version/s: 1.4.0 Support List as a return type in Hive UDF

[jira] [Updated] (SPARK-6747) Support List as a return type in Hive UDF

2015-06-24 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-6747: Labels: 1.5.0 (was: ) Support List as a return type in Hive UDF

[jira] [Updated] (SPARK-6747) Throw an AnalysisException when unsupported Java list types used in Hive UDF

2015-07-06 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-6747: Description: The current implementation can't handle List as a return type in Hive UDF and

[jira] [Updated] (SPARK-6747) Throw an AnalysisException when unsupported Java list types used in Hive UDF

2015-07-06 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-6747: Summary: Throw an AnalysisException when unsupported Java list types used in Hive UDF

[jira] [Updated] (SPARK-6912) Throw an AnalysisException when unsupported Java MapK,V types used in Hive UDF

2015-07-07 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-6912: Summary: Throw an AnalysisException when unsupported Java MapK,V types used in Hive UDF

[jira] [Commented] (SPARK-8786) Create a wrapper for BinaryType

2015-07-29 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645999#comment-14645999 ] Takeshi Yamamuro commented on SPARK-8786: - Right now, spark can correctly handle

[jira] [Updated] (SPARK-8930) Throw a AnalysisException with meaningful messages when DataFrame#explode takes a star in expressions

2015-08-05 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-8930: Summary: Throw a AnalysisException with meaningful messages when DataFrame#explode takes a

[jira] [Updated] (SPARK-8930) Throw a AnalysisException with meaningful messages when DataFrame#explode takes a star in expressions

2015-08-05 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-8930: Description: The current implementation throws an exception with meaningless messages if

[jira] [Updated] (SPARK-8930) Throw a AnalysisException with meaningful messages if DataFrame#explode takes a star in expressions

2015-08-05 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-8930: Summary: Throw a AnalysisException with meaningful messages if DataFrame#explode takes a

[jira] [Updated] (SPARK-8930) Throw a AnalysisException with meaningful messages if DataFrame#explode takes a star in expressions

2015-08-05 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-8930: Description: The current implementation throws an exception with meaningless messages if

[jira] [Commented] (SPARK-8786) Create a wrapper for BinaryType

2015-07-30 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647248#comment-14647248 ] Takeshi Yamamuro commented on SPARK-8786: - Sorry to make you confused though, a

[jira] [Comment Edited] (SPARK-8786) Create a wrapper for BinaryType

2015-07-30 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647248#comment-14647248 ] Takeshi Yamamuro edited comment on SPARK-8786 at 7/30/15 6:26 AM:

[jira] [Comment Edited] (SPARK-8786) Create a wrapper for BinaryType

2015-07-30 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647248#comment-14647248 ] Takeshi Yamamuro edited comment on SPARK-8786 at 7/30/15 6:28 AM:

[jira] [Created] (SPARK-9816) Support BinaryType in Concat

2015-08-11 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-9816: --- Summary: Support BinaryType in Concat Key: SPARK-9816 URL: https://issues.apache.org/jira/browse/SPARK-9816 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-9867) Move utilities for binary data into ByteArray

2015-08-12 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-9867: --- Summary: Move utilities for binary data into ByteArray Key: SPARK-9867 URL: https://issues.apache.org/jira/browse/SPARK-9867 Project: Spark Issue

[jira] [Commented] (SPARK-9816) Support BinaryType in Concat

2015-08-11 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692917#comment-14692917 ] Takeshi Yamamuro commented on SPARK-9816: - I misunderstood, so could you close

[jira] [Commented] (SPARK-9309) Support DecimalType and TimestampType in UnsafeRowConverter

2015-07-26 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642003#comment-14642003 ] Takeshi Yamamuro commented on SPARK-9309: - UnsafeRowConverter didn't support these

[jira] [Created] (SPARK-9360) Support BinaryType in PrefixComparators for UnsafeExternalSort

2015-07-26 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-9360: --- Summary: Support BinaryType in PrefixComparators for UnsafeExternalSort Key: SPARK-9360 URL: https://issues.apache.org/jira/browse/SPARK-9360 Project: Spark

[jira] [Updated] (SPARK-9034) Reflect field names defined in GenericUDTF

2015-07-14 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-9034: Description: GenericUDTF#initialize() in Hive defines field names in a returned schema

[jira] [Updated] (SPARK-9034) Reflect field names defined in GenericUDTF

2015-07-14 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-9034: Description: Hive GenericUDTF#initialize() defines field names in a returned schema though,

[jira] [Created] (SPARK-9034) Reflect field names defined in GenericUDTF

2015-07-14 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-9034: --- Summary: Reflect field names defined in GenericUDTF Key: SPARK-9034 URL: https://issues.apache.org/jira/browse/SPARK-9034 Project: Spark Issue Type:

[jira] [Commented] (SPARK-9034) Reflect field names defined in GenericUDTF

2015-07-14 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626279#comment-14626279 ] Takeshi Yamamuro commented on SPARK-9034: - I'll make a PR for this after

[jira] [Created] (SPARK-11394) PostgreDialect cannot handle BYTE types

2015-10-28 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-11394: Summary: PostgreDialect cannot handle BYTE types Key: SPARK-11394 URL: https://issues.apache.org/jira/browse/SPARK-11394 Project: Spark Issue Type:

[jira] [Commented] (SPARK-11704) Optimize the Cartesian Join

2015-11-13 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15005111#comment-15005111 ] Takeshi Yamamuro commented on SPARK-11704: -- ISTM that some earlier stages in rdd2 are skipped in

[jira] [Commented] (SPARK-11704) Optimize the Cartesian Join

2015-11-13 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15005217#comment-15005217 ] Takeshi Yamamuro commented on SPARK-11704: -- You're right; they're not automatically cached. I

[jira] [Created] (SPARK-8955) Replace a duplicated initialize() in HiveGenericUDTF with new one

2015-07-09 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-8955: --- Summary: Replace a duplicated initialize() in HiveGenericUDTF with new one Key: SPARK-8955 URL: https://issues.apache.org/jira/browse/SPARK-8955 Project: Spark

[jira] [Updated] (SPARK-8930) Support a star '*' in generator function arguments

2015-07-09 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-8930: Description: The current implementation throws an exception if generators contain a star

[jira] [Updated] (SPARK-8930) Support a star '*' in generator function arguments

2015-07-09 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-8930: Description: The current implementation throws an exception if generators contain a star

[jira] [Updated] (SPARK-8930) Support a star '*' in generator function arguments

2015-07-09 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-8930: Description: The current implementation throws an exception if generators contain a star

[jira] [Created] (SPARK-8930) Support a star '*' in the generator function argument

2015-07-08 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-8930: --- Summary: Support a star '*' in the generator function argument Key: SPARK-8930 URL: https://issues.apache.org/jira/browse/SPARK-8930 Project: Spark

[jira] [Updated] (SPARK-8930) Support a star '*' in generator function arguments

2015-07-08 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-8930: Summary: Support a star '*' in generator function arguments (was: Support a star '*' in

[jira] [Created] (SPARK-12392) Optimize a location order of broadcast blocks by considering preferred local hosts

2015-12-16 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-12392: Summary: Optimize a location order of broadcast blocks by considering preferred local hosts Key: SPARK-12392 URL: https://issues.apache.org/jira/browse/SPARK-12392

[jira] [Comment Edited] (SPARK-6521) Bypass network shuffle read if both endpoints are local

2015-12-15 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15033016#comment-15033016 ] Takeshi Yamamuro edited comment on SPARK-6521 at 12/15/15 9:23 AM: ---

[jira] [Created] (SPARK-12686) Support group-by push down into data sources

2016-01-06 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-12686: Summary: Support group-by push down into data sources Key: SPARK-12686 URL: https://issues.apache.org/jira/browse/SPARK-12686 Project: Spark Issue

[jira] [Created] (SPARK-12446) Add unit tests for JDBCRDD internal functions

2015-12-20 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-12446: Summary: Add unit tests for JDBCRDD internal functions Key: SPARK-12446 URL: https://issues.apache.org/jira/browse/SPARK-12446 Project: Spark Issue

[jira] [Updated] (SPARK-12476) Implement JdbcRelation#unhandledFilters for removing unnecessary Spark Fileter

2015-12-21 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-12476: - Description: Input: SELECT * FROM jdbcTable WHERE col0 = 'xxx' {code} Current plan: ==

[jira] [Updated] (SPARK-12476) Implement JdbcRelation#unhandledFilters for removing unnecessary Spark Filter

2015-12-21 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-12476: - Description: Input: SELECT * FROM jdbcTable WHERE col0 = 'xxx' Current plan: {code} ==

[jira] [Updated] (SPARK-12476) Implement JdbcRelation#unhandledFilters for removing unnecessary Spark Filter

2015-12-21 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-12476: - Description: Input: SELECT * FROM jdbcTable WHERE col0 = 'xxx' Current plan: {code} ==

[jira] [Updated] (SPARK-12476) Implement JdbcRelation#unhandledFilters for removing unnecessary Spark Filter

2015-12-21 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-12476: - Summary: Implement JdbcRelation#unhandledFilters for removing unnecessary Spark Filter

[jira] [Updated] (SPARK-12476) Implement JdbcRelation#unhandledFilters for removing unnecessary Spark Fileter

2015-12-21 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-12476: - Description: Input: SELECT * FROM jdbcTable WHERE col0 = 'xxx' {code} Current plan: ==

[jira] [Created] (SPARK-12476) Implement JdbcRelation#unhandledFilters for removing unnecessary Spark Fileter

2015-12-21 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-12476: Summary: Implement JdbcRelation#unhandledFilters for removing unnecessary Spark Fileter Key: SPARK-12476 URL: https://issues.apache.org/jira/browse/SPARK-12476

[jira] [Commented] (SPARK-5753) add basic support to JDBCRDD for postgresql types: uuid, hstore, and array

2015-12-24 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070822#comment-15070822 ] Takeshi Yamamuro commented on SPARK-5753: - [~rxin] This ticket should be closed because it has

[jira] [Created] (SPARK-12581) Support case-sensitive table names in postgresql

2015-12-30 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-12581: Summary: Support case-sensitive table names in postgresql Key: SPARK-12581 URL: https://issues.apache.org/jira/browse/SPARK-12581 Project: Spark

  1   2   3   4   5   6   7   8   9   10   >