[jira] [Commented] (HBASE-15333) Enhance the filter to handle short, integer, long, float and double

2016-04-06 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15228495#comment-15228495 ] Ted Malaska commented on HBASE-15333: - I gave it a quick look and it looks good but let's give

[jira] [Commented] (HBASE-15271) Spark Bulk Load: Need to write HFiles to tmp location then rename to protect from Spark Executor Failures

2016-03-08 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186180#comment-15186180 ] Ted Malaska commented on HBASE-15271: - Hey [~busbey] the current tests will test that everything

[jira] [Commented] (HBASE-14789) Enhance the current spark-hbase connector

2016-02-25 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15168157#comment-15168157 ] Ted Malaska commented on HBASE-14789: - This looks really cool. Can we add a couple more. 5. Add

[jira] [Commented] (HBASE-14801) Enhance the Spark-HBase connector catalog with json format

2016-02-24 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166481#comment-15166481 ] Ted Malaska commented on HBASE-14801: - I'm having a full day I will be able to look tomorrow. But

[jira] [Commented] (HBASE-15184) SparkSQL Scan operation doesn't work on kerberos cluster

2016-02-23 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15159987#comment-15159987 ] Ted Malaska commented on HBASE-15184: - Thank u Ted yu -- Sent from Gmail Mobile > SparkSQL

[jira] [Updated] (HBASE-15184) SparkSQL Scan operation doesn't work on kerberos cluster

2016-02-22 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Malaska updated HBASE-15184: Attachment: HBASE-15184.1.patch This was tested both in unit tests and in a 10 node kerberos

[jira] [Commented] (HBASE-15184) SparkSQL Scan operation doesn't work on kerberos cluster

2016-02-21 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15156351#comment-15156351 ] Ted Malaska commented on HBASE-15184: - OK finally back ported the code and ran it on my Kerberos

[jira] [Commented] (HBASE-15271) Spark Bulk Load: Need to write HFiles to tmp location then rename to protect from Spark Executor Failures

2016-02-19 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154871#comment-15154871 ] Ted Malaska commented on HBASE-15271: - Thank you Joh H and Ted Y > Spark Bulk Load: Need to write

[jira] [Updated] (HBASE-15271) Spark Bulk Load: Need to write HFiles to tmp location then rename to protect from Spark Executor Failures

2016-02-19 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Malaska updated HBASE-15271: Attachment: HBASE-15271.4.patch Made changes based on Jon H comments > Spark Bulk Load: Need to

[jira] [Updated] (HBASE-15271) Spark Bulk Load: Need to write HFiles to tmp location then rename to protect from Spark Executor Failures

2016-02-18 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Malaska updated HBASE-15271: Attachment: HBASE-15271.3.patch Made changes for Ted Yu's comment > Spark Bulk Load: Need to

[jira] [Updated] (HBASE-15271) Spark Bulk Load: Need to write HFiles to tmp location then rename to protect from Spark Executor Failures

2016-02-18 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Malaska updated HBASE-15271: Attachment: HBASE-15271.2.patch Added change based on Ted Yu's comment > Spark Bulk Load: Need to

[jira] [Commented] (HBASE-15282) Bump Spark on Hbase to use Spark 1.6.

2016-02-18 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15153484#comment-15153484 ] Ted Malaska commented on HBASE-15282: - +1 > Bump Spark on Hbase to use Spark 1.6. >

[jira] [Updated] (HBASE-15271) Spark Bulk Load: Need to write HFiles to tmp location then rename to protect from Spark Executor Failures

2016-02-18 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Malaska updated HBASE-15271: Attachment: HBASE-15271.1.patch First draft. Built and ran tests > Spark Bulk Load: Need to

[jira] [Created] (HBASE-15271) Spark Bulk Load: Need to write HFiles to tmp location then rename to protect from Spark Executor Failures

2016-02-15 Thread Ted Malaska (JIRA)
Ted Malaska created HBASE-15271: --- Summary: Spark Bulk Load: Need to write HFiles to tmp location then rename to protect from Spark Executor Failures Key: HBASE-15271 URL:

[jira] [Commented] (HBASE-15184) SparkSQL Scan operation doesn't work on kerberos cluster

2016-02-15 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15147419#comment-15147419 ] Ted Malaska commented on HBASE-15184: - I'm also here on this Jira. I'm on a clint application now

[jira] [Commented] (HBASE-15225) Connecting to HBase via newAPIHadoopRDD in PySpark gives org.apache.hadoop.hbase.client.RetriesExhaustedException

2016-02-06 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136012#comment-15136012 ] Ted Malaska commented on HBASE-15225: - I have a version that works on kerberos clusters that my

[jira] [Commented] (HBASE-15225) Connecting to HBase via newAPIHadoopRDD in PySpark gives org.apache.hadoop.hbase.client.RetriesExhaustedException

2016-02-06 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136013#comment-15136013 ] Ted Malaska commented on HBASE-15225: - OK I have updated the Github. This has everything that is in

[jira] [Commented] (HBASE-14340) Add second bulk load option to Spark Bulk Load to send puts as the value

2016-02-06 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136083#comment-15136083 ] Ted Malaska commented on HBASE-14340: - Thank you Andrew for your review. :) > Add second bulk load

[jira] [Commented] (HBASE-15184) SparkSQL Scan operation doesn't work on kerberos cluster

2016-02-06 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136082#comment-15136082 ] Ted Malaska commented on HBASE-15184: - ok I'm back from vacation I will try to finish a patch by mid

[jira] [Assigned] (HBASE-15184) SparkSQL Scan operation doesn't work on kerberos cluster

2016-02-06 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Malaska reassigned HBASE-15184: --- Assignee: Ted Malaska > SparkSQL Scan operation doesn't work on kerberos cluster >

[jira] [Commented] (HBASE-15225) Connecting to HBase via newAPIHadoopRDD in PySpark gives org.apache.hadoop.hbase.client.RetriesExhaustedException

2016-02-05 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15135624#comment-15135624 ] Ted Malaska commented on HBASE-15225: - This should be marked as involved Jira. [~88.sanjay] don't

[jira] [Commented] (HBASE-15225) Connecting to HBase via newAPIHadoopRDD in PySpark gives org.apache.hadoop.hbase.client.RetriesExhaustedException

2016-02-05 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15135626#comment-15135626 ] Ted Malaska commented on HBASE-15225: - Also if you are using PySpark then use the Spark SQL to HBase

[jira] [Updated] (HBASE-15184) SparkSQL Scan operation doesn't work on kerberos cluster

2016-01-28 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Malaska updated HBASE-15184: Attachment: HBaseSparkModule.zip Solution that worked on CDH 5.5 on client kerberos cluster, but

[jira] [Created] (HBASE-15184) SparkSQL Scan operation doesn't work on kerberos cluster

2016-01-28 Thread Ted Malaska (JIRA)
Ted Malaska created HBASE-15184: --- Summary: SparkSQL Scan operation doesn't work on kerberos cluster Key: HBASE-15184 URL: https://issues.apache.org/jira/browse/HBASE-15184 Project: HBase Issue

[jira] [Commented] (HBASE-14796) Enhance the Gets in the connector

2015-12-28 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072938#comment-15072938 ] Ted Malaska commented on HBASE-14796: - Zhan good points. I agree, even if it is slower it is better.

[jira] [Updated] (HBASE-15036) Update HBase Spark documentation to include bulk load with thin records

2015-12-23 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Malaska updated HBASE-15036: Attachment: HBASE-15036.patch First Draft > Update HBase Spark documentation to include bulk load

[jira] [Updated] (HBASE-15036) Update HBase Spark documentation to include bulk load with thin records

2015-12-23 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Malaska updated HBASE-15036: Attachment: HBASE-15036.1.patch Removed extra spaces > Update HBase Spark documentation to

[jira] [Commented] (HBASE-14796) Enhance the Gets in the connector

2015-12-23 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070177#comment-15070177 ] Ted Malaska commented on HBASE-14796: - I reviewed the code and I'm giving it a +1 Did you do the

[jira] [Created] (HBASE-15036) Update HBase Spark documentation to include bulk load with thin records

2015-12-23 Thread Ted Malaska (JIRA)
Ted Malaska created HBASE-15036: --- Summary: Update HBase Spark documentation to include bulk load with thin records Key: HBASE-15036 URL: https://issues.apache.org/jira/browse/HBASE-15036 Project: HBase

[jira] [Commented] (HBASE-14849) Add option to set block cache to false on SparkSQL executions

2015-12-18 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15064491#comment-15064491 ] Ted Malaska commented on HBASE-14849: - I reviewed the your changes. I'm liking what you did. So I

[jira] [Commented] (HBASE-14849) Add option to set block cache to false on SparkSQL executions

2015-12-17 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062634#comment-15062634 ] Ted Malaska commented on HBASE-14849: - I added comments > Add option to set block cache to false on

[jira] [Commented] (HBASE-14849) Add option to set block cache to false on SparkSQL executions

2015-12-17 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062684#comment-15062684 ] Ted Malaska commented on HBASE-14849: - Thanks Zhan, I updated again. Thank you for the work > Add

[jira] [Commented] (HBASE-14849) Add option to set block cache to false on SparkSQL executions

2015-12-15 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059253#comment-15059253 ] Ted Malaska commented on HBASE-14849: - Can you make the review board? Thanks > Add option to set

[jira] [Updated] (HBASE-14849) Add option to set block cache to false on SparkSQL executions

2015-12-14 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Malaska updated HBASE-14849: Assignee: Zhan Zhang (was: Ted Malaska) > Add option to set block cache to false on SparkSQL

[jira] [Commented] (HBASE-14849) Add option to set block cache to false on SparkSQL executions

2015-12-14 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15057071#comment-15057071 ] Ted Malaska commented on HBASE-14849: - Thanks Zhan. I will be able to review as soon as you finish

[jira] [Commented] (HBASE-14795) Enhance the spark-hbase scan operations

2015-12-11 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052639#comment-15052639 ] Ted Malaska commented on HBASE-14795: - Will do, but don't hold up this patch for my testing. If I

[jira] [Commented] (HBASE-14929) There is a space missing from Table "foo" is not currently available.

2015-12-11 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053519#comment-15053519 ] Ted Malaska commented on HBASE-14929: - Great lets get the patch file up on the jira and create a

[jira] [Commented] (HBASE-14929) There is a space missing from Table "foo" is not currently available.

2015-12-11 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053531#comment-15053531 ] Ted Malaska commented on HBASE-14929: - +1 > There is a space missing from Table "foo" is not

[jira] [Commented] (HBASE-14795) Enhance the spark-hbase scan operations

2015-12-10 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051936#comment-15051936 ] Ted Malaska commented on HBASE-14795: - That was a cool addition. I like the wrapping of the function

[jira] [Commented] (HBASE-14795) Enhance the spark-hbase scan operations

2015-12-10 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051244#comment-15051244 ] Ted Malaska commented on HBASE-14795: - Hey Zhan I left one comment about the sync block. and I do

[jira] [Commented] (HBASE-14795) Enhance the spark-hbase scan operations

2015-12-08 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047701#comment-15047701 ] Ted Malaska commented on HBASE-14795: - Will review tonight. Long day :) -- Sent from Gmail

[jira] [Commented] (HBASE-14795) Enhance the spark-hbase scan operations

2015-12-08 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047779#comment-15047779 ] Ted Malaska commented on HBASE-14795: - OK finished my review. Please review my review, it seems to

[jira] [Commented] (HBASE-14795) Enhance the spark-hbase scan operations

2015-12-07 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046210#comment-15046210 ] Ted Malaska commented on HBASE-14795: - I just looked at the review board. I don't see the changes.

[jira] [Commented] (HBASE-14795) Enhance the spark-hbase scan operations

2015-12-06 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044226#comment-15044226 ] Ted Malaska commented on HBASE-14795: - I did a first pass review and left comments. Mainly concerned

[jira] [Created] (HBASE-14929) There is a space missing from Table "foo" is not currently available.

2015-12-04 Thread Ted Malaska (JIRA)
Ted Malaska created HBASE-14929: --- Summary: There is a space missing from Table "foo" is not currently available. Key: HBASE-14929 URL: https://issues.apache.org/jira/browse/HBASE-14929 Project: HBase

[jira] [Commented] (HBASE-14795) Enhance the spark-hbase scan operations

2015-12-03 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15039668#comment-15039668 ] Ted Malaska commented on HBASE-14795: - Can we open up a review board for this. Thx > Enhance the

[jira] [Updated] (HBASE-14849) Add option to set block cache to false on SparkSQL executions

2015-11-27 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Malaska updated HBASE-14849: Description: I was working at a client with a ported down version of the Spark module for HBase

[jira] [Assigned] (HBASE-14849) Add option to set block cache to false on SparkSQL executions

2015-11-27 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Malaska reassigned HBASE-14849: --- Assignee: Ted Malaska > Add option to set block cache to false on SparkSQL executions >

[jira] [Commented] (HBASE-14849) Add option to set block cache to false on SparkSQL executions

2015-11-27 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029922#comment-15029922 ] Ted Malaska commented on HBASE-14849: - If it is ok I'm going to start this, with the hopes of getting

[jira] [Commented] (HBASE-14795) Enhance the spark-hbase scan operations

2015-11-19 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15014342#comment-15014342 ] Ted Malaska commented on HBASE-14795: - Hey Zhan, What is your ETA on this JIRA. I just opened

[jira] [Created] (HBASE-14849) Add option to set block cache to false on SparkSQL executions

2015-11-19 Thread Ted Malaska (JIRA)
Ted Malaska created HBASE-14849: --- Summary: Add option to set block cache to false on SparkSQL executions Key: HBASE-14849 URL: https://issues.apache.org/jira/browse/HBASE-14849 Project: HBase

[jira] [Commented] (HBASE-14340) Add second bulk load option to Spark Bulk Load to send puts as the value

2015-11-17 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009797#comment-15009797 ] Ted Malaska commented on HBASE-14340: - Thank u Andrew. Let me know if there r any other jiras u

[jira] [Updated] (HBASE-14340) Add second bulk load option to Spark Bulk Load to send puts as the value

2015-11-15 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Malaska updated HBASE-14340: Attachment: HBASE-14340.2.patch Fixed copy paste issue. It was my mistake. The code was write on

[jira] [Commented] (HBASE-14340) Add second bulk load option to Spark Bulk Load to send puts as the value

2015-11-13 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15004362#comment-15004362 ] Ted Malaska commented on HBASE-14340: - Thank you Andrew for the review I will get to this jira in the

[jira] [Commented] (HBASE-14801) Enhance the Spark-HBase connector catalog with json format

2015-11-12 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003057#comment-15003057 ] Ted Malaska commented on HBASE-14801: - I have no problem with this, I think it looks a lot prettier

[jira] [Commented] (HBASE-14789) Enhance the current spark-hbase connector

2015-11-12 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003062#comment-15003062 ] Ted Malaska commented on HBASE-14789: - Adding Jira for Changing the table definition to JSON >

[jira] [Commented] (HBASE-14796) Provide an alternative spark-hbase SQL implementations for Gets

2015-11-11 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15001362#comment-15001362 ] Ted Malaska commented on HBASE-14796: - Yeah agreed. It also depends on the time it takes to start a

[jira] [Commented] (HBASE-14795) Provide an alternative spark-hbase SQL implementations for Scan

2015-11-11 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15001136#comment-15001136 ] Ted Malaska commented on HBASE-14795: - I would like that. Thanks Zhan. > Provide an alternative

[jira] [Commented] (HBASE-14789) Provide an alternative spark-hbase connector

2015-11-11 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15001083#comment-15001083 ] Ted Malaska commented on HBASE-14789: - Hey Zhan, I'm not sure I understand the question. What I'm

[jira] [Commented] (HBASE-14796) Provide an alternative spark-hbase SQL implementations for Gets

2015-11-11 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15001156#comment-15001156 ] Ted Malaska commented on HBASE-14796: - My only concern here is if we are adding latency for the

[jira] [Commented] (HBASE-14796) Provide an alternative spark-hbase SQL implementations for Gets

2015-11-11 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15001301#comment-15001301 ] Ted Malaska commented on HBASE-14796: - I agreed with point one. But the use case I'm thinking about

[jira] [Commented] (HBASE-14789) Provide an alternative spark-hbase connector

2015-11-10 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14999385#comment-14999385 ] Ted Malaska commented on HBASE-14789: - Can you help me understand what components this has that don't

[jira] [Commented] (HBASE-14795) Provide an alternative spark-hbase SQL implementations for Scan

2015-11-10 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14999621#comment-14999621 ] Ted Malaska commented on HBASE-14795: - There is no real negative to this proposed approach other then

[jira] [Commented] (HBASE-14789) Provide an alternative spark-hbase connector

2015-11-10 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14999628#comment-14999628 ] Ted Malaska commented on HBASE-14789: - Put comments related to the bulk get implementation in jira

[jira] [Commented] (HBASE-14796) Provide an alternative spark-hbase SQL implementations for Gets

2015-11-10 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14999635#comment-14999635 ] Ted Malaska commented on HBASE-14796: - If implemented this code would fit great right around

[jira] [Created] (HBASE-14796) Provide an alternative spark-hbase SQL implementations for Gets

2015-11-10 Thread Ted Malaska (JIRA)
Ted Malaska created HBASE-14796: --- Summary: Provide an alternative spark-hbase SQL implementations for Gets Key: HBASE-14796 URL: https://issues.apache.org/jira/browse/HBASE-14796 Project: HBase

[jira] [Commented] (HBASE-14789) Provide an alternative spark-hbase connector

2015-11-10 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14999422#comment-14999422 ] Ted Malaska commented on HBASE-14789: - Cool I read the doc so there are two points. * Bulk Get - Do

[jira] [Created] (HBASE-14795) Provide an alternative spark-hbase SQL implementations for Scan

2015-11-10 Thread Ted Malaska (JIRA)
Ted Malaska created HBASE-14795: --- Summary: Provide an alternative spark-hbase SQL implementations for Scan Key: HBASE-14795 URL: https://issues.apache.org/jira/browse/HBASE-14795 Project: HBase

[jira] [Commented] (HBASE-14789) Provide an alternative spark-hbase connector

2015-11-10 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14999623#comment-14999623 ] Ted Malaska commented on HBASE-14789: - Put response to TableInputFormat design in HBASE-14795 >

[jira] [Commented] (HBASE-14789) Provide an alternative spark-hbase connector

2015-11-10 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14999622#comment-14999622 ] Ted Malaska commented on HBASE-14789: - This is a sub jira > Provide an alternative spark-hbase

[jira] [Commented] (HBASE-14796) Provide an alternative spark-hbase SQL implementations for Gets

2015-11-10 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14999633#comment-14999633 ] Ted Malaska commented on HBASE-14796: - So there is value in this idea for the generated queries, but

[jira] [Commented] (HBASE-14149) Add Data Frame support for HBase-Spark Module

2015-10-30 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982527#comment-14982527 ] Ted Malaska commented on HBASE-14149: - closing this jira because we got dataframe support with

[jira] [Resolved] (HBASE-14149) Add Data Frame support for HBase-Spark Module

2015-10-30 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Malaska resolved HBASE-14149. - Resolution: Duplicate This was done in https://issues.apache.org/jira/browse/HBASE-14181 With

[jira] [Commented] (HBASE-14406) The dataframe datasource filter is wrong, and will result in data loss or unexpected behavior

2015-10-16 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961155#comment-14961155 ] Ted Malaska commented on HBASE-14406: - own -> owe > The dataframe datasource filter is wrong, and

[jira] [Commented] (HBASE-14406) The dataframe datasource filter is wrong, and will result in data loss or unexpected behavior

2015-10-16 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961150#comment-14961150 ] Ted Malaska commented on HBASE-14406: - OMG I own you guys a beer. That was a long patch. Thank you

[jira] [Commented] (HBASE-14406) The dataframe datasource filter is wrong, and will result in data loss or unexpected behavior

2015-10-15 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959844#comment-14959844 ] Ted Malaska commented on HBASE-14406: - I just looked at

[jira] [Commented] (HBASE-14406) The dataframe datasource filter is wrong, and will result in data loss or unexpected behavior

2015-10-15 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959872#comment-14959872 ] Ted Malaska commented on HBASE-14406: - Ohh [~ted_yu] so I need to add the generated file into the

[jira] [Updated] (HBASE-14406) The dataframe datasource filter is wrong, and will result in data loss or unexpected behavior

2015-10-15 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Malaska updated HBASE-14406: Attachment: (was: TestSuite.txt) > The dataframe datasource filter is wrong, and will result

[jira] [Updated] (HBASE-14406) The dataframe datasource filter is wrong, and will result in data loss or unexpected behavior

2015-10-15 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Malaska updated HBASE-14406: Attachment: HBASE-14406.10.patch Just double checking and uploading the newest version > The

[jira] [Updated] (HBASE-14406) The dataframe datasource filter is wrong, and will result in data loss or unexpected behavior

2015-10-15 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Malaska updated HBASE-14406: Attachment: (was: Surefile-reports.zip) > The dataframe datasource filter is wrong, and will

[jira] [Commented] (HBASE-14406) The dataframe datasource filter is wrong, and will result in data loss or unexpected behavior

2015-10-15 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959847#comment-14959847 ] Ted Malaska commented on HBASE-14406: - Also the diff number of the review board if off by one. Which

[jira] [Updated] (HBASE-14406) The dataframe datasource filter is wrong, and will result in data loss or unexpected behavior

2015-10-15 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Malaska updated HBASE-14406: Attachment: HBASE-14406.11.patch Added FilterProtos.java to git > The dataframe datasource filter

[jira] [Commented] (HBASE-14406) The dataframe datasource filter is wrong, and will result in data loss or unexpected behavior

2015-10-15 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959866#comment-14959866 ] Ted Malaska commented on HBASE-14406: - grr the build system didn't generate the proto classes Let me

[jira] [Commented] (HBASE-14406) The dataframe datasource filter is wrong, and will result in data loss or unexpected behavior

2015-10-15 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959791#comment-14959791 ] Ted Malaska commented on HBASE-14406: - OK I rebuilt everything and restarted my computer. And

[jira] [Commented] (HBASE-14406) The dataframe datasource filter is wrong, and will result in data loss or unexpected behavior

2015-10-15 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959830#comment-14959830 ] Ted Malaska commented on HBASE-14406: - yup it is in there

[jira] [Commented] (HBASE-14406) The dataframe datasource filter is wrong, and will result in data loss or unexpected behavior

2015-10-15 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959641#comment-14959641 ] Ted Malaska commented on HBASE-14406: - I just did "mvn -Dtest=NoUnitTests clean verify" in the

[jira] [Updated] (HBASE-14406) The dataframe datasource filter is wrong, and will result in data loss or unexpected behavior

2015-10-15 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Malaska updated HBASE-14406: Attachment: HBASE-14406.9.patch rebasing pom. On a side note something funky happen to hbase when

[jira] [Updated] (HBASE-14406) The dataframe datasource filter is wrong, and will result in data loss or unexpected behavior

2015-10-15 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Malaska updated HBASE-14406: Attachment: TestSuite.txt BTW here is the full stack trace when the host file is not updated to do

[jira] [Commented] (HBASE-14406) The dataframe datasource filter is wrong, and will result in data loss or unexpected behavior

2015-10-15 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959772#comment-14959772 ] Ted Malaska commented on HBASE-14406: - I tried this build and it doesn't have the hbase unit testing

[jira] [Commented] (HBASE-14406) The dataframe datasource filter is wrong, and will result in data loss or unexpected behavior

2015-10-15 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959643#comment-14959643 ] Ted Malaska commented on HBASE-14406: - Also this is my version tmalaska-MBP-2:hbase-spark

[jira] [Commented] (HBASE-14406) The dataframe datasource filter is wrong, and will result in data loss or unexpected behavior

2015-10-15 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959648#comment-14959648 ] Ted Malaska commented on HBASE-14406: - The code that break is just var TEST_UTIL:

[jira] [Commented] (HBASE-14406) The dataframe datasource filter is wrong, and will result in data loss or unexpected behavior

2015-10-15 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959311#comment-14959311 ] Ted Malaska commented on HBASE-14406: - OK I will make this change in the next hour or so. Thanks Ted

[jira] [Commented] (HBASE-14406) The dataframe datasource filter is wrong, and will result in data loss or unexpected behavior

2015-10-14 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957413#comment-14957413 ] Ted Malaska commented on HBASE-14406: - What went wrong with the build? > The dataframe datasource

[jira] [Updated] (HBASE-14406) The dataframe datasource filter is wrong, and will result in data loss or unexpected behavior

2015-10-14 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Malaska updated HBASE-14406: Attachment: HBASE-14406.7.patch Moved ProtoBufs to hbase-spark and out of hbase-protoco > The

[jira] [Commented] (HBASE-14406) The dataframe datasource filter is wrong, and will result in data loss or unexpected behavior

2015-10-13 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955850#comment-14955850 ] Ted Malaska commented on HBASE-14406: - Well that does make sense. Let me look into that tomorrow. >

[jira] [Updated] (HBASE-14158) Add documentation for Initial Release for HBase-Spark Module integration

2015-10-12 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Malaska updated HBASE-14158: Attachment: HBASE-14158.7.patch Removed the long lines and used the following command instead of

[jira] [Commented] (HBASE-14406) The dataframe datasource filter is wrong, and will result in data loss or unexpected behavior

2015-10-12 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953360#comment-14953360 ] Ted Malaska commented on HBASE-14406: - I think the bug from last time was the following two ( rowkey

[jira] [Commented] (HBASE-14406) The dataframe datasource filter is wrong, and will result in data loss or unexpected behavior

2015-10-12 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953463#comment-14953463 ] Ted Malaska commented on HBASE-14406: - [~zhanzhang] np. Lets me add it now. It will take hopefully

[jira] [Updated] (HBASE-14406) The dataframe datasource filter is wrong, and will result in data loss or unexpected behavior

2015-10-12 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Malaska updated HBASE-14406: Attachment: HBASE-14406.4.patch Applied worked for Zhan Zhang and Ted Yu > The dataframe

[jira] [Updated] (HBASE-14406) The dataframe datasource filter is wrong, and will result in data loss or unexpected behavior

2015-10-12 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Malaska updated HBASE-14406: Attachment: HBASE-14406.5.patch Then to Than > The dataframe datasource filter is wrong, and

  1   2   3   >