[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-08-22 Thread saintstack
Github user saintstack commented on a diff in the pull request: https://github.com/apache/spark/pull/1608#discussion_r16606170 --- Diff: external/hbase/pom.xml --- @@ -0,0 +1,140 @@ +?xml version=1.0 encoding=UTF-8? +!-- + ~ Licensed to the Apache Software Foundation

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-08-22 Thread saintstack
Github user saintstack commented on a diff in the pull request: https://github.com/apache/spark/pull/1608#discussion_r16606202 --- Diff: external/hbase/pom.xml --- @@ -0,0 +1,140 @@ +?xml version=1.0 encoding=UTF-8? +!-- + ~ Licensed to the Apache Software Foundation

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-08-22 Thread saintstack
Github user saintstack commented on a diff in the pull request: https://github.com/apache/spark/pull/1608#discussion_r16606346 --- Diff: external/hbase/pom.xml --- @@ -0,0 +1,140 @@ +?xml version=1.0 encoding=UTF-8? +!-- + ~ Licensed to the Apache Software Foundation

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-08-22 Thread saintstack
Github user saintstack commented on a diff in the pull request: https://github.com/apache/spark/pull/1608#discussion_r16606704 --- Diff: external/hbase/src/main/scala/org/apache/spark/hbase/HBaseContext.scala --- @@ -0,0 +1,538 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-08-22 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/1608#discussion_r16606710 --- Diff: external/hbase/pom.xml --- @@ -0,0 +1,140 @@ +?xml version=1.0 encoding=UTF-8? +!-- + ~ Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-08-22 Thread saintstack
Github user saintstack commented on a diff in the pull request: https://github.com/apache/spark/pull/1608#discussion_r16606905 --- Diff: external/hbase/src/main/scala/org/apache/spark/hbase/HBaseContext.scala --- @@ -0,0 +1,538 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-08-22 Thread saintstack
Github user saintstack commented on a diff in the pull request: https://github.com/apache/spark/pull/1608#discussion_r16607037 --- Diff: external/hbase/src/main/scala/org/apache/spark/hbase/HBaseContext.scala --- @@ -0,0 +1,538 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-08-22 Thread saintstack
Github user saintstack commented on a diff in the pull request: https://github.com/apache/spark/pull/1608#discussion_r16607208 --- Diff: external/hbase/src/main/scala/org/apache/spark/hbase/HBaseContext.scala --- @@ -0,0 +1,538 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-08-22 Thread saintstack
Github user saintstack commented on a diff in the pull request: https://github.com/apache/spark/pull/1608#discussion_r16607538 --- Diff: external/hbase/src/main/scala/org/apache/spark/hbase/HBaseContext.scala --- @@ -0,0 +1,538 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-08-22 Thread saintstack
Github user saintstack commented on a diff in the pull request: https://github.com/apache/spark/pull/1608#discussion_r16607576 --- Diff: external/hbase/src/main/scala/org/apache/spark/hbase/HConnectionStaticCache.scala --- @@ -0,0 +1,149 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-08-22 Thread saintstack
Github user saintstack commented on a diff in the pull request: https://github.com/apache/spark/pull/1608#discussion_r16607705 --- Diff: external/hbase/pom.xml --- @@ -0,0 +1,140 @@ +?xml version=1.0 encoding=UTF-8? +!-- + ~ Licensed to the Apache Software Foundation

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-08-22 Thread saintstack
Github user saintstack commented on a diff in the pull request: https://github.com/apache/spark/pull/1608#discussion_r16608036 --- Diff: external/hbase/src/main/scala/org/apache/spark/hbase/example/HBaseBulkDeleteExample.scala --- @@ -0,0 +1,60 @@ +/* + * Licensed to the

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-08-22 Thread saintstack
Github user saintstack commented on a diff in the pull request: https://github.com/apache/spark/pull/1608#discussion_r16608329 --- Diff: external/hbase/src/main/scala/org/apache/spark/hbase/HConnectionStaticCache.scala --- @@ -0,0 +1,149 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-08-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/1608#issuecomment-50910326 QA tests have started for PR 1608. This patch merges cleanly. brView progress: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/17682/consoleFull ---

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-08-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/1608#issuecomment-50914144 QA tests have started for PR 1608. This patch merges cleanly. brView progress: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/17684/consoleFull ---

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-08-01 Thread tmalaska
Github user tmalaska closed the pull request at: https://github.com/apache/spark/pull/1608 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-08-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/1608#issuecomment-50915104 QA results for PR 1608:br- This patch FAILED unit tests.br- This patch merges cleanlybr- This patch adds the following public classes (experimental):br@serializable

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-08-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/1608#issuecomment-50919337 QA results for PR 1608:br- This patch FAILED unit tests.br- This patch merges cleanlybr- This patch adds the following public classes (experimental):br@serializable

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-07-30 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/1608#issuecomment-50693942 Just FYI - there is already an outstanding patch and JIRA for HBase support on Spark: https://github.com/apache/spark/pull/194

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-07-29 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/1608#issuecomment-50513421 Does HBase have some sort of schema information? If yes, maybe we can add it as a data source in SchemaRDD? --- If your project is set up for it, you can reply to this

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-07-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/1608#issuecomment-50541560 QA tests have started for PR 1608. This patch merges cleanly. brView progress: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/17382/consoleFull ---

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-07-29 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/1608#discussion_r1354 --- Diff: external/hbase/src/main/scala/org/apache/spark/hbase/HBaseContext.scala --- @@ -0,0 +1,544 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-07-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/1608#issuecomment-50546377 QA results for PR 1608:br- This patch FAILED unit tests.br- This patch merges cleanlybr- This patch adds the following public classes (experimental):br@serializable

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-07-29 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/1608#discussion_r15557786 --- Diff: external/hbase/src/main/scala/org/apache/spark/hbase/HBaseContext.scala --- @@ -0,0 +1,538 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-07-29 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/1608#discussion_r15563085 --- Diff: external/hbase/src/main/scala/org/apache/spark/hbase/HBaseContext.scala --- @@ -0,0 +1,538 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-07-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/1608#issuecomment-50420751 QA results for PR 1608:br- This patch PASSES unit tests.br- This patch merges cleanlybr- This patch adds the following public classes (experimental):br@serializable

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-07-27 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/1608#discussion_r15438411 --- Diff: external/hbase/pom.xml --- @@ -0,0 +1,217 @@ +project xmlns=http://maven.apache.org/POM/4.0.0;

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-07-27 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/1608#discussion_r15438415 --- Diff: external/hbase/pom.xml --- @@ -0,0 +1,217 @@ +project xmlns=http://maven.apache.org/POM/4.0.0;

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-07-27 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/1608#discussion_r15438420 --- Diff: external/hbase/pom.xml --- @@ -0,0 +1,217 @@ +project xmlns=http://maven.apache.org/POM/4.0.0;

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-07-27 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/1608#discussion_r15438418 --- Diff: external/hbase/pom.xml --- @@ -0,0 +1,217 @@ +project xmlns=http://maven.apache.org/POM/4.0.0;

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-07-27 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/1608#discussion_r15438426 --- Diff: external/hbase/pom.xml --- @@ -0,0 +1,217 @@ +project xmlns=http://maven.apache.org/POM/4.0.0;

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-07-27 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/1608#discussion_r15438429 --- Diff: external/hbase/src/main/scala/org/apache/spark/hbase/HBaseContext.scala --- @@ -0,0 +1,544 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-07-27 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/1608#discussion_r15438438 --- Diff: external/hbase/src/main/scala/org/apache/spark/hbase/HBaseContext.scala --- @@ -0,0 +1,544 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-07-27 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/1608#discussion_r15438442 --- Diff: external/hbase/src/main/scala/org/apache/spark/hbase/HBaseContext.scala --- @@ -0,0 +1,544 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-07-27 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/1608#discussion_r15438453 --- Diff: external/hbase/src/main/scala/org/apache/spark/hbase/HConnectionStaticCache.scala --- @@ -0,0 +1,141 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-07-27 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/1608#discussion_r15438461 --- Diff: external/hbase/src/main/scala/org/apache/spark/hbase/HConnectionStaticCache.scala --- @@ -0,0 +1,141 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-07-27 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/1608#discussion_r15438469 --- Diff: external/hbase/src/main/scala/org/apache/spark/hbase/example/HBaseStreamingBulkPutExample.scala --- @@ -0,0 +1,83 @@ +/* + * Licensed to

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-07-27 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/1608#discussion_r15438472 --- Diff: external/hbase/src/test/scala/org/apache/spark/hbase/HBaseContextSuite.scala --- @@ -0,0 +1,296 @@ +package org.apache.spark.hbase --- End

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-07-27 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/1608#discussion_r15438477 --- Diff: external/hbase/src/test/scala/org/apache/spark/hbase/LocalSparkContext.scala --- @@ -0,0 +1,66 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-07-26 Thread tmalaska
GitHub user tmalaska opened a pull request: https://github.com/apache/spark/pull/1608 Spark-2447 : Spark on HBase Add common solution for sending upsert actions to HBase (put, deletes, and increment) This is the first pull request: mainly to test the review process, but

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-07-26 Thread witgo
Github user witgo commented on a diff in the pull request: https://github.com/apache/spark/pull/1608#discussion_r15437166 --- Diff: external/hbase/pom.xml --- @@ -0,0 +1,217 @@ +project xmlns=http://maven.apache.org/POM/4.0.0;

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-07-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/1608#issuecomment-50254637 QA results for PR 1608:br- This patch FAILED unit tests.br- This patch merges cleanlybr- This patch adds the following public classes (experimental):br@serializable

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-07-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/1608#issuecomment-50254635 QA tests have started for PR 1608. This patch merges cleanly. brView progress: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/17237/consoleFull ---

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-07-26 Thread witgo
Github user witgo commented on a diff in the pull request: https://github.com/apache/spark/pull/1608#discussion_r15437173 --- Diff: external/hbase/pom.xml --- @@ -0,0 +1,217 @@ +project xmlns=http://maven.apache.org/POM/4.0.0;

[GitHub] spark pull request: Spark-2447 : Spark on HBase

2014-07-26 Thread witgo
Github user witgo commented on a diff in the pull request: https://github.com/apache/spark/pull/1608#discussion_r15437185 --- Diff: external/hbase/pom.xml --- @@ -0,0 +1,217 @@ +project xmlns=http://maven.apache.org/POM/4.0.0;