[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2016-02-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/7971 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2016-01-13 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-171385323 @JDrit How about we close this PR (and the jira) for now? We can revisit it later if users have a high demand on this. Thanks! --- If your project is set up for it, you c

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-22 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-142201144 I'm tempted to not merge this - since it is something that can easily be done by the user, and it does introduce strong avro dependency in the API itself. --- If your pr

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-18 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-14124 cc @pwendell --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featur

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-18 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-141544653 This LGTM now. But still need a Spark Core maintainer to have a look at this. Thanks for working on this! --- If your project is set up for it, you can reply to this

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-141513624 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-141513625 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-141513477 [Test build #42664 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42664/console) for PR 7971 at commit [`65617fa`](https://github.

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-141470670 [Test build #42664 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42664/consoleFull) for PR 7971 at commit [`65617fa`](https://gith

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-141467928 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-141467993 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-18 Thread JDrit
Github user JDrit commented on a diff in the pull request: https://github.com/apache/spark/pull/7971#discussion_r39859953 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -794,6 +797,45 @@ class SparkContext(config: SparkConf) extends Logging with ExecutorAl

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-17 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/7971#discussion_r39808267 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -794,6 +797,45 @@ class SparkContext(config: SparkConf) extends Logging with Execut

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-140832536 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-140832537 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-16 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-140832345 [Test build #42536 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42536/console) for PR 7971 at commit [`8ba8e72`](https://github.

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-140776398 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-16 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-140777304 [Test build #42536 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42536/consoleFull) for PR 7971 at commit [`8ba8e72`](https://gith

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-140776424 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-140577967 [Test build #42499 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42499/console) for PR 7971 at commit [`386b8db`](https://github.

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-140578071 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-140578069 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-140521868 [Test build #42499 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42499/consoleFull) for PR 7971 at commit [`386b8db`](https://gith

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-140518956 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-140518933 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-140181568 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-140181566 Build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does n

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-140181441 [Test build #42431 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42431/console) for PR 7971 at commit [`25494f2`](https://github.

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-140136364 [Test build #42431 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42431/consoleFull) for PR 7971 at commit [`25494f2`](https://gith

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-140134115 Build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-140134082 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have thi

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-14 Thread JDrit
Github user JDrit commented on a diff in the pull request: https://github.com/apache/spark/pull/7971#discussion_r39406698 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -794,6 +797,45 @@ class SparkContext(config: SparkConf) extends Logging with ExecutorAl

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-14 Thread JDrit
Github user JDrit commented on a diff in the pull request: https://github.com/apache/spark/pull/7971#discussion_r39406799 --- Diff: core/src/test/scala/org/apache/spark/SparkContextSuite.scala --- @@ -215,6 +224,102 @@ class SparkContextSuite extends SparkFunSuite with LocalSparkCo

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-10 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-139342686 Overall this PR looks pretty good. We might want to add build time Avro Java source generation for both SBT and Maven to remove those generated Java files (together wi

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-10 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/7971#discussion_r39198029 --- Diff: core/src/test/scala/org/apache/spark/SparkContextSuite.scala --- @@ -215,6 +224,102 @@ class SparkContextSuite extends SparkFunSuite with LocalSpa

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-10 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/7971#discussion_r39197650 --- Diff: core/src/test/scala/org/apache/spark/SparkContextSuite.scala --- @@ -215,6 +224,102 @@ class SparkContextSuite extends SparkFunSuite with LocalSpa

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-10 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/7971#discussion_r39197676 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -794,6 +797,45 @@ class SparkContext(config: SparkConf) extends Logging with Execut

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-137800017 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-137800013 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-137799792 [Test build #42000 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42000/console) for PR 7971 at commit [`bc8f2be`](https://github.

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-137751981 [Test build #42000 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42000/consoleFull) for PR 7971 at commit [`bc8f2be`](https://gith

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-137751393 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-137751364 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-04 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/7971#discussion_r38748233 --- Diff: core/src/test/scala/org/apache/spark/SparkFunSuite.scala --- @@ -44,5 +49,27 @@ private[spark] abstract class SparkFunSuite extends FunSuite with

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-137594798 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-137594796 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-137594745 [Test build #41984 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41984/console) for PR 7971 at commit [`9218669`](https://github.

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-137579671 [Test build #41984 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41984/consoleFull) for PR 7971 at commit [`9218669`](https://gith

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-137578541 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-137578497 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-03 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-137578044 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-128122153 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-128121720 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-08-05 Thread JDrit
GitHub user JDrit opened a pull request: https://github.com/apache/spark/pull/7971 [SPARK-9652][CORE] Added method for Avro file input This wraps around the configuration code needed to read Generic, Specific, and Reflect Avro records. This allows a easy way to read Avro records wit