[GitHub] spark pull request: [SPARK-3166]: Allow custom serialiser to be sh...

2015-09-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/1890 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-3166]: Allow custom serialiser to be sh...

2015-09-01 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/1890#issuecomment-136889467 @GrahamDennis let's close this PR since it's mostly gone stale and will likely not be merged. We can always re-open an updated one if necessary. --- If your project

[GitHub] spark pull request: [SPARK-3166]: Allow custom serialiser to be sh...

2015-08-01 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/1890#issuecomment-126942942 I think that we should close this issue / PR for now. I'm not sure this issue is still a problem in newer Spark releases, but this pull request is out-of-date and

[GitHub] spark pull request: [SPARK-3166]: Allow custom serialiser to be sh...

2015-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1890#issuecomment-121073747 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-3166]: Allow custom serialiser to be sh...

2015-04-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1890#issuecomment-96770267 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-3166]: Allow custom serialiser to be sh...

2014-11-27 Thread jjuraszek
Github user jjuraszek commented on the pull request: https://github.com/apache/spark/pull/1890#issuecomment-64792200 it is crucial to have it - currently I can't use spark job operating on avro objects (serializing by hand is no option because of many types needed to be extended). is

[GitHub] spark pull request: [SPARK-3166]: Allow custom serialiser to be sh...

2014-10-05 Thread ash211
Github user ash211 commented on the pull request: https://github.com/apache/spark/pull/1890#issuecomment-57956057 I set the Target Version on SPARK-3166 to 1.2.0 so we can try to get this in --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request: [SPARK-3166]: Allow custom serialiser to be sh...

2014-10-05 Thread GrahamDennis
Github user GrahamDennis commented on the pull request: https://github.com/apache/spark/pull/1890#issuecomment-57956359 @rxin, @ash211 It would be good to have a conversation about whether this is the best approach. My approach is a sort-of brute-force approach of just adding

[GitHub] spark pull request: [SPARK-3166]: Allow custom serialiser to be sh...

2014-10-03 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/1890#issuecomment-57763605 Yes we will take a look at this for 1.2. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-3166]: Allow custom serialiser to be sh...

2014-09-30 Thread ypwais
Github user ypwais commented on the pull request: https://github.com/apache/spark/pull/1890#issuecomment-57271841 Any chance this might make it into v1.2? I'd love to use custom {Input,Output}Formats (e.g. Parquet) and I personally spent almost a day after getting bitten by this

[GitHub] spark pull request: [SPARK-3166]: Allow custom serialiser to be sh...

2014-09-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/1890#issuecomment-54694485 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-3166]: Allow custom serialiser to be sh...

2014-08-24 Thread GrahamDennis
Github user GrahamDennis commented on the pull request: https://github.com/apache/spark/pull/1890#issuecomment-53213573 @rxin: I haven't modified the Mesos code, and it seems that wouldn't be too hard to do, but I have no way of testing it. Suggestions welcomed. As for YARN,

[GitHub] spark pull request: [SPARK-3166]: Allow custom serialiser to be sh...

2014-08-21 Thread mridulm
Github user mridulm commented on the pull request: https://github.com/apache/spark/pull/1890#issuecomment-52918929 Unless user tries addJar, should not be relevant to yarn modes, Regards, Mridul On Thu, Aug 21, 2014 at 5:37 AM, Reynold Xin

[GitHub] spark pull request: [SPARK-3166]: Allow custom serialiser to be sh...

2014-08-20 Thread GrahamDennis
Github user GrahamDennis commented on the pull request: https://github.com/apache/spark/pull/1890#issuecomment-52859692 I've filed a new JIRA ticket for the custom serialiser problem here: https://issues.apache.org/jira/browse/SPARK-3166 and updated the title of this PR to indicate

[GitHub] spark pull request: [SPARK-3166]: Allow custom serialiser to be sh...

2014-08-20 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/1890#issuecomment-52862331 Thanks, @GrahamDennis for updating this. You should get a medal for making it super easy to reproduce problems! How does this fix work on YARN / Mesos? As I