Re: Interest in extending to Cascading?

There was a talk at Apachecon NA, May 2016, Vancouver by Ken Krugler about Cascading + Flink. Flink does provide a Cascading extension but its not part of Apache Flink and is a side project from Data artisans - https://github.com/dataArtisans/cascading-flink But as u said there are no

Jenkins build became unstable: pirk » Apache Pirk (incubating) Project #13

See

Jenkins build became unstable: pirk #13

See

Interest in extending to Cascading?

Cascading is a higher level API for Hadoop-mapreduce, Tez and Flink. The Pirk roadmap mentions support for a number of other frameworks (Flink and Storm being two), this would take care of Flink and add Tez support as well. If there's interest I'll add a JIRA and link other issues accordingly.

[GitHub] incubator-pirk pull request #27: [Pirk 27] - Improve Pirk's Use of Property ...

Github user ellisonanne commented on a diff in the pull request: https://github.com/apache/incubator-pirk/pull/27#discussion_r72732010 --- Diff: src/main/java/org/apache/pirk/responder/wideskies/spark/ComputeResponse.java --- @@ -202,7 +203,7 @@ private void setup() throws

[GitHub] incubator-pirk pull request #27: [Pirk 27] - Improve Pirk's Use of Property ...

Github user clharris commented on a diff in the pull request: https://github.com/apache/incubator-pirk/pull/27#discussion_r72730877 --- Diff: src/main/java/org/apache/pirk/responder/wideskies/spark/ComputeResponse.java --- @@ -202,7 +203,7 @@ private void setup() throws Exception

[GitHub] incubator-pirk issue #27: [Pirk 27] - Improve Pirk's Use of Property Files

Github user ellisonanne commented on the issue: https://github.com/apache/incubator-pirk/pull/27 Did some cleaning as per Tim's comments... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] incubator-pirk pull request #27: [Pirk 27] - Improve Pirk's Use of Property ...

Github user ellisonanne commented on a diff in the pull request: https://github.com/apache/incubator-pirk/pull/27#discussion_r72716104 --- Diff: src/main/resources/querier.properties --- @@ -0,0 +1,123 @@

[GitHub] incubator-pirk issue #27: [Pirk 27] - Improve Pirk's Use of Property Files

Github user tellison commented on the issue: https://github.com/apache/incubator-pirk/pull/27 +1 to merge. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] incubator-pirk pull request #27: [Pirk 27] - Improve Pirk's Use of Property ...

Github user tellison commented on a diff in the pull request: https://github.com/apache/incubator-pirk/pull/27#discussion_r72703868 --- Diff: src/main/java/org/apache/pirk/querier/wideskies/QuerierProps.java --- @@ -0,0 +1,202 @@ +package org.apache.pirk.querier.wideskies;

[GitHub] incubator-pirk pull request #27: [Pirk 27] - Improve Pirk's Use of Property ...

Github user tellison commented on a diff in the pull request: https://github.com/apache/incubator-pirk/pull/27#discussion_r72702440 --- Diff: src/main/resources/pirk.properties-repo --- @@ -0,0 +1,243 @@

[GitHub] incubator-pirk pull request #27: [Pirk 27] - Improve Pirk's Use of Property ...

Github user tellison commented on a diff in the pull request: https://github.com/apache/incubator-pirk/pull/27#discussion_r72702338 --- Diff: src/main/resources/pirk.properties-repo --- @@ -0,0 +1,243 @@

[GitHub] incubator-pirk pull request #27: [Pirk 27] - Improve Pirk's Use of Property ...

Github user tellison commented on a diff in the pull request: https://github.com/apache/incubator-pirk/pull/27#discussion_r72701770 --- Diff: src/main/java/org/apache/pirk/utils/SystemConfiguration.java --- @@ -160,4 +139,78 @@ public static void resetProperties()

[GitHub] incubator-pirk pull request #27: [Pirk 27] - Improve Pirk's Use of Property ...

Github user tellison commented on a diff in the pull request: https://github.com/apache/incubator-pirk/pull/27#discussion_r72698216 --- Diff: src/main/java/org/apache/pirk/querier/wideskies/QuerierDriverCLI.java --- @@ -136,192 +111,26 @@ private boolean parseOptions() {

[GitHub] incubator-pirk pull request #29: Add a no-arguments version of EncryptQuery#...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-pirk/pull/29 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] incubator-pirk issue #29: Add a no-arguments version of EncryptQuery#encrypt...

Github user ellisonanne commented on the issue: https://github.com/apache/incubator-pirk/pull/29 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] incubator-pirk pull request #28: [PIRK-19] Further restructuring in schema l...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-pirk/pull/28 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] incubator-pirk issue #27: [Pirk 27] - Improve Pirk's Use of Property Files

Github user ellisonanne commented on the issue: https://github.com/apache/incubator-pirk/pull/27 This is ready for review --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] incubator-pirk issue #29: Add a no-arguments version of EncryptQuery#encrypt...

Github user tellison commented on the issue: https://github.com/apache/incubator-pirk/pull/29 Does this make sense for EncryptQuery to depend upon SystemConfiguration? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] incubator-pirk pull request #29: Add a no-arguments version of EncryptQuery#...

GitHub user tellison opened a pull request: https://github.com/apache/incubator-pirk/pull/29 Add a no-arguments version of EncryptQuery#encrypt(). - defaults to the system configured number of threads. - special case single threaded encryptions (following lead in

[GitHub] incubator-pirk issue #27: [WIP] Pirk 27 - Improve Pirk's Use of Property Fil...

Github user ellisonanne commented on the issue: https://github.com/apache/incubator-pirk/pull/27 I also still need to make this branch up-to-date with master (and all of the query and data schema refactoring) before pulling the WIP off. I will remove the scripts in the bin folder

[GitHub] incubator-pirk pull request #27: [WIP] Pirk 27 - Improve Pirk's Use of Prope...

Github user ellisonanne commented on a diff in the pull request: https://github.com/apache/incubator-pirk/pull/27#discussion_r72594517 --- Diff: pom.xml --- @@ -117,6 +117,7 @@ 3.3

[GitHub] incubator-pirk pull request #27: [WIP] Pirk 27 - Improve Pirk's Use of Prope...

Github user ellisonanne commented on a diff in the pull request: https://github.com/apache/incubator-pirk/pull/27#discussion_r72594279 --- Diff: src/main/java/org/apache/pirk/utils/SystemConfiguration.java --- @@ -160,4 +138,74 @@ public static void resetProperties()

[GitHub] incubator-pirk pull request #27: [WIP] Pirk 27 - Improve Pirk's Use of Prope...

Github user ellisonanne commented on a diff in the pull request: https://github.com/apache/incubator-pirk/pull/27#discussion_r72594248 --- Diff: src/main/java/org/apache/pirk/utils/SystemConfiguration.java --- @@ -152,6 +105,31 @@ public static void setProperty(String propertyName,

[GitHub] incubator-pirk pull request #27: [WIP] Pirk 27 - Improve Pirk's Use of Prope...

Github user ellisonanne commented on a diff in the pull request: https://github.com/apache/incubator-pirk/pull/27#discussion_r72594185 --- Diff: src/main/java/org/apache/pirk/utils/SystemConfiguration.java --- @@ -24,8 +24,6 @@ import java.io.InputStream; import

[GitHub] incubator-pirk pull request #27: [WIP] Pirk 27 - Improve Pirk's Use of Prope...

Github user tellison commented on a diff in the pull request: https://github.com/apache/incubator-pirk/pull/27#discussion_r72592297 --- Diff: src/main/java/org/apache/pirk/querier/wideskies/QuerierProps.java --- @@ -0,0 +1,202 @@ +package org.apache.pirk.querier.wideskies;

[GitHub] incubator-pirk pull request #27: [WIP] Pirk 27 - Improve Pirk's Use of Prope...

Github user tellison commented on a diff in the pull request: https://github.com/apache/incubator-pirk/pull/27#discussion_r72589271 --- Diff: pom.xml --- @@ -117,6 +117,7 @@ 3.3

[GitHub] incubator-pirk pull request #27: [WIP] Pirk 27 - Improve Pirk's Use of Prope...

Github user tellison commented on a diff in the pull request: https://github.com/apache/incubator-pirk/pull/27#discussion_r72588602 --- Diff: src/main/resources/pirk.properties --- @@ -31,7 +31,8 @@ local.pirk.properties=/root/local.pirk.properties ## ##Spark path for

[GitHub] incubator-pirk pull request #27: [WIP] Pirk 27 - Improve Pirk's Use of Prope...

Github user tellison commented on a diff in the pull request: https://github.com/apache/incubator-pirk/pull/27#discussion_r72588302 --- Diff: src/main/java/org/apache/pirk/utils/SystemConfiguration.java --- @@ -160,4 +138,74 @@ public static void resetProperties()

[GitHub] incubator-pirk pull request #27: [WIP] Pirk 27 - Improve Pirk's Use of Prope...

Github user tellison commented on a diff in the pull request: https://github.com/apache/incubator-pirk/pull/27#discussion_r72586620 --- Diff: src/main/java/org/apache/pirk/utils/SystemConfiguration.java --- @@ -24,8 +24,6 @@ import java.io.InputStream; import

[GitHub] incubator-pirk issue #28: [PIRK-19] Further restructuring in schema loading.

Github user tellison commented on the issue: https://github.com/apache/incubator-pirk/pull/28 @ellisonanne yes, this is ready to merge pls. There may be minor changes but this is the bulk of the clean-up restructuring I intend to do right now. --- If your project is set up

[GitHub] incubator-pirk pull request #28: [PIRK-19] Further restructuring in schema l...

Github user tellison commented on a diff in the pull request: https://github.com/apache/incubator-pirk/pull/28#discussion_r72583147 --- Diff: src/main/java/org/apache/pirk/schema/data/DataSchemaLoader.java --- @@ -181,19 +172,34 @@ public DataSchema loadSchema(InputStream stream)