[jira] [Commented] (STREAMS-417) Collect example AS 2.0 object and activity documents to use in test cases

2016-10-12 Thread Benjamin Young (JIRA)

[ 
https://issues.apache.org/jira/browse/STREAMS-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15568835#comment-15568835
 ] 

Benjamin Young commented on STREAMS-417:


Enjoy! https://github.com/w3c-social/activitystreams-test-documents

> Collect example AS 2.0 object and activity documents to use in test cases
> -
>
> Key: STREAMS-417
> URL: https://issues.apache.org/jira/browse/STREAMS-417
> Project: Streams
>  Issue Type: Task
>Reporter: Steve Blackmon
> Fix For: 0.4
>
>
> Collect example AS 2.0 object and activity documents to use in test cases.
> Place these in a new module with a few basic tests showing they can be read 
> and minimally parsed as valid JSON.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[1/3] incubator-streams git commit: Added missing license headers

2016-10-12 Thread mfranklin
Repository: incubator-streams
Updated Branches:
  refs/heads/invalid_headers [created] 2d8ff2439


Added missing license headers


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/603cfdbe
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/603cfdbe
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/603cfdbe

Branch: refs/heads/invalid_headers
Commit: 603cfdbeda3d811b96f3b4f50d1010ba6302d170
Parents: a726b3c
Author: Matt Franklin 
Authored: Wed Oct 12 09:50:43 2016 -0400
Committer: Matt Franklin 
Committed: Wed Oct 12 09:50:43 2016 -0400

--
 .../elasticsearch/test/ElasticsearchITs.java   | 17 +
 .../resources/DatumFromMetadataProcessorIT.conf| 15 +++
 .../ElasticsearchParentChildUpdaterIT.conf | 15 +++
 .../ElasticsearchParentChildWriterIT.conf  | 15 +++
 .../resources/ElasticsearchPersistUpdaterIT.conf   | 15 +++
 .../resources/ElasticsearchPersistWriterIT.conf| 15 +++
 6 files changed, 92 insertions(+)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/603cfdbe/streams-contrib/streams-persist-elasticsearch/src/test/java/org/apache/streams/elasticsearch/test/ElasticsearchITs.java
--
diff --git 
a/streams-contrib/streams-persist-elasticsearch/src/test/java/org/apache/streams/elasticsearch/test/ElasticsearchITs.java
 
b/streams-contrib/streams-persist-elasticsearch/src/test/java/org/apache/streams/elasticsearch/test/ElasticsearchITs.java
index 504172e..7c655db 100644
--- 
a/streams-contrib/streams-persist-elasticsearch/src/test/java/org/apache/streams/elasticsearch/test/ElasticsearchITs.java
+++ 
b/streams-contrib/streams-persist-elasticsearch/src/test/java/org/apache/streams/elasticsearch/test/ElasticsearchITs.java
@@ -1,3 +1,20 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ *
+ *   http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied.  See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
 package org.apache.streams.elasticsearch.test;
 
 import org.junit.runner.RunWith;

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/603cfdbe/streams-contrib/streams-persist-elasticsearch/src/test/resources/DatumFromMetadataProcessorIT.conf
--
diff --git 
a/streams-contrib/streams-persist-elasticsearch/src/test/resources/DatumFromMetadataProcessorIT.conf
 
b/streams-contrib/streams-persist-elasticsearch/src/test/resources/DatumFromMetadataProcessorIT.conf
index 2905d38..7031388 100644
--- 
a/streams-contrib/streams-persist-elasticsearch/src/test/resources/DatumFromMetadataProcessorIT.conf
+++ 
b/streams-contrib/streams-persist-elasticsearch/src/test/resources/DatumFromMetadataProcessorIT.conf
@@ -1,3 +1,18 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements.  See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership.  The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+#
+#   http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied.  See the License for the
+# specific language governing permissions and limitations
+# under the License.
 elasticsearch {
   hosts += ${es.tcp.host}
   port = ${es.tcp.port}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/603cfdbe/streams-contrib/streams-persist-elasticsearch/src/test/resources/ElasticsearchParentChildUpdaterIT.conf
--
diff --git 
a/streams-contrib/streams-persist-elasticsearch/src/test/resources/ElasticsearchParentChildUpdaterIT.conf
 
b/streams-contrib/streams-persist-elasticsearch/src/test/resources/ElasticsearchParentChildUpdaterIT.conf
index 70a53d9..2d95887 100644
--- 
a/strea

[3/3] incubator-streams git commit: Added missing license headers for twitter

2016-10-12 Thread mfranklin
Added missing license headers for twitter


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/2d8ff243
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/2d8ff243
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/2d8ff243

Branch: refs/heads/invalid_headers
Commit: 2d8ff2439cd8e579896adcc250b048621dea48de
Parents: 0728793
Author: Matt Franklin 
Authored: Wed Oct 12 09:54:00 2016 -0400
Committer: Matt Franklin 
Committed: Wed Oct 12 09:54:00 2016 -0400

--
 .../test/resources/TwitterFollowingProviderIT.conf | 17 +
 .../test/resources/TwitterStreamProviderIT.conf| 17 +
 .../test/resources/TwitterTimelineProviderIT.conf  | 17 +
 .../TwitterUserInformationProviderIT.conf  | 17 +
 4 files changed, 68 insertions(+)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/2d8ff243/streams-contrib/streams-provider-twitter/src/test/resources/TwitterFollowingProviderIT.conf
--
diff --git 
a/streams-contrib/streams-provider-twitter/src/test/resources/TwitterFollowingProviderIT.conf
 
b/streams-contrib/streams-provider-twitter/src/test/resources/TwitterFollowingProviderIT.conf
index 378978a..65f9422 100644
--- 
a/streams-contrib/streams-provider-twitter/src/test/resources/TwitterFollowingProviderIT.conf
+++ 
b/streams-contrib/streams-provider-twitter/src/test/resources/TwitterFollowingProviderIT.conf
@@ -1,3 +1,20 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements.  See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership.  The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License.  You may obtain a copy of the License at
+#
+#   http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied.  See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
 twitter {
   info = [
 18055613

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/2d8ff243/streams-contrib/streams-provider-twitter/src/test/resources/TwitterStreamProviderIT.conf
--
diff --git 
a/streams-contrib/streams-provider-twitter/src/test/resources/TwitterStreamProviderIT.conf
 
b/streams-contrib/streams-provider-twitter/src/test/resources/TwitterStreamProviderIT.conf
index 291a17c..4f808eb 100644
--- 
a/streams-contrib/streams-provider-twitter/src/test/resources/TwitterStreamProviderIT.conf
+++ 
b/streams-contrib/streams-provider-twitter/src/test/resources/TwitterStreamProviderIT.conf
@@ -1,3 +1,20 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements.  See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership.  The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License.  You may obtain a copy of the License at
+#
+#   http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied.  See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
 twitter {
   endpoint = sample
   track = [

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/2d8ff243/streams-contrib/streams-provider-twitter/src/test/resources/TwitterTimelineProviderIT.conf
--
diff --git 
a/streams-contrib/streams-provider-twitter/src/test/resources/TwitterTimelineProviderIT.conf
 
b/streams-contrib/streams-provider-twitter/src/test/resources/TwitterTimelineProviderIT.conf
index a7862c4..1fad66d 100644
--- 
a/streams-contrib/streams-provider-twitter/src/test/resources/TwitterTimelineProviderIT.conf
+++ 
b/streams-contrib/streams-provider-twitter/src/test/resources/TwitterTimelineProviderIT.conf
@@ -1,3 +1,20 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements.  See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership.  The 

[2/3] incubator-streams git commit: Added missing license headers for mongo

2016-10-12 Thread mfranklin
Added missing license headers for mongo


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/0728793b
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/0728793b
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/0728793b

Branch: refs/heads/invalid_headers
Commit: 0728793bb1cb91a845645a7e107a0eaf95b2fd2d
Parents: 603cfdb
Author: Matt Franklin 
Authored: Wed Oct 12 09:52:23 2016 -0400
Committer: Matt Franklin 
Committed: Wed Oct 12 09:52:23 2016 -0400

--
 .../src/test/resources/MongoPersistIT.conf | 17 +
 1 file changed, 17 insertions(+)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/0728793b/streams-contrib/streams-persist-mongo/src/test/resources/MongoPersistIT.conf
--
diff --git 
a/streams-contrib/streams-persist-mongo/src/test/resources/MongoPersistIT.conf 
b/streams-contrib/streams-persist-mongo/src/test/resources/MongoPersistIT.conf
index 5754f35..f356bb0 100644
--- 
a/streams-contrib/streams-persist-mongo/src/test/resources/MongoPersistIT.conf
+++ 
b/streams-contrib/streams-persist-mongo/src/test/resources/MongoPersistIT.conf
@@ -1,3 +1,20 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements.  See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership.  The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License.  You may obtain a copy of the License at
+#
+#   http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied.  See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
 mongo {
   host = ${mongo.tcp.host}
   port = ${mongo.tcp.port}



[GitHub] incubator-streams pull request #295: Invalid headers

2016-10-12 Thread mfranklin
GitHub user mfranklin opened a pull request:

https://github.com/apache/incubator-streams/pull/295

Invalid headers

This fixes the reason the travis CI builds are failing.  

One thing I noticed in the travis configuration is that we are not running 
unit tests.  Is there a reason?

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/apache/incubator-streams invalid_headers

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams/pull/295.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #295


commit 603cfdbeda3d811b96f3b4f50d1010ba6302d170
Author: Matt Franklin 
Date:   2016-10-12T13:50:43Z

Added missing license headers

commit 0728793bb1cb91a845645a7e107a0eaf95b2fd2d
Author: Matt Franklin 
Date:   2016-10-12T13:52:23Z

Added missing license headers for mongo

commit 2d8ff2439cd8e579896adcc250b048621dea48de
Author: Matt Franklin 
Date:   2016-10-12T13:54:00Z

Added missing license headers for twitter




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-streams issue #295: Invalid headers

2016-10-12 Thread steveblackmon
Github user steveblackmon commented on the issue:

https://github.com/apache/incubator-streams/pull/295
  
👍 
IIRC unit testing was disabled because travis builds were timing out.
However it looks like they may no longer have a time-out, so we could try 
enabling.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-streams pull request #291: resolves STREAMS-405

2016-10-12 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/291


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Commented] (STREAMS-405) Link to src/site/markdown/index.md in README.md is broken

2016-10-12 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/STREAMS-405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15568936#comment-15568936
 ] 

ASF GitHub Bot commented on STREAMS-405:


Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/291


> Link to src/site/markdown/index.md in README.md is broken
> -
>
> Key: STREAMS-405
> URL: https://issues.apache.org/jira/browse/STREAMS-405
> Project: Streams
>  Issue Type: Bug
>Reporter: Joey Frazee
>Assignee: Joey Frazee
>Priority: Minor
> Fix For: 0.4
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] incubator-streams pull request #290: resolves STREAMS-409

2016-10-12 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/290


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[2/2] incubator-streams git commit: Merge remote-tracking branch 'charlesmims/STREAMS-409'

2016-10-12 Thread sblackmon
Merge remote-tracking branch 'charlesmims/STREAMS-409'


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/f1e1e114
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/f1e1e114
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/f1e1e114

Branch: refs/heads/master
Commit: f1e1e114ba9b56a141e06d3392918a419957466c
Parents: 51961a0 012d383
Author: Steve Blackmon @steveblackmon 
Authored: Wed Oct 12 09:52:05 2016 -0500
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Oct 12 09:52:05 2016 -0500

--
 NOTICE | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
--




[1/2] incubator-streams git commit: resolves STREAMS-409

2016-10-12 Thread sblackmon
Repository: incubator-streams
Updated Branches:
  refs/heads/master 51961a01d -> f1e1e114b


resolves STREAMS-409


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/012d383e
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/012d383e
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/012d383e

Branch: refs/heads/master
Commit: 012d383ef690259cda96272676094c3ee8f223e7
Parents: a726b3c
Author: charlesmims 
Authored: Tue Oct 11 13:40:08 2016 -0500
Committer: charlesmims 
Committed: Tue Oct 11 13:40:08 2016 -0500

--
 NOTICE | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/012d383e/NOTICE
--
diff --git a/NOTICE b/NOTICE
index 2bb8312..1a7f648 100644
--- a/NOTICE
+++ b/NOTICE
@@ -1,5 +1,5 @@
 Apache Streams
-Copyright 2012-2015 The Apache Software Foundation
+Copyright 2012-2016 The Apache Software Foundation
 
 This product includes software developed at
 The Apache Software Foundation (http://www.apache.org/).



[jira] [Commented] (STREAMS-409) the copyright year in the NOTICE files need to be updated for 2016.

2016-10-12 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/STREAMS-409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15568943#comment-15568943
 ] 

ASF GitHub Bot commented on STREAMS-409:


Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/290


> the copyright year in the NOTICE files need to be updated for 2016. 
> 
>
> Key: STREAMS-409
> URL: https://issues.apache.org/jira/browse/STREAMS-409
> Project: Streams
>  Issue Type: Task
>Reporter: Steve Blackmon
> Fix For: 0.4
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] incubator-streams pull request #293: Resolves STREAMS-410

2016-10-12 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/293


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[3/4] incubator-streams git commit: resolves STREAMS-410

2016-10-12 Thread sblackmon
resolves STREAMS-410


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/ce7aa24d
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/ce7aa24d
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/ce7aa24d

Branch: refs/heads/master
Commit: ce7aa24dab5a417a0470a0ce8e0f7cd2f3520271
Parents: a726b3c
Author: Elias Ponvert 
Authored: Tue Oct 11 17:02:40 2016 -0500
Committer: Elias Ponvert 
Committed: Tue Oct 11 17:02:40 2016 -0500

--
 pom.xml |   1 -
 .../streams-processor-lucene/pom.xml| 163 -
 .../lucene/LuceneSimpleTaggingProcessor.java| 355 ---
 .../lucene/LuceneTaggerConfiguration.json   |  29 --
 .../lucene/TestLucenSimpleTaggingProcessor.java | 171 -
 .../src/test/resources/TestTags.tsv |   2 -
 streams-contrib/streams-processor-tika/pom.xml  | 162 -
 .../org/apache/streams/tika/CategoryParser.java | 114 --
 .../org/apache/streams/tika/TikaProcessor.java  | 139 
 .../apache/streams/tika/BoilerPipeArticle.json  |  76 
 .../apache/streams/tika/TestCategoryParser.java |  30 --
 .../apache/streams/tika/TestTikaProcessor.java  |  29 --
 .../activity-consumer/osgi.bnd  |   9 -
 .../activity-consumer/pom.xml   | 171 -
 .../activityconsumer/ActivityConsumer.java  |  39 --
 .../ActivityConsumerWarehouse.java  |  31 --
 .../impl/ActivityConsumerWarehouseImpl.java |  57 ---
 .../impl/PushActivityConsumer.java  | 106 --
 .../spring/activity-consumer-context.xml|  28 --
 .../META-INF/spring/activity-consumer-osgi.xml  |  29 --
 .../src/main/resources/readme.txt   |   1 -
 .../activity-registration/osgi.bnd  |   9 -
 .../activity-registration/pom.xml   | 130 ---
 .../ActivityPublisherRegistration.java  |  29 --
 .../ActivityStreamsSubscriberRegistration.java  |  29 --
 .../impl/ActivityPublisherRegistrationImpl.java |  67 
 ...tivityStreamsSubscriberRegistrationImpl.java |  67 
 .../activity-registration-context-osgi.xml  |  30 --
 .../spring/activity-registration-context.xml|  29 --
 .../src/main/resources/readme.txt   |   1 -
 .../activity-subscriber/osgi.bnd|   9 -
 .../activity-subscriber/pom.xml | 134 ---
 .../ActivityStreamsSubscriber.java  |  38 --
 .../ActivityStreamsSubscriberWarehouse.java |  34 --
 .../ActivityStreamsSubscription.java|  38 --
 .../ActivityStreamsSubscriptionFilter.java  |  34 --
 .../ActivityStreamsSubscriptionOutput.java  |  47 ---
 .../impl/ActivityStreamsSubscriberDelegate.java | 126 ---
 .../ActivityStreamsSubscriberWarehouseImpl.java |  60 
 ...yStreamsSubscriptionCassandraFilterImpl.java |  42 ---
 .../impl/ActivityStreamsSubscriptionImpl.java   |  74 
 ...vityStreamsSubscriptionLuceneFilterImpl.java |  43 ---
 .../spring/activity-subscriber-context.xml  |  28 --
 .../spring/activity-subscriber-osgi.xml |  29 --
 .../src/main/resources/readme.txt   |   1 -
 .../src/site/resources/readme.txt   |   1 -
 streams-osgi-components/pom.xml |  43 ---
 streams-runtimes/pom.xml|   1 -
 .../jsonschema/SparkRuntimeConfiguration.json   |  27 --
 .../streams-runtime-webapp/README.md|   8 -
 streams-runtimes/streams-runtime-webapp/pom.xml | 250 -
 .../aggregation/ActivityAggregator.java |  59 ---
 .../configuration/EipConfigurator.java  | 201 ---
 .../ActivityPublisherRegistrationProcessor.java |  72 
 ...yStreamsSubscriberRegistrationProcessor.java |  93 -
 .../routers/ActivityConsumerRouteBuilder.java   |  32 --
 .../ActivityStreamsSubscriberRouteBuilder.java  |  32 --
 .../routers/impl/ActivityConsumerRouter.java| 144 
 .../impl/ActivityStreamsSubscriberRouter.java   | 141 
 .../messaging/service/ActivityService.java  |  31 --
 .../messaging/service/SubscriptionService.java  |  29 --
 .../service/impl/CassandraActivityService.java  |  96 -
 .../impl/CassandraSubscriptionService.java  |  43 ---
 .../META-INF/spring/propertiesLoader.xml|  35 --
 .../spring/streams-eip-applicationContext.xml   | 113 --
 .../streams-eip-osgi-component-import.xml   |  38 --
 .../META-INF/spring/streamsCamelContext.xml |  96 -
 .../main/resources/META-INF/streams.properties  |  41 ---
 .../impl/CassandraActivityServiceTest.java  |  86 -
 69 files changed, 4582 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/ce7aa24d/pom.xml
---

[2/4] incubator-streams git commit: resolves STREAMS-410

2016-10-12 Thread sblackmon
http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/ce7aa24d/streams-osgi-components/activity-consumer/src/main/resources/META-INF/spring/activity-consumer-context.xml
--
diff --git 
a/streams-osgi-components/activity-consumer/src/main/resources/META-INF/spring/activity-consumer-context.xml
 
b/streams-osgi-components/activity-consumer/src/main/resources/META-INF/spring/activity-consumer-context.xml
deleted file mode 100644
index f12ab82..000
--- 
a/streams-osgi-components/activity-consumer/src/main/resources/META-INF/spring/activity-consumer-context.xml
+++ /dev/null
@@ -1,28 +0,0 @@
-
-
-http://www.springframework.org/schema/beans";
-   xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance";
-   xsi:schemaLocation="http://www.springframework.org/schema/beans 
http://www.springframework.org/schema/beans/spring-beans.xsd";>
-
-
-
-
\ No newline at end of file

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/ce7aa24d/streams-osgi-components/activity-consumer/src/main/resources/META-INF/spring/activity-consumer-osgi.xml
--
diff --git 
a/streams-osgi-components/activity-consumer/src/main/resources/META-INF/spring/activity-consumer-osgi.xml
 
b/streams-osgi-components/activity-consumer/src/main/resources/META-INF/spring/activity-consumer-osgi.xml
deleted file mode 100644
index 408ce95..000
--- 
a/streams-osgi-components/activity-consumer/src/main/resources/META-INF/spring/activity-consumer-osgi.xml
+++ /dev/null
@@ -1,29 +0,0 @@
-
-
-http://www.springframework.org/schema/beans";
-   xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance";
-   xmlns:osgi="http://www.springframework.org/schema/osgi";
-   xsi:schemaLocation="http://www.springframework.org/schema/beans
-   http://www.springframework.org/schema/beans/spring-beans.xsd
-http://www.springframework.org/schema/osgi
-http://www.springframework.org/schema/osgi/spring-osgi.xsd";>
-
-
-
-
\ No newline at end of file

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/ce7aa24d/streams-osgi-components/activity-consumer/src/main/resources/readme.txt
--
diff --git 
a/streams-osgi-components/activity-consumer/src/main/resources/readme.txt 
b/streams-osgi-components/activity-consumer/src/main/resources/readme.txt
deleted file mode 100644
index 5774586..000
--- a/streams-osgi-components/activity-consumer/src/main/resources/readme.txt
+++ /dev/null
@@ -1 +0,0 @@
-Bundle resources go here

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/ce7aa24d/streams-osgi-components/activity-registration/osgi.bnd
--
diff --git a/streams-osgi-components/activity-registration/osgi.bnd 
b/streams-osgi-components/activity-registration/osgi.bnd
deleted file mode 100644
index 53f60f9..000
--- a/streams-osgi-components/activity-registration/osgi.bnd
+++ /dev/null
@@ -1,9 +0,0 @@
-#
-# Licensed under Apache License 2.0 - 
http://www.apache.org/licenses/LICENSE-2.0
-#
-
-#-
-# Use this file to add customized Bnd instructions for the bundle
-#-
-
-

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/ce7aa24d/streams-osgi-components/activity-registration/pom.xml
--
diff --git a/streams-osgi-components/activity-registration/pom.xml 
b/streams-osgi-components/activity-registration/pom.xml
deleted file mode 100644
index 7871a0e..000
--- a/streams-osgi-components/activity-registration/pom.xml
+++ /dev/null
@@ -1,130 +0,0 @@
-
-
-http://maven.apache.org/POM/4.0.0"; 
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; 
xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 
http://maven.apache.org/maven-v4_0_0.xsd";>
-
-  4.0.0
-
-  
-org.apache.streams.osgi.components
-streams-osgi-components
-0.4-incubating-SNAPSHOT
-  
-
-  activity-registration
-
-  ${bundle.symbolicName} [${bundle.namespace}]
-
-  bundle
-
-  
-activity-registration-bundle
-org.apache.streams.osgi.components
-1.1
-  
-
-  
-
-
-src/main/resources
-
-
-
-.
-
-plugin.xml
-plugin.properties
-icons/**
-
-
-
-
-
-org.ops4j
-maven-pax-plugin
-
-true
-
-
-  

[jira] [Commented] (STREAMS-410) Delete any modules which have been removed from reactor from master branch

2016-10-12 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/STREAMS-410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15568961#comment-15568961
 ] 

ASF GitHub Bot commented on STREAMS-410:


Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/293


> Delete any modules which have been removed from reactor from master branch
> --
>
> Key: STREAMS-410
> URL: https://issues.apache.org/jira/browse/STREAMS-410
> Project: Streams
>  Issue Type: Task
>Reporter: Steve Blackmon
> Fix For: 0.4
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[1/4] incubator-streams git commit: resolves STREAMS-410

2016-10-12 Thread sblackmon
Repository: incubator-streams
Updated Branches:
  refs/heads/master f1e1e114b -> f14a25ced


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/ce7aa24d/streams-runtimes/streams-runtime-webapp/src/main/java/org/apache/streams/messaging/configuration/EipConfigurator.java
--
diff --git 
a/streams-runtimes/streams-runtime-webapp/src/main/java/org/apache/streams/messaging/configuration/EipConfigurator.java
 
b/streams-runtimes/streams-runtime-webapp/src/main/java/org/apache/streams/messaging/configuration/EipConfigurator.java
deleted file mode 100644
index 460c43a..000
--- 
a/streams-runtimes/streams-runtime-webapp/src/main/java/org/apache/streams/messaging/configuration/EipConfigurator.java
+++ /dev/null
@@ -1,201 +0,0 @@
-/*
- * Licensed to the Apache Software Foundation (ASF) under one
- * or more contributor license agreements.  See the NOTICE file
- * distributed with this work for additional information
- * regarding copyright ownership.  The ASF licenses this file
- * to you under the Apache License, Version 2.0 (the
- * "License"); you may not use this file except in compliance
- *
- *   http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing,
- * software distributed under the License is distributed on an
- * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
- * KIND, either express or implied.  See the License for the
- * specific language governing permissions and limitations
- * under the License.
- */
-
-package org.apache.streams.messaging.configuration;
-
-import org.springframework.beans.factory.annotation.Value;
-import org.springframework.stereotype.Component;
-
-@Component
-public class EipConfigurator {
-
-
-
-@Value("${consumer.inRouteHost}")
-private String consumerInRouteHost;
-
-@Value("${consumer.inRoutePort}")
-private String consumerInRoutePort;
-
-@Value("${subscriber.inRouteHost}")
-private String subscriberInRouteHost;
-
-@Value("${subscriber.inRoutePort}")
-private String subscriberInRoutePort;
-
-
-@Value("${consumer.activityQUri}")
-private String consumerActivityQUri;
-
-@Value("${consumer.publisherEndpointProtocol}")
-private String publisherEndpointProtocol;
-
-@Value("${consumer.publisherEndpointUrlResource}")
-private String publisherEndpointUrlResource;
-
-@Value("${consumer.receiveMethod}")
-private String consumerReceiveMethod;
-
-@Value("${consumer.splitMethod}")
-private String consumerSplitMethod;
-
-@Value("${subscriber.subscriberEndpointProtocol}")
-private String subscriberEndpointProtocol;
-
-@Value("${subscriber.subscriberEndpointUrlResource}")
-private String subscriberEndpointUrlResource;
-
-@Value("${subscriber.receiveMethod}")
-private String subscriberReceiveMethod;
-
-@Value("${subscriber.postMethod}")
-private String subscriberPostMethod;
-
-@Value("${subscriber.getMethod}")
-private String subscriberGetMethod;
-
-
-@Value("${servlet.baseUrlPath}")
-private String baseUrlPath;
-
-
-public static String ENDPOINT_PROTOCOL_JETTY="jetty:http://";;
-public static String ENDPOINT_PROTOCOL_SERVLET="servlet:///";
-
-public String getConsumerInRouteHost() {
-return consumerInRouteHost;
-}
-
-public String getConsumerInRoutePort() {
-return consumerInRoutePort;
-}
-
-public String getConsumerActivityQUri() {
-return consumerActivityQUri;
-}
-
-public void setConsumerActivityQUri(String consumerActivityQUri) {
-this.consumerActivityQUri = consumerActivityQUri;
-}
-
-public void setConsumerInRoutePort(String consumerInRoutePort) {
-this.consumerInRoutePort = consumerInRoutePort;
-}
-
-public void setConsumerInRouteHost(String consumerInRouteHost) {
-this.consumerInRouteHost = consumerInRouteHost;
-}
-
-public String getSubscriberInRouteHost() {
-return subscriberInRouteHost;
-}
-
-public void setSubscriberInRouteHost(String subscriberInRouteHost) {
-this.subscriberInRouteHost = subscriberInRouteHost;
-}
-
-public String getSubscriberInRoutePort() {
-return subscriberInRoutePort;
-}
-
-public void setSubscriberInRoutePort(String subscriberInRoutePort) {
-this.subscriberInRoutePort = subscriberInRoutePort;
-}
-
-public String getPublisherEndpointProtocol() {
-return publisherEndpointProtocol;
-}
-
-public void setPublisherEndpointProtocol(String publisherEndpointProtocol) 
{
-this.publisherEndpointProtocol = publisherEndpointProtocol;
-}
-
-public String getPublisherEndpointUrlResource() {
-return publisherEndpointUrlResource;
-}
-
-public void setPublisherEndpointUrlResource(String 
publisherEndpointUrlResource) {
-this.publisherEndpointUrlResource = publisherEndpointUrlResource;
-}
-

[4/4] incubator-streams git commit: Merge remote-tracking branch 'eponvert/STREAMS-410'

2016-10-12 Thread sblackmon
Merge remote-tracking branch 'eponvert/STREAMS-410'


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/f14a25ce
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/f14a25ce
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/f14a25ce

Branch: refs/heads/master
Commit: f14a25cedc6c41f1331fb8783cce1c59f4eb1961
Parents: f1e1e11 ce7aa24
Author: Steve Blackmon @steveblackmon 
Authored: Wed Oct 12 09:58:57 2016 -0500
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Oct 12 09:58:57 2016 -0500

--
 pom.xml |   1 -
 .../streams-processor-lucene/pom.xml| 163 -
 .../lucene/LuceneSimpleTaggingProcessor.java| 355 ---
 .../lucene/LuceneTaggerConfiguration.json   |  29 --
 .../lucene/TestLucenSimpleTaggingProcessor.java | 171 -
 .../src/test/resources/TestTags.tsv |   2 -
 streams-contrib/streams-processor-tika/pom.xml  | 162 -
 .../org/apache/streams/tika/CategoryParser.java | 114 --
 .../org/apache/streams/tika/TikaProcessor.java  | 139 
 .../apache/streams/tika/BoilerPipeArticle.json  |  76 
 .../apache/streams/tika/TestCategoryParser.java |  30 --
 .../apache/streams/tika/TestTikaProcessor.java  |  29 --
 .../activity-consumer/osgi.bnd  |   9 -
 .../activity-consumer/pom.xml   | 171 -
 .../activityconsumer/ActivityConsumer.java  |  39 --
 .../ActivityConsumerWarehouse.java  |  31 --
 .../impl/ActivityConsumerWarehouseImpl.java |  57 ---
 .../impl/PushActivityConsumer.java  | 106 --
 .../spring/activity-consumer-context.xml|  28 --
 .../META-INF/spring/activity-consumer-osgi.xml  |  29 --
 .../src/main/resources/readme.txt   |   1 -
 .../activity-registration/osgi.bnd  |   9 -
 .../activity-registration/pom.xml   | 130 ---
 .../ActivityPublisherRegistration.java  |  29 --
 .../ActivityStreamsSubscriberRegistration.java  |  29 --
 .../impl/ActivityPublisherRegistrationImpl.java |  67 
 ...tivityStreamsSubscriberRegistrationImpl.java |  67 
 .../activity-registration-context-osgi.xml  |  30 --
 .../spring/activity-registration-context.xml|  29 --
 .../src/main/resources/readme.txt   |   1 -
 .../activity-subscriber/osgi.bnd|   9 -
 .../activity-subscriber/pom.xml | 134 ---
 .../ActivityStreamsSubscriber.java  |  38 --
 .../ActivityStreamsSubscriberWarehouse.java |  34 --
 .../ActivityStreamsSubscription.java|  38 --
 .../ActivityStreamsSubscriptionFilter.java  |  34 --
 .../ActivityStreamsSubscriptionOutput.java  |  47 ---
 .../impl/ActivityStreamsSubscriberDelegate.java | 126 ---
 .../ActivityStreamsSubscriberWarehouseImpl.java |  60 
 ...yStreamsSubscriptionCassandraFilterImpl.java |  42 ---
 .../impl/ActivityStreamsSubscriptionImpl.java   |  74 
 ...vityStreamsSubscriptionLuceneFilterImpl.java |  43 ---
 .../spring/activity-subscriber-context.xml  |  28 --
 .../spring/activity-subscriber-osgi.xml |  29 --
 .../src/main/resources/readme.txt   |   1 -
 .../src/site/resources/readme.txt   |   1 -
 streams-osgi-components/pom.xml |  43 ---
 streams-runtimes/pom.xml|   1 -
 .../jsonschema/SparkRuntimeConfiguration.json   |  27 --
 .../streams-runtime-webapp/README.md|   8 -
 streams-runtimes/streams-runtime-webapp/pom.xml | 250 -
 .../aggregation/ActivityAggregator.java |  59 ---
 .../configuration/EipConfigurator.java  | 201 ---
 .../ActivityPublisherRegistrationProcessor.java |  72 
 ...yStreamsSubscriberRegistrationProcessor.java |  93 -
 .../routers/ActivityConsumerRouteBuilder.java   |  32 --
 .../ActivityStreamsSubscriberRouteBuilder.java  |  32 --
 .../routers/impl/ActivityConsumerRouter.java| 144 
 .../impl/ActivityStreamsSubscriberRouter.java   | 141 
 .../messaging/service/ActivityService.java  |  31 --
 .../messaging/service/SubscriptionService.java  |  29 --
 .../service/impl/CassandraActivityService.java  |  96 -
 .../impl/CassandraSubscriptionService.java  |  43 ---
 .../META-INF/spring/propertiesLoader.xml|  35 --
 .../spring/streams-eip-applicationContext.xml   | 113 --
 .../streams-eip-osgi-component-import.xml   |  38 --
 .../META-INF/spring/streamsCamelContext.xml |  96 -
 .../main/resources/META-INF/streams.properties  |  41 ---
 .../impl/CassandraActivityServiceTest.java  |  86 -
 69 files changed, 4582 deletions(-)
--




incubator-streams git commit: resolves STREAMS-405

2016-10-12 Thread sblackmon
Repository: incubator-streams
Updated Branches:
  refs/heads/master a726b3c84 -> 51961a01d


resolves STREAMS-405


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/51961a01
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/51961a01
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/51961a01

Branch: refs/heads/master
Commit: 51961a01ded3072e2a2c1a66a46d22ed5dd64813
Parents: a726b3c
Author: charlesmims 
Authored: Tue Oct 11 13:53:53 2016 -0500
Committer: charlesmims 
Committed: Tue Oct 11 13:53:53 2016 -0500

--
 README.md | 13 -
 1 file changed, 12 insertions(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/51961a01/README.md
--
diff --git a/README.md b/README.md
index 92d2627..4ab85cb 100644
--- a/README.md
+++ b/README.md
@@ -2,6 +2,17 @@ Apache Streams (incubating)
 Licensed under Apache License 2.0 - http://www.apache.org/licenses/LICENSE-2.0
 

 
-[README.md](src/site/markdown/index.md "README")
+## Overview
+Apache Streams (incubating) unifies a diverse world of digital profiles and 
online activities into common formats and vocabularies, and makes these 
datasets accessible across a variety of databases, devices, and platforms for 
streaming, browsing, search, sharing, and analytics use-cases.
 
+### What is Streams?
+Apache Streams contains JRE-based modules that developers can use to easily 
integrate with online data sources and build polyglot indexes of activities, 
entities, and relationships - all based on public standards such as [Activity 
Streams](http://activitystrea.ms/), or other published organizational standards.
 
+### Why use Streams?
+Streams contains libraries and patterns for specifying, publishing, and 
inter-linking schemas, and assists with conversion of activities (posts, 
shares, likes, follows, etc.) and objects (profiles, pages, photos, videos, 
etc.) between the representation, format, and encoding preferred by supported 
data providers (Twitter, Instagram, etc.), and storage services (Cassandra, 
Elasticsearch, HBase, HDFS, Neo4J, etc.)
+
+### Why is Streams important?
+The project aims to provide simple two-way data interchange with all popular 
REST APIs in activity streams formats using a universal protocol.  No other 
active open-source project has this ambitious goal, as well as 
production-worthy implementations for >10 services.  Streams compatibility with 
multiple storage back-ends and ability to be embedded within any java-based 
real-time or batch data processing platform ensures that its interoperability 
features come with little technical baggage.
+
+### Disclaimer
+Apache Streams is an effort undergoing incubation at [The Apache Software 
Foundation (ASF)](http://apache.org) sponsored by the [Apache Incubator 
PMC](http://incubator.apache.org). Incubation is required of all newly accepted 
projects until a further review indicates that the infrastructure, 
communications, and decision making process have stabilized in a manner 
consistent with other successful ASF projects. While incubation status is not 
necessarily a reflection of the completeness or stability of the code, it does 
indicate that the project has yet to be fully endorsed by the ASF.



[jira] [Resolved] (STREAMS-410) Delete any modules which have been removed from reactor from master branch

2016-10-12 Thread Steve Blackmon (JIRA)

 [ 
https://issues.apache.org/jira/browse/STREAMS-410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Blackmon resolved STREAMS-410.

Resolution: Fixed

> Delete any modules which have been removed from reactor from master branch
> --
>
> Key: STREAMS-410
> URL: https://issues.apache.org/jira/browse/STREAMS-410
> Project: Streams
>  Issue Type: Task
>Reporter: Steve Blackmon
> Fix For: 0.4
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (STREAMS-409) the copyright year in the NOTICE files need to be updated for 2016.

2016-10-12 Thread Steve Blackmon (JIRA)

 [ 
https://issues.apache.org/jira/browse/STREAMS-409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Blackmon resolved STREAMS-409.

Resolution: Fixed

> the copyright year in the NOTICE files need to be updated for 2016. 
> 
>
> Key: STREAMS-409
> URL: https://issues.apache.org/jira/browse/STREAMS-409
> Project: Streams
>  Issue Type: Task
>Reporter: Steve Blackmon
> Fix For: 0.4
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (STREAMS-405) Link to src/site/markdown/index.md in README.md is broken

2016-10-12 Thread Steve Blackmon (JIRA)

 [ 
https://issues.apache.org/jira/browse/STREAMS-405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Blackmon resolved STREAMS-405.

Resolution: Fixed

> Link to src/site/markdown/index.md in README.md is broken
> -
>
> Key: STREAMS-405
> URL: https://issues.apache.org/jira/browse/STREAMS-405
> Project: Streams
>  Issue Type: Bug
>Reporter: Joey Frazee
>Assignee: Joey Frazee
>Priority: Minor
> Fix For: 0.4
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[38/38] incubator-streams git commit: remove version declaration from test

2016-10-12 Thread sblackmon
remove version declaration from test


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/b21ec4b5
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/b21ec4b5
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/b21ec4b5

Branch: refs/heads/master
Commit: b21ec4b5028f8fa65ea2223e22af7d7c7bf16d4a
Parents: 150e171
Author: Steve Blackmon @steveblackmon 
Authored: Wed Oct 12 12:41:12 2016 -0500
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Oct 12 12:41:12 2016 -0500

--
 .../org/apache/streams/util/schema/test/SchemaStoreTest.java | 4 ++--
 streams-util/src/test/resources/media_link.json  | 2 +-
 2 files changed, 3 insertions(+), 3 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/b21ec4b5/streams-util/src/test/java/org/apache/streams/util/schema/test/SchemaStoreTest.java
--
diff --git 
a/streams-util/src/test/java/org/apache/streams/util/schema/test/SchemaStoreTest.java
 
b/streams-util/src/test/java/org/apache/streams/util/schema/test/SchemaStoreTest.java
index 9aa7661..6b5e598 100644
--- 
a/streams-util/src/test/java/org/apache/streams/util/schema/test/SchemaStoreTest.java
+++ 
b/streams-util/src/test/java/org/apache/streams/util/schema/test/SchemaStoreTest.java
@@ -44,7 +44,7 @@ public class SchemaStoreTest {
 Schema collection = schemaStore.getByUri(file.toURI()).get();
 assert( collection.getParent() == null );
 assert( schemaStore.getById(
-
URI.create("http://streams.incubator.apache.org/site/0.3-incubating-SNAPSHOT/streams-schemas/object.json#";
+
URI.create("http://streams.incubator.apache.org/site/latest/streams-project/streams-schemas/object.json#";
 )).isPresent());
 }
 
@@ -60,7 +60,7 @@ public class SchemaStoreTest {
 assert( update.getParent() != null );
 assert( update.getParent().getId().getScheme().equals("http"));
 assert( 
update.getParent().getId().getHost().equals("streams.incubator.apache.org"));
-assert( 
update.getParent().getId().getPath().startsWith("/site/0.3-incubating-SNAPSHOT/streams-schemas"));
+assert( 
update.getParent().getId().getPath().startsWith("/site/latest/streams-project/streams-schemas"));
 assert( 
update.getParent().getId().getPath().endsWith("activity.json"));
 }
 

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/b21ec4b5/streams-util/src/test/resources/media_link.json
--
diff --git a/streams-util/src/test/resources/media_link.json 
b/streams-util/src/test/resources/media_link.json
index 0bed6f0..739c66b 100644
--- a/streams-util/src/test/resources/media_link.json
+++ b/streams-util/src/test/resources/media_link.json
@@ -1,5 +1,5 @@
 {
-"$schema": 
"http://streams.incubator.apache.org/site/0.3-incubating-SNAPSHOT/streams-schemas/media_link.json#";,
+"$schema": 
"http://streams.incubator.apache.org/site/latest/streams-project/streams-schemas/media_link.json#";,
 "duration": 3,
 "height": 480,
 "width": 640,



[37/38] incubator-streams git commit: remove extra classes from merge

2016-10-12 Thread sblackmon
remove extra classes from merge


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/150e1715
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/150e1715
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/150e1715

Branch: refs/heads/master
Commit: 150e1715adc0c1dcb270177aedb947803bfbaf68
Parents: 5694ae9
Author: Steve Blackmon @steveblackmon 
Authored: Wed Oct 12 12:40:57 2016 -0500
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Oct 12 12:40:57 2016 -0500

--
 .../streams/plugins/StreamsPojoScala.java   | 371 ---
 .../streams/plugins/StreamsPojoScalaMojo.java   |  71 
 .../plugins/test/StreamsPojoScalaTest.java  |  55 ---
 3 files changed, 497 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/150e1715/streams-plugins/streams-plugin-scala/src/main/java/org/apache/streams/plugins/StreamsPojoScala.java
--
diff --git 
a/streams-plugins/streams-plugin-scala/src/main/java/org/apache/streams/plugins/StreamsPojoScala.java
 
b/streams-plugins/streams-plugin-scala/src/main/java/org/apache/streams/plugins/StreamsPojoScala.java
deleted file mode 100644
index 1c3e317..000
--- 
a/streams-plugins/streams-plugin-scala/src/main/java/org/apache/streams/plugins/StreamsPojoScala.java
+++ /dev/null
@@ -1,371 +0,0 @@
-package org.apache.streams.plugins;
-
-import com.google.common.base.Strings;
-import com.google.common.collect.Iterables;
-import com.google.common.collect.Lists;
-import com.google.common.collect.Maps;
-import com.google.common.collect.Sets;
-import org.apache.streams.data.DocumentClassifier;
-import org.reflections.ReflectionUtils;
-import org.reflections.Reflections;
-import org.reflections.scanners.SubTypesScanner;
-import org.reflections.scanners.TypeAnnotationsScanner;
-import org.reflections.util.ClasspathHelper;
-import org.reflections.util.ConfigurationBuilder;
-import org.reflections.ReflectionUtils.*;
-import org.slf4j.Logger;
-import org.slf4j.LoggerFactory;
-
-import javax.annotation.Generated;
-import java.io.File;
-import java.io.IOException;
-import java.io.Serializable;
-import java.lang.reflect.Field;
-import java.nio.file.Files;
-import java.nio.file.OpenOption;
-import java.nio.file.Paths;
-import java.nio.file.StandardOpenOption;
-import java.util.Collections;
-import java.util.Iterator;
-import java.util.List;
-import java.util.Map;
-import java.util.Set;
-import java.util.TreeSet;
-import java.util.concurrent.ConcurrentHashMap;
-
-/**
- * Created by sblackmon on 11/18/15.
- */
-public class StreamsPojoScala implements Runnable {
-
-private final static Logger LOGGER = 
LoggerFactory.getLogger(StreamsPojoScala.class);
-
-private final static String LS = System.getProperty("line.separator");
-
-private StreamsPojoScalaMojo mojo;
-
-String outDir = "./target/generated-sources/scala";
-String packages = "org.apache.streams.pojo.json";
-
-private final Reflections reflections = new Reflections(
-new ConfigurationBuilder()
-// TODO
-.forPackages(packages)
-.setScanners(
-new SubTypesScanner(),
-new TypeAnnotationsScanner()));
-
-public void main(String[] args) {
-StreamsPojoScala streamsPojoScala = new StreamsPojoScala();
-Thread thread = new Thread(streamsPojoScala);
-thread.start();
-try {
-thread.join();
-} catch (InterruptedException e) {
-LOGGER.error("InterruptedException", e);
-} catch (Exception e) {
-LOGGER.error("Exception", e);
-}
-return;
-}
-
-public StreamsPojoScala(StreamsPojoScalaMojo mojo) {
-this.mojo = mojo;
-if (mojo != null &&
-mojo.getTarget() != null &&
-!Strings.isNullOrEmpty(mojo.getTarget().getAbsolutePath())
-)
-outDir = mojo.getTarget().getAbsolutePath();
-
-if (mojo != null &&
-mojo.getPackages() != null &&
-!Strings.isNullOrEmpty(mojo.getPackages())
-)
-packages = mojo.getPackages();
-}
-
-public StreamsPojoScala() {
-}
-
-public void run() {
-
-List> serializableClasses = detectSerializableClasses();
-
-LOGGER.info("Detected {} serialiables:", serializableClasses.size());
-for( Class clazz : serializableClasses )
-LOGGER.debug(clazz.toString());
-
-List> pojoClasses = detectPojoClasses(serializableClasses);
-
-LOGGER.info("Detected {} pojos:", pojoClasses.size());
-for( Class clazz : pojoClasses 

[16/38] incubator-streams git commit: WIP for apachecon

2016-10-12 Thread sblackmon
http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/site/resources/verbs/read.json
--
diff --git a/streams-schemas/src/site/resources/verbs/read.json 
b/streams-schemas/src/site/resources/verbs/read.json
deleted file mode 100644
index e797f41..000
--- a/streams-schemas/src/site/resources/verbs/read.json
+++ /dev/null
@@ -1,24 +0,0 @@
-{
-"$schema": "http://json-schema.org/draft-03/schema";,
-"$license": [
-
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
-"http://www.apache.org/licenses/LICENSE-2.0";
-],
-"id": "#",
-"type": "object",
-"title": "Read",
-"description": "Indicates that the actor read the object. This is 
typically only applicable for objects representing printed or written content, 
such as a book, a message or a comment.",
-"extends": {
-"$ref": "../activity.json"
-},
-"properties": {
-"verb": {
-"type": "string",
-"default": "read"
-},
-"title": {
-"type": "string",
-"default": "{actor.displayName} read {object.displayName}"
-}
-}
-}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/site/resources/verbs/receive.json
--
diff --git a/streams-schemas/src/site/resources/verbs/receive.json 
b/streams-schemas/src/site/resources/verbs/receive.json
deleted file mode 100644
index 0d44aef..000
--- a/streams-schemas/src/site/resources/verbs/receive.json
+++ /dev/null
@@ -1,24 +0,0 @@
-{
-"$schema": "http://json-schema.org/draft-03/schema";,
-"$license": [
-
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
-"http://www.apache.org/licenses/LICENSE-2.0";
-],
-"id": "#",
-"type": "object",
-"title": "Receive",
-"description": "Indicates that the actor is receiving an object. Examples 
include a person receiving a badge object. The object identifies the object 
being received.",
-"extends": {
-"$ref": "../activity.json"
-},
-"properties": {
-"verb": {
-"type": "string",
-"default": "receive"
-},
-"title": {
-"type": "string",
-"default": "{actor.displayName} received {object.displayName}"
-}
-}
-}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/site/resources/verbs/reject.json
--
diff --git a/streams-schemas/src/site/resources/verbs/reject.json 
b/streams-schemas/src/site/resources/verbs/reject.json
deleted file mode 100644
index b82fac7..000
--- a/streams-schemas/src/site/resources/verbs/reject.json
+++ /dev/null
@@ -1,24 +0,0 @@
-{
-"$schema": "http://json-schema.org/draft-03/schema";,
-"$license": [
-
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
-"http://www.apache.org/licenses/LICENSE-2.0";
-],
-"id": "#",
-"type": "object",
-"title": "Reject",
-"description": "Indicates that the actor has rejected the object.",
-"extends": {
-"$ref": "../activity.json"
-},
-"properties": {
-"verb": {
-"type": "string",
-"default": "reject"
-},
-"title": {
-"type": "string",
-"default": "{actor.displayName} rejected {object.displayName}"
-}
-}
-}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/site/resources/verbs/remove-friend.json
--
diff --git a/streams-schemas/src/site/resources/verbs/remove-friend.json 
b/streams-schemas/src/site/resources/verbs/remove-friend.json
deleted file mode 100644
index 073441d..000
--- a/streams-schemas/src/site/resources/verbs/remove-friend.json
+++ /dev/null
@@ -1,24 +0,0 @@
-{
-"$schema": "http://json-schema.org/draft-03/schema";,
-"$license": [
-
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
-"http://www.apache.org/licenses/LICENSE-2.0";
-],
-"id": "#",
-"type": "object",
-"title": "UnFriend",
-"description": "Indicates that the actor has removed the object from the 
collection of friends.",
-"extends": {
-"$ref": "../activity.json"
-},
-"properties": {
-"verb": {
-"type": "string",
-"default": "remove-friend"
-},
-"title": {
-"type": "string",
-"default": "{actor.displayName} removed friend 
{object.displayName}"
-}
-}
-}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/site/resources/verbs/remove.json

[08/38] incubator-streams git commit: STREAMS-398 - streams-schemas

2016-10-12 Thread sblackmon
http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/0424855c/streams-schemas/src/main/jsonschema/verbs/approve.json
--
diff --git a/streams-schemas/src/main/jsonschema/verbs/approve.json 
b/streams-schemas/src/main/jsonschema/verbs/approve.json
new file mode 100644
index 000..ec66f9b
--- /dev/null
+++ b/streams-schemas/src/main/jsonschema/verbs/approve.json
@@ -0,0 +1,24 @@
+{
+"$schema": "http://json-schema.org/draft-03/schema";,
+"$license": [
+
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+],
+"id": "#",
+"type": "object",
+"title": "Approve",
+"description": "Indicates that the actor has approved the object. For 
instance, a manager might approve a travel request.",
+"extends": {
+"$ref": "../activity.json"
+},
+"properties": {
+"verb": {
+"type": "string",
+"default": "approve"
+},
+"title": {
+"type": "string",
+"default": "{actor.displayName} approved {object.displayName}"
+}
+}
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/0424855c/streams-schemas/src/main/jsonschema/verbs/archive.json
--
diff --git a/streams-schemas/src/main/jsonschema/verbs/archive.json 
b/streams-schemas/src/main/jsonschema/verbs/archive.json
new file mode 100644
index 000..24aea16
--- /dev/null
+++ b/streams-schemas/src/main/jsonschema/verbs/archive.json
@@ -0,0 +1,24 @@
+{
+"$schema": "http://json-schema.org/draft-03/schema";,
+"$license": [
+
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+],
+"id": "#",
+"type": "object",
+"title": "Archive",
+"description": "Indicates that the actor has archived the object.",
+"extends": {
+"$ref": "../activity.json"
+},
+"properties": {
+"verb": {
+"type": "string",
+"default": "archive"
+},
+"title": {
+"type": "string",
+"default": "{actor.displayName} archived {object.displayName}"
+}
+}
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/0424855c/streams-schemas/src/main/jsonschema/verbs/assign.json
--
diff --git a/streams-schemas/src/main/jsonschema/verbs/assign.json 
b/streams-schemas/src/main/jsonschema/verbs/assign.json
new file mode 100644
index 000..8fe5458
--- /dev/null
+++ b/streams-schemas/src/main/jsonschema/verbs/assign.json
@@ -0,0 +1,24 @@
+{
+"$schema": "http://json-schema.org/draft-03/schema";,
+"$license": [
+
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+],
+"id": "#",
+"type": "object",
+"title": "Assign",
+"description": "Indicates that the actor has assigned the object to the 
target.",
+"extends": {
+"$ref": "../activity.json"
+},
+"properties": {
+"verb": {
+"type": "string",
+"default": "assign"
+},
+"title": {
+"type": "string",
+"default": "{actor.displayName} assigned {object.displayName} to 
{target.displayName}"
+}
+}
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/0424855c/streams-schemas/src/main/jsonschema/verbs/at.json
--
diff --git a/streams-schemas/src/main/jsonschema/verbs/at.json 
b/streams-schemas/src/main/jsonschema/verbs/at.json
new file mode 100644
index 000..42c1222
--- /dev/null
+++ b/streams-schemas/src/main/jsonschema/verbs/at.json
@@ -0,0 +1,24 @@
+{
+"$schema": "http://json-schema.org/draft-03/schema";,
+"$license": [
+
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+],
+"id": "#",
+"type": "object",
+"title": "At",
+"description": "Indicates that the actor is currently located at the 
object. For instance, a person being at a specific physical location.",
+"extends": {
+"$ref": "../activity.json"
+},
+"properties": {
+"verb": {
+"type": "string",
+"default": "assign"
+},
+"title": {
+"type": "string",
+"default": "{actor.displayName} assigned {object.displayName} to 
{target.displayName}"
+}
+}
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/0424855c/streams-schemas/src/main/jsonschema/verbs/attach.json
--
diff --git a/streams-schema

[04/38] incubator-streams git commit: rename Hive Generator

2016-10-12 Thread sblackmon
rename Hive Generator


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/7d318c3f
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/7d318c3f
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/7d318c3f

Branch: refs/heads/master
Commit: 7d318c3fba9faf106eed8797263d52114a312d6c
Parents: ded4ad6
Author: Steve Blackmon @steveblackmon 
Authored: Mon Mar 28 08:32:19 2016 -0500
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Jun 1 12:49:27 2016 -0500

--
 .../streams/plugins/StreamsHiveResourceGenerator.java | 10 ++
 1 file changed, 6 insertions(+), 4 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/7d318c3f/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/StreamsHiveResourceGenerator.java
--
diff --git 
a/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/StreamsHiveResourceGenerator.java
 
b/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/StreamsHiveResourceGenerator.java
index 4edacf0..1efb15e 100644
--- 
a/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/StreamsHiveResourceGenerator.java
+++ 
b/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/StreamsHiveResourceGenerator.java
@@ -27,15 +27,14 @@ public class StreamsHiveResourceGenerator implements 
Runnable {
 
 private final static String LS = System.getProperty("line.separator");
 
-private StreamsPojoHiveMojo mojo;
+private StreamsHiveResourceGeneratorMojo mojo;
 
 String inDir = "./target/test-classes/activities";
 String outDir = "./target/generated-sources/hive";
-String packages[] = {"org.apache.streams.pojo.json"};
 
 public void main(String[] args) {
 StreamsHiveResourceGenerator streamsHiveResourceGenerator = new 
StreamsHiveResourceGenerator();
-Thread thread = new Thread(streamsPojoScala);
+Thread thread = new Thread(streamsHiveResourceGenerator);
 thread.start();
 try {
 thread.join();
@@ -47,7 +46,7 @@ public class StreamsHiveResourceGenerator implements Runnable 
{
 return;
 }
 
-public StreamsHiveResourceGenerator(StreamsPojoHiveMojo mojo) {
+public StreamsHiveResourceGenerator(StreamsHiveResourceGeneratorMojo mojo) 
{
 this.mojo = mojo;
 if (mojo != null &&
 mojo.getTarget() != null &&
@@ -67,6 +66,9 @@ public class StreamsHiveResourceGenerator implements Runnable 
{
 
 public void run() {
 
+List schemaFiles;
+
+
 List> serializableClasses = detectSerializableClasses();
 
 LOGGER.info("Detected {} serialiables:", serializableClasses.size());



[25/38] incubator-streams git commit: refactoring, testing, documentation, CLI modes

2016-10-12 Thread sblackmon
http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/d9674f7c/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/verbs/approve.json
--
diff --git 
a/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/verbs/approve.json
 
b/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/verbs/approve.json
new file mode 100644
index 000..247871c
--- /dev/null
+++ 
b/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/verbs/approve.json
@@ -0,0 +1,24 @@
+{
+"$schema": "http://json-schema.org/draft-03/schema";,
+"$license": [
+
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+],
+"id": 
"http://streams.incubator.apache.org/site/0.3-incubating-SNAPSHOT/streams-schemas/verbs/approve.json#";,
+"type": "object",
+"title": "Approve",
+"description": "Indicates that the actor has approved the object. For 
instance, a manager might approve a travel request.",
+"extends": {
+"$ref": "../activity.json"
+},
+"properties": {
+"verb": {
+"type": "string",
+"default": "approve"
+},
+"title": {
+"type": "string",
+"default": "{actor.displayName} approved {object.displayName}"
+}
+}
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/d9674f7c/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/verbs/archive.json
--
diff --git 
a/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/verbs/archive.json
 
b/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/verbs/archive.json
new file mode 100644
index 000..7ee2226
--- /dev/null
+++ 
b/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/verbs/archive.json
@@ -0,0 +1,24 @@
+{
+"$schema": "http://json-schema.org/draft-03/schema";,
+"$license": [
+
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+],
+"id": 
"http://streams.incubator.apache.org/site/0.3-incubating-SNAPSHOT/streams-schemas/verbs/archive.json#";,
+"type": "object",
+"title": "Archive",
+"description": "Indicates that the actor has archived the object.",
+"extends": {
+"$ref": "../activity.json"
+},
+"properties": {
+"verb": {
+"type": "string",
+"default": "archive"
+},
+"title": {
+"type": "string",
+"default": "{actor.displayName} archived {object.displayName}"
+}
+}
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/d9674f7c/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/verbs/assign.json
--
diff --git 
a/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/verbs/assign.json
 
b/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/verbs/assign.json
new file mode 100644
index 000..1d43041
--- /dev/null
+++ 
b/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/verbs/assign.json
@@ -0,0 +1,24 @@
+{
+"$schema": "http://json-schema.org/draft-03/schema";,
+"$license": [
+
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+],
+"id": 
"http://streams.incubator.apache.org/site/0.3-incubating-SNAPSHOT/streams-schemas/verbs/assign.json#";,
+"type": "object",
+"title": "Assign",
+"description": "Indicates that the actor has assigned the object to the 
target.",
+"extends": {
+"$ref": "../activity.json"
+},
+"properties": {
+"verb": {
+"type": "string",
+"default": "assign"
+},
+"title": {
+"type": "string",
+"default": "{actor.displayName} assigned {object.displayName} to 
{target.displayName}"
+}
+}
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/d9674f7c/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/verbs/at.json
--
diff --git 
a/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/verbs/at.json
 
b/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/verbs/at.json
new file mode 100644
index 000..34497e2
--- /dev/null
+++ 
b/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/verbs/at.json
@@ -0,0 +1,24 @@
+{
+"$schema": "http://json-schema.org/draft-03/schema";,
+"$license": [
+
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/li

[36/38] incubator-streams git commit: pom version bump

2016-10-12 Thread sblackmon
pom version bump


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/5694ae95
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/5694ae95
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/5694ae95

Branch: refs/heads/master
Commit: 5694ae953b7e2562df0e3f40f29e5b643ceed317
Parents: 18a29b0
Author: Steve Blackmon @steveblackmon 
Authored: Wed Oct 12 12:40:46 2016 -0500
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Oct 12 12:40:46 2016 -0500

--
 streams-plugins/streams-plugin-cassandra/pom.xml | 4 ++--
 .../src/test/resources/streams-plugin-cassandra/pom.xml  | 4 ++--
 streams-plugins/streams-plugin-elasticsearch/pom.xml | 4 ++--
 .../src/test/resources/streams-plugin-elasticsearch/pom.xml  | 4 ++--
 streams-plugins/streams-plugin-hbase/pom.xml | 4 ++--
 .../src/test/resources/streams-plugin-hbase/pom.xml  | 4 ++--
 streams-plugins/streams-plugin-hive/pom.xml  | 4 ++--
 .../src/test/resources/streams-plugin-hive/pom.xml   | 4 ++--
 streams-plugins/streams-plugin-pig/pom.xml   | 4 ++--
 .../src/test/resources/streams-plugin-pig/pom.xml| 4 ++--
 streams-plugins/streams-plugin-pojo/pom.xml  | 4 ++--
 .../src/test/resources/streams-plugin-pojo/pom.xml   | 4 ++--
 streams-schemas/pom.xml  | 2 +-
 streams-schemas/streams-schema-activitystreams/pom.xml   | 2 +-
 14 files changed, 26 insertions(+), 26 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/5694ae95/streams-plugins/streams-plugin-cassandra/pom.xml
--
diff --git a/streams-plugins/streams-plugin-cassandra/pom.xml 
b/streams-plugins/streams-plugin-cassandra/pom.xml
index d9d3f91..c378a2b 100644
--- a/streams-plugins/streams-plugin-cassandra/pom.xml
+++ b/streams-plugins/streams-plugin-cassandra/pom.xml
@@ -21,13 +21,13 @@
 4.0.0
 org.apache.streams.plugins
 streams-plugin-cassandra
-0.3-incubating-SNAPSHOT
+0.4-incubating-SNAPSHOT
 maven-plugin
 
 
 org.apache.streams
 streams-plugins
-0.3-incubating-SNAPSHOT
+0.4-incubating-SNAPSHOT
 ..
 
 

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/5694ae95/streams-plugins/streams-plugin-cassandra/src/test/resources/streams-plugin-cassandra/pom.xml
--
diff --git 
a/streams-plugins/streams-plugin-cassandra/src/test/resources/streams-plugin-cassandra/pom.xml
 
b/streams-plugins/streams-plugin-cassandra/src/test/resources/streams-plugin-cassandra/pom.xml
index 2a69ec7..d576d72 100644
--- 
a/streams-plugins/streams-plugin-cassandra/src/test/resources/streams-plugin-cassandra/pom.xml
+++ 
b/streams-plugins/streams-plugin-cassandra/src/test/resources/streams-plugin-cassandra/pom.xml
@@ -5,7 +5,7 @@
 
 org.apache.streams.plugins
 streams-plugin-cassandra-test
-0.3-incubating-SNAPSHOT
+0.4-incubating-SNAPSHOT
 jar
 Test StreamsCassandraResourceGeneratorMojo
 
@@ -30,7 +30,7 @@
 
 org.apache.streams.plugins
 streams-plugin-cassandra
-0.3-incubating-SNAPSHOT
+0.4-incubating-SNAPSHOT
 
 
 
target/test-classes/streams-schema-activitystreams/activity.json

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/5694ae95/streams-plugins/streams-plugin-elasticsearch/pom.xml
--
diff --git a/streams-plugins/streams-plugin-elasticsearch/pom.xml 
b/streams-plugins/streams-plugin-elasticsearch/pom.xml
index 07d7fc1..691813a 100644
--- a/streams-plugins/streams-plugin-elasticsearch/pom.xml
+++ b/streams-plugins/streams-plugin-elasticsearch/pom.xml
@@ -21,13 +21,13 @@
 4.0.0
 org.apache.streams.plugins
 streams-plugin-elasticsearch
-0.3-incubating-SNAPSHOT
+0.4-incubating-SNAPSHOT
 maven-plugin
 
 
 org.apache.streams
 streams-plugins
-0.3-incubating-SNAPSHOT
+0.4-incubating-SNAPSHOT
 ..
 
 

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/5694ae95/streams-plugins/streams-plugin-elasticsearch/src/test/resources/streams-plugin-elasticsearch/pom.xml
--
diff --git 
a/streams-plugins/streams-plugin-elasticsearch/src/test/resources/streams-plugin-elasticsearch/pom.xml
 
b/streams-plugins/streams-plugin-elasticsearch/src/test/resour

[jira] [Commented] (STREAMS-389) Support generation of scala source from jsonschemas

2016-10-12 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/STREAMS-389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15569375#comment-15569375
 ] 

ASF GitHub Bot commented on STREAMS-389:


Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/284


> Support generation of scala source from jsonschemas
> ---
>
> Key: STREAMS-389
> URL: https://issues.apache.org/jira/browse/STREAMS-389
> Project: Streams
>  Issue Type: New Feature
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
>
> Support generation of scala source from jsonschemas, similar to what 
> jsonschema2pojo does to generate java pojos.  Implement as a maven plugin 
> that can be enable on a module-by-module basis.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[32/38] incubator-streams git commit: refactoring, testing, documentation, CLI modes

2016-10-12 Thread sblackmon
refactoring, testing, documentation, CLI modes

break up streams-schemas into streams-util and streams-schema-activitystreams
add index.md to each plugin
specify basepath of jsonschema project-wide
harmonize plugin behavior, code style, docs
ensure all tests pass
add CLI modes


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/d9674f7c
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/d9674f7c
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/d9674f7c

Branch: refs/heads/master
Commit: d9674f7c0706d0e170f123c461d22e56e8f73807
Parents: 61f2736
Author: Steve Blackmon @steveblackmon 
Authored: Wed Jun 1 12:32:14 2016 -0500
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Jun 1 12:52:22 2016 -0500

--
 .../spring/streams-cassandra-context.xml|  25 --
 .../streams-plugin-cassandra/pom.xml|  13 +-
 .../StreamsCassandraGenerationConfig.java   |   2 +-
 .../StreamsCassandraResourceGenerator.java  |  42 +--
 .../StreamsCassandraResourceGeneratorMojo.java  |  37 +-
 .../src/site/markdown/index.md  |  22 +-
 ...treamsCassandraResourceGeneratorCLITest.java |  10 +-
 ...reamsCassandraResourceGeneratorMojoTest.java |   9 +-
 .../StreamsCassandraResourceGeneratorTest.java  |  58 +--
 .../resources/streams-plugin-cassandra/pom.xml  |  21 +-
 .../streams-plugin-elasticsearch/pom.xml|  13 +-
 .../StreamsElasticsearchGenerationConfig.java   |   2 +-
 .../StreamsElasticsearchResourceGenerator.java  |  75 ++--
 ...reamsElasticsearchResourceGeneratorMojo.java |  29 +-
 .../src/site/markdown/index.md  |  24 +-
 ...msElasticsearchResourceGeneratorCLITest.java |  39 ++
 ...reamsElasticsearchResourceGeneratorTest.java |  59 +--
 .../streams-plugin-elasticsearch/pom.xml|  23 +-
 streams-plugins/streams-plugin-hbase/pom.xml|  13 +-
 .../hbase/StreamsHbaseGenerationConfig.java |   2 +-
 .../hbase/StreamsHbaseResourceGenerator.java|  41 +-
 .../StreamsHbaseResourceGeneratorMojo.java  |  28 +-
 .../src/site/markdown/index.md  |  26 +-
 .../StreamsHbaseResourceGeneratorCLITest.java   |   2 +-
 .../StreamsHbaseResourceGeneratorMojoTest.java  |   2 +-
 .../test/StreamsHbaseResourceGeneratorTest.java |  31 +-
 .../test/resources/streams-plugin-hbase/pom.xml |  23 +-
 streams-plugins/streams-plugin-hive/pom.xml |  13 +-
 .../hive/StreamsHiveGenerationConfig.java   |   3 +-
 .../hive/StreamsHiveResourceGenerator.java  |  35 +-
 .../hive/StreamsHiveResourceGeneratorMojo.java  |  38 +-
 .../src/site/markdown/index.md  |  28 +-
 .../StreamsHiveResourceGeneratorCLITest.java|   2 +-
 .../StreamsHiveResourceGeneratorMojoTest.java   |   2 +-
 .../test/StreamsHiveResourceGeneratorTest.java  |  32 +-
 .../test/resources/streams-plugin-hive/pom.xml  |  23 +-
 streams-plugins/streams-plugin-pig/pom.xml  |  13 +-
 .../plugins/pig/StreamsPigGenerationConfig.java |   3 +-
 .../pig/StreamsPigResourceGenerator.java|  46 +--
 .../pig/StreamsPigResourceGeneratorMojo.java|  38 +-
 .../src/site/markdown/index.md  |  24 +-
 .../StreamsPigResourceGeneratorCLITest.java |   4 +-
 .../StreamsPigResourceGeneratorMojoTest.java|   4 +-
 .../test/StreamsPigResourceGeneratorTest.java   |  32 +-
 .../test/resources/streams-plugin-pig/pom.xml   |  23 +-
 streams-plugins/streams-plugin-pojo/pom.xml |  13 +-
 .../plugins/StreamsPojoSourceGenerator.java |  15 +-
 .../plugins/StreamsPojoSourceGeneratorMojo.java | 154 +---
 .../src/site/markdown/index.md  |  24 +-
 .../test/StreamsPojoSourceGeneratorCLITest.java |   2 +-
 .../StreamsPojoSourceGeneratorMojoTest.java |   2 +-
 .../test/StreamsPojoSourceGeneratorTest.java|  51 +--
 .../test/resources/streams-plugin-pojo/pom.xml  |  30 +-
 streams-plugins/streams-plugin-scala/pom.xml|  12 +
 .../streams/plugins/StreamsPojoScala.java   | 371 ---
 .../streams/plugins/StreamsPojoScalaMojo.java   |  71 
 .../plugins/StreamsScalaSourceGenerator.java| 351 ++
 .../StreamsScalaSourceGeneratorMojo.java|  59 +++
 .../src/site/markdown/index.md  |  36 ++
 .../plugins/test/StreamsPojoScalaTest.java  |  55 ---
 .../test/StreamsScalaSourceGeneratorTest.java   |  55 +++
 streams-runtimes/streams-runtime-local/pom.xml  |   2 +-
 streams-schemas/pom.xml |  77 +---
 .../org/apache/streams/schema/FieldType.java|  13 -
 .../org/apache/streams/schema/FieldUtil.java|  59 ---
 .../org/apache/streams/schema/FileUtil.java |  76 
 .../apache/streams/schema/GenerationConfig.java | 115 --
 .../java/org/apache/streams/schema/Schema.java  |  57 ---
 .../org/apache/streams/schema/SchemaStore.java  | 283 --
 .../org/apac

[GitHub] incubator-streams pull request #284: source and resource generation modules

2016-10-12 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/284


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[34/38] incubator-streams git commit: Merge branch 'STREAMS-389'

2016-10-12 Thread sblackmon
Merge branch 'STREAMS-389'

# Conflicts:
#   streams-plugins/pom.xml
#   streams-plugins/streams-plugin-scala/pom.xml


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/abc58b42
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/abc58b42
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/abc58b42

Branch: refs/heads/master
Commit: abc58b42db71cad1a9baad51c7a479e56ca4ab4c
Parents: 8e929eb d9674f7
Author: Steve Blackmon @steveblackmon 
Authored: Wed Oct 12 12:27:15 2016 -0500
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Oct 12 12:27:15 2016 -0500

--
 pom.xml |   7 +-
 streams-config/pom.xml  |   2 +-
 .../src/main/jsonschema/com/twitter/tweet.json  |   6 +-
 streams-plugins/pom.xml |   6 +
 .../streams-plugin-cassandra/pom.xml| 251 
 .../StreamsCassandraGenerationConfig.java   |  81 
 .../StreamsCassandraResourceGenerator.java  | 366 ++
 .../StreamsCassandraResourceGeneratorMojo.java  |  62 +++
 .../src/site/markdown/index.md  |  36 ++
 ...treamsCassandraResourceGeneratorCLITest.java |  52 +++
 ...reamsCassandraResourceGeneratorMojoTest.java |  78 
 .../StreamsCassandraResourceGeneratorTest.java  |  80 
 .../resources/streams-plugin-cassandra/pom.xml  |  76 
 .../streams-plugin-elasticsearch/pom.xml| 252 
 .../StreamsElasticsearchGenerationConfig.java   |  81 
 .../StreamsElasticsearchResourceGenerator.java  | 380 +++
 ...reamsElasticsearchResourceGeneratorMojo.java |  72 
 .../src/site/markdown/index.md  |  38 ++
 ...msElasticsearchResourceGeneratorCLITest.java |  39 ++
 ...sElasticsearchResourceGeneratorMojoTest.java |  50 +++
 ...reamsElasticsearchResourceGeneratorTest.java | 110 ++
 .../streams-plugin-elasticsearch/pom.xml|  76 
 streams-plugins/streams-plugin-hbase/pom.xml| 251 
 .../hbase/StreamsHbaseGenerationConfig.java |  90 +
 .../hbase/StreamsHbaseResourceGenerator.java| 193 ++
 .../StreamsHbaseResourceGeneratorMojo.java  |  71 
 .../src/site/markdown/index.md  |  40 ++
 .../StreamsHbaseResourceGeneratorCLITest.java   |  41 ++
 .../StreamsHbaseResourceGeneratorMojoTest.java  |  65 
 .../test/StreamsHbaseResourceGeneratorTest.java | 102 +
 .../test/resources/streams-plugin-hbase/pom.xml |  77 
 streams-plugins/streams-plugin-hive/pom.xml | 251 
 .../hive/StreamsHiveGenerationConfig.java   |  83 
 .../hive/StreamsHiveResourceGenerator.java  | 308 +++
 .../hive/StreamsHiveResourceGeneratorMojo.java  |  63 +++
 .../src/site/markdown/index.md  |  40 ++
 .../StreamsHiveResourceGeneratorCLITest.java|  41 ++
 .../StreamsHiveResourceGeneratorMojoTest.java   |  64 
 .../test/StreamsHiveResourceGeneratorTest.java  | 102 +
 .../src/test/resources/Tweet.hql| 297 +++
 .../src/test/resources/expected/activity.hql| 203 ++
 .../src/test/resources/expected/collection.hql  |  47 +++
 .../src/test/resources/expected/media_link.hql  |  11 +
 .../src/test/resources/expected/object.hql  |  61 +++
 .../resources/expected/objectTypes/place.hql|  79 
 .../test/resources/expected/verbs/purchase.hql  | 203 ++
 .../test/resources/streams-plugin-hive/pom.xml  |  76 
 streams-plugins/streams-plugin-pig/pom.xml  | 251 
 .../plugins/pig/StreamsPigGenerationConfig.java |  83 
 .../pig/StreamsPigResourceGenerator.java| 305 +++
 .../pig/StreamsPigResourceGeneratorMojo.java|  61 +++
 .../src/site/markdown/index.md  |  38 ++
 .../StreamsPigResourceGeneratorCLITest.java |  39 ++
 .../StreamsPigResourceGeneratorMojoTest.java|  64 
 .../test/StreamsPigResourceGeneratorTest.java   | 100 +
 .../src/test/resources/expected/media_link.pig  |   1 +
 .../resources/expected/objectTypes/file.pig |   1 +
 .../expected/objectTypes/photo-album.pig|   1 +
 .../test/resources/streams-plugin-pig/pom.xml   |  76 
 streams-plugins/streams-plugin-pojo/pom.xml | 253 
 .../plugins/StreamsPojoGenerationConfig.java|  68 
 .../plugins/StreamsPojoSourceGenerator.java |  75 
 .../plugins/StreamsPojoSourceGeneratorMojo.java |  95 +
 .../src/site/markdown/index.md  |  38 ++
 .../test/StreamsPojoSourceGeneratorCLITest.java |  43 +++
 .../StreamsPojoSourceGeneratorMojoTest.java |  68 
 .../test/StreamsPojoSourceGeneratorTest.java|  72 
 .../test/resources/streams-plugin-pojo/pom.xml  | 131 +++
 streams-plugins/streams-plugin-scala/pom.xml|  12 +
 .

[29/38] incubator-streams git commit: refactoring, testing, documentation, CLI modes

2016-10-12 Thread sblackmon
http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/d9674f7c/streams-schemas/src/main/jsonschema/object.json
--
diff --git a/streams-schemas/src/main/jsonschema/object.json 
b/streams-schemas/src/main/jsonschema/object.json
deleted file mode 100644
index 94f6719..000
--- a/streams-schemas/src/main/jsonschema/object.json
+++ /dev/null
@@ -1,98 +0,0 @@
-{
-"$schema": "http://json-schema.org/draft-03/schema";,
-"$license": [
-
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
-"http://www.apache.org/licenses/LICENSE-2.0";
-],
-"id": 
"http://streams.incubator.apache.org/site/0.3-incubating-SNAPSHOT/streams-schemas/object.json#";,
-"type": "object",
-"title": "object",
-"javaInterfaces": ["java.io.Serializable"],
-"description": "Basic object on the web. The only required property is the 
id",
-"properties": {
-"id": {
-"type": "string",
-"description": "Provides a permanent, universally unique 
identifier for the object in the form of an absolute IRI [RFC3987]. An object 
SHOULD contain a single id property. If an object does not contain an id 
property, consumers MAY use the value of the url property as a less-reliable, 
non-unique identifier.",
-"required": true
-},
-"image": {
-"format": "image",
-"type": "object",
-"description": "Description of a resource providing a visual 
representation of the object, intended for human consumption. An object MAY 
contain an image property whose value is a Media Link.",
-"extends": {
-"$ref": "./media_link.json"
-}
-},
-"displayName": {
-"type": "string",
-"description": "A natural-language, human-readable and plain-text 
name for the object. HTML markup MUST NOT be included. An object MAY contain a 
displayName property. If the object does not specify an objectType property, 
the object SHOULD specify a displayName"
-},
-"summary": {
-"type": "string",
-"description": "Natural-language summary of the object encoded as 
a single JSON String containing HTML markup. Visual elements such as thumbnail 
images MAY be included. An activity MAY contain a summary property"
-},
-"content": {
-"type": "string",
-"description": "Natural-language description of the object encoded 
as a single JSON String containing HTML markup. Visual elements such as 
thumbnail images MAY be included. An object MAY contain a content property"
-},
-"url": {
-"type": "string",
-"format": "url",
-"description": "An IRI [RFC3987] identifying a resource providing 
an HTML representation of the object. An object MAY contain a url property"
-},
-"objectType": {
-"type": "string",
-"description": "Identifies the type of object. An object MAY 
contain an objectType property whose value is a JSON String that is non-empty 
and matches either the \"isegment-nz-nc\" or the \"IRI\" production in 
[RFC3987]. Note that the use of a relative reference other than a simple name 
is not allowed. If no objectType property is contained, the object has no 
specific type."
-},
-"author": {
-"type": "object",
-"description": "Describes the entity that created or authored the 
object. An object MAY contain a single author property whose value is an Object 
of any type. Note that the author field identifies the entity that created the 
object and does not necessarily identify the entity that published the object. 
For instance, it may be the case that an object created by one person is posted 
and published to a system by an entirely different entity",
-"javaInterfaces": ["java.io.Serializable"],
-"extends": {
-"$ref": "./object.json"
-}
-},
-"published": {
-"type": "string",
-"description": "[RFC3339] date-time. The date and time at which 
the object was published. An object MAY contain a published property",
-"format": "date-time"
-},
-"updated": {
-"type": "string",
-"description": "[RFC3339] date-time. The date and time at which a 
previously published object has been modified. An Object MAY contain an updated 
property.",
-"format": "date-time"
-},
-"attachments": {
-"title": "Related objects",
-"description": "A collection of one or more additional, associated 
objects, similar to the concept of attached files in an email message. An 
object MAY have an attachedObjects property whose value is a JSON Array of 
Objects.",
-"type": "array",
-"items": {
- 

[02/38] incubator-streams git commit: STREAMS-398 - pojo generation

2016-10-12 Thread sblackmon
STREAMS-398 - pojo generation

code and plugin for generating POJOs now resides in streams-project
unit testing for generating POJOs without maven
unit testing for generating POJOs with maven


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/7b8ef0a2
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/7b8ef0a2
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/7b8ef0a2

Branch: refs/heads/master
Commit: 7b8ef0a22707af88426c18e0869ad01a261602c5
Parents: 0424855
Author: Steve Blackmon @steveblackmon 
Authored: Thu Apr 21 11:42:44 2016 -0500
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Jun 1 12:49:27 2016 -0500

--
 pom.xml |   1 +
 streams-plugins/streams-plugin-pojo/pom.xml |  28 ++-
 .../plugins/StreamsPojoGenerationConfig.java| 230 ---
 .../plugins/StreamsPojoSourceGenerator.java |  98 
 .../plugins/StreamsPojoSourceGeneratorMojo.java |  80 +++
 .../StreamsPojoSourceGeneratorMojoTest.java |  96 
 .../test/StreamsPojoSourceGeneratorTest.java|  43 +++-
 .../test/resources/streams-plugin-pojo/pom.xml  |  90 +++-
 streams-pojo/pom.xml|   6 +
 9 files changed, 421 insertions(+), 251 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/7b8ef0a2/pom.xml
--
diff --git a/pom.xml b/pom.xml
index cb935af..6010572 100644
--- a/pom.xml
+++ b/pom.xml
@@ -177,6 +177,7 @@
 streams-pojo-extensions
 streams-plugins
 streams-runtimes
+streams-schemas
 streams-testing
 streams-util
 streams-verbs

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/7b8ef0a2/streams-plugins/streams-plugin-pojo/pom.xml
--
diff --git a/streams-plugins/streams-plugin-pojo/pom.xml 
b/streams-plugins/streams-plugin-pojo/pom.xml
index 399a371..d7210c8 100644
--- a/streams-plugins/streams-plugin-pojo/pom.xml
+++ b/streams-plugins/streams-plugin-pojo/pom.xml
@@ -43,8 +43,14 @@
 ${project.version}
 
 
+org.apache.streams
+streams-schemas
+${project.version}
+
+
 org.jsonschema2pojo
 jsonschema2pojo-core
+0.4.10
 
 
 commons-logging
@@ -55,6 +61,7 @@
 
 org.jsonschema2pojo
 jsonschema2pojo-maven-plugin
+0.4.10
 
 
 org.apache.streams
@@ -86,6 +93,12 @@
 test
 
 
+org.apache.maven.shared
+maven-verifier
+1.6
+test
+
+
 org.apache.maven
 maven-core
 3.3.3
@@ -216,19 +229,20 @@
 
 org.apache.maven.plugins
 maven-dependency-plugin
-2.4
+
+**/*.json
+
${project.build.directory}/test-classes/streams-schemas
+org.apache.streams
+streams-schemas
+jar,test-jar
+
 
 
-resource-dependencies
+test-resource-dependencies
 process-test-resources
 
 unpack-dependencies
 
-
-
streams-pojo
-**/*.json
-
${project.build.directory}/test-classes
-
 
 
 

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/7b8ef0a2/streams-plugins/streams-plugin-pojo/src/main/java/org/apache/streams/plugins/StreamsPojoGenerationConfig.java
--
diff --git 
a/streams-plugins/streams-plugin-pojo/src/main/java/org/apache/streams/plugins/StreamsPojoGenerationConfig.java
 
b/streams-plugins/streams-plugin-pojo/src/main/java/org/apache/streams/plugins/StreamsPojoGenerationConfig.java
index b42ccf9..4c1f850 100644
--- 
a/streams-plugins/streams-plugin-pojo/src/main/java/org/apache/streams/plugins/StreamsPojoGenerationConfig.java
+++ 
b/streams-plugins/streams-plugin-pojo/src/main/java/org/apache/streams/plugins/StreamsPojoGenerationConfig.java
@@ -2,197 +2,67 @@ package org.apache.streams.plugins;
 
 import org.jsonschema2pojo.AnnotationStyle;
 import org.jsonschema2pojo.Annotator;
+import org.jsonsch

[23/38] incubator-streams git commit: refactoring, testing, documentation, CLI modes

2016-10-12 Thread sblackmon
http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/d9674f7c/streams-util/src/test/resources/activities/accept.json
--
diff --git a/streams-util/src/test/resources/activities/accept.json 
b/streams-util/src/test/resources/activities/accept.json
new file mode 100644
index 000..c1dfd5f
--- /dev/null
+++ b/streams-util/src/test/resources/activities/accept.json
@@ -0,0 +1,16 @@
+{
+  "$license": [
+"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+  ],
+  "actor": {
+"objectType": "person",
+"displayName": "Sally"
+  },
+  "verb": "accept",
+  "object": {
+"objectType": "job",
+"displayName": "Director of Marketing"
+  },
+  "title": "Sally accepted the Director of Marketing job."
+}
\ No newline at end of file

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/d9674f7c/streams-util/src/test/resources/activities/access.json
--
diff --git a/streams-util/src/test/resources/activities/access.json 
b/streams-util/src/test/resources/activities/access.json
new file mode 100644
index 000..93bc6e2
--- /dev/null
+++ b/streams-util/src/test/resources/activities/access.json
@@ -0,0 +1,17 @@
+{
+  "$license": [
+"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+  ],
+  "actor": {
+"objectType": "person",
+"displayName": "Joe"
+  },
+  "verb": "access",
+  "object": {
+"objectType": "file",
+"displayName": "4Q2012 Sales Forecast.xls"
+  },
+  "published": "2012-12-12T12:12:12Z",
+  "title": "Joe accessed the file \"4Q2012 Sales Forecast.xls\""
+}
\ No newline at end of file

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/d9674f7c/streams-util/src/test/resources/activities/acknowledge.json
--
diff --git a/streams-util/src/test/resources/activities/acknowledge.json 
b/streams-util/src/test/resources/activities/acknowledge.json
new file mode 100644
index 000..2b69fa7
--- /dev/null
+++ b/streams-util/src/test/resources/activities/acknowledge.json
@@ -0,0 +1,16 @@
+{
+  "$license": [
+"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+  ],
+  "actor": {
+"objectType": "person",
+"displayName": "Sally"
+  },
+  "verb": "acknowledge",
+  "object": {
+"objectType": "issue",
+"displayName": "#123: There is a problem with the build"
+  },
+  "content": "Sally acknowledged Issue #123"
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/d9674f7c/streams-util/src/test/resources/activities/add.json
--
diff --git a/streams-util/src/test/resources/activities/add.json 
b/streams-util/src/test/resources/activities/add.json
new file mode 100644
index 000..b4e8151
--- /dev/null
+++ b/streams-util/src/test/resources/activities/add.json
@@ -0,0 +1,21 @@
+{
+  "$license": [
+"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+  ],
+  "actor": {
+"objectType": "person",
+"displayName": "Joe"
+  },
+  "verb": "add",
+  "object": {
+"objectType": "image",
+"displayName": "My cat",
+"fullImage": {"url": "http://example.org/cat.jpg"}
+  },
+  "target": {
+"objectType": "collection",
+"displayName": "Joe's Photo Album",
+"objectTypes": ["image"]
+  }
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/d9674f7c/streams-util/src/test/resources/activities/agree.json
--
diff --git a/streams-util/src/test/resources/activities/agree.json 
b/streams-util/src/test/resources/activities/agree.json
new file mode 100644
index 000..3034cd8
--- /dev/null
+++ b/streams-util/src/test/resources/activities/agree.json
@@ -0,0 +1,15 @@
+{
+  "$license": [
+"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+  ],
+  "actor": {
+"objectType": "person",
+"displayName": "Sally"
+  },
+  "verb": "agree",
+  "object": {
+"objectType": "article",
+"displayName": "Some Random Article Online"
+  }
+}
\ No newline at end of file

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/d9674f7c/streams-util/src/test/resources/activities/append.json
--
diff --git a/streams-util/src/test/resources/activities/append.json 
b/streams-util/src/test/resources/activities/append.json
new file mode 100644
index 000..d8fb3be
--- /dev/null
+++ b/streams-util/src/test/resources/activities/append.json
@@ -0,0 +1,16 

[10/38] incubator-streams git commit: re-enable hive plugin

2016-10-12 Thread sblackmon
re-enable hive plugin


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/114c1c5f
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/114c1c5f
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/114c1c5f

Branch: refs/heads/master
Commit: 114c1c5ff31447a0ab85d9a2518d5ce08284d3ff
Parents: e84dcd7
Author: Steve Blackmon @steveblackmon 
Authored: Tue May 3 16:33:47 2016 -0500
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Jun 1 12:49:27 2016 -0500

--
 streams-plugins/pom.xml | 1 +
 1 file changed, 1 insertion(+)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/114c1c5f/streams-plugins/pom.xml
--
diff --git a/streams-plugins/pom.xml b/streams-plugins/pom.xml
index 390c8a0..b90e2d5 100644
--- a/streams-plugins/pom.xml
+++ b/streams-plugins/pom.xml
@@ -36,6 +36,7 @@
 
 
 
+streams-plugin-hive
 streams-plugin-pojo

 



[14/38] incubator-streams git commit: first take at STREAMS-389: streams-project/streams-plugins/streams-plugin-scala

2016-10-12 Thread sblackmon
first take at STREAMS-389: streams-project/streams-plugins/streams-plugin-scala


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/61f2736a
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/61f2736a
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/61f2736a

Branch: refs/heads/master
Commit: 61f2736a9424516606b9f7544b894cb81f65922c
Parents: 1bc84db
Author: Steve Blackmon (@steveblackmon) 
Authored: Mon Dec 7 13:48:38 2015 -0700
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Jun 1 12:51:43 2016 -0500

--
 streams-plugins/pom.xml |   1 +
 streams-plugins/streams-plugin-scala/pom.xml| 243 
 .../streams/plugins/StreamsPojoScala.java   | 371 +++
 .../streams/plugins/StreamsPojoScalaMojo.java   |  71 
 .../plugins/test/StreamsPojoScalaTest.java  |  55 +++
 .../test/resources/streams-plugin-scala/pom.xml |  40 ++
 6 files changed, 781 insertions(+)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/61f2736a/streams-plugins/pom.xml
--
diff --git a/streams-plugins/pom.xml b/streams-plugins/pom.xml
index 5d403ac..f2c8999 100644
--- a/streams-plugins/pom.xml
+++ b/streams-plugins/pom.xml
@@ -42,6 +42,7 @@
 streams-plugin-hive
 streams-plugin-pig
 streams-plugin-pojo
+streams-plugin-scala

 
 

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/61f2736a/streams-plugins/streams-plugin-scala/pom.xml
--
diff --git a/streams-plugins/streams-plugin-scala/pom.xml 
b/streams-plugins/streams-plugin-scala/pom.xml
new file mode 100644
index 000..f718260
--- /dev/null
+++ b/streams-plugins/streams-plugin-scala/pom.xml
@@ -0,0 +1,243 @@
+
+
+http://maven.apache.org/POM/4.0.0"; 
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; 
xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 
http://maven.apache.org/xsd/maven-4.0.0.xsd";>
+
+4.0.0
+org.apache.streams.plugins
+streams-plugin-scala
+0.3-incubating-SNAPSHOT
+maven-plugin
+
+
+org.apache.streams
+streams-plugins
+0.3-incubating-SNAPSHOT
+
+
+
+
+org.apache.streams
+streams-config
+${project.version}
+
+
+org.apache.streams
+streams-core
+${project.version}
+
+
+org.jsonschema2pojo
+jsonschema2pojo-core
+
+
+org.apache.streams
+streams-pojo
+${project.version}
+test
+test-jar
+
+
+org.reflections
+reflections
+0.9.9
+
+
+org.apache.maven
+maven-aether-provider
+3.3.3
+
+
+org.apache.maven
+maven-artifact
+3.3.3
+provided
+
+
+org.apache.maven
+maven-compat
+3.3.3
+test
+
+
+org.apache.maven
+maven-core
+3.3.3
+
+
+org.sonatype.aether
+*
+
+
+
+
+org.apache.maven
+maven-plugin-api
+3.3.3
+
+
+org.apache.maven.plugins
+maven-resources-plugin
+2.7
+
+
+org.apache.maven
+*
+
+
+
+
+org.codehaus.plexus
+plexus-utils
+3.0.15
+
+
+org.apache.maven.plugins
+maven-plugin-plugin
+3.4
+
+
+commons-logging
+commons-logging
+
+
+
+
+org.apache.maven.plugin-tools
+maven-plugin-tools-api
+3.3
+
+
+org.apache.maven.plugin-tools
+maven-plugin-annotations
+3.3
+
+
+org.apache.maven.plugin-tools
+maven-plugin-tools-generators
+3.3
+
+
+org.apache.maven.plugin-testing
+maven-plugin-testing-harness
+3.3.0
+test
+
+
+junit
+junit
+test
+
+
+commons-lang
+commons-lang
+2.6
+
+
+j

[35/38] incubator-streams git commit: version bump

2016-10-12 Thread sblackmon
version bump


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/18a29b00
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/18a29b00
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/18a29b00

Branch: refs/heads/master
Commit: 18a29b0079f68eaae008e4eabcc5929e124dc63b
Parents: abc58b4
Author: Steve Blackmon @steveblackmon 
Authored: Wed Oct 12 12:27:44 2016 -0500
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Oct 12 12:27:44 2016 -0500

--
 streams-plugins/pom.xml   | 2 +-
 streams-plugins/streams-plugin-scala/pom.xml  | 7 +--
 .../src/test/resources/streams-plugin-scala/pom.xml   | 4 ++--
 streams-pojo/pom.xml  | 2 +-
 4 files changed, 9 insertions(+), 6 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/18a29b00/streams-plugins/pom.xml
--
diff --git a/streams-plugins/pom.xml b/streams-plugins/pom.xml
index f2c8999..c79e5c2 100644
--- a/streams-plugins/pom.xml
+++ b/streams-plugins/pom.xml
@@ -22,7 +22,7 @@
 
 streams-project
 org.apache.streams
-0.3-incubating-SNAPSHOT
+0.4-incubating-SNAPSHOT
 ../pom.xml
 
 

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/18a29b00/streams-plugins/streams-plugin-scala/pom.xml
--
diff --git a/streams-plugins/streams-plugin-scala/pom.xml 
b/streams-plugins/streams-plugin-scala/pom.xml
index 3988142..1e50141 100644
--- a/streams-plugins/streams-plugin-scala/pom.xml
+++ b/streams-plugins/streams-plugin-scala/pom.xml
@@ -21,13 +21,13 @@
 4.0.0
 org.apache.streams.plugins
 streams-plugin-scala
-0.3-incubating-SNAPSHOT
+0.4-incubating-SNAPSHOT
 maven-plugin
 
 
 org.apache.streams
 streams-plugins
-0.3-incubating-SNAPSHOT
+0.4-incubating-SNAPSHOT
 
 
 
@@ -248,6 +248,9 @@
 
 
 
+
+${scala.version}
+
 
 
 

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/18a29b00/streams-plugins/streams-plugin-scala/src/test/resources/streams-plugin-scala/pom.xml
--
diff --git 
a/streams-plugins/streams-plugin-scala/src/test/resources/streams-plugin-scala/pom.xml
 
b/streams-plugins/streams-plugin-scala/src/test/resources/streams-plugin-scala/pom.xml
index b4867a0..3179e95 100644
--- 
a/streams-plugins/streams-plugin-scala/src/test/resources/streams-plugin-scala/pom.xml
+++ 
b/streams-plugins/streams-plugin-scala/src/test/resources/streams-plugin-scala/pom.xml
@@ -5,7 +5,7 @@
 
 org.apache.streams.plugins
 streams-plugin-scala-test
-0.3-incubating-SNAPSHOT
+0.4-incubating-SNAPSHOT
 jar
 Test StreamsPojoScalaMojo
 
@@ -22,7 +22,7 @@
 
 org.apache.streams.plugins
 streams-plugin-scala
-0.3-incubating-SNAPSHOT
+0.4-incubating-SNAPSHOT
 
 org.apache.streams.pojo.json
 target/test-classes/streams-scala-plugin/

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/18a29b00/streams-pojo/pom.xml
--
diff --git a/streams-pojo/pom.xml b/streams-pojo/pom.xml
index eab4b59..e3f5d3f 100644
--- a/streams-pojo/pom.xml
+++ b/streams-pojo/pom.xml
@@ -64,7 +64,7 @@
 
 
 com.fasterxml.jackson.module
-jackson-module-scala_2.10
+jackson-module-scala_${scala.suffix}
 
 
 



[19/38] incubator-streams git commit: WIP for apachecon

2016-10-12 Thread sblackmon
http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-plugins/streams-plugin-pojo/src/test/java/org/apache/streams/plugins/test/StreamsPojoSourceGeneratorTest.java
--
diff --git 
a/streams-plugins/streams-plugin-pojo/src/test/java/org/apache/streams/plugins/test/StreamsPojoSourceGeneratorTest.java
 
b/streams-plugins/streams-plugin-pojo/src/test/java/org/apache/streams/plugins/test/StreamsPojoSourceGeneratorTest.java
index 667661f..8d904af 100644
--- 
a/streams-plugins/streams-plugin-pojo/src/test/java/org/apache/streams/plugins/test/StreamsPojoSourceGeneratorTest.java
+++ 
b/streams-plugins/streams-plugin-pojo/src/test/java/org/apache/streams/plugins/test/StreamsPojoSourceGeneratorTest.java
@@ -1,14 +1,19 @@
 package org.apache.streams.plugins.test;
 
+import com.google.common.base.Predicate;
 import com.google.common.collect.Lists;
+import com.google.common.io.Files;
 import org.apache.streams.plugins.StreamsPojoGenerationConfig;
 import org.apache.streams.plugins.StreamsPojoSourceGenerator;
+import org.junit.Ignore;
 import org.junit.Test;
 import org.slf4j.Logger;
 import org.slf4j.LoggerFactory;
 
+import javax.annotation.Nullable;
 import java.io.File;
 import java.io.FileFilter;
+import java.util.Collection;
 import java.util.List;
 
 /**
@@ -18,6 +23,15 @@ public class StreamsPojoSourceGeneratorTest {
 
 private final static Logger LOGGER = 
LoggerFactory.getLogger(StreamsPojoSourceGeneratorTest.class);
 
+public static final Predicate javaFilter = new Predicate() {
+@Override
+public boolean apply(@Nullable File file) {
+if( file.getName().endsWith(".java") )
+return true;
+else return false;
+}
+};
+
 /**
  * Tests that all example activities can be loaded into Activity beans
  *
@@ -54,18 +68,16 @@ public class StreamsPojoSourceGeneratorTest {
 }
 
 File testOutput = new File( "target/generated-sources/test");
-FileFilter javaFilter = new FileFilter() {
-@Override
-public boolean accept(File pathname) {
-if( pathname.getName().endsWith(".java") )
-return true;
-return false;
-}
-};
 
 assert( testOutput != null );
 assert( testOutput.exists() == true );
 assert( testOutput.isDirectory() == true );
+
+Iterable outputIterator = 
Files.fileTreeTraverser().breadthFirstTraversal(testOutput)
+.filter(javaFilter);
+Collection outputCollection = Lists.newArrayList(outputIterator);
+assert( outputCollection.size() > 133 );
+
 //assert( testOutput.listFiles(javaFilter).length == 11 );
 //assert( new File(testOutput + "/traits").exists() == true );
 //assert( new File(testOutput + "/traits").isDirectory() == true );

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-plugins/streams-plugin-pojo/src/test/resources/streams-plugin-pojo/pom.xml
--
diff --git 
a/streams-plugins/streams-plugin-pojo/src/test/resources/streams-plugin-pojo/pom.xml
 
b/streams-plugins/streams-plugin-pojo/src/test/resources/streams-plugin-pojo/pom.xml
index 359179e..21fd50e 100644
--- 
a/streams-plugins/streams-plugin-pojo/src/test/resources/streams-plugin-pojo/pom.xml
+++ 
b/streams-plugins/streams-plugin-pojo/src/test/resources/streams-plugin-pojo/pom.xml
@@ -104,6 +104,7 @@
 
 org.codehaus.mojo
 build-helper-maven-plugin
+1.8
 
 
 add-source

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/main/java/org/apache/streams/schema/FieldUtil.java
--
diff --git 
a/streams-schemas/src/main/java/org/apache/streams/schema/FieldUtil.java 
b/streams-schemas/src/main/java/org/apache/streams/schema/FieldUtil.java
index 5f83767..4173e50 100644
--- a/streams-schemas/src/main/java/org/apache/streams/schema/FieldUtil.java
+++ b/streams-schemas/src/main/java/org/apache/streams/schema/FieldUtil.java
@@ -1,11 +1,20 @@
 package org.apache.streams.schema;
 
+import com.fasterxml.jackson.databind.JsonNode;
 import com.fasterxml.jackson.databind.node.ObjectNode;
+import com.google.common.collect.ImmutableList;
+import com.google.common.collect.Lists;
+
+import java.util.Collection;
+import java.util.List;
+import java.util.Map;
+import java.util.Set;
 
 /**
  * Created by steve on 5/1/16.
  */
 public class FieldUtil {
+
 public static FieldType determineFieldType(ObjectNode fieldNode) {
 String typeSchemaField = "type";
 if( !fieldNode.has(typeSchemaField))
@@ -26,4 +35,25 @@ public class FieldUtil {
 }
 else return null;
 }

[13/38] incubator-streams git commit: start of implementation for STREAMS-398

2016-10-12 Thread sblackmon
start of implementation for STREAMS-398


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/50f67bf8
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/50f67bf8
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/50f67bf8

Branch: refs/heads/master
Commit: 50f67bf8d97a61bb325f8524472f5c20e86287d0
Parents: 0e7fbcb
Author: Steve Blackmon (@steveblackmon) 
Authored: Tue Dec 29 17:19:15 2015 -0600
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Jun 1 12:49:27 2016 -0500

--
 streams-plugins/pom.xml |  56 
 streams-plugins/streams-plugin-hive/pom.xml | 232 +++
 .../apache/streams/plugins/StreamsPojoHive.java | 242 +++
 .../streams/plugins/StreamsPojoHiveMojo.java|  71 +
 .../plugins/test/StreamsPojoHiveTest.java   |  55 
 .../src/test/resources/Tweet.hql| 297 +++
 .../test/resources/streams-plugin-hive/pom.xml  |  42 +++
 7 files changed, 995 insertions(+)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/50f67bf8/streams-plugins/pom.xml
--
diff --git a/streams-plugins/pom.xml b/streams-plugins/pom.xml
new file mode 100644
index 000..2306aab
--- /dev/null
+++ b/streams-plugins/pom.xml
@@ -0,0 +1,56 @@
+
+
+
+http://maven.apache.org/POM/4.0.0"; 
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; 
xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 
http://maven.apache.org/xsd/maven-4.0.0.xsd";>
+4.0.0
+
+streams-project
+org.apache.streams
+0.3-incubating-SNAPSHOT
+../pom.xml
+
+
+streams-plugins
+
+pom
+streams-plugins
+
+
+
+
+
+
+streams-plugin-scala
+   
+
+
+
+
+org.apache.streams
+streams-config
+${project.version}
+
+
+org.apache.streams
+streams-pojo
+${project.version}
+
+
+
+

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/50f67bf8/streams-plugins/streams-plugin-hive/pom.xml
--
diff --git a/streams-plugins/streams-plugin-hive/pom.xml 
b/streams-plugins/streams-plugin-hive/pom.xml
new file mode 100644
index 000..cbc055b
--- /dev/null
+++ b/streams-plugins/streams-plugin-hive/pom.xml
@@ -0,0 +1,232 @@
+
+
+http://maven.apache.org/POM/4.0.0"; 
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; 
xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 
http://maven.apache.org/xsd/maven-4.0.0.xsd";>
+
+4.0.0
+org.apache.streams.plugins
+streams-plugin-hive
+0.3-incubating-SNAPSHOT
+maven-plugin
+
+
+org.apache.streams
+streams-plugins
+0.3-incubating-SNAPSHOT
+..
+
+
+
+1.14
+
+
+
+
+org.apache.streams
+streams-config
+${project.version}
+
+
+org.apache.streams
+streams-core
+${project.version}
+
+
+org.jsonschema2pojo
+jsonschema2pojo-core
+
+
+org.apache.streams
+streams-pojo
+${project.version}
+test
+test-jar
+
+
+org.reflections
+reflections
+0.9.9
+
+
+org.apache.maven
+maven-aether-provider
+3.3.3
+
+
+org.apache.maven
+maven-artifact
+3.3.3
+provided
+
+
+org.apache.maven
+maven-compat
+3.3.3
+test
+
+
+org.apache.maven
+maven-core
+3.3.3
+
+
+org.sonatype.aether
+*
+
+
+
+
+org.apache.maven
+maven-plugin-api
+3.3.3
+
+
+org.apache.maven.plugins
+maven-resources-plugin
+2.7
+
+
+org.apache.maven
+*
+
+
+
+
+org.codehaus.plexus
+plexus-utils
+3.0.15
+
+
+org.apache.maven.plugins
+maven-plugin-plugin
+3.4
+
+
+commons-logging
+commons-logging
+
+
+
+  

[30/38] incubator-streams git commit: refactoring, testing, documentation, CLI modes

2016-10-12 Thread sblackmon
http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/d9674f7c/streams-plugins/streams-plugin-scala/pom.xml
--
diff --git a/streams-plugins/streams-plugin-scala/pom.xml 
b/streams-plugins/streams-plugin-scala/pom.xml
index f718260..3988142 100644
--- a/streams-plugins/streams-plugin-scala/pom.xml
+++ b/streams-plugins/streams-plugin-scala/pom.xml
@@ -42,6 +42,18 @@
 ${project.version}
 
 
+org.apache.streams
+streams-util
+${project.version}
+
+
+org.apache.streams
+streams-schema-activitystreams
+${project.version}
+test-jar
+test
+
+
 org.jsonschema2pojo
 jsonschema2pojo-core
 

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/d9674f7c/streams-plugins/streams-plugin-scala/src/main/java/org/apache/streams/plugins/StreamsPojoScala.java
--
diff --git 
a/streams-plugins/streams-plugin-scala/src/main/java/org/apache/streams/plugins/StreamsPojoScala.java
 
b/streams-plugins/streams-plugin-scala/src/main/java/org/apache/streams/plugins/StreamsPojoScala.java
deleted file mode 100644
index 1c3e317..000
--- 
a/streams-plugins/streams-plugin-scala/src/main/java/org/apache/streams/plugins/StreamsPojoScala.java
+++ /dev/null
@@ -1,371 +0,0 @@
-package org.apache.streams.plugins;
-
-import com.google.common.base.Strings;
-import com.google.common.collect.Iterables;
-import com.google.common.collect.Lists;
-import com.google.common.collect.Maps;
-import com.google.common.collect.Sets;
-import org.apache.streams.data.DocumentClassifier;
-import org.reflections.ReflectionUtils;
-import org.reflections.Reflections;
-import org.reflections.scanners.SubTypesScanner;
-import org.reflections.scanners.TypeAnnotationsScanner;
-import org.reflections.util.ClasspathHelper;
-import org.reflections.util.ConfigurationBuilder;
-import org.reflections.ReflectionUtils.*;
-import org.slf4j.Logger;
-import org.slf4j.LoggerFactory;
-
-import javax.annotation.Generated;
-import java.io.File;
-import java.io.IOException;
-import java.io.Serializable;
-import java.lang.reflect.Field;
-import java.nio.file.Files;
-import java.nio.file.OpenOption;
-import java.nio.file.Paths;
-import java.nio.file.StandardOpenOption;
-import java.util.Collections;
-import java.util.Iterator;
-import java.util.List;
-import java.util.Map;
-import java.util.Set;
-import java.util.TreeSet;
-import java.util.concurrent.ConcurrentHashMap;
-
-/**
- * Created by sblackmon on 11/18/15.
- */
-public class StreamsPojoScala implements Runnable {
-
-private final static Logger LOGGER = 
LoggerFactory.getLogger(StreamsPojoScala.class);
-
-private final static String LS = System.getProperty("line.separator");
-
-private StreamsPojoScalaMojo mojo;
-
-String outDir = "./target/generated-sources/scala";
-String packages = "org.apache.streams.pojo.json";
-
-private final Reflections reflections = new Reflections(
-new ConfigurationBuilder()
-// TODO
-.forPackages(packages)
-.setScanners(
-new SubTypesScanner(),
-new TypeAnnotationsScanner()));
-
-public void main(String[] args) {
-StreamsPojoScala streamsPojoScala = new StreamsPojoScala();
-Thread thread = new Thread(streamsPojoScala);
-thread.start();
-try {
-thread.join();
-} catch (InterruptedException e) {
-LOGGER.error("InterruptedException", e);
-} catch (Exception e) {
-LOGGER.error("Exception", e);
-}
-return;
-}
-
-public StreamsPojoScala(StreamsPojoScalaMojo mojo) {
-this.mojo = mojo;
-if (mojo != null &&
-mojo.getTarget() != null &&
-!Strings.isNullOrEmpty(mojo.getTarget().getAbsolutePath())
-)
-outDir = mojo.getTarget().getAbsolutePath();
-
-if (mojo != null &&
-mojo.getPackages() != null &&
-!Strings.isNullOrEmpty(mojo.getPackages())
-)
-packages = mojo.getPackages();
-}
-
-public StreamsPojoScala() {
-}
-
-public void run() {
-
-List> serializableClasses = detectSerializableClasses();
-
-LOGGER.info("Detected {} serialiables:", serializableClasses.size());
-for( Class clazz : serializableClasses )
-LOGGER.debug(clazz.toString());
-
-List> pojoClasses = detectPojoClasses(serializableClasses);
-
-LOGGER.info("Detected {} pojos:", pojoClasses.size());
-for( Class clazz : pojoClasses )
-LOGGER.debug(clazz.toString());
-
-List> traits = detectTraits(pojoClasses);
-
-LOGGER.i

[11/38] incubator-streams git commit: hive generation is looking pretty good

2016-10-12 Thread sblackmon
hive generation is looking pretty good


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/e84dcd72
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/e84dcd72
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/e84dcd72

Branch: refs/heads/master
Commit: e84dcd7230f02087db2b6bf7ea6d2148d585e77d
Parents: 7b8ef0a
Author: Steve Blackmon @steveblackmon 
Authored: Tue May 3 16:32:58 2016 -0500
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Jun 1 12:49:27 2016 -0500

--
 streams-plugins/streams-plugin-hive/pom.xml |  23 +-
 .../plugins/StreamsHiveResourceGenerator.java   | 221 -
 .../StreamsHiveResourceGeneratorMojo.java   |  68 
 .../hive/StreamsHiveGenerationConfig.java   |  84 +
 .../hive/StreamsHiveResourceGenerator.java  | 322 +++
 .../hive/StreamsHiveResourceGeneratorMojo.java  |  76 +
 .../test/StreamsHiveResourceGeneratorTest.java  |  88 -
 .../src/test/resources/expected/activity.hql| 203 
 .../src/test/resources/expected/collection.hql  |  47 +++
 .../src/test/resources/expected/media_link.hql  |  11 +
 .../src/test/resources/expected/object.hql  |  61 
 .../resources/expected/objectTypes/place.hql|  79 +
 .../test/resources/expected/verbs/purchase.hql  | 203 
 streams-schemas/pom.xml |  37 ++-
 .../org/apache/streams/schema/FieldType.java|  13 +
 .../org/apache/streams/schema/FieldUtil.java|  29 ++
 .../org/apache/streams/schema/FileUtil.java |  69 
 .../apache/streams/schema/GenerationConfig.java | 115 +++
 .../java/org/apache/streams/schema/Schema.java  |  57 
 .../org/apache/streams/schema/SchemaStore.java  | 283 
 .../org/apache/streams/schema/SchemaUtil.java   |  50 +++
 .../java/org/apache/streams/schema/URIUtil.java |  31 ++
 22 files changed, 1860 insertions(+), 310 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/e84dcd72/streams-plugins/streams-plugin-hive/pom.xml
--
diff --git a/streams-plugins/streams-plugin-hive/pom.xml 
b/streams-plugins/streams-plugin-hive/pom.xml
index 22d75ce..b173a8d 100644
--- a/streams-plugins/streams-plugin-hive/pom.xml
+++ b/streams-plugins/streams-plugin-hive/pom.xml
@@ -40,6 +40,12 @@
 org.apache.streams
 streams-config
 ${project.version}
+
+
+commons-logging
+commons-logging
+
+
 
 
 org.apache.streams
@@ -47,15 +53,13 @@
 ${project.version}
 
 
-org.jsonschema2pojo
-jsonschema2pojo-core
-
-
 org.apache.streams
-streams-pojo
+streams-schemas
 ${project.version}
-test
-test-jar
+
+
+com.google.guava
+guava
 
 
 org.reflections
@@ -219,9 +223,10 @@
 unpack-dependencies
 
 
-
streams-pojo
+
org.apache.streams
+
streams-schemas
 **/*.json
-
${project.build.directory}/test-classes
+
${project.build.directory}/test-classes/streams-schemas
 
 
 

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/e84dcd72/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/StreamsHiveResourceGenerator.java
--
diff --git 
a/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/StreamsHiveResourceGenerator.java
 
b/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/StreamsHiveResourceGenerator.java
deleted file mode 100644
index 1efb15e..000
--- 
a/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/StreamsHiveResourceGenerator.java
+++ /dev/null
@@ -1,221 +0,0 @@
-package org.apache.streams.plugins;
-
-import com.google.common.base.Strings;
-import com.google.common.collect.Lists;
-import com.google.common.collect.Maps;
-import org.reflections.ReflectionUtils;
-import org.slf4j.Logger;
-import org.slf4j.LoggerFactory;
-
-import java.io.File;
-import java.io.Serializable;
-import java.lang.reflect.Field;
-import java.nio.file.Files;
-import java.nio.file.Paths;
-import java.nio.file.StandardOpenOption;
-import java.ut

[18/38] incubator-streams git commit: WIP for apachecon

2016-10-12 Thread sblackmon
http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/main/jsonschema/verbs/join.json
--
diff --git a/streams-schemas/src/main/jsonschema/verbs/join.json 
b/streams-schemas/src/main/jsonschema/verbs/join.json
index 78daed8..5276072 100644
--- a/streams-schemas/src/main/jsonschema/verbs/join.json
+++ b/streams-schemas/src/main/jsonschema/verbs/join.json
@@ -4,7 +4,7 @@
 
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
 "http://www.apache.org/licenses/LICENSE-2.0";
 ],
-"id": "#",
+"id": 
"http://streams.incubator.apache.org/site/0.3-incubating-SNAPSHOT/streams-schemas/verbs/join.json#";,
 "type": "object",
 "title": "Join",
 "description": "Indicates that the actor has become a member of the 
object.",

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/main/jsonschema/verbs/leave.json
--
diff --git a/streams-schemas/src/main/jsonschema/verbs/leave.json 
b/streams-schemas/src/main/jsonschema/verbs/leave.json
index 1ce73bc..9995099 100644
--- a/streams-schemas/src/main/jsonschema/verbs/leave.json
+++ b/streams-schemas/src/main/jsonschema/verbs/leave.json
@@ -4,7 +4,7 @@
 
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
 "http://www.apache.org/licenses/LICENSE-2.0";
 ],
-"id": "#",
+"id": 
"http://streams.incubator.apache.org/site/0.3-incubating-SNAPSHOT/streams-schemas/verbs/leave.json#";,
 "type": "object",
 "title": "Leave",
 "description": "Indicates that the actor has left the object. For 
instance, a Person leaving a Group or checking-out of a Place.",

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/main/jsonschema/verbs/like.json
--
diff --git a/streams-schemas/src/main/jsonschema/verbs/like.json 
b/streams-schemas/src/main/jsonschema/verbs/like.json
index 4ac1bf7..d583305 100644
--- a/streams-schemas/src/main/jsonschema/verbs/like.json
+++ b/streams-schemas/src/main/jsonschema/verbs/like.json
@@ -4,7 +4,7 @@
 
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
 "http://www.apache.org/licenses/LICENSE-2.0";
 ],
-"id": "#",
+"id": 
"http://streams.incubator.apache.org/site/0.3-incubating-SNAPSHOT/streams-schemas/verbs/like.json#";,
 "type": "object",
 "title": "Like",
 "description": "Indicates that the actor marked the object as an item of 
special interest.",

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/main/jsonschema/verbs/listen.json
--
diff --git a/streams-schemas/src/main/jsonschema/verbs/listen.json 
b/streams-schemas/src/main/jsonschema/verbs/listen.json
index 3476144..9982ac6 100644
--- a/streams-schemas/src/main/jsonschema/verbs/listen.json
+++ b/streams-schemas/src/main/jsonschema/verbs/listen.json
@@ -4,7 +4,7 @@
 
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
 "http://www.apache.org/licenses/LICENSE-2.0";
 ],
-"id": "#",
+"id": 
"http://streams.incubator.apache.org/site/0.3-incubating-SNAPSHOT/streams-schemas/verbs/listen.json#";,
 "type": "object",
 "title": "Listen",
 "description": "Indicates that the actor has listened to the object. This 
is typically only applicable for objects representing audio content, such as 
music, an audio-book, or a radio broadcast.",

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/main/jsonschema/verbs/lose.json
--
diff --git a/streams-schemas/src/main/jsonschema/verbs/lose.json 
b/streams-schemas/src/main/jsonschema/verbs/lose.json
index 60899ba..1d959a4 100644
--- a/streams-schemas/src/main/jsonschema/verbs/lose.json
+++ b/streams-schemas/src/main/jsonschema/verbs/lose.json
@@ -4,7 +4,7 @@
 
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
 "http://www.apache.org/licenses/LICENSE-2.0";
 ],
-"id": "#",
+"id": 
"http://streams.incubator.apache.org/site/0.3-incubating-SNAPSHOT/streams-schemas/verbs/lose.json#";,
 "type": "object",
 "title": "Lose",
 "description": "Indicates that the actor has lost the object. For 
instance, if a person loses a game.",

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/main/jsonschema/verbs/make-friend.json
--
diff --git a/streams-schemas/src/main/jsonschema/verbs/make-friend.json 
b/streams-schemas/src/main/jsonschema/verbs/make-friend.json
index a64

[22/38] incubator-streams git commit: WIP for apachecon

2016-10-12 Thread sblackmon
WIP for apachecon


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/1bc84dbc
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/1bc84dbc
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/1bc84dbc

Branch: refs/heads/master
Commit: 1bc84dbc614cc0537e3238a6786a005f609b429c
Parents: 114c1c5
Author: Steve Blackmon @steveblackmon 
Authored: Fri May 6 19:45:12 2016 -0500
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Jun 1 12:51:43 2016 -0500

--
 pom.xml |  10 -
 streams-config/pom.xml  |   2 +-
 .../spring/streams-cassandra-context.xml|  25 ++
 .../src/main/jsonschema/com/twitter/tweet.json  |   6 +-
 streams-plugins/pom.xml |   4 +
 .../streams-plugin-cassandra/pom.xml| 244 
 .../StreamsCassandraGenerationConfig.java   |  81 
 .../StreamsCassandraResourceGenerator.java  | 376 +++
 .../StreamsCassandraResourceGeneratorMojo.java  |  93 +
 .../src/site/markdown/index.md  |  22 ++
 ...treamsCassandraResourceGeneratorCLITest.java |  50 +++
 ...reamsCassandraResourceGeneratorMojoTest.java |  75 
 .../StreamsCassandraResourceGeneratorTest.java  | 124 ++
 .../resources/streams-plugin-cassandra/pom.xml  |  75 
 .../streams-plugin-elasticsearch/pom.xml| 245 
 .../StreamsElasticsearchGenerationConfig.java   |  81 
 .../StreamsElasticsearchResourceGenerator.java  | 373 ++
 ...reamsElasticsearchResourceGeneratorMojo.java |  93 +
 .../src/site/markdown/index.md  |  22 ++
 ...sElasticsearchResourceGeneratorMojoTest.java |  50 +++
 ...reamsElasticsearchResourceGeneratorTest.java | 139 +++
 .../streams-plugin-elasticsearch/pom.xml|  75 
 streams-plugins/streams-plugin-hbase/pom.xml| 244 
 .../hbase/StreamsHbaseGenerationConfig.java |  90 +
 .../hbase/StreamsHbaseResourceGenerator.java| 204 ++
 .../StreamsHbaseResourceGeneratorMojo.java  |  93 +
 .../src/site/markdown/index.md  |  22 ++
 .../StreamsHbaseResourceGeneratorCLITest.java   |  41 ++
 .../StreamsHbaseResourceGeneratorMojoTest.java  |  65 
 .../test/StreamsHbaseResourceGeneratorTest.java | 125 ++
 .../test/resources/streams-plugin-hbase/pom.xml |  76 
 streams-plugins/streams-plugin-hive/pom.xml |   6 +
 .../hive/StreamsHiveResourceGenerator.java  |   7 +-
 .../hive/StreamsHiveResourceGeneratorMojo.java  |  33 +-
 .../src/site/markdown/index.md  |  22 ++
 .../StreamsHiveResourceGeneratorCLITest.java|  41 ++
 .../StreamsHiveResourceGeneratorMojoTest.java   |  64 
 .../test/StreamsHiveResourceGeneratorTest.java  |  21 +-
 .../test/resources/streams-plugin-hive/pom.xml  |  41 +-
 streams-plugins/streams-plugin-pig/pom.xml  | 244 
 .../plugins/pig/StreamsPigGenerationConfig.java |  84 +
 .../pig/StreamsPigResourceGenerator.java| 317 
 .../pig/StreamsPigResourceGeneratorMojo.java|  93 +
 .../src/site/markdown/index.md  |  22 ++
 .../StreamsPigResourceGeneratorCLITest.java |  39 ++
 .../StreamsPigResourceGeneratorMojoTest.java|  64 
 .../test/StreamsPigResourceGeneratorTest.java   | 122 ++
 .../src/test/resources/expected/media_link.pig  |   1 +
 .../resources/expected/objectTypes/file.pig |   1 +
 .../expected/objectTypes/photo-album.pig|   1 +
 .../test/resources/streams-plugin-pig/pom.xml   |  75 
 streams-plugins/streams-plugin-pojo/pom.xml |   7 -
 .../plugins/StreamsPojoSourceGenerator.java |  16 +-
 .../plugins/StreamsPojoSourceGeneratorMojo.java |  43 +--
 .../src/site/markdown/index.md  |  22 ++
 .../test/StreamsPojoSourceGeneratorCLITest.java |  43 +++
 .../StreamsPojoSourceGeneratorMojoTest.java |  68 +---
 .../test/StreamsPojoSourceGeneratorTest.java|  28 +-
 .../test/resources/streams-plugin-pojo/pom.xml  |   1 +
 .../org/apache/streams/schema/FieldUtil.java|  30 ++
 .../org/apache/streams/schema/FileUtil.java |  13 +-
 .../apache/streams/schema/GenerationConfig.java |   4 +-
 .../org/apache/streams/schema/SchemaUtil.java   |   4 +-
 .../src/main/jsonschema/activity.json   |  10 +-
 .../src/main/jsonschema/collection.json |   2 +-
 .../src/main/jsonschema/media_link.json |   2 +-
 streams-schemas/src/main/jsonschema/object.json |   6 +-
 .../src/main/jsonschema/objectTypes/alert.json  |   2 +-
 .../jsonschema/objectTypes/application.json |   2 +-
 .../main/jsonschema/objectTypes/article.json|   2 +-
 .../src/main/jsonschema/objectTypes/audio.json  |   2 +-
 .../src/main/jsonschema/objectTypes/badge.json  |   2 +-
 .../src/main/jsonsche

Build failed in Jenkins: Streams Trunk #231

2016-10-12 Thread Apache Jenkins Server
See 

Changes:

[sblackmon] first take at STREAMS-389:

[sblackmon] start of implementation for STREAMS-398

[sblackmon] create streams-plugin-pojo

[sblackmon] rename Hive Generator

[sblackmon] test pom for streams-plugin-pojo

[sblackmon] STREAMS-398 - streams-schemas

[sblackmon] STREAMS-398 - pojo generation

[sblackmon] hive generation is looking pretty good

[sblackmon] re-enable hive plugin

[sblackmon] WIP for apachecon

[sblackmon] first take at STREAMS-389:

[sblackmon] refactoring, testing, documentation, CLI modes

[sblackmon] version bump

[sblackmon] pom version bump

[sblackmon] remove extra classes from merge

[sblackmon] remove version declaration from test

--
Started by user sblackmon
[EnvInject] - Loading node environment variables.
Building remotely on ubuntu-2 (Ubuntu yahoo-not-h2 ubuntu docker) in workspace 

Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://git-wip-us.apache.org/repos/asf/incubator-streams.git
 > git init  # timeout=10
Fetching upstream changes from 
https://git-wip-us.apache.org/repos/asf/incubator-streams.git
 > git --version # timeout=10
 > git -c core.askpass=true fetch --tags --progress 
 > https://git-wip-us.apache.org/repos/asf/incubator-streams.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git config remote.origin.url 
 > https://git-wip-us.apache.org/repos/asf/incubator-streams.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # 
 > timeout=10
 > git config remote.origin.url 
 > https://git-wip-us.apache.org/repos/asf/incubator-streams.git # timeout=10
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=10
No valid HEAD. Skipping the resetting
 > git clean -fdx # timeout=10
Fetching upstream changes from 
https://git-wip-us.apache.org/repos/asf/incubator-streams.git
 > git -c core.askpass=true fetch --tags --progress 
 > https://git-wip-us.apache.org/repos/asf/incubator-streams.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision b21ec4b5028f8fa65ea2223e22af7d7c7bf16d4a (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f b21ec4b5028f8fa65ea2223e22af7d7c7bf16d4a
 > git rev-list f14a25cedc6c41f1331fb8783cce1c59f4eb1961 # timeout=10
Parsing POMs
using settings config with name simple-deploy-settings-no-mirror
Replacing all maven server entries not found in credentials list is true
Downloaded artifact 
https://repository.apache.org/content/repositories/snapshots/org/apache/streams/streams-master/0.4-incubating-SNAPSHOT/maven-metadata.xml
Downloaded artifact 
https://repository.apache.org/content/repositories/snapshots/org/apache/streams/streams-master/0.4-incubating-SNAPSHOT/streams-master-0.4-incubating-20161007.194956-5.pom
Failed to transfer Could not find metadata 
org.apache.streams:streams-master:0.4-incubating-SNAPSHOT/maven-metadata.xml in 
sonatype (https://oss.sonatype.org/content/repositories/snapshots)
Failed to transfer Could not find metadata 
org.apache.streams:streams-master:0.4-incubating-SNAPSHOT/maven-metadata.xml in 
typesafe (http://repo.typesafe.com/typesafe/repo)
Failed to transfer Could not find metadata 
org.apache.streams:streams-master:0.4-incubating-SNAPSHOT/maven-metadata.xml in 
google-api-services (http://google-api-client-libraries.appspot.com/mavenrepo)
ERROR: Failed to parse POMs
java.io.IOException: remote file operation failed: 
 at 
hudson.remoting.Channel@7366df2e:ubuntu-2: hudson.remoting.ProxyException: 
hudson.maven.MavenModuleSetBuild$MavenExecutionException: 
org.apache.maven.project.ProjectBuildingException: Some problems were 
encountered while processing the POMs:
[WARNING] 'dependencies.dependency.exclusions.exclusion.artifactId' for 
org.apache.streams:streams-persist-hdfs:jar with value '*' does not match a 
valid id pattern. @ line 78, column 33
[ERROR] 'dependencies.dependency.artifactId' for 
com.fasterxml.jackson.module:jackson-module-scala_${scala.suffix}:jar with 
value 'jackson-module-scala_${scala.suffix}' does not match a valid id pattern. 
@ line 67, column 25
[ERROR] 'dependencies.dependency.version' for 
com.fasterxml.jackson.module:jackson-module-scala_${scala.suffix}:jar is 
missing. @ line 65, column 21
[WARNING] 'dependencies.dependency.exclusions.exclusion.artifactId' for 
org.apache.maven:maven-core:jar with value '*' does not match a valid id 
pattern. @ line 100, column 33
[WARNING] 'dependencies.dependency.exclusions.exclusion.artifactId' for 
org.apache.maven.plugins:maven-resources-plugin:jar with value '*' does not 
match a valid id pattern. @ line 116, column 33
[WARNING] 'dependencies.dependency.exclusions.exclusion.artifactId' for 
org.apache.maven:maven-

[17/38] incubator-streams git commit: WIP for apachecon

2016-10-12 Thread sblackmon
http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/site/resources/objectTypes/note.json
--
diff --git a/streams-schemas/src/site/resources/objectTypes/note.json 
b/streams-schemas/src/site/resources/objectTypes/note.json
deleted file mode 100644
index 09de97c..000
--- a/streams-schemas/src/site/resources/objectTypes/note.json
+++ /dev/null
@@ -1,19 +0,0 @@
-{
-"$schema": "http://json-schema.org/draft-03/schema";,
-"$license": [
-
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
-"http://www.apache.org/licenses/LICENSE-2.0";
-],
-"id": "#",
-"type": "object",
-"title": "note",
-"extends": {
-"$ref": "../object.json"
-},
-"properties": {
-"objectType": {
-"type": "string",
-"default": "note"
-}
-}
-}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/site/resources/objectTypes/offer.json
--
diff --git a/streams-schemas/src/site/resources/objectTypes/offer.json 
b/streams-schemas/src/site/resources/objectTypes/offer.json
deleted file mode 100644
index 38db718..000
--- a/streams-schemas/src/site/resources/objectTypes/offer.json
+++ /dev/null
@@ -1,19 +0,0 @@
-{
-"$schema": "http://json-schema.org/draft-03/schema";,
-"$license": [
-
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
-"http://www.apache.org/licenses/LICENSE-2.0";
-],
-"id": "#",
-"type": "object",
-"title": "offer",
-"extends": {
-"$ref": "../object.json"
-},
-"properties": {
-"objectType": {
-"type": "string",
-"default": "offer"
-}
-}
-}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/site/resources/objectTypes/organization.json
--
diff --git a/streams-schemas/src/site/resources/objectTypes/organization.json 
b/streams-schemas/src/site/resources/objectTypes/organization.json
deleted file mode 100644
index a3fd5a2..000
--- a/streams-schemas/src/site/resources/objectTypes/organization.json
+++ /dev/null
@@ -1,19 +0,0 @@
-{
-"$schema": "http://json-schema.org/draft-03/schema";,
-"$license": [
-
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
-"http://www.apache.org/licenses/LICENSE-2.0";
-],
-"id": "#",
-"type": "object",
-"title": "organization",
-"extends": {
-"$ref": "../object.json"
-},
-"properties": {
-"objectType": {
-"type": "string",
-"default": "organization"
-}
-}
-}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/site/resources/objectTypes/page.json
--
diff --git a/streams-schemas/src/site/resources/objectTypes/page.json 
b/streams-schemas/src/site/resources/objectTypes/page.json
deleted file mode 100644
index 4f76aa2..000
--- a/streams-schemas/src/site/resources/objectTypes/page.json
+++ /dev/null
@@ -1,19 +0,0 @@
-{
-"$schema": "http://json-schema.org/draft-03/schema";,
-"$license": [
-
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
-"http://www.apache.org/licenses/LICENSE-2.0";
-],
-"id": "#",
-"type": "object",
-"title": "page",
-"extends": {
-"$ref": "../object.json"
-},
-"properties": {
-"objectType": {
-"type": "string",
-"default": "page"
-}
-}
-}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/site/resources/objectTypes/permission.json
--
diff --git a/streams-schemas/src/site/resources/objectTypes/permission.json 
b/streams-schemas/src/site/resources/objectTypes/permission.json
deleted file mode 100644
index 32b395c..000
--- a/streams-schemas/src/site/resources/objectTypes/permission.json
+++ /dev/null
@@ -1,36 +0,0 @@
-{
-"$schema": "http://json-schema.org/draft-03/schema";,
-"$license": [
-
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
-"http://www.apache.org/licenses/LICENSE-2.0";
-],
-"id": "#",
-"type": "object",
-"title": "permission",
-"extends": {
-"$ref": "../object.json"
-},
-"properties": {
-"objectType": {
-"type": "string",
-"default": "permission"
-},
-"scope": {
-"type": "object",
-"extends": {
-  "$ref": "../object.json"
-}
-},
-"actions": 

[26/38] incubator-streams git commit: refactoring, testing, documentation, CLI modes

2016-10-12 Thread sblackmon
http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/d9674f7c/streams-schemas/src/test/resources/objects/event.json
--
diff --git a/streams-schemas/src/test/resources/objects/event.json 
b/streams-schemas/src/test/resources/objects/event.json
deleted file mode 100644
index ae1108e..000
--- a/streams-schemas/src/test/resources/objects/event.json
+++ /dev/null
@@ -1,18 +0,0 @@
-{
-"objectType": "event",
-"displayName": "Meeting with Joe",
-"startTime": "2012-12-12T12:00:00Z",
-"endTime: "2012-12-12T13:00:00Z",
-"invited": {
-  "items": [
-{"objectType": "person",
- "displayName": "Joe"}
-  ]
-},
-"attending": {
-  "items": [
-{"objectType": "person",
- "displayName": "Joe"}
-  ]
-}
-}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/d9674f7c/streams-schemas/src/test/resources/objects/group.json
--
diff --git a/streams-schemas/src/test/resources/objects/group.json 
b/streams-schemas/src/test/resources/objects/group.json
deleted file mode 100644
index 9721874..000
--- a/streams-schemas/src/test/resources/objects/group.json
+++ /dev/null
@@ -1,16 +0,0 @@
-{
-  "objectType": "group",
-  "displayName": "My Work Group",
-  "members": {
-   "items": [
- {
-   "objectType": "person",
-   "displayName": "Laura"
- },
- {
-   "objectType": "person",
-   "displayName": "Mark"
- }
-   ]
-  }
-}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/d9674f7c/streams-schemas/src/test/resources/objects/issue.json
--
diff --git a/streams-schemas/src/test/resources/objects/issue.json 
b/streams-schemas/src/test/resources/objects/issue.json
deleted file mode 100644
index 86bc6d2..000
--- a/streams-schemas/src/test/resources/objects/issue.json
+++ /dev/null
@@ -1,9 +0,0 @@
-{
-   "objectType": "issue",
-   "displayName": "Terms of Use Violation",
-   "url": "http://.../terms-of-use";,
-   "types": [
-"http://example.org/codes/inappropriateMaterial";,
-"http://example.org/codes/copyrightViolation";
-   ]
-}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/d9674f7c/streams-schemas/src/test/resources/objects/note.json
--
diff --git a/streams-schemas/src/test/resources/objects/note.json 
b/streams-schemas/src/test/resources/objects/note.json
deleted file mode 100644
index 15a4495..000
--- a/streams-schemas/src/test/resources/objects/note.json
+++ /dev/null
@@ -1,12 +0,0 @@
-{
-  "objectType": "note",
-  "displayName": "A note with a binary attachment",
-  "attachments": [
-   {
- "objectType": "binary",
- "data": "dGhpcyBpcyB1bmNvbXByZXNzZWQgZGF0YQo=",
- "md5": "827ae7e1ab45e4dd591d087c741e5770",
- "length": 25
-   }
-  ]
-}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/d9674f7c/streams-schemas/src/test/resources/objects/permission.json
--
diff --git a/streams-schemas/src/test/resources/objects/permission.json 
b/streams-schemas/src/test/resources/objects/permission.json
deleted file mode 100644
index 24b6fa2..000
--- a/streams-schemas/src/test/resources/objects/permission.json
+++ /dev/null
@@ -1,9 +0,0 @@
-{
-"objectType": "permission",
-"displayName": "Permission to Edit File: 2Q2014 Sales Forecast.xls",
-"scope": {
-  "objectType": "file",
-  "displayName": "2Q2014 Sales Forecast.xls"
-},
-"actions": ["modify", "delete", "create"]
-}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/d9674f7c/streams-schemas/src/test/resources/objects/place.json
--
diff --git a/streams-schemas/src/test/resources/objects/place.json 
b/streams-schemas/src/test/resources/objects/place.json
deleted file mode 100644
index 8e454be..000
--- a/streams-schemas/src/test/resources/objects/place.json
+++ /dev/null
@@ -1,9 +0,0 @@
-{
-  "objectType": "place",
-  "displayName": "Some Random Location on Earth",
-  "position": {
-   "latitude": 34.34,
-   "longitude": -127.23,
-   "altitude": 100.05
-  }
-}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/d9674f7c/streams-schemas/src/test/resources/objects/task.json
--
diff --git a/streams-schemas/src/test/resources/objects/task.json 
b/streams-schemas/src/test/resources/objects/task.json
deleted file mode 100644
index f4878dc..000
--- a/streams-schemas/src/test/resources/objects/task.json
+++ /dev/null
@@ -1,16 +0,0 @@
-{
-"objectType": "task",
-"displayName": "

[20/38] incubator-streams git commit: WIP for apachecon

2016-10-12 Thread sblackmon
http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-plugins/streams-plugin-hbase/src/test/resources/streams-plugin-hbase/pom.xml
--
diff --git 
a/streams-plugins/streams-plugin-hbase/src/test/resources/streams-plugin-hbase/pom.xml
 
b/streams-plugins/streams-plugin-hbase/src/test/resources/streams-plugin-hbase/pom.xml
new file mode 100644
index 000..9aa7d8d
--- /dev/null
+++ 
b/streams-plugins/streams-plugin-hbase/src/test/resources/streams-plugin-hbase/pom.xml
@@ -0,0 +1,76 @@
+http://maven.apache.org/POM/4.0.0";
+ xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance";
+ xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 
http://maven.apache.org/xsd/maven-4.0.0.xsd";>
+4.0.0
+
+org.apache.streams.plugins
+streams-plugin-hbase-test
+0.3-incubating-SNAPSHOT
+jar
+Test StreamsHbaseResourceGeneratorMojo
+
+
+
+junit
+junit
+4.11
+test
+
+
+org.apache.streams
+streams-schemas
+${project.version}
+test
+
+
+
+
+
+
+org.apache.streams.plugins
+streams-plugin-hbase
+0.3-incubating-SNAPSHOT
+
+
+
target/test-classes/streams-schemas/activity.json
+
target/test-classes/streams-schemas/collection.json
+
target/test-classes/streams-schemas/media_link.json
+
target/test-classes/streams-schemas/object.json
+
target/test-classes/streams-schemas/objectTypes
+
target/test-classes/streams-schemas/verbs
+
+
target/generated-resources/test-mojo
+cf
+
+
+
+
+hbase
+
+
+
+
+
+org.apache.maven.plugins
+maven-dependency-plugin
+2.10
+
+**/*.json
+
${project.build.directory}/test-classes/streams-schemas
+org.apache.streams
+streams-schemas
+jar,test-jar
+
+
+
+unpack-schemas
+process-resources
+
+unpack-dependencies
+
+
+
+
+
+
+
\ No newline at end of file

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-plugins/streams-plugin-hive/pom.xml
--
diff --git a/streams-plugins/streams-plugin-hive/pom.xml 
b/streams-plugins/streams-plugin-hive/pom.xml
index b173a8d..515314a 100644
--- a/streams-plugins/streams-plugin-hive/pom.xml
+++ b/streams-plugins/streams-plugin-hive/pom.xml
@@ -148,6 +148,12 @@
 test
 
 
+org.apache.maven.shared
+maven-verifier
+1.6
+test
+
+
 junit
 junit
 test

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/hive/StreamsHiveResourceGenerator.java
--
diff --git 
a/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/hive/StreamsHiveResourceGenerator.java
 
b/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/hive/StreamsHiveResourceGenerator.java
index 06c1499..c09f7dd 100644
--- 
a/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/hive/StreamsHiveResourceGenerator.java
+++ 
b/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/hive/StreamsHiveResourceGenerator.java
@@ -46,12 +46,11 @@ public class StreamsHiveResourceGenerator implements 
Runnable {
 
 private int currentDepth = 0;
 
-public void main(String[] args) {
+public static void main(String[] args) {
 StreamsHiveGenerationConfig config = new StreamsHiveGenerationConfig();
 
-String sourceDirectory = "./target/test-classes/activities";
-String targetDirectory = 
"./target/generated-sources/streams-plugin-hive";
-String targetPackage = "";
+String sourceDirectory = "src/main/jsonschema";
+String targetDirectory = "target/generated-resources/hive";
 
 if( args.length > 0 )
 sourceDirectory = args[0];

http://git-wip-us.apache.org/repos/a

[33/38] incubator-streams git commit: Merge remote-tracking branch 'steveblackmon/STREAMS-389'

2016-10-12 Thread sblackmon
Merge remote-tracking branch 'steveblackmon/STREAMS-389'


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/8e929ebf
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/8e929ebf
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/8e929ebf

Branch: refs/heads/master
Commit: 8e929ebf811abf5402514bd5030f064a02157127
Parents: f14a25c c89fe1e
Author: Steve Blackmon @steveblackmon 
Authored: Wed Oct 12 10:50:44 2016 -0500
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Oct 12 10:50:44 2016 -0500

--
 pom.xml |   1 +
 streams-plugins/pom.xml |  56 +++
 streams-plugins/streams-plugin-scala/pom.xml| 243 
 .../streams/plugins/StreamsPojoScala.java   | 371 +++
 .../streams/plugins/StreamsPojoScalaMojo.java   |  71 
 .../plugins/test/StreamsPojoScalaTest.java  |  55 +++
 .../test/resources/streams-plugin-scala/pom.xml |  40 ++
 7 files changed, 837 insertions(+)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/8e929ebf/pom.xml
--
diff --cc pom.xml
index 466e94b,58304e0..48a5ad6
--- a/pom.xml
+++ b/pom.xml
@@@ -174,10 -172,11 +174,11 @@@
  streams-contrib
  streams-components
  streams-monitoring
 -streams-osgi-components
  streams-pojo
  streams-pojo-extensions
+ streams-plugins
  streams-runtimes
 +streams-testing
  streams-util
  streams-verbs
  



[27/38] incubator-streams git commit: refactoring, testing, documentation, CLI modes

2016-10-12 Thread sblackmon
http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/d9674f7c/streams-schemas/src/test/java/org/apache/streams/schema/test/SchemaOrderingTests.java
--
diff --git 
a/streams-schemas/src/test/java/org/apache/streams/schema/test/SchemaOrderingTests.java
 
b/streams-schemas/src/test/java/org/apache/streams/schema/test/SchemaOrderingTests.java
deleted file mode 100644
index 9979250..000
--- 
a/streams-schemas/src/test/java/org/apache/streams/schema/test/SchemaOrderingTests.java
+++ /dev/null
@@ -1,146 +0,0 @@
-package org.apache.streams.schema.test;
-
-import com.google.common.base.Optional;
-import com.google.common.base.Predicate;
-import com.google.common.collect.Iterators;
-import com.google.common.collect.Lists;
-import org.apache.streams.schema.Schema;
-import org.apache.streams.schema.SchemaStore;
-import org.junit.Test;
-
-import java.io.File;
-import java.util.Iterator;
-import java.util.List;
-
-/**
- * Created by sblackmon on 5/3/16.
- */
-public class SchemaOrderingTests {
-
-@Test
-public void compareVerbParent() {
-SchemaStore schemaStore = new SchemaStore();
-File update = new File("target/classes/verbs/update.json");
-schemaStore.create(update.toURI());
-File activity = new File("target/classes/activity.json");
-schemaStore.create(activity.toURI());
-assert( schemaStore.compare( 
schemaStore.getByUri(update.toURI()).get(), 
schemaStore.getByUri(activity.toURI()).get()) == 1);
-Iterator schemaIterator = schemaStore.getSchemaIterator();
-assertContainsItemsEndingWithInOrder(
-schemaIterator,
-Lists.newArrayList(
-"activity.json",
-"update.json"
-)
-);
-}
-
-@Test
-public void compareObjectTypeParent() {
-SchemaStore schemaStore = new SchemaStore();
-File alert = new File("target/classes/objectTypes/alert.json");
-schemaStore.create(alert.toURI());
-File object = new File("target/classes/object.json");
-schemaStore.create(object.toURI());
-assert( schemaStore.compare( 
schemaStore.getByUri(object.toURI()).get(), 
schemaStore.getByUri(alert.toURI()).get()) == -1);
-Iterator schemaIterator = schemaStore.getSchemaIterator();
-assertContainsItemsEndingWithInOrder(
-schemaIterator,
-Lists.newArrayList(
-"object.json",
-"alert.json"
-)
-);
-}
-
-@Test
-public void compareUnrelated() {
-SchemaStore schemaStore = new SchemaStore();
-File alert = new File("target/classes/objectTypes/alert.json");
-schemaStore.create(alert.toURI());
-File update = new File("target/classes/verbs/update.json");
-schemaStore.create(update.toURI());
-assert( schemaStore.compare( 
schemaStore.getByUri(alert.toURI()).get(), 
schemaStore.getByUri(update.toURI()).get()) == 0);
-}
-
-@Test
-public void compareVerbFieldRef() {
-SchemaStore schemaStore = new SchemaStore();
-File update = new File("target/classes/verbs/update.json");
-schemaStore.create(update.toURI());
-File object = new File("target/classes/object.json");
-schemaStore.create(object.toURI());
-assert( schemaStore.compare( 
schemaStore.getByUri(update.toURI()).get(), 
schemaStore.getByUri(object.toURI()).get()) == 1);
-Iterator schemaIterator = schemaStore.getSchemaIterator();
-assertContainsItemsEndingWithInOrder(
-schemaIterator,
-Lists.newArrayList(
-"object.json",
-"update.json"
-)
-);
-}
-
-@Test
-public void compareObjectTypeFieldRef() {
-SchemaStore schemaStore = new SchemaStore();
-File alert = new File("target/classes/objectTypes/alert.json");
-schemaStore.create(alert.toURI());
-File media_link = new File("target/classes/media_link.json");
-schemaStore.create(media_link.toURI());
-assert( schemaStore.compare( 
schemaStore.getByUri(media_link.toURI()).get(), 
schemaStore.getByUri(alert.toURI()).get()) == -1);
-Iterator schemaIterator = schemaStore.getSchemaIterator();
-assertContainsItemsEndingWithInOrder(
-schemaIterator,
-Lists.newArrayList(
-"media_link.json",
-"object.json",
-"alert.json"
-)
-);
-}
-
-@Test
-public void compareVerbAncestorIndirect() {
-SchemaStore schemaStore = new SchemaStore();
-File update = new File("target/classes/verbs/update.json");
-schemaStore.create(update.toURI());
-File media_link = new File("target/classes/media_link.jso

[15/38] incubator-streams git commit: WIP for apachecon

2016-10-12 Thread sblackmon
http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/test/resources/activities/install.json
--
diff --git a/streams-schemas/src/test/resources/activities/install.json 
b/streams-schemas/src/test/resources/activities/install.json
new file mode 100644
index 000..1ecdecd
--- /dev/null
+++ b/streams-schemas/src/test/resources/activities/install.json
@@ -0,0 +1,18 @@
+{
+  "$license": [
+"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+  ],
+  "actor": {
+"objectType": "person",
+"displayName": "Laura"
+  },
+  "verb": "install",
+  "object": {
+"objectType": "application",
+"displayName": "Approved Software Scanning Tool",
+"location": {
+  "displayName": "All computers in Building A"
+}
+  }
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/test/resources/activities/interact.json
--
diff --git a/streams-schemas/src/test/resources/activities/interact.json 
b/streams-schemas/src/test/resources/activities/interact.json
new file mode 100644
index 000..f427513
--- /dev/null
+++ b/streams-schemas/src/test/resources/activities/interact.json
@@ -0,0 +1,16 @@
+{
+  "$license": [
+"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+  ],
+  "actor": {
+"objectType": "person",
+"displayName": "Bob"
+  },
+  "verb": "interact",
+  "object": {
+"objectType": "person",
+"displayName": "Laura"
+  },
+  "title": "Bob called Laura."
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/test/resources/activities/invite.json
--
diff --git a/streams-schemas/src/test/resources/activities/invite.json 
b/streams-schemas/src/test/resources/activities/invite.json
new file mode 100644
index 000..7c84b78
--- /dev/null
+++ b/streams-schemas/src/test/resources/activities/invite.json
@@ -0,0 +1,19 @@
+{
+  "$license": [
+"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+  ],
+  "actor": {
+"objectType": "person",
+"displayName": "Laura"
+  },
+  "verb": "invite",
+  "object": {
+"objectType": "person",
+"displayName": "Mark"
+  },
+  "target": {
+"objectType": "event",
+"displayName": "Job Interview"
+  }
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/test/resources/activities/join.json
--
diff --git a/streams-schemas/src/test/resources/activities/join.json 
b/streams-schemas/src/test/resources/activities/join.json
new file mode 100644
index 000..7996a9b
--- /dev/null
+++ b/streams-schemas/src/test/resources/activities/join.json
@@ -0,0 +1,15 @@
+{
+  "$license": [
+"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+  ],
+  "actor": {
+"objectType": "person",
+"displayName": "Mark"
+  },
+  "verb": "join",
+  "object": {
+"objectType": "organization",
+"displayName": "Acme, Co"
+  }
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/test/resources/activities/leave.json
--
diff --git a/streams-schemas/src/test/resources/activities/leave.json 
b/streams-schemas/src/test/resources/activities/leave.json
new file mode 100644
index 000..08516c5
--- /dev/null
+++ b/streams-schemas/src/test/resources/activities/leave.json
@@ -0,0 +1,15 @@
+{
+  "$license": [
+"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+  ],
+  "actor": {
+"objectType": "person",
+"displayName": "Mark"
+  },
+  "verb": "leave",
+  "object": {
+"objectType": "organization",
+"displayName": "Other, Co"
+  }
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/test/resources/activities/like.json
--
diff --git a/streams-schemas/src/test/resources/activities/like.json 
b/streams-schemas/src/test/resources/activities/like.json
new file mode 100644
index 000..853676f
--- /dev/null
+++ b/streams-schemas/src/test/resources/activities/like.json
@@ -0,0 +1,22 @@
+{
+  "$license": [
+"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+  ],
+  "actor": {
+"objectType": "person",
+"displayName": "Laura"
+  },
+  "verb": "like",
+  "ob

[09/38] incubator-streams git commit: STREAMS-398 - streams-schemas

2016-10-12 Thread sblackmon
STREAMS-398 - streams-schemas

moves jsonschemas to a seperate module
  this averts dependency graph cycle that would occur once streams-plugin-pojo 
is a dependency of streams-pojo and streams-scala


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/0424855c
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/0424855c
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/0424855c

Branch: refs/heads/master
Commit: 0424855cf0a4fd15be298906922333ae74c8e9ae
Parents: 387da68
Author: Steve Blackmon @steveblackmon 
Authored: Thu Apr 21 11:41:59 2016 -0500
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Jun 1 12:49:27 2016 -0500

--
 streams-schemas/pom.xml |  71 
 .../src/main/jsonschema/activity.json   | 108 +++
 .../src/main/jsonschema/collection.json |  47 
 .../src/main/jsonschema/media_link.json |  34 ++
 streams-schemas/src/main/jsonschema/object.json |  98 +
 .../src/main/jsonschema/objectTypes/alert.json  |  19 
 .../jsonschema/objectTypes/application.json |  19 
 .../main/jsonschema/objectTypes/article.json|  19 
 .../src/main/jsonschema/objectTypes/audio.json  |  19 
 .../src/main/jsonschema/objectTypes/badge.json  |  19 
 .../src/main/jsonschema/objectTypes/binary.json |  19 
 .../main/jsonschema/objectTypes/bookmark.json   |  19 
 .../main/jsonschema/objectTypes/comment.json|  19 
 .../src/main/jsonschema/objectTypes/device.json |  19 
 .../src/main/jsonschema/objectTypes/event.json  |  51 +
 .../src/main/jsonschema/objectTypes/file.json   |  25 +
 .../src/main/jsonschema/objectTypes/folder.json |  19 
 .../src/main/jsonschema/objectTypes/game.json   |  19 
 .../src/main/jsonschema/objectTypes/group.json  |  19 
 .../src/main/jsonschema/objectTypes/image.json  |  22 
 .../src/main/jsonschema/objectTypes/issue.json  |  25 +
 .../src/main/jsonschema/objectTypes/job.json|  19 
 .../src/main/jsonschema/objectTypes/list.json   |  28 +
 .../src/main/jsonschema/objectTypes/note.json   |  19 
 .../src/main/jsonschema/objectTypes/offer.json  |  19 
 .../jsonschema/objectTypes/organization.json|  19 
 .../src/main/jsonschema/objectTypes/page.json   |  19 
 .../main/jsonschema/objectTypes/permission.json |  36 +++
 .../src/main/jsonschema/objectTypes/person.json |  25 +
 .../jsonschema/objectTypes/photo-album.json |  19 
 .../src/main/jsonschema/objectTypes/photo.json  |  23 
 .../src/main/jsonschema/objectTypes/place.json  |  43 
 .../main/jsonschema/objectTypes/playlist.json   |  19 
 .../main/jsonschema/objectTypes/process.json|  19 
 .../main/jsonschema/objectTypes/product.json|  25 +
 .../main/jsonschema/objectTypes/property.json   |  48 +
 .../main/jsonschema/objectTypes/question.json   |  28 +
 .../src/main/jsonschema/objectTypes/review.json |  22 
 .../src/main/jsonschema/objectTypes/role.json   |  25 +
 .../main/jsonschema/objectTypes/service.json|  19 
 .../src/main/jsonschema/objectTypes/song.json   |  19 
 .../src/main/jsonschema/objectTypes/status.json |  19 
 .../src/main/jsonschema/objectTypes/task.json   |  40 +++
 .../src/main/jsonschema/objectTypes/team.json   |  19 
 .../src/main/jsonschema/objectTypes/video.json  |  19 
 .../src/main/jsonschema/verbs/accept.json   |  24 +
 .../src/main/jsonschema/verbs/access.json   |  24 +
 .../src/main/jsonschema/verbs/acknowledge.json  |  24 +
 .../src/main/jsonschema/verbs/add.json  |  24 +
 .../src/main/jsonschema/verbs/agree.json|  24 +
 .../src/main/jsonschema/verbs/append.json   |  24 +
 .../src/main/jsonschema/verbs/approve.json  |  24 +
 .../src/main/jsonschema/verbs/archive.json  |  24 +
 .../src/main/jsonschema/verbs/assign.json   |  24 +
 .../src/main/jsonschema/verbs/at.json   |  24 +
 .../src/main/jsonschema/verbs/attach.json   |  24 +
 .../src/main/jsonschema/verbs/attend.json   |  24 +
 .../src/main/jsonschema/verbs/author.json   |  24 +
 .../src/main/jsonschema/verbs/authorize.json|  24 +
 .../src/main/jsonschema/verbs/borrow.json   |  24 +
 .../src/main/jsonschema/verbs/build.json|  24 +
 .../src/main/jsonschema/verbs/cancel.json   |  24 +
 .../src/main/jsonschema/verbs/checkin.json  |  24 +
 .../src/main/jsonschema/verbs/close.json|  24 +
 .../src/main/jsonschema/verbs/complete.json |  24 +
 .../src/main/jsonschema/verbs/confirm.json  |  24 +
 .../src/main/jsonschema/verbs/consume.json  |  24 +
 .../src/main/jsonschema/verbs/create.json   |  

[24/38] incubator-streams git commit: refactoring, testing, documentation, CLI modes

2016-10-12 Thread sblackmon
http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/d9674f7c/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/verbs/save.json
--
diff --git 
a/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/verbs/save.json
 
b/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/verbs/save.json
new file mode 100644
index 000..06ec16f
--- /dev/null
+++ 
b/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/verbs/save.json
@@ -0,0 +1,24 @@
+{
+"$schema": "http://json-schema.org/draft-03/schema";,
+"$license": [
+
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+],
+"id": 
"http://streams.incubator.apache.org/site/0.3-incubating-SNAPSHOT/streams-schemas/verbs/save.json#";,
+"type": "object",
+"title": "Save",
+"description": "Indicates that the actor has called out the object as 
being of interest primarily to him- or herself. Though this action MAY be 
shared publicly, the implication is that the object has been saved primarily 
for the actor's own benefit rather than to show it to others as would be 
indicated by the \"share\" verb.",
+"extends": {
+"$ref": "../activity.json"
+},
+"properties": {
+"verb": {
+"type": "string",
+"default": "save"
+},
+"title": {
+"type": "string",
+"default": "{actor.displayName} saved {object.displayName}"
+}
+}
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/d9674f7c/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/verbs/schedule.json
--
diff --git 
a/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/verbs/schedule.json
 
b/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/verbs/schedule.json
new file mode 100644
index 000..a42d955
--- /dev/null
+++ 
b/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/verbs/schedule.json
@@ -0,0 +1,24 @@
+{
+"$schema": "http://json-schema.org/draft-03/schema";,
+"$license": [
+
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+],
+"id": 
"http://streams.incubator.apache.org/site/0.3-incubating-SNAPSHOT/streams-schemas/verbs/schedule.json#";,
+"type": "object",
+"title": "Schedule",
+"description": "Indicates that the actor has scheduled the object. For 
instance, scheduling a meeting.",
+"extends": {
+"$ref": "../activity.json"
+},
+"properties": {
+"verb": {
+"type": "string",
+"default": "schedule"
+},
+"title": {
+"type": "string",
+"default": "{actor.displayName} scheduled {object.displayName}"
+}
+}
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/d9674f7c/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/verbs/search.json
--
diff --git 
a/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/verbs/search.json
 
b/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/verbs/search.json
new file mode 100644
index 000..1cb8572
--- /dev/null
+++ 
b/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/verbs/search.json
@@ -0,0 +1,24 @@
+{
+"$schema": "http://json-schema.org/draft-03/schema";,
+"$license": [
+
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+],
+"id": 
"http://streams.incubator.apache.org/site/0.3-incubating-SNAPSHOT/streams-schemas/verbs/search.json#";,
+"type": "object",
+"title": "Search",
+"description": "Indicates that the actor is or has searched for the 
object. If a target is specified, it indicates the context within which the 
search is or has been conducted.",
+"extends": {
+"$ref": "../activity.json"
+},
+"properties": {
+"verb": {
+"type": "string",
+"default": "search"
+},
+"title": {
+"type": "string",
+"default": "{actor.displayName} search for {object.displayName} in 
{target.displayName}"
+}
+}
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/d9674f7c/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/verbs/sell.json
--
diff --git 
a/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/verbs/sell.json
 
b/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/verbs/sell.json
new file mode 100644
index 

[07/38] incubator-streams git commit: STREAMS-398 - streams-schemas

2016-10-12 Thread sblackmon
http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/0424855c/streams-schemas/src/main/jsonschema/verbs/terminate.json
--
diff --git a/streams-schemas/src/main/jsonschema/verbs/terminate.json 
b/streams-schemas/src/main/jsonschema/verbs/terminate.json
new file mode 100644
index 000..280eb31
--- /dev/null
+++ b/streams-schemas/src/main/jsonschema/verbs/terminate.json
@@ -0,0 +1,24 @@
+{
+"$schema": "http://json-schema.org/draft-03/schema";,
+"$license": [
+
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+],
+"id": "#",
+"type": "object",
+"title": "Terminate",
+"description": "Indicates that the actor has terminated the object.",
+"extends": {
+"$ref": "../activity.json"
+},
+"properties": {
+"verb": {
+"type": "string",
+"default": "terminate"
+},
+"title": {
+"type": "string",
+"default": "{actor.displayName} terminated {object.displayName}"
+}
+}
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/0424855c/streams-schemas/src/main/jsonschema/verbs/tie.json
--
diff --git a/streams-schemas/src/main/jsonschema/verbs/tie.json 
b/streams-schemas/src/main/jsonschema/verbs/tie.json
new file mode 100644
index 000..7530ed2
--- /dev/null
+++ b/streams-schemas/src/main/jsonschema/verbs/tie.json
@@ -0,0 +1,24 @@
+{
+"$schema": "http://json-schema.org/draft-03/schema";,
+"$license": [
+
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+],
+"id": "#",
+"type": "object",
+"title": "Tie",
+"description": "Indicates that the actor has neither won or lost the 
object. This verb is generally only applicable when the object represents some 
form of competition, such as a game.",
+"extends": {
+"$ref": "../activity.json"
+},
+"properties": {
+"verb": {
+"type": "string",
+"default": "tie"
+},
+"title": {
+"type": "string",
+"default": "{actor.displayName} tied at {object.displayName}"
+}
+}
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/0424855c/streams-schemas/src/main/jsonschema/verbs/unfavorite.json
--
diff --git a/streams-schemas/src/main/jsonschema/verbs/unfavorite.json 
b/streams-schemas/src/main/jsonschema/verbs/unfavorite.json
new file mode 100644
index 000..bfa9c20
--- /dev/null
+++ b/streams-schemas/src/main/jsonschema/verbs/unfavorite.json
@@ -0,0 +1,24 @@
+{
+"$schema": "http://json-schema.org/draft-03/schema";,
+"$license": [
+
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+],
+"id": "#",
+"type": "object",
+"title": "UnFavorite",
+"description": "Indicates that the actor has removed the object from the 
collection of favorited items.",
+"extends": {
+"$ref": "../activity.json"
+},
+"properties": {
+"verb": {
+"type": "string",
+"default": "unfavorite"
+},
+"title": {
+"type": "string",
+"default": "{actor.displayName} removed {object.displayName} as a 
favorite"
+}
+}
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/0424855c/streams-schemas/src/main/jsonschema/verbs/unlike.json
--
diff --git a/streams-schemas/src/main/jsonschema/verbs/unlike.json 
b/streams-schemas/src/main/jsonschema/verbs/unlike.json
new file mode 100644
index 000..4dc75f6
--- /dev/null
+++ b/streams-schemas/src/main/jsonschema/verbs/unlike.json
@@ -0,0 +1,24 @@
+{
+"$schema": "http://json-schema.org/draft-03/schema";,
+"$license": [
+
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+],
+"id": "#",
+"type": "object",
+"title": "UnLike",
+"description": "Indicates that the actor has removed the object from the 
collection of liked items.",
+"extends": {
+"$ref": "../activity.json"
+},
+"properties": {
+"verb": {
+"type": "string",
+"default": "unlike"
+},
+"title": {
+"type": "string",
+"default": "{actor.displayName} no longer likes 
{object.displayName}"
+}
+}
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/0424855c/streams-schemas/src/main/jsonschema/verbs/unsatisfy.json
---

[01/38] incubator-streams git commit: first take at STREAMS-389: streams-project/streams-plugins/streams-plugin-scala

2016-10-12 Thread sblackmon
Repository: incubator-streams
Updated Branches:
  refs/heads/master f14a25ced -> b21ec4b50


first take at STREAMS-389: streams-project/streams-plugins/streams-plugin-scala


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/c89fe1e5
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/c89fe1e5
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/c89fe1e5

Branch: refs/heads/master
Commit: c89fe1e5a1271d95862a74a218da578167d68ea9
Parents: 7da029d
Author: Steve Blackmon (@steveblackmon) 
Authored: Mon Dec 7 13:48:38 2015 -0700
Committer: Steve Blackmon (@steveblackmon) 
Committed: Mon Dec 7 13:48:38 2015 -0700

--
 pom.xml |   1 +
 streams-plugins/pom.xml |  56 +++
 streams-plugins/streams-plugin-scala/pom.xml| 243 
 .../streams/plugins/StreamsPojoScala.java   | 371 +++
 .../streams/plugins/StreamsPojoScalaMojo.java   |  71 
 .../plugins/test/StreamsPojoScalaTest.java  |  55 +++
 .../test/resources/streams-plugin-scala/pom.xml |  40 ++
 7 files changed, 837 insertions(+)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/c89fe1e5/pom.xml
--
diff --git a/pom.xml b/pom.xml
index 70e3a8c..58304e0 100644
--- a/pom.xml
+++ b/pom.xml
@@ -175,6 +175,7 @@
 streams-osgi-components
 streams-pojo
 streams-pojo-extensions
+streams-plugins
 streams-runtimes
 streams-util
 streams-verbs

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/c89fe1e5/streams-plugins/pom.xml
--
diff --git a/streams-plugins/pom.xml b/streams-plugins/pom.xml
new file mode 100644
index 000..2306aab
--- /dev/null
+++ b/streams-plugins/pom.xml
@@ -0,0 +1,56 @@
+
+
+
+http://maven.apache.org/POM/4.0.0"; 
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; 
xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 
http://maven.apache.org/xsd/maven-4.0.0.xsd";>
+4.0.0
+
+streams-project
+org.apache.streams
+0.3-incubating-SNAPSHOT
+../pom.xml
+
+
+streams-plugins
+
+pom
+streams-plugins
+
+
+
+
+
+
+streams-plugin-scala
+   
+
+
+
+
+org.apache.streams
+streams-config
+${project.version}
+
+
+org.apache.streams
+streams-pojo
+${project.version}
+
+
+
+

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/c89fe1e5/streams-plugins/streams-plugin-scala/pom.xml
--
diff --git a/streams-plugins/streams-plugin-scala/pom.xml 
b/streams-plugins/streams-plugin-scala/pom.xml
new file mode 100644
index 000..f718260
--- /dev/null
+++ b/streams-plugins/streams-plugin-scala/pom.xml
@@ -0,0 +1,243 @@
+
+
+http://maven.apache.org/POM/4.0.0"; 
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; 
xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 
http://maven.apache.org/xsd/maven-4.0.0.xsd";>
+
+4.0.0
+org.apache.streams.plugins
+streams-plugin-scala
+0.3-incubating-SNAPSHOT
+maven-plugin
+
+
+org.apache.streams
+streams-plugins
+0.3-incubating-SNAPSHOT
+
+
+
+
+org.apache.streams
+streams-config
+${project.version}
+
+
+org.apache.streams
+streams-core
+${project.version}
+
+
+org.jsonschema2pojo
+jsonschema2pojo-core
+
+
+org.apache.streams
+streams-pojo
+${project.version}
+test
+test-jar
+
+
+org.reflections
+reflections
+0.9.9
+
+
+org.apache.maven
+maven-aether-provider
+3.3.3
+
+
+org.apache.maven
+maven-artifact
+3.3.3
+provided
+
+
+org.apache.maven
+maven-compat
+3.3.3
+test
+
+
+org.apache.maven
+maven-core
+3.3.3
+
+
+org.sonatype.aether
+*
+
+
+
+
+org.apache.maven
+maven-plugin-api
+3.3.3
+
+
+org.apache.maven.plugins
+m

[05/38] incubator-streams git commit: STREAMS-398 - streams-schemas

2016-10-12 Thread sblackmon
http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/0424855c/streams-schemas/src/site/resources/verbs/tag.json
--
diff --git a/streams-schemas/src/site/resources/verbs/tag.json 
b/streams-schemas/src/site/resources/verbs/tag.json
new file mode 100644
index 000..6208eae
--- /dev/null
+++ b/streams-schemas/src/site/resources/verbs/tag.json
@@ -0,0 +1,24 @@
+{
+"$schema": "http://json-schema.org/draft-03/schema";,
+"$license": [
+
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+],
+"id": "#",
+"type": "object",
+"title": "Tag",
+"description": "Indicates that the actor has associated the object with 
the target. For example, if the actor specifies that a particular user appears 
in a photo. the object is the user and the target is the photo.",
+"extends": {
+"$ref": "../activity.json"
+},
+"properties": {
+"verb": {
+"type": "string",
+"default": "tag"
+},
+"title": {
+"type": "string",
+"default": "{actor.displayName} tagged {object.displayName} as 
{target.displayName}"
+}
+}
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/0424855c/streams-schemas/src/site/resources/verbs/terminate.json
--
diff --git a/streams-schemas/src/site/resources/verbs/terminate.json 
b/streams-schemas/src/site/resources/verbs/terminate.json
new file mode 100644
index 000..280eb31
--- /dev/null
+++ b/streams-schemas/src/site/resources/verbs/terminate.json
@@ -0,0 +1,24 @@
+{
+"$schema": "http://json-schema.org/draft-03/schema";,
+"$license": [
+
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+],
+"id": "#",
+"type": "object",
+"title": "Terminate",
+"description": "Indicates that the actor has terminated the object.",
+"extends": {
+"$ref": "../activity.json"
+},
+"properties": {
+"verb": {
+"type": "string",
+"default": "terminate"
+},
+"title": {
+"type": "string",
+"default": "{actor.displayName} terminated {object.displayName}"
+}
+}
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/0424855c/streams-schemas/src/site/resources/verbs/tie.json
--
diff --git a/streams-schemas/src/site/resources/verbs/tie.json 
b/streams-schemas/src/site/resources/verbs/tie.json
new file mode 100644
index 000..7530ed2
--- /dev/null
+++ b/streams-schemas/src/site/resources/verbs/tie.json
@@ -0,0 +1,24 @@
+{
+"$schema": "http://json-schema.org/draft-03/schema";,
+"$license": [
+
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+],
+"id": "#",
+"type": "object",
+"title": "Tie",
+"description": "Indicates that the actor has neither won or lost the 
object. This verb is generally only applicable when the object represents some 
form of competition, such as a game.",
+"extends": {
+"$ref": "../activity.json"
+},
+"properties": {
+"verb": {
+"type": "string",
+"default": "tie"
+},
+"title": {
+"type": "string",
+"default": "{actor.displayName} tied at {object.displayName}"
+}
+}
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/0424855c/streams-schemas/src/site/resources/verbs/unfavorite.json
--
diff --git a/streams-schemas/src/site/resources/verbs/unfavorite.json 
b/streams-schemas/src/site/resources/verbs/unfavorite.json
new file mode 100644
index 000..bfa9c20
--- /dev/null
+++ b/streams-schemas/src/site/resources/verbs/unfavorite.json
@@ -0,0 +1,24 @@
+{
+"$schema": "http://json-schema.org/draft-03/schema";,
+"$license": [
+
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+],
+"id": "#",
+"type": "object",
+"title": "UnFavorite",
+"description": "Indicates that the actor has removed the object from the 
collection of favorited items.",
+"extends": {
+"$ref": "../activity.json"
+},
+"properties": {
+"verb": {
+"type": "string",
+"default": "unfavorite"
+},
+"title": {
+"type": "string",
+"default": "{actor.displayName} removed {object.displayName} as a 
favorite"
+}
+}
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/0424855c

[03/38] incubator-streams git commit: test pom for streams-plugin-pojo

2016-10-12 Thread sblackmon
test pom for streams-plugin-pojo


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/387da685
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/387da685
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/387da685

Branch: refs/heads/master
Commit: 387da685f37a7135d556f4f645a3e77e6138f958
Parents: 7d318c3
Author: Steve Blackmon @steveblackmon 
Authored: Mon Mar 28 08:32:27 2016 -0500
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Jun 1 12:49:27 2016 -0500

--
 .../src/test/resources/streams-plugin-pojo/pom.xml| 10 +-
 1 file changed, 5 insertions(+), 5 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/387da685/streams-plugins/streams-plugin-pojo/src/test/resources/streams-plugin-pojo/pom.xml
--
diff --git 
a/streams-plugins/streams-plugin-pojo/src/test/resources/streams-plugin-pojo/pom.xml
 
b/streams-plugins/streams-plugin-pojo/src/test/resources/streams-plugin-pojo/pom.xml
index b1de7b8..fbb2864 100644
--- 
a/streams-plugins/streams-plugin-pojo/src/test/resources/streams-plugin-pojo/pom.xml
+++ 
b/streams-plugins/streams-plugin-pojo/src/test/resources/streams-plugin-pojo/pom.xml
@@ -4,10 +4,10 @@
 4.0.0
 
 org.apache.streams.plugins
-streams-plugin-hive-test
+streams-plugin-pojo-test
 0.3-incubating-SNAPSHOT
 jar
-Test StreamsPojoHiveMojo
+Test StreamsPojoMojo
 
 
 
@@ -21,18 +21,18 @@
 
 
 org.apache.streams.plugins
-streams-plugin-hive
+streams-plugin-pojo
 0.3-incubating-SNAPSHOT
 
 
 org.apache.streams.pojo.json
 
-target/test-classes/streams-hive-plugin/
+target/test-classes/streams-pojo-plugin/
 
 
 
 
-hive
+pojo
 
 
 



[28/38] incubator-streams git commit: refactoring, testing, documentation, CLI modes

2016-10-12 Thread sblackmon
http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/d9674f7c/streams-schemas/src/main/jsonschema/verbs/disagree.json
--
diff --git a/streams-schemas/src/main/jsonschema/verbs/disagree.json 
b/streams-schemas/src/main/jsonschema/verbs/disagree.json
deleted file mode 100644
index 17f0c4c..000
--- a/streams-schemas/src/main/jsonschema/verbs/disagree.json
+++ /dev/null
@@ -1,24 +0,0 @@
-{
-"$schema": "http://json-schema.org/draft-03/schema";,
-"$license": [
-
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
-"http://www.apache.org/licenses/LICENSE-2.0";
-],
-"id": 
"http://streams.incubator.apache.org/site/0.3-incubating-SNAPSHOT/streams-schemas/verbs/disagree.json#";,
-"type": "object",
-"title": "Disagree",
-"description": "Indicates that the actor disagrees with the object.",
-"extends": {
-"$ref": "../activity.json"
-},
-"properties": {
-"verb": {
-"type": "string",
-"default": "disagree"
-},
-"title": {
-"type": "string",
-"default": "{actor.displayName} disagrees with 
{object.displayName}"
-}
-}
-}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/d9674f7c/streams-schemas/src/main/jsonschema/verbs/dislike.json
--
diff --git a/streams-schemas/src/main/jsonschema/verbs/dislike.json 
b/streams-schemas/src/main/jsonschema/verbs/dislike.json
deleted file mode 100644
index 308d5eb..000
--- a/streams-schemas/src/main/jsonschema/verbs/dislike.json
+++ /dev/null
@@ -1,24 +0,0 @@
-{
-"$schema": "http://json-schema.org/draft-03/schema";,
-"$license": [
-
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
-"http://www.apache.org/licenses/LICENSE-2.0";
-],
-"id": 
"http://streams.incubator.apache.org/site/0.3-incubating-SNAPSHOT/streams-schemas/verbs/dislike.json#";,
-"type": "object",
-"title": "Dislike",
-"description": "Indicates that the actor dislikes the object. Note that 
the \"dislike\" verb is distinct from the \"unlike\" verb which assumes that 
the object had been previously \"liked\".",
-"extends": {
-"$ref": "../activity.json"
-},
-"properties": {
-"verb": {
-"type": "string",
-"default": "dislike"
-},
-"title": {
-"type": "string",
-"default": "{actor.displayName} dislikes {object.displayName}"
-}
-}
-}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/d9674f7c/streams-schemas/src/main/jsonschema/verbs/experience.json
--
diff --git a/streams-schemas/src/main/jsonschema/verbs/experience.json 
b/streams-schemas/src/main/jsonschema/verbs/experience.json
deleted file mode 100644
index 543ac2c..000
--- a/streams-schemas/src/main/jsonschema/verbs/experience.json
+++ /dev/null
@@ -1,24 +0,0 @@
-{
-"$schema": "http://json-schema.org/draft-03/schema";,
-"$license": [
-
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
-"http://www.apache.org/licenses/LICENSE-2.0";
-],
-"id": 
"http://streams.incubator.apache.org/site/0.3-incubating-SNAPSHOT/streams-schemas/verbs/experience.json#";,
-"type": "object",
-"title": "Experience",
-"description": "Indicates that the actor has experienced the object in 
some manner. Note that, depending on the specific object types used for both 
the actor and object, the meaning of this verb can overlap that of the 
\"consume\" and \"play\" verbs. For instance, a person might \"experience\" a 
movie; or \"play\" the movie; or \"consume\" the movie. The \"experience\" verb 
can be considered a more generic form of other more specific verbs as 
\"consume\", \"play\", \"watch\", \"listen\", and \"read\"",
-"extends": {
-"$ref": "../activity.json"
-},
-"properties": {
-"verb": {
-"type": "string",
-"default": "experience"
-},
-"title": {
-"type": "string",
-"default": "{actor.displayName} experienced {object.displayName}"
-}
-}
-}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/d9674f7c/streams-schemas/src/main/jsonschema/verbs/favorite.json
--
diff --git a/streams-schemas/src/main/jsonschema/verbs/favorite.json 
b/streams-schemas/src/main/jsonschema/verbs/favorite.json
deleted file mode 100644
index 17e2490..000
--- a/streams-schemas/src/main/jsonschema/verbs/favorite.json
+++ /dev/null
@@ -1,24 +0,0 @@
-{
-"$schema": "http://json-schema.org/draft-03/schema";,
-"$license": [
-
"http://www.openwebfoundation.org/legal/the-owf-1-0-ag

[12/38] incubator-streams git commit: create streams-plugin-pojo

2016-10-12 Thread sblackmon
create streams-plugin-pojo


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/ded4ad68
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/ded4ad68
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/ded4ad68

Branch: refs/heads/master
Commit: ded4ad68d41c8b158fdca3f249a57055eab095f8
Parents: 50f67bf
Author: Steve Blackmon @steveblackmon 
Authored: Mon Mar 28 08:32:00 2016 -0500
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Jun 1 12:49:27 2016 -0500

--
 pom.xml |   5 +
 streams-plugins/pom.xml |   2 +-
 streams-plugins/streams-plugin-hive/pom.xml |   5 +-
 .../plugins/StreamsHiveResourceGenerator.java   | 219 +++
 .../StreamsHiveResourceGeneratorMojo.java   |  68 +
 .../apache/streams/plugins/StreamsPojoHive.java | 242 -
 .../streams/plugins/StreamsPojoHiveMojo.java|  71 -
 .../test/StreamsHiveResourceGeneratorTest.java  |  55 
 .../plugins/test/StreamsPojoHiveTest.java   |  55 
 streams-plugins/streams-plugin-pojo/pom.xml | 239 
 .../plugins/StreamsPojoGenerationConfig.java| 198 ++
 .../plugins/StreamsPojoSourceGeneratorMojo.java | 272 +++
 .../test/StreamsPojoSourceGeneratorTest.java|  54 
 .../test/resources/streams-plugin-pojo/pom.xml  |  42 +++
 14 files changed, 1156 insertions(+), 371 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/ded4ad68/pom.xml
--
diff --git a/pom.xml b/pom.xml
index 2d79739..cb935af 100644
--- a/pom.xml
+++ b/pom.xml
@@ -175,6 +175,7 @@
 
 streams-pojo
 streams-pojo-extensions
+streams-plugins
 streams-runtimes
 streams-testing
 streams-util
@@ -183,6 +184,10 @@
 
 pom
 
+
+0.4.22
+
+
 
 
 

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/ded4ad68/streams-plugins/pom.xml
--
diff --git a/streams-plugins/pom.xml b/streams-plugins/pom.xml
index 2306aab..390c8a0 100644
--- a/streams-plugins/pom.xml
+++ b/streams-plugins/pom.xml
@@ -36,7 +36,7 @@
 
 
 
-streams-plugin-scala
+streams-plugin-pojo

 
 

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/ded4ad68/streams-plugins/streams-plugin-hive/pom.xml
--
diff --git a/streams-plugins/streams-plugin-hive/pom.xml 
b/streams-plugins/streams-plugin-hive/pom.xml
index cbc055b..22d75ce 100644
--- a/streams-plugins/streams-plugin-hive/pom.xml
+++ b/streams-plugins/streams-plugin-hive/pom.xml
@@ -213,19 +213,20 @@
 2.4
 
 
-streams-pojo-resource-dependencies
+resource-dependencies
 process-test-resources
 
 unpack-dependencies
 
 
 
streams-pojo
-
org/apache/streams/pojo/json/**
+**/*.json
 
${project.build.directory}/test-classes
 
 
 
 
+
 
 
 

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/ded4ad68/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/StreamsHiveResourceGenerator.java
--
diff --git 
a/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/StreamsHiveResourceGenerator.java
 
b/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/StreamsHiveResourceGenerator.java
new file mode 100644
index 000..4edacf0
--- /dev/null
+++ 
b/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/StreamsHiveResourceGenerator.java
@@ -0,0 +1,219 @@
+package org.apache.streams.plugins;
+
+import com.google.common.base.Strings;
+import com.google.common.collect.Lists;
+import com.google.common.collect.Maps;
+import org.reflections.ReflectionUtils;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+
+import java.io.File;
+import java.io.Serializable;
+import java.lang.reflect.Field;
+import java.nio.file.Files;
+import java.nio.file.Paths;
+import java.nio.file.StandardOpenOption;
+import java.util.Iterator;
+import java.util.List;
+import java.util.Map;
+import java.util.Set;
+
+/**
+ * Created by sblackmon on 

[31/38] incubator-streams git commit: refactoring, testing, documentation, CLI modes

2016-10-12 Thread sblackmon
http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/d9674f7c/streams-plugins/streams-plugin-hbase/src/main/java/org/apache/streams/plugins/hbase/StreamsHbaseGenerationConfig.java
--
diff --git 
a/streams-plugins/streams-plugin-hbase/src/main/java/org/apache/streams/plugins/hbase/StreamsHbaseGenerationConfig.java
 
b/streams-plugins/streams-plugin-hbase/src/main/java/org/apache/streams/plugins/hbase/StreamsHbaseGenerationConfig.java
index 2612ec2..3972a54 100644
--- 
a/streams-plugins/streams-plugin-hbase/src/main/java/org/apache/streams/plugins/hbase/StreamsHbaseGenerationConfig.java
+++ 
b/streams-plugins/streams-plugin-hbase/src/main/java/org/apache/streams/plugins/hbase/StreamsHbaseGenerationConfig.java
@@ -1,6 +1,6 @@
 package org.apache.streams.plugins.hbase;
 
-import org.apache.streams.schema.GenerationConfig;
+import org.apache.streams.util.schema.GenerationConfig;
 import org.jsonschema2pojo.DefaultGenerationConfig;
 import org.jsonschema2pojo.util.URLUtil;
 

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/d9674f7c/streams-plugins/streams-plugin-hbase/src/main/java/org/apache/streams/plugins/hbase/StreamsHbaseResourceGenerator.java
--
diff --git 
a/streams-plugins/streams-plugin-hbase/src/main/java/org/apache/streams/plugins/hbase/StreamsHbaseResourceGenerator.java
 
b/streams-plugins/streams-plugin-hbase/src/main/java/org/apache/streams/plugins/hbase/StreamsHbaseResourceGenerator.java
index 649bdd9..71a8705 100644
--- 
a/streams-plugins/streams-plugin-hbase/src/main/java/org/apache/streams/plugins/hbase/StreamsHbaseResourceGenerator.java
+++ 
b/streams-plugins/streams-plugin-hbase/src/main/java/org/apache/streams/plugins/hbase/StreamsHbaseResourceGenerator.java
@@ -3,21 +3,18 @@ package org.apache.streams.plugins.hbase;
 import com.fasterxml.jackson.databind.JsonNode;
 import com.fasterxml.jackson.databind.node.ObjectNode;
 import com.google.common.base.Joiner;
-import com.google.common.base.Optional;
-import com.google.common.base.Preconditions;
-import com.google.common.base.Strings;
 import com.google.common.collect.Lists;
-import org.apache.streams.schema.FieldType;
-import org.apache.streams.schema.FieldUtil;
-import org.apache.streams.schema.GenerationConfig;
-import org.apache.streams.schema.Schema;
-import org.apache.streams.schema.SchemaStore;
+import org.apache.streams.util.schema.FieldType;
+import org.apache.streams.util.schema.FieldUtil;
+import org.apache.streams.util.schema.GenerationConfig;
+import org.apache.streams.util.schema.Schema;
+import org.apache.streams.util.schema.SchemaStore;
+import org.apache.streams.util.schema.SchemaStoreImpl;
 import org.jsonschema2pojo.util.URLUtil;
 import org.slf4j.Logger;
 import org.slf4j.LoggerFactory;
 
 import java.io.File;
-import java.net.URI;
 import java.net.URL;
 import java.util.Iterator;
 import java.util.LinkedList;
@@ -25,11 +22,11 @@ import java.util.List;
 import java.util.Map;
 
 import static com.google.common.base.Preconditions.checkNotNull;
-import static org.apache.streams.schema.FileUtil.dropExtension;
-import static org.apache.streams.schema.FileUtil.dropSourcePathPrefix;
-import static org.apache.streams.schema.FileUtil.resolveRecursive;
-import static org.apache.streams.schema.FileUtil.swapExtension;
-import static org.apache.streams.schema.FileUtil.writeFile;
+import static org.apache.streams.util.schema.FileUtil.dropExtension;
+import static org.apache.streams.util.schema.FileUtil.dropSourcePathPrefix;
+import static org.apache.streams.util.schema.FileUtil.resolveRecursive;
+import static org.apache.streams.util.schema.FileUtil.swapExtension;
+import static org.apache.streams.util.schema.FileUtil.writeFile;
 
 /**
  * Created by sblackmon on 5/3/16.
@@ -42,7 +39,7 @@ public class StreamsHbaseResourceGenerator implements 
Runnable {
 
 private StreamsHbaseGenerationConfig config;
 
-private SchemaStore schemaStore = new SchemaStore();
+private SchemaStore schemaStore = new SchemaStoreImpl();
 
 private int currentDepth = 0;
 
@@ -60,17 +57,9 @@ public class StreamsHbaseResourceGenerator implements 
Runnable {
 config.setSourceDirectory(sourceDirectory);
 config.setTargetDirectory(targetDirectory);
 
-StreamsHbaseResourceGenerator StreamsHbaseResourceGenerator = new 
StreamsHbaseResourceGenerator(config);
-Thread thread = new Thread(StreamsHbaseResourceGenerator);
-thread.start();
-try {
-thread.join();
-} catch (InterruptedException e) {
-LOGGER.error("InterruptedException", e);
-} catch (Exception e) {
-LOGGER.error("Exception", e);
-}
-return;
+StreamsHbaseResourceGenerator streamsHbaseResourceGenerator = new 
StreamsHbaseResourceGenerator(config);
+streamsHbaseResourceGenerator.run();
+
 }
 
 public Strea

[21/38] incubator-streams git commit: WIP for apachecon

2016-10-12 Thread sblackmon
http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-plugins/streams-plugin-elasticsearch/pom.xml
--
diff --git a/streams-plugins/streams-plugin-elasticsearch/pom.xml 
b/streams-plugins/streams-plugin-elasticsearch/pom.xml
new file mode 100644
index 000..4f0ed4a
--- /dev/null
+++ b/streams-plugins/streams-plugin-elasticsearch/pom.xml
@@ -0,0 +1,245 @@
+
+
+http://maven.apache.org/POM/4.0.0"; 
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; 
xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 
http://maven.apache.org/xsd/maven-4.0.0.xsd";>
+
+4.0.0
+org.apache.streams.plugins
+streams-plugin-elasticsearch
+0.3-incubating-SNAPSHOT
+maven-plugin
+
+
+org.apache.streams
+streams-plugins
+0.3-incubating-SNAPSHOT
+..
+
+
+
+2.3.0
+5.4.0
+
+
+
+
+org.apache.streams
+streams-config
+${project.version}
+
+
+commons-logging
+commons-logging
+
+
+
+
+org.apache.streams
+streams-core
+${project.version}
+
+
+org.apache.streams
+streams-schemas
+${project.version}
+
+
+com.google.guava
+guava
+
+
+org.reflections
+reflections
+0.9.9
+
+
+org.apache.maven
+maven-aether-provider
+3.3.3
+
+
+org.apache.maven
+maven-artifact
+3.3.3
+provided
+
+
+org.apache.maven
+maven-compat
+3.3.3
+test
+
+
+org.apache.maven
+maven-core
+3.3.3
+
+
+org.sonatype.aether
+*
+
+
+
+
+org.apache.maven
+maven-plugin-api
+3.3.3
+
+
+org.apache.maven.plugins
+maven-resources-plugin
+2.7
+
+
+org.apache.maven
+*
+
+
+
+
+org.apache.maven.shared
+maven-verifier
+1.6
+test
+
+
+org.codehaus.plexus
+plexus-utils
+3.0.15
+
+
+org.apache.maven.plugins
+maven-plugin-plugin
+3.4
+
+
+commons-logging
+commons-logging
+
+
+
+
+org.apache.maven.plugin-tools
+maven-plugin-tools-api
+3.3
+
+
+org.apache.maven.plugin-tools
+maven-plugin-annotations
+3.3
+
+
+org.apache.maven.plugin-tools
+maven-plugin-tools-generators
+3.3
+
+
+org.apache.maven.plugin-testing
+maven-plugin-testing-harness
+3.3.0
+test
+
+
+junit
+junit
+test
+
+
+commons-lang
+commons-lang
+2.6
+
+
+joda-time
+joda-time
+2.2
+
+
+org.joda
+joda-convert
+1.8.1
+
+
+
+
+src/main/java
+src/test/java
+
+
+src/main/resources
+
+
+
+
+src/test/resources
+
+
+
+
+maven-plugin-plugin
+3.4
+
+
true
+
+
+
+mojo-descriptor
+process-classes
+
+descriptor
+
+
+
+
+
+org.reflections
+reflections-maven
+
+
+
+reflections
+
+process-classes
+
+
+
+
+org.apache.maven.plugins
+maven-dependency-plugin
+2.4
+
+
+resource-dependencies
+process-test-resources
+

[06/38] incubator-streams git commit: STREAMS-398 - streams-schemas

2016-10-12 Thread sblackmon
http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/0424855c/streams-schemas/src/site/resources/verbs/agree.json
--
diff --git a/streams-schemas/src/site/resources/verbs/agree.json 
b/streams-schemas/src/site/resources/verbs/agree.json
new file mode 100644
index 000..5095153
--- /dev/null
+++ b/streams-schemas/src/site/resources/verbs/agree.json
@@ -0,0 +1,24 @@
+{
+"$schema": "http://json-schema.org/draft-03/schema";,
+"$license": [
+
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+],
+"id": "#",
+"type": "object",
+"title": "Agree",
+"description": "Indicates that the actor agrees with the object. For 
example, a person agreeing with an argument, or expressing agreement with a 
particular issue.",
+"extends": {
+"$ref": "../activity.json"
+},
+"properties": {
+"verb": {
+"type": "string",
+"default": "agree"
+},
+"title": {
+"type": "string",
+"default": "{actor.displayName} agrees with {object.displayName}"
+}
+}
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/0424855c/streams-schemas/src/site/resources/verbs/append.json
--
diff --git a/streams-schemas/src/site/resources/verbs/append.json 
b/streams-schemas/src/site/resources/verbs/append.json
new file mode 100644
index 000..648d192
--- /dev/null
+++ b/streams-schemas/src/site/resources/verbs/append.json
@@ -0,0 +1,24 @@
+{
+"$schema": "http://json-schema.org/draft-03/schema";,
+"$license": [
+
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+],
+"id": "#",
+"type": "object",
+"title": "Append",
+"description": "Indicates that the actor has appended the object to the 
target. For instance, a person appending a new record to a database.",
+"extends": {
+"$ref": "../activity.json"
+},
+"properties": {
+"verb": {
+"type": "string",
+"default": "append"
+},
+"title": {
+"type": "string",
+"default": "{actor.displayName} append {object.displayName} to 
{target.displayName}"
+}
+}
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/0424855c/streams-schemas/src/site/resources/verbs/approve.json
--
diff --git a/streams-schemas/src/site/resources/verbs/approve.json 
b/streams-schemas/src/site/resources/verbs/approve.json
new file mode 100644
index 000..ec66f9b
--- /dev/null
+++ b/streams-schemas/src/site/resources/verbs/approve.json
@@ -0,0 +1,24 @@
+{
+"$schema": "http://json-schema.org/draft-03/schema";,
+"$license": [
+
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+],
+"id": "#",
+"type": "object",
+"title": "Approve",
+"description": "Indicates that the actor has approved the object. For 
instance, a manager might approve a travel request.",
+"extends": {
+"$ref": "../activity.json"
+},
+"properties": {
+"verb": {
+"type": "string",
+"default": "approve"
+},
+"title": {
+"type": "string",
+"default": "{actor.displayName} approved {object.displayName}"
+}
+}
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/0424855c/streams-schemas/src/site/resources/verbs/archive.json
--
diff --git a/streams-schemas/src/site/resources/verbs/archive.json 
b/streams-schemas/src/site/resources/verbs/archive.json
new file mode 100644
index 000..24aea16
--- /dev/null
+++ b/streams-schemas/src/site/resources/verbs/archive.json
@@ -0,0 +1,24 @@
+{
+"$schema": "http://json-schema.org/draft-03/schema";,
+"$license": [
+
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+],
+"id": "#",
+"type": "object",
+"title": "Archive",
+"description": "Indicates that the actor has archived the object.",
+"extends": {
+"$ref": "../activity.json"
+},
+"properties": {
+"verb": {
+"type": "string",
+"default": "archive"
+},
+"title": {
+"type": "string",
+"default": "{actor.displayName} archived {object.displayName}"
+}
+}
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/0424855c/streams-schemas/src/site/resources/verbs/assign.json
---

incubator-streams-master git commit: misc changes merging STREAMS-398

2016-10-12 Thread sblackmon
Repository: incubator-streams-master
Updated Branches:
  refs/heads/master c54bc9018 -> fe4a2f69a


misc changes merging STREAMS-398


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams-master/repo
Commit: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-master/commit/fe4a2f69
Tree: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-master/tree/fe4a2f69
Diff: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-master/diff/fe4a2f69

Branch: refs/heads/master
Commit: fe4a2f69ac399a0ea66ccf69b1ff34c91a003953
Parents: c54bc90
Author: Steve Blackmon @steveblackmon 
Authored: Wed Oct 12 12:01:13 2016 -0500
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Oct 12 12:01:13 2016 -0500

--
 pom.xml | 10 +++---
 1 file changed, 7 insertions(+), 3 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams-master/blob/fe4a2f69/pom.xml
--
diff --git a/pom.xml b/pom.xml
index 1b27b48..a416d04 100644
--- a/pom.xml
+++ b/pom.xml
@@ -239,11 +239,12 @@
 
 
 1.7
-2.10
+2.10
+2.10.6
 false
 UTF-8
 
UTF-8
-0.3-incubating-SNAPSHOT
+0.4-incubating-SNAPSHOT
 
 
 
@@ -381,6 +382,9 @@
 
 
src/site/diagrams
 
+
+
src/test/resources
+
 
 
 
@@ -908,7 +912,7 @@
 
 
 com.fasterxml.jackson.module
-jackson-module-scala_${scala.version}
+jackson-module-scala_${scala.suffix}
 ${jackson.version}
 
 



incubator-streams-master git commit: remove the tutorial menu as all relevant information has been re-organized under the examples section

2016-10-12 Thread sblackmon
Repository: incubator-streams-master
Updated Branches:
  refs/heads/master fe4a2f69a -> d0fff9488


remove the tutorial menu as all relevant information has been re-organized 
under the examples section


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams-master/repo
Commit: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-master/commit/d0fff948
Tree: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-master/tree/d0fff948
Diff: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-master/diff/d0fff948

Branch: refs/heads/master
Commit: d0fff94888e95622a57c596b58bcec4786fda71c
Parents: fe4a2f6
Author: Steve Blackmon @steveblackmon 
Authored: Wed Oct 12 13:00:56 2016 -0500
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Oct 12 13:00:56 2016 -0500

--
 src/site/markdown/tutorial/build.md   | 81 --
 src/site/markdown/tutorial/database.md| 43 --
 src/site/markdown/tutorial/docker.md  | 18 --
 src/site/markdown/tutorial/environment.md | 34 ---
 src/site/site.xml |  9 +--
 src/site/site_en.xml  | 13 +
 6 files changed, 4 insertions(+), 194 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams-master/blob/d0fff948/src/site/markdown/tutorial/build.md
--
diff --git a/src/site/markdown/tutorial/build.md 
b/src/site/markdown/tutorial/build.md
deleted file mode 100644
index a940bdc..000
--- a/src/site/markdown/tutorial/build.md
+++ /dev/null
@@ -1,81 +0,0 @@
-## Build streams and streams-examples from source
-
-This tutorial assumes you are using linux or Mac OS X.
-
-### Setup Tools
-
-You'll need the following tools installed in your command line:
-
-* Git
-* Java SDK 
-* Maven
-* Docker
-
- Git
-
-git -version
-
-| Possible result | Explanation |
-|-|-|
-| bash: git: No such file or directory | You need to install git |
-| git version < 2.7 | You should upgrade git for security reasons |
-| git version > 2.7 | You are all good |
-
- Maven and Java SDK
-
-Run from your command line:
-
-mvn -version
-
-| Possible result | Explanation |
-|-|-|
-| -bash: mvn: command not found | You need to install maven |
-| Error: JAVA_HOME is not defined correctly. | You need to install JDK |
-| Apache Maven >= 3.2.5+\nJava Version >= 1.7.0u72) | You're all good |
-| Apache Maven >= 3.2.5+\nJava Version >= 1.8.0u25) | You're all good |
-| Apache Maven < 3.2.5 | You need a newer version of maven |
-| Java Version < 1.7.0u72 | You need a newer version of maven |
-| Java Version < 1.8.0u25 | You need a newer JDK |
-
- Docker
-
-Run from your command line:
-
-docker version
-
-| Possible result | Explanation |
-|-|-|
-| bash: docker: No such file or directory | You need to install docker |
-| Client: Version: < 1.0.0 | You need a newer version of docker |
-| Server: Version: < 1.0.0 | You need a newer version of docker |
-| Client: Version: > 1.0.0\nServer: Version: > 1.0.0 | You are all good |
-
-See 
[streams-project-index.html](http://streams.incubator.apache.org/site/0.2-incubating/streams-project/index.html
 "streams-project/index.html") for more information.
-
-### Download Sources
-
-Run from your command line:
-
-git clone https://github.com/apache/incubator-streams
-git clone https://github.com/apache/incubator-streams-examples
-  
-### Build Projects
-
-Run from your command line:
-
-export MAVEN_OPTS="-Xmx2G"
-cd incubator-streams
-mvn clean install -Dmaven.test.skip.exec=true
-  
-| Possible result | Explanation |
-|-|-|
-| BUILD SUCCESSFUL | You are all good |
-| BUILD FAILED | Check yourself |
-  
-cd ../incubator-streams-examples
-mvn clean package
-  
-| Possible result | Explanation |
-|-|-|
-| BUILD SUCCESSFUL | You are all good |
-| BUILD FAILED | Check yourself |
\ No newline at end of file

http://git-wip-us.apache.org/repos/asf/incubator-streams-master/blob/d0fff948/src/site/markdown/tutorial/database.md
--
diff --git a/src/site/markdown/tutorial/database.md 
b/src/site/markdown/tutorial/database.md
deleted file mode 100644
index 1d7d752..000
--- a/src/site/markdown/tutorial/database.md
+++ /dev/null
@@ -1,43 +0,0 @@
-## Set up databases to store and analyze streams content
-
-This tutorial assumes you are using linux or Mac OS X.
-
-### Confirm Docker is healthy
-
-We'll assume you've got docker up and running.
-
-Run from your command line:
-
-docker ps
-  
-If you see a (possibly empty) list of running containers, you are good.
-
-### Run Elasticsearch
-
-Elasticsearch is 

[jira] [Comment Edited] (STREAMS-419) reboot: cleanup git branches and tags

2016-10-12 Thread Steve Blackmon (JIRA)

[ 
https://issues.apache.org/jira/browse/STREAMS-419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15545924#comment-15545924
 ] 

Steve Blackmon edited comment on STREAMS-419 at 10/12/16 6:07 PM:
--

per the reboot theme: get rid of any old or irrelevant asf branches


was (Author: steveblackmon):
per the reboot theme: get rid of anything old or irrelevant in JIRA

> reboot: cleanup git branches and tags 
> --
>
> Key: STREAMS-419
> URL: https://issues.apache.org/jira/browse/STREAMS-419
> Project: Streams
>  Issue Type: Task
>Reporter: Steve Blackmon
> Fix For: 0.4
>
>
> Get rid of anything old or irrelevant.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (STREAMS-414) Incorrect Documentation

2016-10-12 Thread Steve Blackmon (JIRA)

[ 
https://issues.apache.org/jira/browse/STREAMS-414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15569433#comment-15569433
 ] 

Steve Blackmon commented on STREAMS-414:


thanks Praveen.  This page has actually be removed as part of work on 
STREAMS-428.  Would appreciate feedback on the examples refactor in 
https://github.com/apache/incubator-streams-examples/pull/15 now or once it 
gets pushed to streams.staging.apache.org

> Incorrect Documentation 
> 
>
> Key: STREAMS-414
> URL: https://issues.apache.org/jira/browse/STREAMS-414
> Project: Streams
>  Issue Type: Bug
>Reporter: Praveen Adlakha
> Fix For: 0.4
>
>
> Hi All,
> At page :
> http://streams.incubator.apache.org/site/0.3-incubating-SNAPSHOT/streams-master/tutorial/environment.html
> The documentation says:
> export STREAMS=$(cd ~streams; pwd)
> however, it should be 
> export STREAMS=$(cd ~/streams; pwd)
> Thanks
> Praveen



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Jenkins build is unstable: Streams Trunk #232

2016-10-12 Thread Apache Jenkins Server
See 



Build failed in Jenkins: Streams Project Site #14

2016-10-12 Thread Apache Jenkins Server
See 

Changes:

[sblackmon] first take at STREAMS-389:

[sblackmon] start of implementation for STREAMS-398

[sblackmon] create streams-plugin-pojo

[sblackmon] rename Hive Generator

[sblackmon] test pom for streams-plugin-pojo

[sblackmon] STREAMS-398 - streams-schemas

[sblackmon] STREAMS-398 - pojo generation

[sblackmon] hive generation is looking pretty good

[sblackmon] re-enable hive plugin

[sblackmon] WIP for apachecon

[sblackmon] first take at STREAMS-389:

[sblackmon] refactoring, testing, documentation, CLI modes

[sblackmon] version bump

[sblackmon] pom version bump

[sblackmon] remove extra classes from merge

[sblackmon] remove version declaration from test

--
Started by user sblackmon
[EnvInject] - Loading node environment variables.
Building remotely on ubuntu-6 (Ubuntu yahoo-not-h2 ubuntu docker) in workspace 

Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://git-wip-us.apache.org/repos/asf/incubator-streams.git
 > git init  # 
 > timeout=10
Fetching upstream changes from 
https://git-wip-us.apache.org/repos/asf/incubator-streams.git
 > git --version # timeout=10
 > git -c core.askpass=true fetch --tags --progress 
 > https://git-wip-us.apache.org/repos/asf/incubator-streams.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git config remote.origin.url 
 > https://git-wip-us.apache.org/repos/asf/incubator-streams.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # 
 > timeout=10
 > git config remote.origin.url 
 > https://git-wip-us.apache.org/repos/asf/incubator-streams.git # timeout=10
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=10
No valid HEAD. Skipping the resetting
 > git clean -fdx # timeout=10
Fetching upstream changes from 
https://git-wip-us.apache.org/repos/asf/incubator-streams.git
 > git -c core.askpass=true fetch --tags --progress 
 > https://git-wip-us.apache.org/repos/asf/incubator-streams.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision b21ec4b5028f8fa65ea2223e22af7d7c7bf16d4a (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f b21ec4b5028f8fa65ea2223e22af7d7c7bf16d4a
 > git rev-list f14a25cedc6c41f1331fb8783cce1c59f4eb1961 # timeout=10
Parsing POMs
using settings config with name simple-deploy-settings-no-mirror
Replacing all maven server entries not found in credentials list is true
Downloaded artifact 
https://repository.apache.org/content/repositories/snapshots/org/apache/streams/streams-master/0.4-incubating-SNAPSHOT/maven-metadata.xml
Downloaded artifact 
https://repository.apache.org/content/repositories/snapshots/org/apache/streams/streams-master/0.4-incubating-SNAPSHOT/streams-master-0.4-incubating-20161012.174637-6.pom
Failed to transfer Could not find metadata 
org.apache.streams:streams-master:0.4-incubating-SNAPSHOT/maven-metadata.xml in 
sonatype (https://oss.sonatype.org/content/repositories/snapshots)
Failed to transfer Could not find metadata 
org.apache.streams:streams-master:0.4-incubating-SNAPSHOT/maven-metadata.xml in 
typesafe (http://repo.typesafe.com/typesafe/repo)
Failed to transfer Could not find metadata 
org.apache.streams:streams-master:0.4-incubating-SNAPSHOT/maven-metadata.xml in 
google-api-services (http://google-api-client-libraries.appspot.com/mavenrepo)
Downloaded artifact 
http://repository.apache.org/snapshots/org/apache/streams/streams-master/0.4-incubating-SNAPSHOT/maven-metadata.xml
Discovered a new module org.apache.streams:streams-plugins streams-plugins
Discovered a new module org.apache.streams.plugins:streams-plugin-cassandra 
streams-plugin-cassandra
Discovered a new module org.apache.streams.plugins:streams-plugin-elasticsearch 
streams-plugin-elasticsearch
Discovered a new module org.apache.streams.plugins:streams-plugin-hbase 
streams-plugin-hbase
Discovered a new module org.apache.streams.plugins:streams-plugin-hive 
streams-plugin-hive
Discovered a new module org.apache.streams.plugins:streams-plugin-pig 
streams-plugin-pig
Discovered a new module org.apache.streams.plugins:streams-plugin-pojo 
streams-plugin-pojo
Discovered a new module org.apache.streams.plugins:streams-plugin-scala 
streams-plugin-scala
Discovered a new module org.apache.streams:streams-schemas streams-schemas
Discovered a new module org.apache.streams:streams-schema-activitystreams 
streams-schema-activitystreams
Modules changed, recalculating dependency graph
Established TCP socket on 41203
maven32-agent.jar already up to date
maven32-interceptor.jar already up to date
maven3-interceptor-commons.jar already up to date
[Streams Project Site] $ /home/jenkins/tools/java/latest1.8/bin/java -Xmx2g 
-Xms256m -XX:MaxPermSize=512m -Dfile.

incubator-streams git commit: update ids to match final destination of schemata

2016-10-12 Thread sblackmon
Repository: incubator-streams
Updated Branches:
  refs/heads/master b21ec4b50 -> c16c2b6bd


update ids to match final destination of schemata


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/c16c2b6b
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/c16c2b6b
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/c16c2b6b

Branch: refs/heads/master
Commit: c16c2b6bd2da655c54f105a76c7a7d8a35e63770
Parents: b21ec4b
Author: Steve Blackmon @steveblackmon 
Authored: Wed Oct 12 13:40:56 2016 -0500
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Oct 12 13:40:56 2016 -0500

--
 .../src/main/jsonschema/objectTypes/alert.json | 2 +-
 .../src/main/jsonschema/objectTypes/application.json   | 2 +-
 .../src/main/jsonschema/objectTypes/article.json   | 2 +-
 .../src/main/jsonschema/objectTypes/audio.json | 2 +-
 .../src/main/jsonschema/objectTypes/badge.json | 2 +-
 .../src/main/jsonschema/objectTypes/binary.json| 2 +-
 .../src/main/jsonschema/objectTypes/bookmark.json  | 2 +-
 .../src/main/jsonschema/objectTypes/comment.json   | 2 +-
 .../src/main/jsonschema/objectTypes/device.json| 2 +-
 .../src/main/jsonschema/objectTypes/event.json | 2 +-
 .../src/main/jsonschema/objectTypes/file.json  | 2 +-
 .../src/main/jsonschema/objectTypes/folder.json| 2 +-
 .../src/main/jsonschema/objectTypes/game.json  | 2 +-
 .../src/main/jsonschema/objectTypes/group.json | 2 +-
 .../src/main/jsonschema/objectTypes/image.json | 2 +-
 .../src/main/jsonschema/objectTypes/issue.json | 2 +-
 .../src/main/jsonschema/objectTypes/job.json   | 2 +-
 .../src/main/jsonschema/objectTypes/list.json  | 2 +-
 .../src/main/jsonschema/objectTypes/note.json  | 2 +-
 .../src/main/jsonschema/objectTypes/offer.json | 2 +-
 .../src/main/jsonschema/objectTypes/organization.json  | 2 +-
 .../src/main/jsonschema/objectTypes/page.json  | 2 +-
 .../src/main/jsonschema/objectTypes/permission.json| 2 +-
 .../src/main/jsonschema/objectTypes/person.json| 2 +-
 .../src/main/jsonschema/objectTypes/photo-album.json   | 2 +-
 .../src/main/jsonschema/objectTypes/photo.json | 2 +-
 .../src/main/jsonschema/objectTypes/place.json | 2 +-
 .../src/main/jsonschema/objectTypes/playlist.json  | 2 +-
 .../src/main/jsonschema/objectTypes/process.json   | 2 +-
 .../src/main/jsonschema/objectTypes/product.json   | 2 +-
 .../src/main/jsonschema/objectTypes/property.json  | 2 +-
 .../src/main/jsonschema/objectTypes/question.json  | 2 +-
 .../src/main/jsonschema/objectTypes/review.json| 2 +-
 .../src/main/jsonschema/objectTypes/role.json  | 2 +-
 .../src/main/jsonschema/objectTypes/service.json   | 2 +-
 .../src/main/jsonschema/objectTypes/song.json  | 2 +-
 .../src/main/jsonschema/objectTypes/status.json| 2 +-
 .../src/main/jsonschema/objectTypes/task.json  | 2 +-
 .../src/main/jsonschema/objectTypes/team.json  | 2 +-
 .../src/main/jsonschema/objectTypes/video.json | 2 +-
 40 files changed, 40 insertions(+), 40 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/c16c2b6b/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/objectTypes/alert.json
--
diff --git 
a/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/objectTypes/alert.json
 
b/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/objectTypes/alert.json
index 0fa4d60..e85dc1b 100644
--- 
a/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/objectTypes/alert.json
+++ 
b/streams-schemas/streams-schema-activitystreams/src/main/jsonschema/objectTypes/alert.json
@@ -4,7 +4,7 @@
 
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
 "http://www.apache.org/licenses/LICENSE-2.0";
 ],
-"id": 
"http://streams.incubator.apache.org/site/0.3-incubating-SNAPSHOT/streams-schemas/objectTypes/alert.json#";,
+"id": 
"http://streams.incubator.apache.org/site/0.4-incubating-SNAPSHOT/streams-project/streams-schemas/objectTypes/alert.json#";,
 "type": "obj

[10/53] [abbrv] incubator-streams git commit: re-enable hive plugin

2016-10-12 Thread mfranklin
re-enable hive plugin


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/114c1c5f
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/114c1c5f
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/114c1c5f

Branch: refs/heads/invalid_headers
Commit: 114c1c5ff31447a0ab85d9a2518d5ce08284d3ff
Parents: e84dcd7
Author: Steve Blackmon @steveblackmon 
Authored: Tue May 3 16:33:47 2016 -0500
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Jun 1 12:49:27 2016 -0500

--
 streams-plugins/pom.xml | 1 +
 1 file changed, 1 insertion(+)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/114c1c5f/streams-plugins/pom.xml
--
diff --git a/streams-plugins/pom.xml b/streams-plugins/pom.xml
index 390c8a0..b90e2d5 100644
--- a/streams-plugins/pom.xml
+++ b/streams-plugins/pom.xml
@@ -36,6 +36,7 @@
 
 
 
+streams-plugin-hive
 streams-plugin-pojo

 



[40/53] [abbrv] incubator-streams git commit: version bump

2016-10-12 Thread mfranklin
version bump


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/18a29b00
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/18a29b00
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/18a29b00

Branch: refs/heads/invalid_headers
Commit: 18a29b0079f68eaae008e4eabcc5929e124dc63b
Parents: abc58b4
Author: Steve Blackmon @steveblackmon 
Authored: Wed Oct 12 12:27:44 2016 -0500
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Oct 12 12:27:44 2016 -0500

--
 streams-plugins/pom.xml   | 2 +-
 streams-plugins/streams-plugin-scala/pom.xml  | 7 +--
 .../src/test/resources/streams-plugin-scala/pom.xml   | 4 ++--
 streams-pojo/pom.xml  | 2 +-
 4 files changed, 9 insertions(+), 6 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/18a29b00/streams-plugins/pom.xml
--
diff --git a/streams-plugins/pom.xml b/streams-plugins/pom.xml
index f2c8999..c79e5c2 100644
--- a/streams-plugins/pom.xml
+++ b/streams-plugins/pom.xml
@@ -22,7 +22,7 @@
 
 streams-project
 org.apache.streams
-0.3-incubating-SNAPSHOT
+0.4-incubating-SNAPSHOT
 ../pom.xml
 
 

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/18a29b00/streams-plugins/streams-plugin-scala/pom.xml
--
diff --git a/streams-plugins/streams-plugin-scala/pom.xml 
b/streams-plugins/streams-plugin-scala/pom.xml
index 3988142..1e50141 100644
--- a/streams-plugins/streams-plugin-scala/pom.xml
+++ b/streams-plugins/streams-plugin-scala/pom.xml
@@ -21,13 +21,13 @@
 4.0.0
 org.apache.streams.plugins
 streams-plugin-scala
-0.3-incubating-SNAPSHOT
+0.4-incubating-SNAPSHOT
 maven-plugin
 
 
 org.apache.streams
 streams-plugins
-0.3-incubating-SNAPSHOT
+0.4-incubating-SNAPSHOT
 
 
 
@@ -248,6 +248,9 @@
 
 
 
+
+${scala.version}
+
 
 
 

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/18a29b00/streams-plugins/streams-plugin-scala/src/test/resources/streams-plugin-scala/pom.xml
--
diff --git 
a/streams-plugins/streams-plugin-scala/src/test/resources/streams-plugin-scala/pom.xml
 
b/streams-plugins/streams-plugin-scala/src/test/resources/streams-plugin-scala/pom.xml
index b4867a0..3179e95 100644
--- 
a/streams-plugins/streams-plugin-scala/src/test/resources/streams-plugin-scala/pom.xml
+++ 
b/streams-plugins/streams-plugin-scala/src/test/resources/streams-plugin-scala/pom.xml
@@ -5,7 +5,7 @@
 
 org.apache.streams.plugins
 streams-plugin-scala-test
-0.3-incubating-SNAPSHOT
+0.4-incubating-SNAPSHOT
 jar
 Test StreamsPojoScalaMojo
 
@@ -22,7 +22,7 @@
 
 org.apache.streams.plugins
 streams-plugin-scala
-0.3-incubating-SNAPSHOT
+0.4-incubating-SNAPSHOT
 
 org.apache.streams.pojo.json
 target/test-classes/streams-scala-plugin/

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/18a29b00/streams-pojo/pom.xml
--
diff --git a/streams-pojo/pom.xml b/streams-pojo/pom.xml
index eab4b59..e3f5d3f 100644
--- a/streams-pojo/pom.xml
+++ b/streams-pojo/pom.xml
@@ -64,7 +64,7 @@
 
 
 com.fasterxml.jackson.module
-jackson-module-scala_2.10
+jackson-module-scala_${scala.suffix}
 
 
 



[38/53] [abbrv] incubator-streams git commit: Merge remote-tracking branch 'steveblackmon/STREAMS-389'

2016-10-12 Thread mfranklin
Merge remote-tracking branch 'steveblackmon/STREAMS-389'


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/8e929ebf
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/8e929ebf
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/8e929ebf

Branch: refs/heads/invalid_headers
Commit: 8e929ebf811abf5402514bd5030f064a02157127
Parents: f14a25c c89fe1e
Author: Steve Blackmon @steveblackmon 
Authored: Wed Oct 12 10:50:44 2016 -0500
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Oct 12 10:50:44 2016 -0500

--
 pom.xml |   1 +
 streams-plugins/pom.xml |  56 +++
 streams-plugins/streams-plugin-scala/pom.xml| 243 
 .../streams/plugins/StreamsPojoScala.java   | 371 +++
 .../streams/plugins/StreamsPojoScalaMojo.java   |  71 
 .../plugins/test/StreamsPojoScalaTest.java  |  55 +++
 .../test/resources/streams-plugin-scala/pom.xml |  40 ++
 7 files changed, 837 insertions(+)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/8e929ebf/pom.xml
--
diff --cc pom.xml
index 466e94b,58304e0..48a5ad6
--- a/pom.xml
+++ b/pom.xml
@@@ -174,10 -172,11 +174,11 @@@
  streams-contrib
  streams-components
  streams-monitoring
 -streams-osgi-components
  streams-pojo
  streams-pojo-extensions
+ streams-plugins
  streams-runtimes
 +streams-testing
  streams-util
  streams-verbs
  



[53/53] [abbrv] incubator-streams git commit: Added license headers

2016-10-12 Thread mfranklin
Added license headers


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/b8f36f7b
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/b8f36f7b
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/b8f36f7b

Branch: refs/heads/invalid_headers
Commit: b8f36f7b9237442ccc79b3b4135a8713f21792ea
Parents: 2652ba3
Author: Matt Franklin 
Authored: Wed Oct 12 14:59:29 2016 -0400
Committer: Matt Franklin 
Committed: Wed Oct 12 14:59:29 2016 -0400

--
 streams-plugins/pom.xml|  1 +
 streams-plugins/streams-plugin-cassandra/pom.xml   |  1 +
 .../StreamsCassandraGenerationConfig.java  |  1 +
 .../StreamsCassandraResourceGenerator.java |  1 +
 .../StreamsCassandraResourceGeneratorMojo.java |  1 +
 .../StreamsCassandraResourceGeneratorCLITest.java  |  1 +
 .../StreamsCassandraResourceGeneratorMojoTest.java |  1 +
 .../StreamsCassandraResourceGeneratorTest.java |  1 +
 .../resources/streams-plugin-cassandra/pom.xml |  1 +
 .../streams-plugin-elasticsearch/pom.xml   |  1 +
 .../StreamsElasticsearchGenerationConfig.java  |  1 +
 .../StreamsElasticsearchResourceGenerator.java |  1 +
 .../StreamsElasticsearchResourceGeneratorMojo.java |  1 +
 ...reamsElasticsearchResourceGeneratorCLITest.java |  1 +
 ...eamsElasticsearchResourceGeneratorMojoTest.java |  1 +
 .../StreamsElasticsearchResourceGeneratorTest.java |  1 +
 .../resources/streams-plugin-elasticsearch/pom.xml |  1 +
 .../src/test/resources/Tweet.hql   | 16 
 .../src/test/resources/expected/activity.hql   | 16 
 .../src/test/resources/expected/collection.hql | 16 
 .../src/test/resources/expected/media_link.hql | 16 
 .../src/test/resources/expected/object.hql | 16 
 .../test/resources/expected/objectTypes/place.hql  | 17 +
 .../src/test/resources/expected/verbs/purchase.hql | 17 +
 .../src/test/resources/expected/media_link.pig | 16 
 .../test/resources/expected/objectTypes/file.pig   | 16 
 .../resources/expected/objectTypes/photo-album.pig | 16 
 27 files changed, 179 insertions(+)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/b8f36f7b/streams-plugins/pom.xml
--
diff --git a/streams-plugins/pom.xml b/streams-plugins/pom.xml
index c79e5c2..44487a0 100644
--- a/streams-plugins/pom.xml
+++ b/streams-plugins/pom.xml
@@ -6,6 +6,7 @@
   ~ regarding copyright ownership.  The ASF licenses this file
   ~ to you under the Apache License, Version 2.0 (the
   ~ "License"); you may not use this file except in compliance
+  ~ with the License.  You may obtain a copy of the License at
   ~
   ~   http://www.apache.org/licenses/LICENSE-2.0
   ~

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/b8f36f7b/streams-plugins/streams-plugin-cassandra/pom.xml
--
diff --git a/streams-plugins/streams-plugin-cassandra/pom.xml 
b/streams-plugins/streams-plugin-cassandra/pom.xml
index c378a2b..e191e40 100644
--- a/streams-plugins/streams-plugin-cassandra/pom.xml
+++ b/streams-plugins/streams-plugin-cassandra/pom.xml
@@ -6,6 +6,7 @@
   ~ regarding copyright ownership.  The ASF licenses this file
   ~ to you under the Apache License, Version 2.0 (the
   ~ "License"); you may not use this file except in compliance
+  ~ with the License.  You may obtain a copy of the License at
   ~
   ~   http://www.apache.org/licenses/LICENSE-2.0
   ~

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/b8f36f7b/streams-plugins/streams-plugin-cassandra/src/main/java/org/apache/streams/plugins/cassandra/StreamsCassandraGenerationConfig.java
--
diff --git 
a/streams-plugins/streams-plugin-cassandra/src/main/java/org/apache/streams/plugins/cassandra/StreamsCassandraGenerationConfig.java
 
b/streams-plugins/streams-plugin-cassandra/src/main/java/org/apache/streams/plugins/cassandra/StreamsCassandraGenerationConfig.java
index 613cba2..964fff6 100644
--- 
a/streams-plugins/streams-plugin-cassandra/src/main/java/org/apache/streams/plugins/cassandra/StreamsCassandraGenerationConfig.java
+++ 
b/streams-plugins/streams-plugin-cassandra/src/main/java/org/apache/streams/plugins/cassandra/StreamsCassandraGenerationConfig.java
@@ -5,6 +5,7 @@
  * regarding copyright ownership.  The ASF licenses this file
  * to you under the Apache License, Version 2.0 (the
  * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy o

[46/53] [abbrv] incubator-streams git commit: Added missing license headers for elasticsearch plugin

2016-10-12 Thread mfranklin
Added missing license headers for elasticsearch plugin


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/4d32e640
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/4d32e640
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/4d32e640

Branch: refs/heads/invalid_headers
Commit: 4d32e640f8a7f97cc2c2f382475f685cf7f7cf82
Parents: 94f7ea0
Author: Matt Franklin 
Authored: Wed Oct 12 14:20:19 2016 -0400
Committer: Matt Franklin 
Committed: Wed Oct 12 14:20:19 2016 -0400

--
 .../StreamsElasticsearchGenerationConfig.java  | 17 +
 .../StreamsElasticsearchResourceGenerator.java | 17 +
 .../StreamsElasticsearchResourceGeneratorMojo.java | 17 +
 ...reamsElasticsearchResourceGeneratorCLITest.java | 17 +
 ...eamsElasticsearchResourceGeneratorMojoTest.java | 17 +
 .../StreamsElasticsearchResourceGeneratorTest.java | 17 +
 .../resources/streams-plugin-elasticsearch/pom.xml | 17 +
 7 files changed, 119 insertions(+)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/4d32e640/streams-plugins/streams-plugin-elasticsearch/src/main/java/org/apache/streams/plugins/elasticsearch/StreamsElasticsearchGenerationConfig.java
--
diff --git 
a/streams-plugins/streams-plugin-elasticsearch/src/main/java/org/apache/streams/plugins/elasticsearch/StreamsElasticsearchGenerationConfig.java
 
b/streams-plugins/streams-plugin-elasticsearch/src/main/java/org/apache/streams/plugins/elasticsearch/StreamsElasticsearchGenerationConfig.java
index 71bbdf8..42cd6f6 100644
--- 
a/streams-plugins/streams-plugin-elasticsearch/src/main/java/org/apache/streams/plugins/elasticsearch/StreamsElasticsearchGenerationConfig.java
+++ 
b/streams-plugins/streams-plugin-elasticsearch/src/main/java/org/apache/streams/plugins/elasticsearch/StreamsElasticsearchGenerationConfig.java
@@ -1,3 +1,20 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ *
+ *   http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied.  See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
 package org.apache.streams.plugins.elasticsearch;
 
 import org.apache.streams.util.schema.GenerationConfig;

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/4d32e640/streams-plugins/streams-plugin-elasticsearch/src/main/java/org/apache/streams/plugins/elasticsearch/StreamsElasticsearchResourceGenerator.java
--
diff --git 
a/streams-plugins/streams-plugin-elasticsearch/src/main/java/org/apache/streams/plugins/elasticsearch/StreamsElasticsearchResourceGenerator.java
 
b/streams-plugins/streams-plugin-elasticsearch/src/main/java/org/apache/streams/plugins/elasticsearch/StreamsElasticsearchResourceGenerator.java
index 4d16f7e..d8497dc 100644
--- 
a/streams-plugins/streams-plugin-elasticsearch/src/main/java/org/apache/streams/plugins/elasticsearch/StreamsElasticsearchResourceGenerator.java
+++ 
b/streams-plugins/streams-plugin-elasticsearch/src/main/java/org/apache/streams/plugins/elasticsearch/StreamsElasticsearchResourceGenerator.java
@@ -1,3 +1,20 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ *
+ *   http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied.  See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
 package org.apache.streams.plugins.elasticsearch;
 
 import com.fasterxml.jackson.core.JsonProcessingException;

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/4d32e640/streams

[09/53] [abbrv] incubator-streams git commit: STREAMS-398 - pojo generation

2016-10-12 Thread mfranklin
STREAMS-398 - pojo generation

code and plugin for generating POJOs now resides in streams-project
unit testing for generating POJOs without maven
unit testing for generating POJOs with maven


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/7b8ef0a2
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/7b8ef0a2
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/7b8ef0a2

Branch: refs/heads/invalid_headers
Commit: 7b8ef0a22707af88426c18e0869ad01a261602c5
Parents: 0424855
Author: Steve Blackmon @steveblackmon 
Authored: Thu Apr 21 11:42:44 2016 -0500
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Jun 1 12:49:27 2016 -0500

--
 pom.xml |   1 +
 streams-plugins/streams-plugin-pojo/pom.xml |  28 ++-
 .../plugins/StreamsPojoGenerationConfig.java| 230 ---
 .../plugins/StreamsPojoSourceGenerator.java |  98 
 .../plugins/StreamsPojoSourceGeneratorMojo.java |  80 +++
 .../StreamsPojoSourceGeneratorMojoTest.java |  96 
 .../test/StreamsPojoSourceGeneratorTest.java|  43 +++-
 .../test/resources/streams-plugin-pojo/pom.xml  |  90 +++-
 streams-pojo/pom.xml|   6 +
 9 files changed, 421 insertions(+), 251 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/7b8ef0a2/pom.xml
--
diff --git a/pom.xml b/pom.xml
index cb935af..6010572 100644
--- a/pom.xml
+++ b/pom.xml
@@ -177,6 +177,7 @@
 streams-pojo-extensions
 streams-plugins
 streams-runtimes
+streams-schemas
 streams-testing
 streams-util
 streams-verbs

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/7b8ef0a2/streams-plugins/streams-plugin-pojo/pom.xml
--
diff --git a/streams-plugins/streams-plugin-pojo/pom.xml 
b/streams-plugins/streams-plugin-pojo/pom.xml
index 399a371..d7210c8 100644
--- a/streams-plugins/streams-plugin-pojo/pom.xml
+++ b/streams-plugins/streams-plugin-pojo/pom.xml
@@ -43,8 +43,14 @@
 ${project.version}
 
 
+org.apache.streams
+streams-schemas
+${project.version}
+
+
 org.jsonschema2pojo
 jsonschema2pojo-core
+0.4.10
 
 
 commons-logging
@@ -55,6 +61,7 @@
 
 org.jsonschema2pojo
 jsonschema2pojo-maven-plugin
+0.4.10
 
 
 org.apache.streams
@@ -86,6 +93,12 @@
 test
 
 
+org.apache.maven.shared
+maven-verifier
+1.6
+test
+
+
 org.apache.maven
 maven-core
 3.3.3
@@ -216,19 +229,20 @@
 
 org.apache.maven.plugins
 maven-dependency-plugin
-2.4
+
+**/*.json
+
${project.build.directory}/test-classes/streams-schemas
+org.apache.streams
+streams-schemas
+jar,test-jar
+
 
 
-resource-dependencies
+test-resource-dependencies
 process-test-resources
 
 unpack-dependencies
 
-
-
streams-pojo
-**/*.json
-
${project.build.directory}/test-classes
-
 
 
 

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/7b8ef0a2/streams-plugins/streams-plugin-pojo/src/main/java/org/apache/streams/plugins/StreamsPojoGenerationConfig.java
--
diff --git 
a/streams-plugins/streams-plugin-pojo/src/main/java/org/apache/streams/plugins/StreamsPojoGenerationConfig.java
 
b/streams-plugins/streams-plugin-pojo/src/main/java/org/apache/streams/plugins/StreamsPojoGenerationConfig.java
index b42ccf9..4c1f850 100644
--- 
a/streams-plugins/streams-plugin-pojo/src/main/java/org/apache/streams/plugins/StreamsPojoGenerationConfig.java
+++ 
b/streams-plugins/streams-plugin-pojo/src/main/java/org/apache/streams/plugins/StreamsPojoGenerationConfig.java
@@ -2,197 +2,67 @@ package org.apache.streams.plugins;
 
 import org.jsonschema2pojo.AnnotationStyle;
 import org.jsonschema2pojo.Annotator;
+import or

[37/53] [abbrv] incubator-streams git commit: Merge remote-tracking branch 'eponvert/STREAMS-410'

2016-10-12 Thread mfranklin
Merge remote-tracking branch 'eponvert/STREAMS-410'


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/f14a25ce
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/f14a25ce
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/f14a25ce

Branch: refs/heads/invalid_headers
Commit: f14a25cedc6c41f1331fb8783cce1c59f4eb1961
Parents: f1e1e11 ce7aa24
Author: Steve Blackmon @steveblackmon 
Authored: Wed Oct 12 09:58:57 2016 -0500
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Oct 12 09:58:57 2016 -0500

--
 pom.xml |   1 -
 .../streams-processor-lucene/pom.xml| 163 -
 .../lucene/LuceneSimpleTaggingProcessor.java| 355 ---
 .../lucene/LuceneTaggerConfiguration.json   |  29 --
 .../lucene/TestLucenSimpleTaggingProcessor.java | 171 -
 .../src/test/resources/TestTags.tsv |   2 -
 streams-contrib/streams-processor-tika/pom.xml  | 162 -
 .../org/apache/streams/tika/CategoryParser.java | 114 --
 .../org/apache/streams/tika/TikaProcessor.java  | 139 
 .../apache/streams/tika/BoilerPipeArticle.json  |  76 
 .../apache/streams/tika/TestCategoryParser.java |  30 --
 .../apache/streams/tika/TestTikaProcessor.java  |  29 --
 .../activity-consumer/osgi.bnd  |   9 -
 .../activity-consumer/pom.xml   | 171 -
 .../activityconsumer/ActivityConsumer.java  |  39 --
 .../ActivityConsumerWarehouse.java  |  31 --
 .../impl/ActivityConsumerWarehouseImpl.java |  57 ---
 .../impl/PushActivityConsumer.java  | 106 --
 .../spring/activity-consumer-context.xml|  28 --
 .../META-INF/spring/activity-consumer-osgi.xml  |  29 --
 .../src/main/resources/readme.txt   |   1 -
 .../activity-registration/osgi.bnd  |   9 -
 .../activity-registration/pom.xml   | 130 ---
 .../ActivityPublisherRegistration.java  |  29 --
 .../ActivityStreamsSubscriberRegistration.java  |  29 --
 .../impl/ActivityPublisherRegistrationImpl.java |  67 
 ...tivityStreamsSubscriberRegistrationImpl.java |  67 
 .../activity-registration-context-osgi.xml  |  30 --
 .../spring/activity-registration-context.xml|  29 --
 .../src/main/resources/readme.txt   |   1 -
 .../activity-subscriber/osgi.bnd|   9 -
 .../activity-subscriber/pom.xml | 134 ---
 .../ActivityStreamsSubscriber.java  |  38 --
 .../ActivityStreamsSubscriberWarehouse.java |  34 --
 .../ActivityStreamsSubscription.java|  38 --
 .../ActivityStreamsSubscriptionFilter.java  |  34 --
 .../ActivityStreamsSubscriptionOutput.java  |  47 ---
 .../impl/ActivityStreamsSubscriberDelegate.java | 126 ---
 .../ActivityStreamsSubscriberWarehouseImpl.java |  60 
 ...yStreamsSubscriptionCassandraFilterImpl.java |  42 ---
 .../impl/ActivityStreamsSubscriptionImpl.java   |  74 
 ...vityStreamsSubscriptionLuceneFilterImpl.java |  43 ---
 .../spring/activity-subscriber-context.xml  |  28 --
 .../spring/activity-subscriber-osgi.xml |  29 --
 .../src/main/resources/readme.txt   |   1 -
 .../src/site/resources/readme.txt   |   1 -
 streams-osgi-components/pom.xml |  43 ---
 streams-runtimes/pom.xml|   1 -
 .../jsonschema/SparkRuntimeConfiguration.json   |  27 --
 .../streams-runtime-webapp/README.md|   8 -
 streams-runtimes/streams-runtime-webapp/pom.xml | 250 -
 .../aggregation/ActivityAggregator.java |  59 ---
 .../configuration/EipConfigurator.java  | 201 ---
 .../ActivityPublisherRegistrationProcessor.java |  72 
 ...yStreamsSubscriberRegistrationProcessor.java |  93 -
 .../routers/ActivityConsumerRouteBuilder.java   |  32 --
 .../ActivityStreamsSubscriberRouteBuilder.java  |  32 --
 .../routers/impl/ActivityConsumerRouter.java| 144 
 .../impl/ActivityStreamsSubscriberRouter.java   | 141 
 .../messaging/service/ActivityService.java  |  31 --
 .../messaging/service/SubscriptionService.java  |  29 --
 .../service/impl/CassandraActivityService.java  |  96 -
 .../impl/CassandraSubscriptionService.java  |  43 ---
 .../META-INF/spring/propertiesLoader.xml|  35 --
 .../spring/streams-eip-applicationContext.xml   | 113 --
 .../streams-eip-osgi-component-import.xml   |  38 --
 .../META-INF/spring/streamsCamelContext.xml |  96 -
 .../main/resources/META-INF/streams.properties  |  41 ---
 .../impl/CassandraActivityServiceTest.java  |  86 -
 69 files changed, 4582 deletions(-)
--




[31/53] [abbrv] incubator-streams git commit: resolves STREAMS-409

2016-10-12 Thread mfranklin
resolves STREAMS-409


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/012d383e
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/012d383e
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/012d383e

Branch: refs/heads/invalid_headers
Commit: 012d383ef690259cda96272676094c3ee8f223e7
Parents: a726b3c
Author: charlesmims 
Authored: Tue Oct 11 13:40:08 2016 -0500
Committer: charlesmims 
Committed: Tue Oct 11 13:40:08 2016 -0500

--
 NOTICE | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/012d383e/NOTICE
--
diff --git a/NOTICE b/NOTICE
index 2bb8312..1a7f648 100644
--- a/NOTICE
+++ b/NOTICE
@@ -1,5 +1,5 @@
 Apache Streams
-Copyright 2012-2015 The Apache Software Foundation
+Copyright 2012-2016 The Apache Software Foundation
 
 This product includes software developed at
 The Apache Software Foundation (http://www.apache.org/).



[06/53] [abbrv] incubator-streams git commit: rename Hive Generator

2016-10-12 Thread mfranklin
rename Hive Generator


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/7d318c3f
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/7d318c3f
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/7d318c3f

Branch: refs/heads/invalid_headers
Commit: 7d318c3fba9faf106eed8797263d52114a312d6c
Parents: ded4ad6
Author: Steve Blackmon @steveblackmon 
Authored: Mon Mar 28 08:32:19 2016 -0500
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Jun 1 12:49:27 2016 -0500

--
 .../streams/plugins/StreamsHiveResourceGenerator.java | 10 ++
 1 file changed, 6 insertions(+), 4 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/7d318c3f/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/StreamsHiveResourceGenerator.java
--
diff --git 
a/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/StreamsHiveResourceGenerator.java
 
b/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/StreamsHiveResourceGenerator.java
index 4edacf0..1efb15e 100644
--- 
a/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/StreamsHiveResourceGenerator.java
+++ 
b/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/StreamsHiveResourceGenerator.java
@@ -27,15 +27,14 @@ public class StreamsHiveResourceGenerator implements 
Runnable {
 
 private final static String LS = System.getProperty("line.separator");
 
-private StreamsPojoHiveMojo mojo;
+private StreamsHiveResourceGeneratorMojo mojo;
 
 String inDir = "./target/test-classes/activities";
 String outDir = "./target/generated-sources/hive";
-String packages[] = {"org.apache.streams.pojo.json"};
 
 public void main(String[] args) {
 StreamsHiveResourceGenerator streamsHiveResourceGenerator = new 
StreamsHiveResourceGenerator();
-Thread thread = new Thread(streamsPojoScala);
+Thread thread = new Thread(streamsHiveResourceGenerator);
 thread.start();
 try {
 thread.join();
@@ -47,7 +46,7 @@ public class StreamsHiveResourceGenerator implements Runnable 
{
 return;
 }
 
-public StreamsHiveResourceGenerator(StreamsPojoHiveMojo mojo) {
+public StreamsHiveResourceGenerator(StreamsHiveResourceGeneratorMojo mojo) 
{
 this.mojo = mojo;
 if (mojo != null &&
 mojo.getTarget() != null &&
@@ -67,6 +66,9 @@ public class StreamsHiveResourceGenerator implements Runnable 
{
 
 public void run() {
 
+List schemaFiles;
+
+
 List> serializableClasses = detectSerializableClasses();
 
 LOGGER.info("Detected {} serialiables:", serializableClasses.size());



[01/53] [abbrv] incubator-streams git commit: STREAMS-398 - streams-schemas

2016-10-12 Thread mfranklin
Repository: incubator-streams
Updated Branches:
  refs/heads/invalid_headers 2d8ff2439 -> b8f36f7b9


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/0424855c/streams-schemas/src/site/resources/verbs/tag.json
--
diff --git a/streams-schemas/src/site/resources/verbs/tag.json 
b/streams-schemas/src/site/resources/verbs/tag.json
new file mode 100644
index 000..6208eae
--- /dev/null
+++ b/streams-schemas/src/site/resources/verbs/tag.json
@@ -0,0 +1,24 @@
+{
+"$schema": "http://json-schema.org/draft-03/schema";,
+"$license": [
+
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+],
+"id": "#",
+"type": "object",
+"title": "Tag",
+"description": "Indicates that the actor has associated the object with 
the target. For example, if the actor specifies that a particular user appears 
in a photo. the object is the user and the target is the photo.",
+"extends": {
+"$ref": "../activity.json"
+},
+"properties": {
+"verb": {
+"type": "string",
+"default": "tag"
+},
+"title": {
+"type": "string",
+"default": "{actor.displayName} tagged {object.displayName} as 
{target.displayName}"
+}
+}
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/0424855c/streams-schemas/src/site/resources/verbs/terminate.json
--
diff --git a/streams-schemas/src/site/resources/verbs/terminate.json 
b/streams-schemas/src/site/resources/verbs/terminate.json
new file mode 100644
index 000..280eb31
--- /dev/null
+++ b/streams-schemas/src/site/resources/verbs/terminate.json
@@ -0,0 +1,24 @@
+{
+"$schema": "http://json-schema.org/draft-03/schema";,
+"$license": [
+
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+],
+"id": "#",
+"type": "object",
+"title": "Terminate",
+"description": "Indicates that the actor has terminated the object.",
+"extends": {
+"$ref": "../activity.json"
+},
+"properties": {
+"verb": {
+"type": "string",
+"default": "terminate"
+},
+"title": {
+"type": "string",
+"default": "{actor.displayName} terminated {object.displayName}"
+}
+}
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/0424855c/streams-schemas/src/site/resources/verbs/tie.json
--
diff --git a/streams-schemas/src/site/resources/verbs/tie.json 
b/streams-schemas/src/site/resources/verbs/tie.json
new file mode 100644
index 000..7530ed2
--- /dev/null
+++ b/streams-schemas/src/site/resources/verbs/tie.json
@@ -0,0 +1,24 @@
+{
+"$schema": "http://json-schema.org/draft-03/schema";,
+"$license": [
+
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+],
+"id": "#",
+"type": "object",
+"title": "Tie",
+"description": "Indicates that the actor has neither won or lost the 
object. This verb is generally only applicable when the object represents some 
form of competition, such as a game.",
+"extends": {
+"$ref": "../activity.json"
+},
+"properties": {
+"verb": {
+"type": "string",
+"default": "tie"
+},
+"title": {
+"type": "string",
+"default": "{actor.displayName} tied at {object.displayName}"
+}
+}
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/0424855c/streams-schemas/src/site/resources/verbs/unfavorite.json
--
diff --git a/streams-schemas/src/site/resources/verbs/unfavorite.json 
b/streams-schemas/src/site/resources/verbs/unfavorite.json
new file mode 100644
index 000..bfa9c20
--- /dev/null
+++ b/streams-schemas/src/site/resources/verbs/unfavorite.json
@@ -0,0 +1,24 @@
+{
+"$schema": "http://json-schema.org/draft-03/schema";,
+"$license": [
+
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+],
+"id": "#",
+"type": "object",
+"title": "UnFavorite",
+"description": "Indicates that the actor has removed the object from the 
collection of favorited items.",
+"extends": {
+"$ref": "../activity.json"
+},
+"properties": {
+"verb": {
+"type": "string",
+"default": "unfavorite"
+},
+"title": {
+"type": "string",
+"default": "{actor.displayName} removed {object.displayName} as a 

[52/53] [abbrv] incubator-streams git commit: Added missing license headers for scala plugin

2016-10-12 Thread mfranklin
Added missing license headers for scala plugin


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/2652ba3e
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/2652ba3e
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/2652ba3e

Branch: refs/heads/invalid_headers
Commit: 2652ba3e9d22093eb5a5935b4a13fa9c9dcad785
Parents: 3b7509f
Author: Matt Franklin 
Authored: Wed Oct 12 14:23:00 2016 -0400
Committer: Matt Franklin 
Committed: Wed Oct 12 14:23:00 2016 -0400

--
 streams-plugins/streams-plugin-scala/pom.xml |  1 +
 .../plugins/StreamsScalaSourceGenerator.java | 19 +++
 .../plugins/StreamsScalaSourceGeneratorMojo.java | 19 +++
 .../test/StreamsScalaSourceGeneratorTest.java| 19 +++
 .../test/resources/streams-plugin-scala/pom.xml  | 19 +++
 5 files changed, 77 insertions(+)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/2652ba3e/streams-plugins/streams-plugin-scala/pom.xml
--
diff --git a/streams-plugins/streams-plugin-scala/pom.xml 
b/streams-plugins/streams-plugin-scala/pom.xml
index 1e50141..b02d5f6 100644
--- a/streams-plugins/streams-plugin-scala/pom.xml
+++ b/streams-plugins/streams-plugin-scala/pom.xml
@@ -6,6 +6,7 @@
   ~ regarding copyright ownership.  The ASF licenses this file
   ~ to you under the Apache License, Version 2.0 (the
   ~ "License"); you may not use this file except in compliance
+  ~ with the License.  You may obtain a copy of the License at
   ~
   ~   http://www.apache.org/licenses/LICENSE-2.0
   ~

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/2652ba3e/streams-plugins/streams-plugin-scala/src/main/java/org/apache/streams/plugins/StreamsScalaSourceGenerator.java
--
diff --git 
a/streams-plugins/streams-plugin-scala/src/main/java/org/apache/streams/plugins/StreamsScalaSourceGenerator.java
 
b/streams-plugins/streams-plugin-scala/src/main/java/org/apache/streams/plugins/StreamsScalaSourceGenerator.java
index 7199be3..73d2f5d 100644
--- 
a/streams-plugins/streams-plugin-scala/src/main/java/org/apache/streams/plugins/StreamsScalaSourceGenerator.java
+++ 
b/streams-plugins/streams-plugin-scala/src/main/java/org/apache/streams/plugins/StreamsScalaSourceGenerator.java
@@ -1,3 +1,22 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *   http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied.  See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+
 package org.apache.streams.plugins;
 
 import com.google.common.base.Strings;

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/2652ba3e/streams-plugins/streams-plugin-scala/src/main/java/org/apache/streams/plugins/StreamsScalaSourceGeneratorMojo.java
--
diff --git 
a/streams-plugins/streams-plugin-scala/src/main/java/org/apache/streams/plugins/StreamsScalaSourceGeneratorMojo.java
 
b/streams-plugins/streams-plugin-scala/src/main/java/org/apache/streams/plugins/StreamsScalaSourceGeneratorMojo.java
index 8d85c90..c88ce41 100644
--- 
a/streams-plugins/streams-plugin-scala/src/main/java/org/apache/streams/plugins/StreamsScalaSourceGeneratorMojo.java
+++ 
b/streams-plugins/streams-plugin-scala/src/main/java/org/apache/streams/plugins/StreamsScalaSourceGeneratorMojo.java
@@ -1,3 +1,22 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *   http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT 

[12/53] [abbrv] incubator-streams git commit: first take at STREAMS-389: streams-project/streams-plugins/streams-plugin-scala

2016-10-12 Thread mfranklin
first take at STREAMS-389: streams-project/streams-plugins/streams-plugin-scala


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/61f2736a
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/61f2736a
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/61f2736a

Branch: refs/heads/invalid_headers
Commit: 61f2736a9424516606b9f7544b894cb81f65922c
Parents: 1bc84db
Author: Steve Blackmon (@steveblackmon) 
Authored: Mon Dec 7 13:48:38 2015 -0700
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Jun 1 12:51:43 2016 -0500

--
 streams-plugins/pom.xml |   1 +
 streams-plugins/streams-plugin-scala/pom.xml| 243 
 .../streams/plugins/StreamsPojoScala.java   | 371 +++
 .../streams/plugins/StreamsPojoScalaMojo.java   |  71 
 .../plugins/test/StreamsPojoScalaTest.java  |  55 +++
 .../test/resources/streams-plugin-scala/pom.xml |  40 ++
 6 files changed, 781 insertions(+)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/61f2736a/streams-plugins/pom.xml
--
diff --git a/streams-plugins/pom.xml b/streams-plugins/pom.xml
index 5d403ac..f2c8999 100644
--- a/streams-plugins/pom.xml
+++ b/streams-plugins/pom.xml
@@ -42,6 +42,7 @@
 streams-plugin-hive
 streams-plugin-pig
 streams-plugin-pojo
+streams-plugin-scala

 
 

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/61f2736a/streams-plugins/streams-plugin-scala/pom.xml
--
diff --git a/streams-plugins/streams-plugin-scala/pom.xml 
b/streams-plugins/streams-plugin-scala/pom.xml
new file mode 100644
index 000..f718260
--- /dev/null
+++ b/streams-plugins/streams-plugin-scala/pom.xml
@@ -0,0 +1,243 @@
+
+
+http://maven.apache.org/POM/4.0.0"; 
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; 
xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 
http://maven.apache.org/xsd/maven-4.0.0.xsd";>
+
+4.0.0
+org.apache.streams.plugins
+streams-plugin-scala
+0.3-incubating-SNAPSHOT
+maven-plugin
+
+
+org.apache.streams
+streams-plugins
+0.3-incubating-SNAPSHOT
+
+
+
+
+org.apache.streams
+streams-config
+${project.version}
+
+
+org.apache.streams
+streams-core
+${project.version}
+
+
+org.jsonschema2pojo
+jsonschema2pojo-core
+
+
+org.apache.streams
+streams-pojo
+${project.version}
+test
+test-jar
+
+
+org.reflections
+reflections
+0.9.9
+
+
+org.apache.maven
+maven-aether-provider
+3.3.3
+
+
+org.apache.maven
+maven-artifact
+3.3.3
+provided
+
+
+org.apache.maven
+maven-compat
+3.3.3
+test
+
+
+org.apache.maven
+maven-core
+3.3.3
+
+
+org.sonatype.aether
+*
+
+
+
+
+org.apache.maven
+maven-plugin-api
+3.3.3
+
+
+org.apache.maven.plugins
+maven-resources-plugin
+2.7
+
+
+org.apache.maven
+*
+
+
+
+
+org.codehaus.plexus
+plexus-utils
+3.0.15
+
+
+org.apache.maven.plugins
+maven-plugin-plugin
+3.4
+
+
+commons-logging
+commons-logging
+
+
+
+
+org.apache.maven.plugin-tools
+maven-plugin-tools-api
+3.3
+
+
+org.apache.maven.plugin-tools
+maven-plugin-annotations
+3.3
+
+
+org.apache.maven.plugin-tools
+maven-plugin-tools-generators
+3.3
+
+
+org.apache.maven.plugin-testing
+maven-plugin-testing-harness
+3.3.0
+test
+
+
+junit
+junit
+test
+
+
+commons-lang
+commons-lang
+2.6
+
+
+

[15/53] [abbrv] incubator-streams git commit: WIP for apachecon

2016-10-12 Thread mfranklin
http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/site/resources/objectTypes/note.json
--
diff --git a/streams-schemas/src/site/resources/objectTypes/note.json 
b/streams-schemas/src/site/resources/objectTypes/note.json
deleted file mode 100644
index 09de97c..000
--- a/streams-schemas/src/site/resources/objectTypes/note.json
+++ /dev/null
@@ -1,19 +0,0 @@
-{
-"$schema": "http://json-schema.org/draft-03/schema";,
-"$license": [
-
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
-"http://www.apache.org/licenses/LICENSE-2.0";
-],
-"id": "#",
-"type": "object",
-"title": "note",
-"extends": {
-"$ref": "../object.json"
-},
-"properties": {
-"objectType": {
-"type": "string",
-"default": "note"
-}
-}
-}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/site/resources/objectTypes/offer.json
--
diff --git a/streams-schemas/src/site/resources/objectTypes/offer.json 
b/streams-schemas/src/site/resources/objectTypes/offer.json
deleted file mode 100644
index 38db718..000
--- a/streams-schemas/src/site/resources/objectTypes/offer.json
+++ /dev/null
@@ -1,19 +0,0 @@
-{
-"$schema": "http://json-schema.org/draft-03/schema";,
-"$license": [
-
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
-"http://www.apache.org/licenses/LICENSE-2.0";
-],
-"id": "#",
-"type": "object",
-"title": "offer",
-"extends": {
-"$ref": "../object.json"
-},
-"properties": {
-"objectType": {
-"type": "string",
-"default": "offer"
-}
-}
-}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/site/resources/objectTypes/organization.json
--
diff --git a/streams-schemas/src/site/resources/objectTypes/organization.json 
b/streams-schemas/src/site/resources/objectTypes/organization.json
deleted file mode 100644
index a3fd5a2..000
--- a/streams-schemas/src/site/resources/objectTypes/organization.json
+++ /dev/null
@@ -1,19 +0,0 @@
-{
-"$schema": "http://json-schema.org/draft-03/schema";,
-"$license": [
-
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
-"http://www.apache.org/licenses/LICENSE-2.0";
-],
-"id": "#",
-"type": "object",
-"title": "organization",
-"extends": {
-"$ref": "../object.json"
-},
-"properties": {
-"objectType": {
-"type": "string",
-"default": "organization"
-}
-}
-}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/site/resources/objectTypes/page.json
--
diff --git a/streams-schemas/src/site/resources/objectTypes/page.json 
b/streams-schemas/src/site/resources/objectTypes/page.json
deleted file mode 100644
index 4f76aa2..000
--- a/streams-schemas/src/site/resources/objectTypes/page.json
+++ /dev/null
@@ -1,19 +0,0 @@
-{
-"$schema": "http://json-schema.org/draft-03/schema";,
-"$license": [
-
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
-"http://www.apache.org/licenses/LICENSE-2.0";
-],
-"id": "#",
-"type": "object",
-"title": "page",
-"extends": {
-"$ref": "../object.json"
-},
-"properties": {
-"objectType": {
-"type": "string",
-"default": "page"
-}
-}
-}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/site/resources/objectTypes/permission.json
--
diff --git a/streams-schemas/src/site/resources/objectTypes/permission.json 
b/streams-schemas/src/site/resources/objectTypes/permission.json
deleted file mode 100644
index 32b395c..000
--- a/streams-schemas/src/site/resources/objectTypes/permission.json
+++ /dev/null
@@ -1,36 +0,0 @@
-{
-"$schema": "http://json-schema.org/draft-03/schema";,
-"$license": [
-
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
-"http://www.apache.org/licenses/LICENSE-2.0";
-],
-"id": "#",
-"type": "object",
-"title": "permission",
-"extends": {
-"$ref": "../object.json"
-},
-"properties": {
-"objectType": {
-"type": "string",
-"default": "permission"
-},
-"scope": {
-"type": "object",
-"extends": {
-  "$ref": "../object.json"
-}
-},
-"actions": 

[48/53] [abbrv] incubator-streams git commit: Added missing license headers for hbase plugin

2016-10-12 Thread mfranklin
Added missing license headers for hbase plugin


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/897df797
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/897df797
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/897df797

Branch: refs/heads/invalid_headers
Commit: 897df797283550963556b58dff2902fcfbfb39a1
Parents: 78b801d
Author: Matt Franklin 
Authored: Wed Oct 12 14:21:59 2016 -0400
Committer: Matt Franklin 
Committed: Wed Oct 12 14:21:59 2016 -0400

--
 streams-plugins/streams-plugin-hbase/pom.xml |  1 +
 .../hbase/StreamsHbaseGenerationConfig.java  | 19 +++
 .../hbase/StreamsHbaseResourceGenerator.java | 19 +++
 .../hbase/StreamsHbaseResourceGeneratorMojo.java | 19 +++
 .../StreamsHbaseResourceGeneratorCLITest.java| 19 +++
 .../StreamsHbaseResourceGeneratorMojoTest.java   | 19 +++
 .../test/StreamsHbaseResourceGeneratorTest.java  | 19 +++
 .../test/resources/streams-plugin-hbase/pom.xml  | 19 +++
 8 files changed, 134 insertions(+)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/897df797/streams-plugins/streams-plugin-hbase/pom.xml
--
diff --git a/streams-plugins/streams-plugin-hbase/pom.xml 
b/streams-plugins/streams-plugin-hbase/pom.xml
index 648f870..787f42b 100644
--- a/streams-plugins/streams-plugin-hbase/pom.xml
+++ b/streams-plugins/streams-plugin-hbase/pom.xml
@@ -6,6 +6,7 @@
   ~ regarding copyright ownership.  The ASF licenses this file
   ~ to you under the Apache License, Version 2.0 (the
   ~ "License"); you may not use this file except in compliance
+  ~ with the License.  You may obtain a copy of the License at
   ~
   ~   http://www.apache.org/licenses/LICENSE-2.0
   ~

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/897df797/streams-plugins/streams-plugin-hbase/src/main/java/org/apache/streams/plugins/hbase/StreamsHbaseGenerationConfig.java
--
diff --git 
a/streams-plugins/streams-plugin-hbase/src/main/java/org/apache/streams/plugins/hbase/StreamsHbaseGenerationConfig.java
 
b/streams-plugins/streams-plugin-hbase/src/main/java/org/apache/streams/plugins/hbase/StreamsHbaseGenerationConfig.java
index 3972a54..977c3d9 100644
--- 
a/streams-plugins/streams-plugin-hbase/src/main/java/org/apache/streams/plugins/hbase/StreamsHbaseGenerationConfig.java
+++ 
b/streams-plugins/streams-plugin-hbase/src/main/java/org/apache/streams/plugins/hbase/StreamsHbaseGenerationConfig.java
@@ -1,3 +1,22 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *   http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied.  See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+
 package org.apache.streams.plugins.hbase;
 
 import org.apache.streams.util.schema.GenerationConfig;

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/897df797/streams-plugins/streams-plugin-hbase/src/main/java/org/apache/streams/plugins/hbase/StreamsHbaseResourceGenerator.java
--
diff --git 
a/streams-plugins/streams-plugin-hbase/src/main/java/org/apache/streams/plugins/hbase/StreamsHbaseResourceGenerator.java
 
b/streams-plugins/streams-plugin-hbase/src/main/java/org/apache/streams/plugins/hbase/StreamsHbaseResourceGenerator.java
index 71a8705..5fde715 100644
--- 
a/streams-plugins/streams-plugin-hbase/src/main/java/org/apache/streams/plugins/hbase/StreamsHbaseResourceGenerator.java
+++ 
b/streams-plugins/streams-plugin-hbase/src/main/java/org/apache/streams/plugins/hbase/StreamsHbaseResourceGenerator.java
@@ -1,3 +1,22 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use t

[07/53] [abbrv] incubator-streams git commit: create streams-plugin-pojo

2016-10-12 Thread mfranklin
create streams-plugin-pojo


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/ded4ad68
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/ded4ad68
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/ded4ad68

Branch: refs/heads/invalid_headers
Commit: ded4ad68d41c8b158fdca3f249a57055eab095f8
Parents: 50f67bf
Author: Steve Blackmon @steveblackmon 
Authored: Mon Mar 28 08:32:00 2016 -0500
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Jun 1 12:49:27 2016 -0500

--
 pom.xml |   5 +
 streams-plugins/pom.xml |   2 +-
 streams-plugins/streams-plugin-hive/pom.xml |   5 +-
 .../plugins/StreamsHiveResourceGenerator.java   | 219 +++
 .../StreamsHiveResourceGeneratorMojo.java   |  68 +
 .../apache/streams/plugins/StreamsPojoHive.java | 242 -
 .../streams/plugins/StreamsPojoHiveMojo.java|  71 -
 .../test/StreamsHiveResourceGeneratorTest.java  |  55 
 .../plugins/test/StreamsPojoHiveTest.java   |  55 
 streams-plugins/streams-plugin-pojo/pom.xml | 239 
 .../plugins/StreamsPojoGenerationConfig.java| 198 ++
 .../plugins/StreamsPojoSourceGeneratorMojo.java | 272 +++
 .../test/StreamsPojoSourceGeneratorTest.java|  54 
 .../test/resources/streams-plugin-pojo/pom.xml  |  42 +++
 14 files changed, 1156 insertions(+), 371 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/ded4ad68/pom.xml
--
diff --git a/pom.xml b/pom.xml
index 2d79739..cb935af 100644
--- a/pom.xml
+++ b/pom.xml
@@ -175,6 +175,7 @@
 
 streams-pojo
 streams-pojo-extensions
+streams-plugins
 streams-runtimes
 streams-testing
 streams-util
@@ -183,6 +184,10 @@
 
 pom
 
+
+0.4.22
+
+
 
 
 

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/ded4ad68/streams-plugins/pom.xml
--
diff --git a/streams-plugins/pom.xml b/streams-plugins/pom.xml
index 2306aab..390c8a0 100644
--- a/streams-plugins/pom.xml
+++ b/streams-plugins/pom.xml
@@ -36,7 +36,7 @@
 
 
 
-streams-plugin-scala
+streams-plugin-pojo

 
 

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/ded4ad68/streams-plugins/streams-plugin-hive/pom.xml
--
diff --git a/streams-plugins/streams-plugin-hive/pom.xml 
b/streams-plugins/streams-plugin-hive/pom.xml
index cbc055b..22d75ce 100644
--- a/streams-plugins/streams-plugin-hive/pom.xml
+++ b/streams-plugins/streams-plugin-hive/pom.xml
@@ -213,19 +213,20 @@
 2.4
 
 
-streams-pojo-resource-dependencies
+resource-dependencies
 process-test-resources
 
 unpack-dependencies
 
 
 
streams-pojo
-
org/apache/streams/pojo/json/**
+**/*.json
 
${project.build.directory}/test-classes
 
 
 
 
+
 
 
 

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/ded4ad68/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/StreamsHiveResourceGenerator.java
--
diff --git 
a/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/StreamsHiveResourceGenerator.java
 
b/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/StreamsHiveResourceGenerator.java
new file mode 100644
index 000..4edacf0
--- /dev/null
+++ 
b/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/StreamsHiveResourceGenerator.java
@@ -0,0 +1,219 @@
+package org.apache.streams.plugins;
+
+import com.google.common.base.Strings;
+import com.google.common.collect.Lists;
+import com.google.common.collect.Maps;
+import org.reflections.ReflectionUtils;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+
+import java.io.File;
+import java.io.Serializable;
+import java.lang.reflect.Field;
+import java.nio.file.Files;
+import java.nio.file.Paths;
+import java.nio.file.StandardOpenOption;
+import java.util.Iterator;
+import java.util.List;
+import java.util.Map;
+import java.util.Set;
+
+/**
+ * Created by sbla

[29/53] [abbrv] incubator-streams git commit: refactoring, testing, documentation, CLI modes

2016-10-12 Thread mfranklin
http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/d9674f7c/streams-plugins/streams-plugin-hbase/src/main/java/org/apache/streams/plugins/hbase/StreamsHbaseGenerationConfig.java
--
diff --git 
a/streams-plugins/streams-plugin-hbase/src/main/java/org/apache/streams/plugins/hbase/StreamsHbaseGenerationConfig.java
 
b/streams-plugins/streams-plugin-hbase/src/main/java/org/apache/streams/plugins/hbase/StreamsHbaseGenerationConfig.java
index 2612ec2..3972a54 100644
--- 
a/streams-plugins/streams-plugin-hbase/src/main/java/org/apache/streams/plugins/hbase/StreamsHbaseGenerationConfig.java
+++ 
b/streams-plugins/streams-plugin-hbase/src/main/java/org/apache/streams/plugins/hbase/StreamsHbaseGenerationConfig.java
@@ -1,6 +1,6 @@
 package org.apache.streams.plugins.hbase;
 
-import org.apache.streams.schema.GenerationConfig;
+import org.apache.streams.util.schema.GenerationConfig;
 import org.jsonschema2pojo.DefaultGenerationConfig;
 import org.jsonschema2pojo.util.URLUtil;
 

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/d9674f7c/streams-plugins/streams-plugin-hbase/src/main/java/org/apache/streams/plugins/hbase/StreamsHbaseResourceGenerator.java
--
diff --git 
a/streams-plugins/streams-plugin-hbase/src/main/java/org/apache/streams/plugins/hbase/StreamsHbaseResourceGenerator.java
 
b/streams-plugins/streams-plugin-hbase/src/main/java/org/apache/streams/plugins/hbase/StreamsHbaseResourceGenerator.java
index 649bdd9..71a8705 100644
--- 
a/streams-plugins/streams-plugin-hbase/src/main/java/org/apache/streams/plugins/hbase/StreamsHbaseResourceGenerator.java
+++ 
b/streams-plugins/streams-plugin-hbase/src/main/java/org/apache/streams/plugins/hbase/StreamsHbaseResourceGenerator.java
@@ -3,21 +3,18 @@ package org.apache.streams.plugins.hbase;
 import com.fasterxml.jackson.databind.JsonNode;
 import com.fasterxml.jackson.databind.node.ObjectNode;
 import com.google.common.base.Joiner;
-import com.google.common.base.Optional;
-import com.google.common.base.Preconditions;
-import com.google.common.base.Strings;
 import com.google.common.collect.Lists;
-import org.apache.streams.schema.FieldType;
-import org.apache.streams.schema.FieldUtil;
-import org.apache.streams.schema.GenerationConfig;
-import org.apache.streams.schema.Schema;
-import org.apache.streams.schema.SchemaStore;
+import org.apache.streams.util.schema.FieldType;
+import org.apache.streams.util.schema.FieldUtil;
+import org.apache.streams.util.schema.GenerationConfig;
+import org.apache.streams.util.schema.Schema;
+import org.apache.streams.util.schema.SchemaStore;
+import org.apache.streams.util.schema.SchemaStoreImpl;
 import org.jsonschema2pojo.util.URLUtil;
 import org.slf4j.Logger;
 import org.slf4j.LoggerFactory;
 
 import java.io.File;
-import java.net.URI;
 import java.net.URL;
 import java.util.Iterator;
 import java.util.LinkedList;
@@ -25,11 +22,11 @@ import java.util.List;
 import java.util.Map;
 
 import static com.google.common.base.Preconditions.checkNotNull;
-import static org.apache.streams.schema.FileUtil.dropExtension;
-import static org.apache.streams.schema.FileUtil.dropSourcePathPrefix;
-import static org.apache.streams.schema.FileUtil.resolveRecursive;
-import static org.apache.streams.schema.FileUtil.swapExtension;
-import static org.apache.streams.schema.FileUtil.writeFile;
+import static org.apache.streams.util.schema.FileUtil.dropExtension;
+import static org.apache.streams.util.schema.FileUtil.dropSourcePathPrefix;
+import static org.apache.streams.util.schema.FileUtil.resolveRecursive;
+import static org.apache.streams.util.schema.FileUtil.swapExtension;
+import static org.apache.streams.util.schema.FileUtil.writeFile;
 
 /**
  * Created by sblackmon on 5/3/16.
@@ -42,7 +39,7 @@ public class StreamsHbaseResourceGenerator implements 
Runnable {
 
 private StreamsHbaseGenerationConfig config;
 
-private SchemaStore schemaStore = new SchemaStore();
+private SchemaStore schemaStore = new SchemaStoreImpl();
 
 private int currentDepth = 0;
 
@@ -60,17 +57,9 @@ public class StreamsHbaseResourceGenerator implements 
Runnable {
 config.setSourceDirectory(sourceDirectory);
 config.setTargetDirectory(targetDirectory);
 
-StreamsHbaseResourceGenerator StreamsHbaseResourceGenerator = new 
StreamsHbaseResourceGenerator(config);
-Thread thread = new Thread(StreamsHbaseResourceGenerator);
-thread.start();
-try {
-thread.join();
-} catch (InterruptedException e) {
-LOGGER.error("InterruptedException", e);
-} catch (Exception e) {
-LOGGER.error("Exception", e);
-}
-return;
+StreamsHbaseResourceGenerator streamsHbaseResourceGenerator = new 
StreamsHbaseResourceGenerator(config);
+streamsHbaseResourceGenerator.run();
+
 }
 
 public Strea

[42/53] [abbrv] incubator-streams git commit: remove extra classes from merge

2016-10-12 Thread mfranklin
remove extra classes from merge


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/150e1715
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/150e1715
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/150e1715

Branch: refs/heads/invalid_headers
Commit: 150e1715adc0c1dcb270177aedb947803bfbaf68
Parents: 5694ae9
Author: Steve Blackmon @steveblackmon 
Authored: Wed Oct 12 12:40:57 2016 -0500
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Oct 12 12:40:57 2016 -0500

--
 .../streams/plugins/StreamsPojoScala.java   | 371 ---
 .../streams/plugins/StreamsPojoScalaMojo.java   |  71 
 .../plugins/test/StreamsPojoScalaTest.java  |  55 ---
 3 files changed, 497 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/150e1715/streams-plugins/streams-plugin-scala/src/main/java/org/apache/streams/plugins/StreamsPojoScala.java
--
diff --git 
a/streams-plugins/streams-plugin-scala/src/main/java/org/apache/streams/plugins/StreamsPojoScala.java
 
b/streams-plugins/streams-plugin-scala/src/main/java/org/apache/streams/plugins/StreamsPojoScala.java
deleted file mode 100644
index 1c3e317..000
--- 
a/streams-plugins/streams-plugin-scala/src/main/java/org/apache/streams/plugins/StreamsPojoScala.java
+++ /dev/null
@@ -1,371 +0,0 @@
-package org.apache.streams.plugins;
-
-import com.google.common.base.Strings;
-import com.google.common.collect.Iterables;
-import com.google.common.collect.Lists;
-import com.google.common.collect.Maps;
-import com.google.common.collect.Sets;
-import org.apache.streams.data.DocumentClassifier;
-import org.reflections.ReflectionUtils;
-import org.reflections.Reflections;
-import org.reflections.scanners.SubTypesScanner;
-import org.reflections.scanners.TypeAnnotationsScanner;
-import org.reflections.util.ClasspathHelper;
-import org.reflections.util.ConfigurationBuilder;
-import org.reflections.ReflectionUtils.*;
-import org.slf4j.Logger;
-import org.slf4j.LoggerFactory;
-
-import javax.annotation.Generated;
-import java.io.File;
-import java.io.IOException;
-import java.io.Serializable;
-import java.lang.reflect.Field;
-import java.nio.file.Files;
-import java.nio.file.OpenOption;
-import java.nio.file.Paths;
-import java.nio.file.StandardOpenOption;
-import java.util.Collections;
-import java.util.Iterator;
-import java.util.List;
-import java.util.Map;
-import java.util.Set;
-import java.util.TreeSet;
-import java.util.concurrent.ConcurrentHashMap;
-
-/**
- * Created by sblackmon on 11/18/15.
- */
-public class StreamsPojoScala implements Runnable {
-
-private final static Logger LOGGER = 
LoggerFactory.getLogger(StreamsPojoScala.class);
-
-private final static String LS = System.getProperty("line.separator");
-
-private StreamsPojoScalaMojo mojo;
-
-String outDir = "./target/generated-sources/scala";
-String packages = "org.apache.streams.pojo.json";
-
-private final Reflections reflections = new Reflections(
-new ConfigurationBuilder()
-// TODO
-.forPackages(packages)
-.setScanners(
-new SubTypesScanner(),
-new TypeAnnotationsScanner()));
-
-public void main(String[] args) {
-StreamsPojoScala streamsPojoScala = new StreamsPojoScala();
-Thread thread = new Thread(streamsPojoScala);
-thread.start();
-try {
-thread.join();
-} catch (InterruptedException e) {
-LOGGER.error("InterruptedException", e);
-} catch (Exception e) {
-LOGGER.error("Exception", e);
-}
-return;
-}
-
-public StreamsPojoScala(StreamsPojoScalaMojo mojo) {
-this.mojo = mojo;
-if (mojo != null &&
-mojo.getTarget() != null &&
-!Strings.isNullOrEmpty(mojo.getTarget().getAbsolutePath())
-)
-outDir = mojo.getTarget().getAbsolutePath();
-
-if (mojo != null &&
-mojo.getPackages() != null &&
-!Strings.isNullOrEmpty(mojo.getPackages())
-)
-packages = mojo.getPackages();
-}
-
-public StreamsPojoScala() {
-}
-
-public void run() {
-
-List> serializableClasses = detectSerializableClasses();
-
-LOGGER.info("Detected {} serialiables:", serializableClasses.size());
-for( Class clazz : serializableClasses )
-LOGGER.debug(clazz.toString());
-
-List> pojoClasses = detectPojoClasses(serializableClasses);
-
-LOGGER.info("Detected {} pojos:", pojoClasses.size());
-for( Class clazz : poj

[19/53] [abbrv] incubator-streams git commit: WIP for apachecon

2016-10-12 Thread mfranklin
http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-plugins/streams-plugin-elasticsearch/pom.xml
--
diff --git a/streams-plugins/streams-plugin-elasticsearch/pom.xml 
b/streams-plugins/streams-plugin-elasticsearch/pom.xml
new file mode 100644
index 000..4f0ed4a
--- /dev/null
+++ b/streams-plugins/streams-plugin-elasticsearch/pom.xml
@@ -0,0 +1,245 @@
+
+
+http://maven.apache.org/POM/4.0.0"; 
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; 
xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 
http://maven.apache.org/xsd/maven-4.0.0.xsd";>
+
+4.0.0
+org.apache.streams.plugins
+streams-plugin-elasticsearch
+0.3-incubating-SNAPSHOT
+maven-plugin
+
+
+org.apache.streams
+streams-plugins
+0.3-incubating-SNAPSHOT
+..
+
+
+
+2.3.0
+5.4.0
+
+
+
+
+org.apache.streams
+streams-config
+${project.version}
+
+
+commons-logging
+commons-logging
+
+
+
+
+org.apache.streams
+streams-core
+${project.version}
+
+
+org.apache.streams
+streams-schemas
+${project.version}
+
+
+com.google.guava
+guava
+
+
+org.reflections
+reflections
+0.9.9
+
+
+org.apache.maven
+maven-aether-provider
+3.3.3
+
+
+org.apache.maven
+maven-artifact
+3.3.3
+provided
+
+
+org.apache.maven
+maven-compat
+3.3.3
+test
+
+
+org.apache.maven
+maven-core
+3.3.3
+
+
+org.sonatype.aether
+*
+
+
+
+
+org.apache.maven
+maven-plugin-api
+3.3.3
+
+
+org.apache.maven.plugins
+maven-resources-plugin
+2.7
+
+
+org.apache.maven
+*
+
+
+
+
+org.apache.maven.shared
+maven-verifier
+1.6
+test
+
+
+org.codehaus.plexus
+plexus-utils
+3.0.15
+
+
+org.apache.maven.plugins
+maven-plugin-plugin
+3.4
+
+
+commons-logging
+commons-logging
+
+
+
+
+org.apache.maven.plugin-tools
+maven-plugin-tools-api
+3.3
+
+
+org.apache.maven.plugin-tools
+maven-plugin-annotations
+3.3
+
+
+org.apache.maven.plugin-tools
+maven-plugin-tools-generators
+3.3
+
+
+org.apache.maven.plugin-testing
+maven-plugin-testing-harness
+3.3.0
+test
+
+
+junit
+junit
+test
+
+
+commons-lang
+commons-lang
+2.6
+
+
+joda-time
+joda-time
+2.2
+
+
+org.joda
+joda-convert
+1.8.1
+
+
+
+
+src/main/java
+src/test/java
+
+
+src/main/resources
+
+
+
+
+src/test/resources
+
+
+
+
+maven-plugin-plugin
+3.4
+
+
true
+
+
+
+mojo-descriptor
+process-classes
+
+descriptor
+
+
+
+
+
+org.reflections
+reflections-maven
+
+
+
+reflections
+
+process-classes
+
+
+
+
+org.apache.maven.plugins
+maven-dependency-plugin
+2.4
+
+
+resource-dependencies
+process-test-resources
+

[47/53] [abbrv] incubator-streams git commit: Added missing license headers for cassandra plugin

2016-10-12 Thread mfranklin
Added missing license headers for cassandra plugin


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/78b801dc
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/78b801dc
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/78b801dc

Branch: refs/heads/invalid_headers
Commit: 78b801dc8455d72a01c531dc51a9bf3388c6e178
Parents: 4d32e64
Author: Matt Franklin 
Authored: Wed Oct 12 14:20:41 2016 -0400
Committer: Matt Franklin 
Committed: Wed Oct 12 14:20:41 2016 -0400

--
 .../StreamsCassandraGenerationConfig.java  | 17 +
 .../StreamsCassandraResourceGenerator.java | 17 +
 .../StreamsCassandraResourceGeneratorMojo.java | 17 +
 .../StreamsCassandraResourceGeneratorCLITest.java  | 17 +
 .../StreamsCassandraResourceGeneratorMojoTest.java | 17 +
 .../StreamsCassandraResourceGeneratorTest.java | 17 +
 .../resources/streams-plugin-cassandra/pom.xml | 17 +
 7 files changed, 119 insertions(+)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/78b801dc/streams-plugins/streams-plugin-cassandra/src/main/java/org/apache/streams/plugins/cassandra/StreamsCassandraGenerationConfig.java
--
diff --git 
a/streams-plugins/streams-plugin-cassandra/src/main/java/org/apache/streams/plugins/cassandra/StreamsCassandraGenerationConfig.java
 
b/streams-plugins/streams-plugin-cassandra/src/main/java/org/apache/streams/plugins/cassandra/StreamsCassandraGenerationConfig.java
index 1950796..613cba2 100644
--- 
a/streams-plugins/streams-plugin-cassandra/src/main/java/org/apache/streams/plugins/cassandra/StreamsCassandraGenerationConfig.java
+++ 
b/streams-plugins/streams-plugin-cassandra/src/main/java/org/apache/streams/plugins/cassandra/StreamsCassandraGenerationConfig.java
@@ -1,3 +1,20 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ *
+ *   http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied.  See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
 package org.apache.streams.plugins.cassandra;
 
 import org.apache.streams.util.schema.GenerationConfig;

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/78b801dc/streams-plugins/streams-plugin-cassandra/src/main/java/org/apache/streams/plugins/cassandra/StreamsCassandraResourceGenerator.java
--
diff --git 
a/streams-plugins/streams-plugin-cassandra/src/main/java/org/apache/streams/plugins/cassandra/StreamsCassandraResourceGenerator.java
 
b/streams-plugins/streams-plugin-cassandra/src/main/java/org/apache/streams/plugins/cassandra/StreamsCassandraResourceGenerator.java
index 7889bdc..00416b1 100644
--- 
a/streams-plugins/streams-plugin-cassandra/src/main/java/org/apache/streams/plugins/cassandra/StreamsCassandraResourceGenerator.java
+++ 
b/streams-plugins/streams-plugin-cassandra/src/main/java/org/apache/streams/plugins/cassandra/StreamsCassandraResourceGenerator.java
@@ -1,3 +1,20 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ *
+ *   http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied.  See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
 package org.apache.streams.plugins.cassandra;
 
 import com.fasterxml.jackson.databind.JsonNode;

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/78b801dc/streams-plugins/streams-plugin-cassandra/src/main/java/org/apache/streams/plugins/cassandra/StreamsCassandraResourceGeneratorMojo.java
---

[44/53] [abbrv] incubator-streams git commit: Merge branch 'master' into invalid_headers

2016-10-12 Thread mfranklin
Merge branch 'master' into invalid_headers


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/b569cd4d
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/b569cd4d
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/b569cd4d

Branch: refs/heads/invalid_headers
Commit: b569cd4dc0b3e10e1174ceabb9fdbc259b229e5f
Parents: 2d8ff24 b21ec4b
Author: Matt Franklin 
Authored: Wed Oct 12 13:47:47 2016 -0400
Committer: Matt Franklin 
Committed: Wed Oct 12 13:47:47 2016 -0400

--
 NOTICE  |   2 +-
 README.md   |  13 +-
 pom.xml |   9 +-
 streams-config/pom.xml  |   2 +-
 .../streams-processor-lucene/pom.xml| 163 
 .../lucene/LuceneSimpleTaggingProcessor.java| 355 -
 .../lucene/LuceneTaggerConfiguration.json   |  29 --
 .../lucene/TestLucenSimpleTaggingProcessor.java | 171 -
 .../src/test/resources/TestTags.tsv |   2 -
 streams-contrib/streams-processor-tika/pom.xml  | 162 
 .../org/apache/streams/tika/CategoryParser.java | 114 --
 .../org/apache/streams/tika/TikaProcessor.java  | 139 ---
 .../apache/streams/tika/BoilerPipeArticle.json  |  76 
 .../apache/streams/tika/TestCategoryParser.java |  30 --
 .../apache/streams/tika/TestTikaProcessor.java  |  29 --
 .../src/main/jsonschema/com/twitter/tweet.json  |   6 +-
 .../activity-consumer/osgi.bnd  |   9 -
 .../activity-consumer/pom.xml   | 171 -
 .../activityconsumer/ActivityConsumer.java  |  39 --
 .../ActivityConsumerWarehouse.java  |  31 --
 .../impl/ActivityConsumerWarehouseImpl.java |  57 ---
 .../impl/PushActivityConsumer.java  | 106 --
 .../spring/activity-consumer-context.xml|  28 --
 .../META-INF/spring/activity-consumer-osgi.xml  |  29 --
 .../src/main/resources/readme.txt   |   1 -
 .../activity-registration/osgi.bnd  |   9 -
 .../activity-registration/pom.xml   | 130 ---
 .../ActivityPublisherRegistration.java  |  29 --
 .../ActivityStreamsSubscriberRegistration.java  |  29 --
 .../impl/ActivityPublisherRegistrationImpl.java |  67 
 ...tivityStreamsSubscriberRegistrationImpl.java |  67 
 .../activity-registration-context-osgi.xml  |  30 --
 .../spring/activity-registration-context.xml|  29 --
 .../src/main/resources/readme.txt   |   1 -
 .../activity-subscriber/osgi.bnd|   9 -
 .../activity-subscriber/pom.xml | 134 ---
 .../ActivityStreamsSubscriber.java  |  38 --
 .../ActivityStreamsSubscriberWarehouse.java |  34 --
 .../ActivityStreamsSubscription.java|  38 --
 .../ActivityStreamsSubscriptionFilter.java  |  34 --
 .../ActivityStreamsSubscriptionOutput.java  |  47 ---
 .../impl/ActivityStreamsSubscriberDelegate.java | 126 --
 .../ActivityStreamsSubscriberWarehouseImpl.java |  60 ---
 ...yStreamsSubscriptionCassandraFilterImpl.java |  42 --
 .../impl/ActivityStreamsSubscriptionImpl.java   |  74 
 ...vityStreamsSubscriptionLuceneFilterImpl.java |  43 ---
 .../spring/activity-subscriber-context.xml  |  28 --
 .../spring/activity-subscriber-osgi.xml |  29 --
 .../src/main/resources/readme.txt   |   1 -
 .../src/site/resources/readme.txt   |   1 -
 streams-osgi-components/pom.xml |  43 ---
 streams-plugins/pom.xml |  62 +++
 .../streams-plugin-cassandra/pom.xml| 251 
 .../StreamsCassandraGenerationConfig.java   |  81 
 .../StreamsCassandraResourceGenerator.java  | 366 ++
 .../StreamsCassandraResourceGeneratorMojo.java  |  62 +++
 .../src/site/markdown/index.md  |  36 ++
 ...treamsCassandraResourceGeneratorCLITest.java |  52 +++
 ...reamsCassandraResourceGeneratorMojoTest.java |  78 
 .../StreamsCassandraResourceGeneratorTest.java  |  80 
 .../resources/streams-plugin-cassandra/pom.xml  |  76 
 .../streams-plugin-elasticsearch/pom.xml| 252 
 .../StreamsElasticsearchGenerationConfig.java   |  81 
 .../StreamsElasticsearchResourceGenerator.java  | 380 +++
 ...reamsElasticsearchResourceGeneratorMojo.java |  72 
 .../src/site/markdown/index.md  |  38 ++
 ...msElasticsearchResourceGeneratorCLITest.java |  39 ++
 ...sElasticsearchResourceGeneratorMojoTest.java |  50 +++
 ...reamsElasticsearchResourceGeneratorTest.java | 110 ++
 .../streams-plugin-elasticsearch/pom.xml|  76 
 streams-plugins/streams-plugin-hbase/pom.xml| 251 
 .../hbase/StreamsHbaseGenerationConfig.java |  90 +++

[16/53] [abbrv] incubator-streams git commit: WIP for apachecon

2016-10-12 Thread mfranklin
http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/main/jsonschema/verbs/join.json
--
diff --git a/streams-schemas/src/main/jsonschema/verbs/join.json 
b/streams-schemas/src/main/jsonschema/verbs/join.json
index 78daed8..5276072 100644
--- a/streams-schemas/src/main/jsonschema/verbs/join.json
+++ b/streams-schemas/src/main/jsonschema/verbs/join.json
@@ -4,7 +4,7 @@
 
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
 "http://www.apache.org/licenses/LICENSE-2.0";
 ],
-"id": "#",
+"id": 
"http://streams.incubator.apache.org/site/0.3-incubating-SNAPSHOT/streams-schemas/verbs/join.json#";,
 "type": "object",
 "title": "Join",
 "description": "Indicates that the actor has become a member of the 
object.",

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/main/jsonschema/verbs/leave.json
--
diff --git a/streams-schemas/src/main/jsonschema/verbs/leave.json 
b/streams-schemas/src/main/jsonschema/verbs/leave.json
index 1ce73bc..9995099 100644
--- a/streams-schemas/src/main/jsonschema/verbs/leave.json
+++ b/streams-schemas/src/main/jsonschema/verbs/leave.json
@@ -4,7 +4,7 @@
 
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
 "http://www.apache.org/licenses/LICENSE-2.0";
 ],
-"id": "#",
+"id": 
"http://streams.incubator.apache.org/site/0.3-incubating-SNAPSHOT/streams-schemas/verbs/leave.json#";,
 "type": "object",
 "title": "Leave",
 "description": "Indicates that the actor has left the object. For 
instance, a Person leaving a Group or checking-out of a Place.",

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/main/jsonschema/verbs/like.json
--
diff --git a/streams-schemas/src/main/jsonschema/verbs/like.json 
b/streams-schemas/src/main/jsonschema/verbs/like.json
index 4ac1bf7..d583305 100644
--- a/streams-schemas/src/main/jsonschema/verbs/like.json
+++ b/streams-schemas/src/main/jsonschema/verbs/like.json
@@ -4,7 +4,7 @@
 
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
 "http://www.apache.org/licenses/LICENSE-2.0";
 ],
-"id": "#",
+"id": 
"http://streams.incubator.apache.org/site/0.3-incubating-SNAPSHOT/streams-schemas/verbs/like.json#";,
 "type": "object",
 "title": "Like",
 "description": "Indicates that the actor marked the object as an item of 
special interest.",

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/main/jsonschema/verbs/listen.json
--
diff --git a/streams-schemas/src/main/jsonschema/verbs/listen.json 
b/streams-schemas/src/main/jsonschema/verbs/listen.json
index 3476144..9982ac6 100644
--- a/streams-schemas/src/main/jsonschema/verbs/listen.json
+++ b/streams-schemas/src/main/jsonschema/verbs/listen.json
@@ -4,7 +4,7 @@
 
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
 "http://www.apache.org/licenses/LICENSE-2.0";
 ],
-"id": "#",
+"id": 
"http://streams.incubator.apache.org/site/0.3-incubating-SNAPSHOT/streams-schemas/verbs/listen.json#";,
 "type": "object",
 "title": "Listen",
 "description": "Indicates that the actor has listened to the object. This 
is typically only applicable for objects representing audio content, such as 
music, an audio-book, or a radio broadcast.",

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/main/jsonschema/verbs/lose.json
--
diff --git a/streams-schemas/src/main/jsonschema/verbs/lose.json 
b/streams-schemas/src/main/jsonschema/verbs/lose.json
index 60899ba..1d959a4 100644
--- a/streams-schemas/src/main/jsonschema/verbs/lose.json
+++ b/streams-schemas/src/main/jsonschema/verbs/lose.json
@@ -4,7 +4,7 @@
 
"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
 "http://www.apache.org/licenses/LICENSE-2.0";
 ],
-"id": "#",
+"id": 
"http://streams.incubator.apache.org/site/0.3-incubating-SNAPSHOT/streams-schemas/verbs/lose.json#";,
 "type": "object",
 "title": "Lose",
 "description": "Indicates that the actor has lost the object. For 
instance, if a person loses a game.",

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/main/jsonschema/verbs/make-friend.json
--
diff --git a/streams-schemas/src/main/jsonschema/verbs/make-friend.json 
b/streams-schemas/src/main/jsonschema/verbs/make-friend.json
index a64

[30/53] [abbrv] incubator-streams git commit: refactoring, testing, documentation, CLI modes

2016-10-12 Thread mfranklin
refactoring, testing, documentation, CLI modes

break up streams-schemas into streams-util and streams-schema-activitystreams
add index.md to each plugin
specify basepath of jsonschema project-wide
harmonize plugin behavior, code style, docs
ensure all tests pass
add CLI modes


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/d9674f7c
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/d9674f7c
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/d9674f7c

Branch: refs/heads/invalid_headers
Commit: d9674f7c0706d0e170f123c461d22e56e8f73807
Parents: 61f2736
Author: Steve Blackmon @steveblackmon 
Authored: Wed Jun 1 12:32:14 2016 -0500
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Jun 1 12:52:22 2016 -0500

--
 .../spring/streams-cassandra-context.xml|  25 --
 .../streams-plugin-cassandra/pom.xml|  13 +-
 .../StreamsCassandraGenerationConfig.java   |   2 +-
 .../StreamsCassandraResourceGenerator.java  |  42 +--
 .../StreamsCassandraResourceGeneratorMojo.java  |  37 +-
 .../src/site/markdown/index.md  |  22 +-
 ...treamsCassandraResourceGeneratorCLITest.java |  10 +-
 ...reamsCassandraResourceGeneratorMojoTest.java |   9 +-
 .../StreamsCassandraResourceGeneratorTest.java  |  58 +--
 .../resources/streams-plugin-cassandra/pom.xml  |  21 +-
 .../streams-plugin-elasticsearch/pom.xml|  13 +-
 .../StreamsElasticsearchGenerationConfig.java   |   2 +-
 .../StreamsElasticsearchResourceGenerator.java  |  75 ++--
 ...reamsElasticsearchResourceGeneratorMojo.java |  29 +-
 .../src/site/markdown/index.md  |  24 +-
 ...msElasticsearchResourceGeneratorCLITest.java |  39 ++
 ...reamsElasticsearchResourceGeneratorTest.java |  59 +--
 .../streams-plugin-elasticsearch/pom.xml|  23 +-
 streams-plugins/streams-plugin-hbase/pom.xml|  13 +-
 .../hbase/StreamsHbaseGenerationConfig.java |   2 +-
 .../hbase/StreamsHbaseResourceGenerator.java|  41 +-
 .../StreamsHbaseResourceGeneratorMojo.java  |  28 +-
 .../src/site/markdown/index.md  |  26 +-
 .../StreamsHbaseResourceGeneratorCLITest.java   |   2 +-
 .../StreamsHbaseResourceGeneratorMojoTest.java  |   2 +-
 .../test/StreamsHbaseResourceGeneratorTest.java |  31 +-
 .../test/resources/streams-plugin-hbase/pom.xml |  23 +-
 streams-plugins/streams-plugin-hive/pom.xml |  13 +-
 .../hive/StreamsHiveGenerationConfig.java   |   3 +-
 .../hive/StreamsHiveResourceGenerator.java  |  35 +-
 .../hive/StreamsHiveResourceGeneratorMojo.java  |  38 +-
 .../src/site/markdown/index.md  |  28 +-
 .../StreamsHiveResourceGeneratorCLITest.java|   2 +-
 .../StreamsHiveResourceGeneratorMojoTest.java   |   2 +-
 .../test/StreamsHiveResourceGeneratorTest.java  |  32 +-
 .../test/resources/streams-plugin-hive/pom.xml  |  23 +-
 streams-plugins/streams-plugin-pig/pom.xml  |  13 +-
 .../plugins/pig/StreamsPigGenerationConfig.java |   3 +-
 .../pig/StreamsPigResourceGenerator.java|  46 +--
 .../pig/StreamsPigResourceGeneratorMojo.java|  38 +-
 .../src/site/markdown/index.md  |  24 +-
 .../StreamsPigResourceGeneratorCLITest.java |   4 +-
 .../StreamsPigResourceGeneratorMojoTest.java|   4 +-
 .../test/StreamsPigResourceGeneratorTest.java   |  32 +-
 .../test/resources/streams-plugin-pig/pom.xml   |  23 +-
 streams-plugins/streams-plugin-pojo/pom.xml |  13 +-
 .../plugins/StreamsPojoSourceGenerator.java |  15 +-
 .../plugins/StreamsPojoSourceGeneratorMojo.java | 154 +---
 .../src/site/markdown/index.md  |  24 +-
 .../test/StreamsPojoSourceGeneratorCLITest.java |   2 +-
 .../StreamsPojoSourceGeneratorMojoTest.java |   2 +-
 .../test/StreamsPojoSourceGeneratorTest.java|  51 +--
 .../test/resources/streams-plugin-pojo/pom.xml  |  30 +-
 streams-plugins/streams-plugin-scala/pom.xml|  12 +
 .../streams/plugins/StreamsPojoScala.java   | 371 ---
 .../streams/plugins/StreamsPojoScalaMojo.java   |  71 
 .../plugins/StreamsScalaSourceGenerator.java| 351 ++
 .../StreamsScalaSourceGeneratorMojo.java|  59 +++
 .../src/site/markdown/index.md  |  36 ++
 .../plugins/test/StreamsPojoScalaTest.java  |  55 ---
 .../test/StreamsScalaSourceGeneratorTest.java   |  55 +++
 streams-runtimes/streams-runtime-local/pom.xml  |   2 +-
 streams-schemas/pom.xml |  77 +---
 .../org/apache/streams/schema/FieldType.java|  13 -
 .../org/apache/streams/schema/FieldUtil.java|  59 ---
 .../org/apache/streams/schema/FileUtil.java |  76 
 .../apache/streams/schema/GenerationConfig.java | 115 --
 .../java/org/apache/streams/schema/Schema.java  |  57 ---
 .../org/apache/streams/schema/SchemaStore.java  | 283 --
 ...

[49/53] [abbrv] incubator-streams git commit: Added missing license headers for hive plugin

2016-10-12 Thread mfranklin
Added missing license headers for hive plugin


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/536acbd2
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/536acbd2
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/536acbd2

Branch: refs/heads/invalid_headers
Commit: 536acbd206043778f69ce302143303914ab46cc4
Parents: 897df79
Author: Matt Franklin 
Authored: Wed Oct 12 14:22:16 2016 -0400
Committer: Matt Franklin 
Committed: Wed Oct 12 14:22:16 2016 -0400

--
 streams-plugins/streams-plugin-hive/pom.xml  |  1 +
 .../hive/StreamsHiveGenerationConfig.java| 19 +++
 .../hive/StreamsHiveResourceGenerator.java   | 19 +++
 .../hive/StreamsHiveResourceGeneratorMojo.java   | 19 +++
 .../StreamsHiveResourceGeneratorCLITest.java | 19 +++
 .../StreamsHiveResourceGeneratorMojoTest.java| 19 +++
 .../test/StreamsHiveResourceGeneratorTest.java   | 19 +++
 .../test/resources/streams-plugin-hive/pom.xml   | 19 +++
 8 files changed, 134 insertions(+)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/536acbd2/streams-plugins/streams-plugin-hive/pom.xml
--
diff --git a/streams-plugins/streams-plugin-hive/pom.xml 
b/streams-plugins/streams-plugin-hive/pom.xml
index 68c9dd4..321c090 100644
--- a/streams-plugins/streams-plugin-hive/pom.xml
+++ b/streams-plugins/streams-plugin-hive/pom.xml
@@ -6,6 +6,7 @@
   ~ regarding copyright ownership.  The ASF licenses this file
   ~ to you under the Apache License, Version 2.0 (the
   ~ "License"); you may not use this file except in compliance
+  ~ with the License.  You may obtain a copy of the License at
   ~
   ~   http://www.apache.org/licenses/LICENSE-2.0
   ~

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/536acbd2/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/hive/StreamsHiveGenerationConfig.java
--
diff --git 
a/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/hive/StreamsHiveGenerationConfig.java
 
b/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/hive/StreamsHiveGenerationConfig.java
index f957757..b09ce18 100644
--- 
a/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/hive/StreamsHiveGenerationConfig.java
+++ 
b/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/hive/StreamsHiveGenerationConfig.java
@@ -1,3 +1,22 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *   http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied.  See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+
 package org.apache.streams.plugins.hive;
 
 import org.apache.streams.util.schema.GenerationConfig;

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/536acbd2/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/hive/StreamsHiveResourceGenerator.java
--
diff --git 
a/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/hive/StreamsHiveResourceGenerator.java
 
b/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/hive/StreamsHiveResourceGenerator.java
index 60c59ca..c270e14 100644
--- 
a/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/hive/StreamsHiveResourceGenerator.java
+++ 
b/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/hive/StreamsHiveResourceGenerator.java
@@ -1,3 +1,22 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * wit

[08/53] [abbrv] incubator-streams git commit: test pom for streams-plugin-pojo

2016-10-12 Thread mfranklin
test pom for streams-plugin-pojo


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/387da685
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/387da685
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/387da685

Branch: refs/heads/invalid_headers
Commit: 387da685f37a7135d556f4f645a3e77e6138f958
Parents: 7d318c3
Author: Steve Blackmon @steveblackmon 
Authored: Mon Mar 28 08:32:27 2016 -0500
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Jun 1 12:49:27 2016 -0500

--
 .../src/test/resources/streams-plugin-pojo/pom.xml| 10 +-
 1 file changed, 5 insertions(+), 5 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/387da685/streams-plugins/streams-plugin-pojo/src/test/resources/streams-plugin-pojo/pom.xml
--
diff --git 
a/streams-plugins/streams-plugin-pojo/src/test/resources/streams-plugin-pojo/pom.xml
 
b/streams-plugins/streams-plugin-pojo/src/test/resources/streams-plugin-pojo/pom.xml
index b1de7b8..fbb2864 100644
--- 
a/streams-plugins/streams-plugin-pojo/src/test/resources/streams-plugin-pojo/pom.xml
+++ 
b/streams-plugins/streams-plugin-pojo/src/test/resources/streams-plugin-pojo/pom.xml
@@ -4,10 +4,10 @@
 4.0.0
 
 org.apache.streams.plugins
-streams-plugin-hive-test
+streams-plugin-pojo-test
 0.3-incubating-SNAPSHOT
 jar
-Test StreamsPojoHiveMojo
+Test StreamsPojoMojo
 
 
 
@@ -21,18 +21,18 @@
 
 
 org.apache.streams.plugins
-streams-plugin-hive
+streams-plugin-pojo
 0.3-incubating-SNAPSHOT
 
 
 org.apache.streams.pojo.json
 
-target/test-classes/streams-hive-plugin/
+target/test-classes/streams-pojo-plugin/
 
 
 
 
-hive
+pojo
 
 
 



[13/53] [abbrv] incubator-streams git commit: WIP for apachecon

2016-10-12 Thread mfranklin
http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/test/resources/activities/install.json
--
diff --git a/streams-schemas/src/test/resources/activities/install.json 
b/streams-schemas/src/test/resources/activities/install.json
new file mode 100644
index 000..1ecdecd
--- /dev/null
+++ b/streams-schemas/src/test/resources/activities/install.json
@@ -0,0 +1,18 @@
+{
+  "$license": [
+"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+  ],
+  "actor": {
+"objectType": "person",
+"displayName": "Laura"
+  },
+  "verb": "install",
+  "object": {
+"objectType": "application",
+"displayName": "Approved Software Scanning Tool",
+"location": {
+  "displayName": "All computers in Building A"
+}
+  }
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/test/resources/activities/interact.json
--
diff --git a/streams-schemas/src/test/resources/activities/interact.json 
b/streams-schemas/src/test/resources/activities/interact.json
new file mode 100644
index 000..f427513
--- /dev/null
+++ b/streams-schemas/src/test/resources/activities/interact.json
@@ -0,0 +1,16 @@
+{
+  "$license": [
+"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+  ],
+  "actor": {
+"objectType": "person",
+"displayName": "Bob"
+  },
+  "verb": "interact",
+  "object": {
+"objectType": "person",
+"displayName": "Laura"
+  },
+  "title": "Bob called Laura."
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/test/resources/activities/invite.json
--
diff --git a/streams-schemas/src/test/resources/activities/invite.json 
b/streams-schemas/src/test/resources/activities/invite.json
new file mode 100644
index 000..7c84b78
--- /dev/null
+++ b/streams-schemas/src/test/resources/activities/invite.json
@@ -0,0 +1,19 @@
+{
+  "$license": [
+"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+  ],
+  "actor": {
+"objectType": "person",
+"displayName": "Laura"
+  },
+  "verb": "invite",
+  "object": {
+"objectType": "person",
+"displayName": "Mark"
+  },
+  "target": {
+"objectType": "event",
+"displayName": "Job Interview"
+  }
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/test/resources/activities/join.json
--
diff --git a/streams-schemas/src/test/resources/activities/join.json 
b/streams-schemas/src/test/resources/activities/join.json
new file mode 100644
index 000..7996a9b
--- /dev/null
+++ b/streams-schemas/src/test/resources/activities/join.json
@@ -0,0 +1,15 @@
+{
+  "$license": [
+"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+  ],
+  "actor": {
+"objectType": "person",
+"displayName": "Mark"
+  },
+  "verb": "join",
+  "object": {
+"objectType": "organization",
+"displayName": "Acme, Co"
+  }
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/test/resources/activities/leave.json
--
diff --git a/streams-schemas/src/test/resources/activities/leave.json 
b/streams-schemas/src/test/resources/activities/leave.json
new file mode 100644
index 000..08516c5
--- /dev/null
+++ b/streams-schemas/src/test/resources/activities/leave.json
@@ -0,0 +1,15 @@
+{
+  "$license": [
+"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+  ],
+  "actor": {
+"objectType": "person",
+"displayName": "Mark"
+  },
+  "verb": "leave",
+  "object": {
+"objectType": "organization",
+"displayName": "Other, Co"
+  }
+}

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-schemas/src/test/resources/activities/like.json
--
diff --git a/streams-schemas/src/test/resources/activities/like.json 
b/streams-schemas/src/test/resources/activities/like.json
new file mode 100644
index 000..853676f
--- /dev/null
+++ b/streams-schemas/src/test/resources/activities/like.json
@@ -0,0 +1,22 @@
+{
+  "$license": [
+"http://www.openwebfoundation.org/legal/the-owf-1-0-agreements/owfa-1-0";,
+"http://www.apache.org/licenses/LICENSE-2.0";
+  ],
+  "actor": {
+"objectType": "person",
+"displayName": "Laura"
+  },
+  "verb": "like",
+  "ob

[05/53] [abbrv] incubator-streams git commit: STREAMS-398 - streams-schemas

2016-10-12 Thread mfranklin
STREAMS-398 - streams-schemas

moves jsonschemas to a seperate module
  this averts dependency graph cycle that would occur once streams-plugin-pojo 
is a dependency of streams-pojo and streams-scala


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/0424855c
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/0424855c
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/0424855c

Branch: refs/heads/invalid_headers
Commit: 0424855cf0a4fd15be298906922333ae74c8e9ae
Parents: 387da68
Author: Steve Blackmon @steveblackmon 
Authored: Thu Apr 21 11:41:59 2016 -0500
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Jun 1 12:49:27 2016 -0500

--
 streams-schemas/pom.xml |  71 
 .../src/main/jsonschema/activity.json   | 108 +++
 .../src/main/jsonschema/collection.json |  47 
 .../src/main/jsonschema/media_link.json |  34 ++
 streams-schemas/src/main/jsonschema/object.json |  98 +
 .../src/main/jsonschema/objectTypes/alert.json  |  19 
 .../jsonschema/objectTypes/application.json |  19 
 .../main/jsonschema/objectTypes/article.json|  19 
 .../src/main/jsonschema/objectTypes/audio.json  |  19 
 .../src/main/jsonschema/objectTypes/badge.json  |  19 
 .../src/main/jsonschema/objectTypes/binary.json |  19 
 .../main/jsonschema/objectTypes/bookmark.json   |  19 
 .../main/jsonschema/objectTypes/comment.json|  19 
 .../src/main/jsonschema/objectTypes/device.json |  19 
 .../src/main/jsonschema/objectTypes/event.json  |  51 +
 .../src/main/jsonschema/objectTypes/file.json   |  25 +
 .../src/main/jsonschema/objectTypes/folder.json |  19 
 .../src/main/jsonschema/objectTypes/game.json   |  19 
 .../src/main/jsonschema/objectTypes/group.json  |  19 
 .../src/main/jsonschema/objectTypes/image.json  |  22 
 .../src/main/jsonschema/objectTypes/issue.json  |  25 +
 .../src/main/jsonschema/objectTypes/job.json|  19 
 .../src/main/jsonschema/objectTypes/list.json   |  28 +
 .../src/main/jsonschema/objectTypes/note.json   |  19 
 .../src/main/jsonschema/objectTypes/offer.json  |  19 
 .../jsonschema/objectTypes/organization.json|  19 
 .../src/main/jsonschema/objectTypes/page.json   |  19 
 .../main/jsonschema/objectTypes/permission.json |  36 +++
 .../src/main/jsonschema/objectTypes/person.json |  25 +
 .../jsonschema/objectTypes/photo-album.json |  19 
 .../src/main/jsonschema/objectTypes/photo.json  |  23 
 .../src/main/jsonschema/objectTypes/place.json  |  43 
 .../main/jsonschema/objectTypes/playlist.json   |  19 
 .../main/jsonschema/objectTypes/process.json|  19 
 .../main/jsonschema/objectTypes/product.json|  25 +
 .../main/jsonschema/objectTypes/property.json   |  48 +
 .../main/jsonschema/objectTypes/question.json   |  28 +
 .../src/main/jsonschema/objectTypes/review.json |  22 
 .../src/main/jsonschema/objectTypes/role.json   |  25 +
 .../main/jsonschema/objectTypes/service.json|  19 
 .../src/main/jsonschema/objectTypes/song.json   |  19 
 .../src/main/jsonschema/objectTypes/status.json |  19 
 .../src/main/jsonschema/objectTypes/task.json   |  40 +++
 .../src/main/jsonschema/objectTypes/team.json   |  19 
 .../src/main/jsonschema/objectTypes/video.json  |  19 
 .../src/main/jsonschema/verbs/accept.json   |  24 +
 .../src/main/jsonschema/verbs/access.json   |  24 +
 .../src/main/jsonschema/verbs/acknowledge.json  |  24 +
 .../src/main/jsonschema/verbs/add.json  |  24 +
 .../src/main/jsonschema/verbs/agree.json|  24 +
 .../src/main/jsonschema/verbs/append.json   |  24 +
 .../src/main/jsonschema/verbs/approve.json  |  24 +
 .../src/main/jsonschema/verbs/archive.json  |  24 +
 .../src/main/jsonschema/verbs/assign.json   |  24 +
 .../src/main/jsonschema/verbs/at.json   |  24 +
 .../src/main/jsonschema/verbs/attach.json   |  24 +
 .../src/main/jsonschema/verbs/attend.json   |  24 +
 .../src/main/jsonschema/verbs/author.json   |  24 +
 .../src/main/jsonschema/verbs/authorize.json|  24 +
 .../src/main/jsonschema/verbs/borrow.json   |  24 +
 .../src/main/jsonschema/verbs/build.json|  24 +
 .../src/main/jsonschema/verbs/cancel.json   |  24 +
 .../src/main/jsonschema/verbs/checkin.json  |  24 +
 .../src/main/jsonschema/verbs/close.json|  24 +
 .../src/main/jsonschema/verbs/complete.json |  24 +
 .../src/main/jsonschema/verbs/confirm.json  |  24 +
 .../src/main/jsonschema/verbs/consume.json  |  24 +
 .../src/main/jsonschema/verbs/create.json 

[18/53] [abbrv] incubator-streams git commit: WIP for apachecon

2016-10-12 Thread mfranklin
http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-plugins/streams-plugin-hbase/src/test/resources/streams-plugin-hbase/pom.xml
--
diff --git 
a/streams-plugins/streams-plugin-hbase/src/test/resources/streams-plugin-hbase/pom.xml
 
b/streams-plugins/streams-plugin-hbase/src/test/resources/streams-plugin-hbase/pom.xml
new file mode 100644
index 000..9aa7d8d
--- /dev/null
+++ 
b/streams-plugins/streams-plugin-hbase/src/test/resources/streams-plugin-hbase/pom.xml
@@ -0,0 +1,76 @@
+http://maven.apache.org/POM/4.0.0";
+ xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance";
+ xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 
http://maven.apache.org/xsd/maven-4.0.0.xsd";>
+4.0.0
+
+org.apache.streams.plugins
+streams-plugin-hbase-test
+0.3-incubating-SNAPSHOT
+jar
+Test StreamsHbaseResourceGeneratorMojo
+
+
+
+junit
+junit
+4.11
+test
+
+
+org.apache.streams
+streams-schemas
+${project.version}
+test
+
+
+
+
+
+
+org.apache.streams.plugins
+streams-plugin-hbase
+0.3-incubating-SNAPSHOT
+
+
+
target/test-classes/streams-schemas/activity.json
+
target/test-classes/streams-schemas/collection.json
+
target/test-classes/streams-schemas/media_link.json
+
target/test-classes/streams-schemas/object.json
+
target/test-classes/streams-schemas/objectTypes
+
target/test-classes/streams-schemas/verbs
+
+
target/generated-resources/test-mojo
+cf
+
+
+
+
+hbase
+
+
+
+
+
+org.apache.maven.plugins
+maven-dependency-plugin
+2.10
+
+**/*.json
+
${project.build.directory}/test-classes/streams-schemas
+org.apache.streams
+streams-schemas
+jar,test-jar
+
+
+
+unpack-schemas
+process-resources
+
+unpack-dependencies
+
+
+
+
+
+
+
\ No newline at end of file

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-plugins/streams-plugin-hive/pom.xml
--
diff --git a/streams-plugins/streams-plugin-hive/pom.xml 
b/streams-plugins/streams-plugin-hive/pom.xml
index b173a8d..515314a 100644
--- a/streams-plugins/streams-plugin-hive/pom.xml
+++ b/streams-plugins/streams-plugin-hive/pom.xml
@@ -148,6 +148,12 @@
 test
 
 
+org.apache.maven.shared
+maven-verifier
+1.6
+test
+
+
 junit
 junit
 test

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/1bc84dbc/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/hive/StreamsHiveResourceGenerator.java
--
diff --git 
a/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/hive/StreamsHiveResourceGenerator.java
 
b/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/hive/StreamsHiveResourceGenerator.java
index 06c1499..c09f7dd 100644
--- 
a/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/hive/StreamsHiveResourceGenerator.java
+++ 
b/streams-plugins/streams-plugin-hive/src/main/java/org/apache/streams/plugins/hive/StreamsHiveResourceGenerator.java
@@ -46,12 +46,11 @@ public class StreamsHiveResourceGenerator implements 
Runnable {
 
 private int currentDepth = 0;
 
-public void main(String[] args) {
+public static void main(String[] args) {
 StreamsHiveGenerationConfig config = new StreamsHiveGenerationConfig();
 
-String sourceDirectory = "./target/test-classes/activities";
-String targetDirectory = 
"./target/generated-sources/streams-plugin-hive";
-String targetPackage = "";
+String sourceDirectory = "src/main/jsonschema";
+String targetDirectory = "target/generated-resources/hive";
 
 if( args.length > 0 )
 sourceDirectory = args[0];

http://git-wip-us.apache.org/repos/a

[45/53] [abbrv] incubator-streams git commit: Fixed license headers on new merge

2016-10-12 Thread mfranklin
Fixed license headers on new merge


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/94f7ea06
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/94f7ea06
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/94f7ea06

Branch: refs/heads/invalid_headers
Commit: 94f7ea06253c5e3fc9bdd0bceafbf0d65ec42618
Parents: b569cd4
Author: Matt Franklin 
Authored: Wed Oct 12 14:12:28 2016 -0400
Committer: Matt Franklin 
Committed: Wed Oct 12 14:12:28 2016 -0400

--
 .../org/apache/streams/util/ComponentUtils.java |  1 -
 .../apache/streams/util/schema/FieldType.java   | 17 +
 .../apache/streams/util/schema/FieldUtil.java   | 17 +
 .../apache/streams/util/schema/FileUtil.java| 17 +
 .../streams/util/schema/GenerationConfig.java   | 17 +
 .../org/apache/streams/util/schema/Schema.java  | 17 +
 .../apache/streams/util/schema/SchemaStore.java | 17 +
 .../streams/util/schema/SchemaStoreImpl.java| 17 +
 .../apache/streams/util/schema/SchemaUtil.java  | 17 +
 .../org/apache/streams/util/schema/URIUtil.java | 17 +
 .../util/schema/test/SchemaOrderingTest.java| 17 +
 .../util/schema/test/SchemaStoreTest.java   | 17 +
 .../src/test/resources/activities/post.json | 10 +++--
 streams-util/src/test/resources/media_link.json | 14 ---
 .../src/test/resources/objects/event.json   | 40 
 .../src/test/resources/objects/group.json   | 24 +++-
 .../src/test/resources/objects/issue.json   | 18 +
 .../src/test/resources/objects/note.json| 16 +---
 .../src/test/resources/objects/permission.json  | 22 +++
 .../src/test/resources/objects/place.json   | 10 +++--
 .../src/test/resources/objects/task.json| 32 +---
 .../src/test/resources/objects/video.json   | 16 +---
 22 files changed, 312 insertions(+), 78 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/94f7ea06/streams-util/src/main/java/org/apache/streams/util/ComponentUtils.java
--
diff --git 
a/streams-util/src/main/java/org/apache/streams/util/ComponentUtils.java 
b/streams-util/src/main/java/org/apache/streams/util/ComponentUtils.java
index d62182f..6037f28 100644
--- a/streams-util/src/main/java/org/apache/streams/util/ComponentUtils.java
+++ b/streams-util/src/main/java/org/apache/streams/util/ComponentUtils.java
@@ -15,7 +15,6 @@
  * specific language governing permissions and limitations
  * under the License.
  */
-
 package org.apache.streams.util;
 
 import org.apache.commons.lang3.StringUtils;

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/94f7ea06/streams-util/src/main/java/org/apache/streams/util/schema/FieldType.java
--
diff --git 
a/streams-util/src/main/java/org/apache/streams/util/schema/FieldType.java 
b/streams-util/src/main/java/org/apache/streams/util/schema/FieldType.java
index 6a2290c..450851e 100644
--- a/streams-util/src/main/java/org/apache/streams/util/schema/FieldType.java
+++ b/streams-util/src/main/java/org/apache/streams/util/schema/FieldType.java
@@ -1,3 +1,20 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ *
+ *   http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied.  See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
 package org.apache.streams.util.schema;
 
 /**

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/94f7ea06/streams-util/src/main/java/org/apache/streams/util/schema/FieldUtil.java
--
diff --git 
a/streams-util/src/main/java/org/apache/streams/util/schema/FieldUtil.java 
b/streams-util/src/main/java/org/apache/streams/util/schema/FieldUtil.java
index 20435c9..6582565 100644
--- a/streams-util/src/main/java/org/apache/streams/util/schema/FieldUtil.java
+++ b/streams-util/src/main/java/org/apache/streams/util/schema/FieldUtil.java
@@ -1,3 +1,20 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contribu

[41/53] [abbrv] incubator-streams git commit: pom version bump

2016-10-12 Thread mfranklin
pom version bump


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/5694ae95
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/5694ae95
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/5694ae95

Branch: refs/heads/invalid_headers
Commit: 5694ae953b7e2562df0e3f40f29e5b643ceed317
Parents: 18a29b0
Author: Steve Blackmon @steveblackmon 
Authored: Wed Oct 12 12:40:46 2016 -0500
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Oct 12 12:40:46 2016 -0500

--
 streams-plugins/streams-plugin-cassandra/pom.xml | 4 ++--
 .../src/test/resources/streams-plugin-cassandra/pom.xml  | 4 ++--
 streams-plugins/streams-plugin-elasticsearch/pom.xml | 4 ++--
 .../src/test/resources/streams-plugin-elasticsearch/pom.xml  | 4 ++--
 streams-plugins/streams-plugin-hbase/pom.xml | 4 ++--
 .../src/test/resources/streams-plugin-hbase/pom.xml  | 4 ++--
 streams-plugins/streams-plugin-hive/pom.xml  | 4 ++--
 .../src/test/resources/streams-plugin-hive/pom.xml   | 4 ++--
 streams-plugins/streams-plugin-pig/pom.xml   | 4 ++--
 .../src/test/resources/streams-plugin-pig/pom.xml| 4 ++--
 streams-plugins/streams-plugin-pojo/pom.xml  | 4 ++--
 .../src/test/resources/streams-plugin-pojo/pom.xml   | 4 ++--
 streams-schemas/pom.xml  | 2 +-
 streams-schemas/streams-schema-activitystreams/pom.xml   | 2 +-
 14 files changed, 26 insertions(+), 26 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/5694ae95/streams-plugins/streams-plugin-cassandra/pom.xml
--
diff --git a/streams-plugins/streams-plugin-cassandra/pom.xml 
b/streams-plugins/streams-plugin-cassandra/pom.xml
index d9d3f91..c378a2b 100644
--- a/streams-plugins/streams-plugin-cassandra/pom.xml
+++ b/streams-plugins/streams-plugin-cassandra/pom.xml
@@ -21,13 +21,13 @@
 4.0.0
 org.apache.streams.plugins
 streams-plugin-cassandra
-0.3-incubating-SNAPSHOT
+0.4-incubating-SNAPSHOT
 maven-plugin
 
 
 org.apache.streams
 streams-plugins
-0.3-incubating-SNAPSHOT
+0.4-incubating-SNAPSHOT
 ..
 
 

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/5694ae95/streams-plugins/streams-plugin-cassandra/src/test/resources/streams-plugin-cassandra/pom.xml
--
diff --git 
a/streams-plugins/streams-plugin-cassandra/src/test/resources/streams-plugin-cassandra/pom.xml
 
b/streams-plugins/streams-plugin-cassandra/src/test/resources/streams-plugin-cassandra/pom.xml
index 2a69ec7..d576d72 100644
--- 
a/streams-plugins/streams-plugin-cassandra/src/test/resources/streams-plugin-cassandra/pom.xml
+++ 
b/streams-plugins/streams-plugin-cassandra/src/test/resources/streams-plugin-cassandra/pom.xml
@@ -5,7 +5,7 @@
 
 org.apache.streams.plugins
 streams-plugin-cassandra-test
-0.3-incubating-SNAPSHOT
+0.4-incubating-SNAPSHOT
 jar
 Test StreamsCassandraResourceGeneratorMojo
 
@@ -30,7 +30,7 @@
 
 org.apache.streams.plugins
 streams-plugin-cassandra
-0.3-incubating-SNAPSHOT
+0.4-incubating-SNAPSHOT
 
 
 
target/test-classes/streams-schema-activitystreams/activity.json

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/5694ae95/streams-plugins/streams-plugin-elasticsearch/pom.xml
--
diff --git a/streams-plugins/streams-plugin-elasticsearch/pom.xml 
b/streams-plugins/streams-plugin-elasticsearch/pom.xml
index 07d7fc1..691813a 100644
--- a/streams-plugins/streams-plugin-elasticsearch/pom.xml
+++ b/streams-plugins/streams-plugin-elasticsearch/pom.xml
@@ -21,13 +21,13 @@
 4.0.0
 org.apache.streams.plugins
 streams-plugin-elasticsearch
-0.3-incubating-SNAPSHOT
+0.4-incubating-SNAPSHOT
 maven-plugin
 
 
 org.apache.streams
 streams-plugins
-0.3-incubating-SNAPSHOT
+0.4-incubating-SNAPSHOT
 ..
 
 

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/5694ae95/streams-plugins/streams-plugin-elasticsearch/src/test/resources/streams-plugin-elasticsearch/pom.xml
--
diff --git 
a/streams-plugins/streams-plugin-elasticsearch/src/test/resources/streams-plugin-elasticsearch/pom.xml
 
b/streams-plugins/streams-plugin-elasticsearch/src/te

[11/53] [abbrv] incubator-streams git commit: start of implementation for STREAMS-398

2016-10-12 Thread mfranklin
start of implementation for STREAMS-398


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/50f67bf8
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/50f67bf8
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/50f67bf8

Branch: refs/heads/invalid_headers
Commit: 50f67bf8d97a61bb325f8524472f5c20e86287d0
Parents: 0e7fbcb
Author: Steve Blackmon (@steveblackmon) 
Authored: Tue Dec 29 17:19:15 2015 -0600
Committer: Steve Blackmon @steveblackmon 
Committed: Wed Jun 1 12:49:27 2016 -0500

--
 streams-plugins/pom.xml |  56 
 streams-plugins/streams-plugin-hive/pom.xml | 232 +++
 .../apache/streams/plugins/StreamsPojoHive.java | 242 +++
 .../streams/plugins/StreamsPojoHiveMojo.java|  71 +
 .../plugins/test/StreamsPojoHiveTest.java   |  55 
 .../src/test/resources/Tweet.hql| 297 +++
 .../test/resources/streams-plugin-hive/pom.xml  |  42 +++
 7 files changed, 995 insertions(+)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/50f67bf8/streams-plugins/pom.xml
--
diff --git a/streams-plugins/pom.xml b/streams-plugins/pom.xml
new file mode 100644
index 000..2306aab
--- /dev/null
+++ b/streams-plugins/pom.xml
@@ -0,0 +1,56 @@
+
+
+
+http://maven.apache.org/POM/4.0.0"; 
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; 
xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 
http://maven.apache.org/xsd/maven-4.0.0.xsd";>
+4.0.0
+
+streams-project
+org.apache.streams
+0.3-incubating-SNAPSHOT
+../pom.xml
+
+
+streams-plugins
+
+pom
+streams-plugins
+
+
+
+
+
+
+streams-plugin-scala
+   
+
+
+
+
+org.apache.streams
+streams-config
+${project.version}
+
+
+org.apache.streams
+streams-pojo
+${project.version}
+
+
+
+

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/50f67bf8/streams-plugins/streams-plugin-hive/pom.xml
--
diff --git a/streams-plugins/streams-plugin-hive/pom.xml 
b/streams-plugins/streams-plugin-hive/pom.xml
new file mode 100644
index 000..cbc055b
--- /dev/null
+++ b/streams-plugins/streams-plugin-hive/pom.xml
@@ -0,0 +1,232 @@
+
+
+http://maven.apache.org/POM/4.0.0"; 
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; 
xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 
http://maven.apache.org/xsd/maven-4.0.0.xsd";>
+
+4.0.0
+org.apache.streams.plugins
+streams-plugin-hive
+0.3-incubating-SNAPSHOT
+maven-plugin
+
+
+org.apache.streams
+streams-plugins
+0.3-incubating-SNAPSHOT
+..
+
+
+
+1.14
+
+
+
+
+org.apache.streams
+streams-config
+${project.version}
+
+
+org.apache.streams
+streams-core
+${project.version}
+
+
+org.jsonschema2pojo
+jsonschema2pojo-core
+
+
+org.apache.streams
+streams-pojo
+${project.version}
+test
+test-jar
+
+
+org.reflections
+reflections
+0.9.9
+
+
+org.apache.maven
+maven-aether-provider
+3.3.3
+
+
+org.apache.maven
+maven-artifact
+3.3.3
+provided
+
+
+org.apache.maven
+maven-compat
+3.3.3
+test
+
+
+org.apache.maven
+maven-core
+3.3.3
+
+
+org.sonatype.aether
+*
+
+
+
+
+org.apache.maven
+maven-plugin-api
+3.3.3
+
+
+org.apache.maven.plugins
+maven-resources-plugin
+2.7
+
+
+org.apache.maven
+*
+
+
+
+
+org.codehaus.plexus
+plexus-utils
+3.0.15
+
+
+org.apache.maven.plugins
+maven-plugin-plugin
+3.4
+
+
+commons-logging
+commons-logging
+
+
+   

  1   2   >