Build failed in Jenkins: streams-project-site #121

[Apache Jenkins Server]

See 

Changes:

[smarthi] [maven-release-plugin] prepare release 
streams-project-0.4.1-incubating

[smarthi] [maven-release-plugin] prepare for next development iteration

--
Started by upstream project "streams-project" build number 337
originally caused by:
 Started by an SCM change
[EnvInject] - Loading node environment variables.
Building remotely on H11 (ubuntu) in workspace 

Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://git-wip-us.apache.org/repos/asf/incubator-streams.git
 > git init  # 
 > timeout=10
Fetching upstream changes from 
https://git-wip-us.apache.org/repos/asf/incubator-streams.git
 > git --version # timeout=10
 > git -c core.askpass=true fetch --tags --progress 
 > https://git-wip-us.apache.org/repos/asf/incubator-streams.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git config remote.origin.url 
 > https://git-wip-us.apache.org/repos/asf/incubator-streams.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # 
 > timeout=10
 > git config remote.origin.url 
 > https://git-wip-us.apache.org/repos/asf/incubator-streams.git # timeout=10
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=10
No valid HEAD. Skipping the resetting
 > git clean -fdx # timeout=10
Fetching upstream changes from 
https://git-wip-us.apache.org/repos/asf/incubator-streams.git
 > git -c core.askpass=true fetch --tags --progress 
 > https://git-wip-us.apache.org/repos/asf/incubator-streams.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision cee5a231a84ee1adb9033030e0964bcdc93c9cb5 (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f cee5a231a84ee1adb9033030e0964bcdc93c9cb5
 > git rev-list 4ac71f4856a8172dbca0309e48da03470e4365e1 # timeout=10
Parsing POMs
using settings config with name simple-deploy-settings-no-mirror
Replacing all maven server entries not found in credentials list is true
Downloaded artifact 
https://repository.apache.org/content/repositories/snapshots/org/apache/streams/streams-master/0.5-incubating-SNAPSHOT/maven-metadata.xml
Failed to transfer Could not find metadata 
org.apache.streams:streams-master:0.5-incubating-SNAPSHOT/maven-metadata.xml in 
sonatype (https://oss.sonatype.org/content/repositories/snapshots)
Failed to transfer Could not find metadata 
org.apache.streams:streams-master:0.5-incubating-SNAPSHOT/maven-metadata.xml in 
typesafe (http://repo.typesafe.com/typesafe/repo)
Failed to transfer Could not find metadata 
org.apache.streams:streams-master:0.5-incubating-SNAPSHOT/maven-metadata.xml in 
google-api-services (http://google-api-client-libraries.appspot.com/mavenrepo)
Downloaded artifact 
https://repository.apache.org/snapshots/org/apache/streams/streams-master/0.5-incubating-SNAPSHOT/maven-metadata.xml
Modules changed, recalculating dependency graph
Established TCP socket on 52857
maven32-agent.jar already up to date
maven32-interceptor.jar already up to date
maven3-interceptor-commons.jar already up to date
[streams-project-site] $ /home/jenkins/tools/java/latest1.8/bin/java -Xmx2g 
-Xms256m -XX:MaxPermSize=512m -Dfile.encoding=UTF-8 -cp 
/home/jenkins/jenkins-slave/maven32-agent.jar:/home/jenkins/tools/maven/apache-maven-3.3.9/boot/plexus-classworlds-2.5.2.jar:/home/jenkins/tools/maven/apache-maven-3.3.9/conf/logging
 jenkins.maven3.agent.Maven32Main /home/jenkins/tools/maven/apache-maven-3.3.9 
/home/jenkins/jenkins-slave/slave.jar 
/home/jenkins/jenkins-slave/maven32-interceptor.jar 
/home/jenkins/jenkins-slave/maven3-interceptor-commons.jar 52857
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; 
support was removed in 8.0
<===[JENKINS REMOTING CAPACITY]===>   channel started
using settings config with name simple-deploy-settings-no-mirror
Replacing all maven server entries not found in credentials list is true
Executing Maven:  -B -f 
 
-Dmaven.repo.local=/home/jenkins/jenkins-slave/maven-repositories/0 -s 
/tmp/settings1909863108186595883.xml -q -U generate-sources site:site site:stage
Saving to 
outputFile=
Processed 0 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 135 ms
[JENKINS] Archiving site from 
 to 
/x1/jenkins/jenkins-home/jobs/streams-project-site/site
file:// 
- Session: Opened  
file:// 
- Session: Disconnecting  

Build failed in Jenkins: streams-examples #169

[Apache Jenkins Server]

See 

--
[...truncated 20 lines...]
Downloaded artifact 
https://repository.apache.org/content/repositories/snapshots/org/apache/streams/streams-master/0.5-incubating-SNAPSHOT/streams-master-0.5-incubating-20161218.042418-41.pom
Downloaded artifact 
https://repository.apache.org/snapshots/org/apache/streams/streams-master/0.5-incubating-SNAPSHOT/maven-metadata.xml
Modules changed, recalculating dependency graph
Established TCP socket on 38042
maven32-agent.jar already up to date
maven32-interceptor.jar already up to date
maven3-interceptor-commons.jar already up to date
[streams-examples] $ /home/jenkins/tools/java/latest1.8/bin/java -Xmx2g 
-Xms256m -XX:MaxPermSize=512m -Dfile.encoding=ISO-8859-1 -cp 
/home/jenkins/jenkins-slave/maven32-agent.jar:/home/jenkins/tools/maven/apache-maven-3.3.9/boot/plexus-classworlds-2.5.2.jar:/home/jenkins/tools/maven/apache-maven-3.3.9/conf/logging
 jenkins.maven3.agent.Maven32Main /home/jenkins/tools/maven/apache-maven-3.3.9 
/home/jenkins/jenkins-slave/slave.jar 
/home/jenkins/jenkins-slave/maven32-interceptor.jar 
/home/jenkins/jenkins-slave/maven3-interceptor-commons.jar 38042
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; 
support was removed in 8.0
<===[JENKINS REMOTING CAPACITY]===>   channel started
using settings config with name simple-deploy-settings-no-mirror
Replacing all maven server entries not found in credentials list is true
Executing Maven:  -B -f 
 
-Dmaven.repo.local=/home/jenkins/jenkins-slave/maven-repositories/1 -s 
/tmp/settings821485346133056781.xml clean install verify
[INFO] Scanning for projects...
[INFO] 
[INFO] Reactor Build Order:
[INFO] 
[INFO] streams-examples
[INFO] streams-examples-flink
[INFO] flink-twitter-collection
[INFO] streams-examples-local
[INFO] elasticsearch-hdfs
[INFO] elasticsearch-reindex
[INFO] mongo-elasticsearch-sync
[INFO] twitter-follow-neo4j
[INFO] twitter-history-elasticsearch
[INFO] twitter-userstream-elasticsearch
[INFO] 
[INFO] 
[INFO] Building streams-examples 0.5-incubating-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-clean-plugin:2.6:clean (default-clean) @ streams-examples ---
[INFO] Deleting 
[INFO] 
[INFO] --- maven-resources-plugin:2.7:copy-resources (copy-resources) @ 
streams-examples ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] 
[INFO] --- maven-checkstyle-plugin:2.17:check (validate) @ streams-examples ---
[INFO] Starting audit...
Audit done.
[INFO] 
[INFO] --- scalastyle-maven-plugin:0.8.0:check (validate) @ streams-examples ---
[WARNING] sourceDirectory is not specified or does not exist 
value=
[WARNING] testSourceDirectory is not specified or does not exist 
value=
Saving to 
outputFile=
Processed 0 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 216 ms
[INFO] 
[INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-java) @ 
streams-examples ---
[INFO] 
[INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-banned-dependencies) @ 
streams-examples ---
[INFO] 
[INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-no-snapshots) @ 
streams-examples ---
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.4:process (default) @ 
streams-examples ---
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.4:process (process-resource-bundles) 
@ streams-examples ---
[INFO] 
[INFO] --- maven-surefire-plugin:2.19.1:test (test) @ streams-examples ---
[INFO] No tests to run.
[JENKINS] Recording test results[INFO] 
[INFO] --- maven-site-plugin:3.5:attach-descriptor (attach-descriptor) @ 
streams-examples ---

[INFO] 
[INFO] --- maven-failsafe-plugin:2.19.1:integration-test (integration-tests) @ 
streams-examples ---
[INFO] Tests are skipped.
[INFO] 
[INFO] --- maven-failsafe-plugin:2.19.1:verify (integration-tests) @ 
streams-examples ---
[INFO] Tests are skipped.
[INFO] 
[INFO] --- maven-install-plugin:2.5.2:install (default-install) @ 
streams-examples ---
[INFO] Installing  
to 
/home/jenkins/jenkins-slave/maven-repositories/1/org/apache/streams/streams-examples/0.5-incubating-SNAPSHOT/streams-examples-0.5-incubating-SNAPSHOT.pom
[INFO] Installing 

[incubator-streams] Git Push Summary

[smarthi]

Repository: incubator-streams
Updated Tags:  refs/tags/streams-project-0.4.1-incubating [created] 00e56473e

incubator-streams git commit: [maven-release-plugin] prepare for next development iteration

[smarthi]

Repository: incubator-streams
Updated Branches:
  refs/heads/master 0ab58845d -> cee5a231a


[maven-release-plugin] prepare for next development iteration


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/cee5a231
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/cee5a231
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/cee5a231

Branch: refs/heads/master
Commit: cee5a231a84ee1adb9033030e0964bcdc93c9cb5
Parents: 0ab5884
Author: smarthi 
Authored: Sun Dec 18 02:01:56 2016 -0500
Committer: smarthi 
Committed: Sun Dec 18 02:01:56 2016 -0500

--
 pom.xml| 6 +++---
 streams-components/pom.xml | 2 +-
 streams-components/streams-converters/pom.xml  | 4 ++--
 streams-components/streams-filters/pom.xml | 2 +-
 streams-components/streams-http/pom.xml| 2 +-
 streams-config/pom.xml | 2 +-
 streams-contrib/pom.xml| 2 +-
 streams-contrib/streams-amazon-aws/pom.xml | 2 +-
 .../streams-amazon-aws/streams-persist-kinesis/pom.xml | 2 +-
 streams-contrib/streams-amazon-aws/streams-persist-s3/pom.xml  | 2 +-
 streams-contrib/streams-persist-console/pom.xml| 2 +-
 streams-contrib/streams-persist-elasticsearch/pom.xml  | 2 +-
 streams-contrib/streams-persist-filebuffer/pom.xml | 2 +-
 streams-contrib/streams-persist-graph/pom.xml  | 2 +-
 streams-contrib/streams-persist-hbase/pom.xml  | 2 +-
 streams-contrib/streams-persist-hdfs/pom.xml   | 2 +-
 streams-contrib/streams-persist-kafka/pom.xml  | 2 +-
 streams-contrib/streams-persist-mongo/pom.xml  | 2 +-
 streams-contrib/streams-processor-jackson/pom.xml  | 2 +-
 streams-contrib/streams-processor-json/pom.xml | 2 +-
 streams-contrib/streams-processor-peoplepattern/pom.xml| 2 +-
 streams-contrib/streams-processor-regex/pom.xml| 2 +-
 streams-contrib/streams-processor-urls/pom.xml | 2 +-
 streams-contrib/streams-provider-facebook/pom.xml  | 2 +-
 streams-contrib/streams-provider-google/google-gmail/pom.xml   | 2 +-
 streams-contrib/streams-provider-google/google-gplus/pom.xml   | 2 +-
 streams-contrib/streams-provider-google/pom.xml| 2 +-
 streams-contrib/streams-provider-instagram/pom.xml | 2 +-
 streams-contrib/streams-provider-moreover/pom.xml  | 2 +-
 streams-contrib/streams-provider-rss/pom.xml   | 2 +-
 streams-contrib/streams-provider-sysomos/pom.xml   | 2 +-
 streams-contrib/streams-provider-twitter/pom.xml   | 2 +-
 streams-contrib/streams-provider-youtube/pom.xml   | 2 +-
 streams-core/pom.xml   | 2 +-
 streams-monitoring/pom.xml | 2 +-
 streams-plugins/pom.xml| 2 +-
 streams-plugins/streams-plugin-cassandra/pom.xml   | 4 ++--
 streams-plugins/streams-plugin-elasticsearch/pom.xml   | 4 ++--
 streams-plugins/streams-plugin-hbase/pom.xml   | 4 ++--
 streams-plugins/streams-plugin-hive/pom.xml| 4 ++--
 streams-plugins/streams-plugin-pig/pom.xml | 4 ++--
 streams-plugins/streams-plugin-pojo/pom.xml| 4 ++--
 streams-plugins/streams-plugin-scala/pom.xml   | 4 ++--
 streams-pojo-extensions/pom.xml| 2 +-
 streams-pojo/pom.xml   | 2 +-
 streams-runtimes/pom.xml   | 2 +-
 streams-runtimes/streams-runtime-dropwizard/pom.xml| 2 +-
 streams-runtimes/streams-runtime-local/pom.xml | 2 +-
 streams-schemas/pom.xml| 2 +-
 streams-schemas/streams-schema-activitystreams/pom.xml | 2 +-
 streams-schemas/streams-schema-activitystreams2/pom.xml| 2 +-
 streams-testing/pom.xml| 2 +-
 streams-util/pom.xml   | 2 +-
 streams-verbs/pom.xml  | 2 +-
 54 files changed, 64 insertions(+), 64 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/cee5a231/pom.xml
--
diff --git a/pom.xml b/pom.xml
index b0f7cb0..69366a0 100644
--- a/pom.xml
+++ 

Build failed in Jenkins: streams-project-site #120

[Apache Jenkins Server]

See 

--
Started by upstream project "streams-project" build number 336
originally caused by:
 Started by upstream project "streams-master" build number 108
 originally caused by:
  Started by an SCM change
[EnvInject] - Loading node environment variables.
Building remotely on H11 (ubuntu) in workspace 

Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://git-wip-us.apache.org/repos/asf/incubator-streams.git
 > git init  # 
 > timeout=10
Fetching upstream changes from 
https://git-wip-us.apache.org/repos/asf/incubator-streams.git
 > git --version # timeout=10
 > git -c core.askpass=true fetch --tags --progress 
 > https://git-wip-us.apache.org/repos/asf/incubator-streams.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git config remote.origin.url 
 > https://git-wip-us.apache.org/repos/asf/incubator-streams.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # 
 > timeout=10
 > git config remote.origin.url 
 > https://git-wip-us.apache.org/repos/asf/incubator-streams.git # timeout=10
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=10
No valid HEAD. Skipping the resetting
 > git clean -fdx # timeout=10
Fetching upstream changes from 
https://git-wip-us.apache.org/repos/asf/incubator-streams.git
 > git -c core.askpass=true fetch --tags --progress 
 > https://git-wip-us.apache.org/repos/asf/incubator-streams.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 4ac71f4856a8172dbca0309e48da03470e4365e1 (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 4ac71f4856a8172dbca0309e48da03470e4365e1
 > git rev-list 4ac71f4856a8172dbca0309e48da03470e4365e1 # timeout=10
Parsing POMs
using settings config with name simple-deploy-settings-no-mirror
Replacing all maven server entries not found in credentials list is true
Downloaded artifact 
https://repository.apache.org/content/repositories/snapshots/org/apache/streams/streams-master/0.5-incubating-SNAPSHOT/maven-metadata.xml
Downloaded artifact 
https://repository.apache.org/content/repositories/snapshots/org/apache/streams/streams-master/0.5-incubating-SNAPSHOT/streams-master-0.5-incubating-20161218.042418-41.pom
Failed to transfer Could not find metadata 
org.apache.streams:streams-master:0.5-incubating-SNAPSHOT/maven-metadata.xml in 
sonatype (https://oss.sonatype.org/content/repositories/snapshots)
Failed to transfer Could not find metadata 
org.apache.streams:streams-master:0.5-incubating-SNAPSHOT/maven-metadata.xml in 
typesafe (http://repo.typesafe.com/typesafe/repo)
Failed to transfer Could not find metadata 
org.apache.streams:streams-master:0.5-incubating-SNAPSHOT/maven-metadata.xml in 
google-api-services (http://google-api-client-libraries.appspot.com/mavenrepo)
Downloaded artifact 
https://repository.apache.org/snapshots/org/apache/streams/streams-master/0.5-incubating-SNAPSHOT/maven-metadata.xml
Modules changed, recalculating dependency graph
Established TCP socket on 44676
maven32-agent.jar already up to date
maven32-interceptor.jar already up to date
maven3-interceptor-commons.jar already up to date
[streams-project-site] $ /home/jenkins/tools/java/latest1.8/bin/java -Xmx2g 
-Xms256m -XX:MaxPermSize=512m -Dfile.encoding=UTF-8 -cp 
/home/jenkins/jenkins-slave/maven32-agent.jar:/home/jenkins/tools/maven/apache-maven-3.3.9/boot/plexus-classworlds-2.5.2.jar:/home/jenkins/tools/maven/apache-maven-3.3.9/conf/logging
 jenkins.maven3.agent.Maven32Main /home/jenkins/tools/maven/apache-maven-3.3.9 
/home/jenkins/jenkins-slave/slave.jar 
/home/jenkins/jenkins-slave/maven32-interceptor.jar 
/home/jenkins/jenkins-slave/maven3-interceptor-commons.jar 44676
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; 
support was removed in 8.0
<===[JENKINS REMOTING CAPACITY]===>   channel started
using settings config with name simple-deploy-settings-no-mirror
Replacing all maven server entries not found in credentials list is true
Executing Maven:  -B -f 
 
-Dmaven.repo.local=/home/jenkins/jenkins-slave/maven-repositories/1 -s 
/tmp/settings7453552602472955614.xml -q -U generate-sources site:site site:stage
Saving to 
outputFile=
Processed 0 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 154 ms
[JENKINS] Archiving site from 
 to 
/x1/jenkins/jenkins-home/jobs/streams-project-site/site
file:// 
- Session: Opened  

Build failed in Jenkins: streams-examples-site #56

[Apache Jenkins Server]

See 

--
Started by upstream project "streams-master-site" build number 41
originally caused by:
 Started by an SCM change
[EnvInject] - Loading node environment variables.
Building remotely on ubuntu-4 (ubuntu) in workspace 

Wiping out workspace first.
Cloning the remote Git repository
Cloning repository 
https://git-wip-us.apache.org/repos/asf/incubator-streams-examples.git
 > git init  # 
 > timeout=10
Fetching upstream changes from 
https://git-wip-us.apache.org/repos/asf/incubator-streams-examples.git
 > git --version # timeout=10
 > git -c core.askpass=true fetch --tags --progress 
 > https://git-wip-us.apache.org/repos/asf/incubator-streams-examples.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git config remote.origin.url 
 > https://git-wip-us.apache.org/repos/asf/incubator-streams-examples.git # 
 > timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # 
 > timeout=10
 > git config remote.origin.url 
 > https://git-wip-us.apache.org/repos/asf/incubator-streams-examples.git # 
 > timeout=10
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=10
No valid HEAD. Skipping the resetting
 > git clean -fdx # timeout=10
Fetching upstream changes from 
https://git-wip-us.apache.org/repos/asf/incubator-streams-examples.git
 > git -c core.askpass=true fetch --tags --progress 
 > https://git-wip-us.apache.org/repos/asf/incubator-streams-examples.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 1fb1e0e11afee3f76e4eb3b61dcd70884a738043 (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 1fb1e0e11afee3f76e4eb3b61dcd70884a738043
 > git rev-list 1fb1e0e11afee3f76e4eb3b61dcd70884a738043 # timeout=10
Parsing POMs
using settings config with name simple-deploy-settings-no-mirror
Replacing all maven server entries not found in credentials list is true
Downloaded artifact 
https://repository.apache.org/content/repositories/snapshots/org/apache/streams/streams-master/0.5-incubating-SNAPSHOT/maven-metadata.xml
Downloaded artifact 
https://repository.apache.org/content/repositories/snapshots/org/apache/streams/streams-master/0.5-incubating-SNAPSHOT/streams-master-0.5-incubating-20161218.040839-39.pom
Downloaded artifact 
https://repository.apache.org/snapshots/org/apache/streams/streams-master/0.5-incubating-SNAPSHOT/maven-metadata.xml
Modules changed, recalculating dependency graph
Established TCP socket on 44558
maven32-agent.jar already up to date
maven32-interceptor.jar already up to date
maven3-interceptor-commons.jar already up to date
[streams-examples-site] $ /home/jenkins/tools/java/latest1.8/bin/java -Xmx2g 
-Xms256m -XX:MaxPermSize=512m -Dfile.encoding=UTF-8 -cp 
/home/jenkins/jenkins-slave/maven32-agent.jar:/home/jenkins/tools/maven/apache-maven-3.3.9/boot/plexus-classworlds-2.5.2.jar:/home/jenkins/tools/maven/apache-maven-3.3.9/conf/logging
 jenkins.maven3.agent.Maven32Main /home/jenkins/tools/maven/apache-maven-3.3.9 
/home/jenkins/jenkins-slave/slave.jar 
/home/jenkins/jenkins-slave/maven32-interceptor.jar 
/home/jenkins/jenkins-slave/maven3-interceptor-commons.jar 44558
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; 
support was removed in 8.0
<===[JENKINS REMOTING CAPACITY]===>   channel started
using settings config with name simple-deploy-settings-no-mirror
Replacing all maven server entries not found in credentials list is true
Executing Maven:  -B -f 
 
-Dmaven.repo.local=/home/jenkins/jenkins-slave/maven-repositories/0 -s 
/tmp/settings6438860518441930038.xml -q -U generate-sources site:site site:stage
Saving to 
outputFile=
Processed 0 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 231 ms
[JENKINS] Archiving site from 
 to 
/x1/jenkins/jenkins-home/jobs/streams-examples-site/site
file:// 
- Session: Opened  
file:// 
- Session: Disconnecting  
file:// 
- Session: Disconnected
Saving to 
outputFile=
Processed 0 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 2 ms
[JENKINS] Archiving site from 
 to 
/x1/jenkins/jenkins-home/jobs/streams-examples-site/site/streams-examples-flink

[incubator-streams-master] Git Push Summary

[smarthi]

Repository: incubator-streams-master
Updated Tags:  refs/tags/streams-master-0.4.1-incubating [created] 269c3d17a

incubator-streams-master git commit: [maven-release-plugin] prepare for next development iteration

[smarthi]

Repository: incubator-streams-master
Updated Branches:
  refs/heads/master 8b9948833 -> 903c5762f


[maven-release-plugin] prepare for next development iteration


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams-master/repo
Commit: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-master/commit/903c5762
Tree: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-master/tree/903c5762
Diff: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-master/diff/903c5762

Branch: refs/heads/master
Commit: 903c5762f34f4961f21b8e79d2f168309c03ded1
Parents: 8b99488
Author: smarthi 
Authored: Sat Dec 17 22:38:38 2016 -0500
Committer: smarthi 
Committed: Sat Dec 17 22:38:38 2016 -0500

--
 pom.xml | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams-master/blob/903c5762/pom.xml
--
diff --git a/pom.xml b/pom.xml
index debfc4b..bdc765c 100644
--- a/pom.xml
+++ b/pom.xml
@@ -32,7 +32,7 @@
 Apache Streams :: streams-master
 Apache Streams Master Pom
 pom
-0.4.1-incubating
+0.5-incubating-SNAPSHOT
 
 2012
 
@@ -51,7 +51,7 @@
 
scm:git:g...@github.com:apache/incubator-streams-master.git
 
scm:git:https://git-wip-us.apache.org/repos/asf/incubator-streams-master.git
 scm:git:g...@github.com:apache/incubator-streams-master.git
-  streams-master-0.4.1-incubating
+  HEAD
   
 
 

incubator-streams-master git commit: [maven-release-plugin] prepare release streams-master-0.4.1-incubating

[smarthi]

Repository: incubator-streams-master
Updated Branches:
  refs/heads/master 5c9d96794 -> 8b9948833


[maven-release-plugin] prepare release streams-master-0.4.1-incubating


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams-master/repo
Commit: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-master/commit/8b994883
Tree: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-master/tree/8b994883
Diff: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-master/diff/8b994883

Branch: refs/heads/master
Commit: 8b99488333700d2ff91bf846f656df28f90ef2fc
Parents: 5c9d967
Author: smarthi 
Authored: Sat Dec 17 22:38:23 2016 -0500
Committer: smarthi 
Committed: Sat Dec 17 22:38:23 2016 -0500

--
 pom.xml | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams-master/blob/8b994883/pom.xml
--
diff --git a/pom.xml b/pom.xml
index bdc765c..debfc4b 100644
--- a/pom.xml
+++ b/pom.xml
@@ -32,7 +32,7 @@
 Apache Streams :: streams-master
 Apache Streams Master Pom
 pom
-0.5-incubating-SNAPSHOT
+0.4.1-incubating
 
 2012
 
@@ -51,7 +51,7 @@
 
scm:git:g...@github.com:apache/incubator-streams-master.git
 
scm:git:https://git-wip-us.apache.org/repos/asf/incubator-streams-master.git
 scm:git:g...@github.com:apache/incubator-streams-master.git
-  HEAD
+  streams-master-0.4.1-incubating
   
 
 

[1/2] incubator-streams-master git commit: [maven-release-plugin] prepare release streams-master-0.4-incubating

[smarthi]

Repository: incubator-streams-master
Updated Branches:
  refs/heads/master a86e99562 -> 5c9d96794


[maven-release-plugin] prepare release streams-master-0.4-incubating


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams-master/repo
Commit: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-master/commit/3f3d5d53
Tree: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-master/tree/3f3d5d53
Diff: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-master/diff/3f3d5d53

Branch: refs/heads/master
Commit: 3f3d5d53e5294704ff3a70bda310fcfaba2cef8c
Parents: a86e995
Author: smarthi 
Authored: Sat Dec 17 22:34:47 2016 -0500
Committer: smarthi 
Committed: Sat Dec 17 22:34:47 2016 -0500

--
 pom.xml | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams-master/blob/3f3d5d53/pom.xml
--
diff --git a/pom.xml b/pom.xml
index bdc765c..700ec10 100644
--- a/pom.xml
+++ b/pom.xml
@@ -32,7 +32,7 @@
 Apache Streams :: streams-master
 Apache Streams Master Pom
 pom
-0.5-incubating-SNAPSHOT
+0.4-incubating
 
 2012
 
@@ -51,7 +51,7 @@
 
scm:git:g...@github.com:apache/incubator-streams-master.git
 
scm:git:https://git-wip-us.apache.org/repos/asf/incubator-streams-master.git
 scm:git:g...@github.com:apache/incubator-streams-master.git
-  HEAD
+  streams-master-0.4-incubating
   
 
 

Build failed in Jenkins: streams-examples #167

[Apache Jenkins Server]

See 

--
[...truncated 16 lines...]
Parsing POMs
using settings config with name simple-deploy-settings-no-mirror
Replacing all maven server entries not found in credentials list is true
Modules changed, recalculating dependency graph
Established TCP socket on 37311
maven32-agent.jar already up to date
maven32-interceptor.jar already up to date
maven3-interceptor-commons.jar already up to date
[streams-examples] $ /home/jenkins/tools/java/latest1.8/bin/java -Xmx2g 
-Xms256m -XX:MaxPermSize=512m -Dfile.encoding=ISO-8859-1 -cp 
/home/jenkins/jenkins-slave/maven32-agent.jar:/home/jenkins/tools/maven/apache-maven-3.3.9/boot/plexus-classworlds-2.5.2.jar:/home/jenkins/tools/maven/apache-maven-3.3.9/conf/logging
 jenkins.maven3.agent.Maven32Main /home/jenkins/tools/maven/apache-maven-3.3.9 
/home/jenkins/jenkins-slave/slave.jar 
/home/jenkins/jenkins-slave/maven32-interceptor.jar 
/home/jenkins/jenkins-slave/maven3-interceptor-commons.jar 37311
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; 
support was removed in 8.0
<===[JENKINS REMOTING CAPACITY]===>   channel started
using settings config with name simple-deploy-settings-no-mirror
Replacing all maven server entries not found in credentials list is true
Executing Maven:  -B -f 
 
-Dmaven.repo.local=/home/jenkins/jenkins-slave/maven-repositories/1 -s 
/tmp/settings6474631454816928154.xml clean install verify
[INFO] Scanning for projects...
[INFO] 
[INFO] Reactor Build Order:
[INFO] 
[INFO] streams-examples
[INFO] streams-examples-flink
[INFO] flink-twitter-collection
[INFO] streams-examples-local
[INFO] elasticsearch-hdfs
[INFO] elasticsearch-reindex
[INFO] mongo-elasticsearch-sync
[INFO] twitter-follow-neo4j
[INFO] twitter-history-elasticsearch
[INFO] twitter-userstream-elasticsearch
[INFO] 
[INFO] 
[INFO] Building streams-examples 0.5-incubating-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-clean-plugin:2.6:clean (default-clean) @ streams-examples ---
[INFO] Deleting 
[INFO] 
[INFO] --- maven-resources-plugin:2.7:copy-resources (copy-resources) @ 
streams-examples ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] 
[INFO] --- maven-checkstyle-plugin:2.17:check (validate) @ streams-examples ---
[INFO] Starting audit...
Audit done.
[INFO] 
[INFO] --- scalastyle-maven-plugin:0.8.0:check (validate) @ streams-examples ---
[WARNING] sourceDirectory is not specified or does not exist 
value=
[WARNING] testSourceDirectory is not specified or does not exist 
value=
Saving to 
outputFile=
Processed 0 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 170 ms
[INFO] 
[INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-java) @ 
streams-examples ---
[INFO] 
[INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-banned-dependencies) @ 
streams-examples ---
[INFO] 
[INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-no-snapshots) @ 
streams-examples ---
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.4:process (default) @ 
streams-examples ---
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.4:process (process-resource-bundles) 
@ streams-examples ---
[INFO] 
[INFO] --- maven-surefire-plugin:2.19.1:test (test) @ streams-examples ---
[INFO] No tests to run.
[JENKINS] Recording test results[INFO] 
[INFO] --- maven-site-plugin:3.5:attach-descriptor (attach-descriptor) @ 
streams-examples ---

[INFO] 
[INFO] --- maven-failsafe-plugin:2.19.1:integration-test (integration-tests) @ 
streams-examples ---
[INFO] Tests are skipped.
[INFO] 
[INFO] --- maven-failsafe-plugin:2.19.1:verify (integration-tests) @ 
streams-examples ---
[INFO] Tests are skipped.
[INFO] 
[INFO] --- maven-install-plugin:2.5.2:install (default-install) @ 
streams-examples ---
[INFO] Installing  
to 
/home/jenkins/jenkins-slave/maven-repositories/1/org/apache/streams/streams-examples/0.5-incubating-SNAPSHOT/streams-examples-0.5-incubating-SNAPSHOT.pom
[INFO] Installing 

 to 

[GitHub] incubator-streams pull request #344: Trivial Anonymous -> Java 8 lambdas, re...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/344


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Build failed in Jenkins: streams-project-site #118

[Apache Jenkins Server]

See 

--
Started by upstream project "streams-project" build number 334
originally caused by:
 Started by an SCM change
[EnvInject] - Loading node environment variables.
Building remotely on H11 (ubuntu) in workspace 

Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://git-wip-us.apache.org/repos/asf/incubator-streams.git
 > git init  # 
 > timeout=10
Fetching upstream changes from 
https://git-wip-us.apache.org/repos/asf/incubator-streams.git
 > git --version # timeout=10
 > git -c core.askpass=true fetch --tags --progress 
 > https://git-wip-us.apache.org/repos/asf/incubator-streams.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git config remote.origin.url 
 > https://git-wip-us.apache.org/repos/asf/incubator-streams.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # 
 > timeout=10
 > git config remote.origin.url 
 > https://git-wip-us.apache.org/repos/asf/incubator-streams.git # timeout=10
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=10
No valid HEAD. Skipping the resetting
 > git clean -fdx # timeout=10
Fetching upstream changes from 
https://git-wip-us.apache.org/repos/asf/incubator-streams.git
 > git -c core.askpass=true fetch --tags --progress 
 > https://git-wip-us.apache.org/repos/asf/incubator-streams.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 00363f213880f333d8d3d6d21a7369198e70b37d (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 00363f213880f333d8d3d6d21a7369198e70b37d
 > git rev-list 5e1bd10be6b2b45b91c0cdc26e22508d6445e021 # timeout=10
Parsing POMs
using settings config with name simple-deploy-settings-no-mirror
Replacing all maven server entries not found in credentials list is true
Downloaded artifact 
https://repository.apache.org/content/repositories/snapshots/org/apache/streams/streams-master/0.5-incubating-SNAPSHOT/maven-metadata.xml
Failed to transfer Could not find metadata 
org.apache.streams:streams-master:0.5-incubating-SNAPSHOT/maven-metadata.xml in 
sonatype (https://oss.sonatype.org/content/repositories/snapshots)
Failed to transfer Could not find metadata 
org.apache.streams:streams-master:0.5-incubating-SNAPSHOT/maven-metadata.xml in 
typesafe (http://repo.typesafe.com/typesafe/repo)
Failed to transfer Could not find metadata 
org.apache.streams:streams-master:0.5-incubating-SNAPSHOT/maven-metadata.xml in 
google-api-services (http://google-api-client-libraries.appspot.com/mavenrepo)
Downloaded artifact 
https://repository.apache.org/snapshots/org/apache/streams/streams-master/0.5-incubating-SNAPSHOT/maven-metadata.xml
Modules changed, recalculating dependency graph
Established TCP socket on 54013
maven32-agent.jar already up to date
maven32-interceptor.jar already up to date
maven3-interceptor-commons.jar already up to date
[streams-project-site] $ /home/jenkins/tools/java/latest1.8/bin/java -Xmx2g 
-Xms256m -XX:MaxPermSize=512m -Dfile.encoding=UTF-8 -cp 
/home/jenkins/jenkins-slave/maven32-agent.jar:/home/jenkins/tools/maven/apache-maven-3.3.9/boot/plexus-classworlds-2.5.2.jar:/home/jenkins/tools/maven/apache-maven-3.3.9/conf/logging
 jenkins.maven3.agent.Maven32Main /home/jenkins/tools/maven/apache-maven-3.3.9 
/home/jenkins/jenkins-slave/slave.jar 
/home/jenkins/jenkins-slave/maven32-interceptor.jar 
/home/jenkins/jenkins-slave/maven3-interceptor-commons.jar 54013
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; 
support was removed in 8.0
<===[JENKINS REMOTING CAPACITY]===>   channel started
using settings config with name simple-deploy-settings-no-mirror
Replacing all maven server entries not found in credentials list is true
Executing Maven:  -B -f 
 
-Dmaven.repo.local=/home/jenkins/jenkins-slave/maven-repositories/0 -s 
/tmp/settings8482122674587512305.xml -q -U generate-sources site:site site:stage
Saving to 
outputFile=
Processed 0 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 129 ms
[JENKINS] Archiving site from 
 to 
/x1/jenkins/jenkins-home/jobs/streams-project-site/site
file:// 
- Session: Opened  
file:// 
- Session: Disconnecting  
file:// 
- Session: Disconnected
Saving to 
outputFile=

Build failed in Jenkins: streams-examples #166

[Apache Jenkins Server]

See 

--
[...truncated 19 lines...]
Downloaded artifact 
https://repository.apache.org/content/repositories/snapshots/org/apache/streams/streams-master/0.5-incubating-SNAPSHOT/maven-metadata.xml
Downloaded artifact 
https://repository.apache.org/content/repositories/snapshots/org/apache/streams/streams-master/0.5-incubating-SNAPSHOT/streams-master-0.5-incubating-20161217.193142-38.pom
Downloaded artifact 
https://repository.apache.org/snapshots/org/apache/streams/streams-master/0.5-incubating-SNAPSHOT/maven-metadata.xml
Modules changed, recalculating dependency graph
Established TCP socket on 51451
maven32-agent.jar already up to date
maven32-interceptor.jar already up to date
maven3-interceptor-commons.jar already up to date
[streams-examples] $ /home/jenkins/tools/java/latest1.8/bin/java -Xmx2g 
-Xms256m -XX:MaxPermSize=512m -Dfile.encoding=ISO-8859-1 -cp 
/home/jenkins/jenkins-slave/maven32-agent.jar:/home/jenkins/tools/maven/apache-maven-3.3.9/boot/plexus-classworlds-2.5.2.jar:/home/jenkins/tools/maven/apache-maven-3.3.9/conf/logging
 jenkins.maven3.agent.Maven32Main /home/jenkins/tools/maven/apache-maven-3.3.9 
/home/jenkins/jenkins-slave/slave.jar 
/home/jenkins/jenkins-slave/maven32-interceptor.jar 
/home/jenkins/jenkins-slave/maven3-interceptor-commons.jar 51451
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; 
support was removed in 8.0
<===[JENKINS REMOTING CAPACITY]===>   channel started
using settings config with name simple-deploy-settings-no-mirror
Replacing all maven server entries not found in credentials list is true
Executing Maven:  -B -f 
 
-Dmaven.repo.local=/home/jenkins/jenkins-slave/maven-repositories/0 -s 
/tmp/settings8676038279804098082.xml clean install verify
[INFO] Scanning for projects...
[INFO] 
[INFO] Reactor Build Order:
[INFO] 
[INFO] streams-examples
[INFO] streams-examples-flink
[INFO] flink-twitter-collection
[INFO] streams-examples-local
[INFO] elasticsearch-hdfs
[INFO] elasticsearch-reindex
[INFO] mongo-elasticsearch-sync
[INFO] twitter-follow-neo4j
[INFO] twitter-history-elasticsearch
[INFO] twitter-userstream-elasticsearch
[INFO] 
[INFO] 
[INFO] Building streams-examples 0.5-incubating-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-clean-plugin:2.6:clean (default-clean) @ streams-examples ---
[INFO] Deleting 
[INFO] 
[INFO] --- maven-resources-plugin:2.7:copy-resources (copy-resources) @ 
streams-examples ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] 
[INFO] --- maven-checkstyle-plugin:2.17:check (validate) @ streams-examples ---
[INFO] Starting audit...
Audit done.
[INFO] 
[INFO] --- scalastyle-maven-plugin:0.8.0:check (validate) @ streams-examples ---
[WARNING] sourceDirectory is not specified or does not exist 
value=
[WARNING] testSourceDirectory is not specified or does not exist 
value=
Saving to 
outputFile=
Processed 0 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 169 ms
[INFO] 
[INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-java) @ 
streams-examples ---
[INFO] 
[INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-banned-dependencies) @ 
streams-examples ---
[INFO] 
[INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-no-snapshots) @ 
streams-examples ---
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.4:process (default) @ 
streams-examples ---
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.4:process (process-resource-bundles) 
@ streams-examples ---
[INFO] 
[INFO] --- maven-surefire-plugin:2.19.1:test (test) @ streams-examples ---
[INFO] No tests to run.
[JENKINS] Recording test results[INFO] 
[INFO] --- maven-site-plugin:3.5:attach-descriptor (attach-descriptor) @ 
streams-examples ---

[INFO] 
[INFO] --- maven-failsafe-plugin:2.19.1:integration-test (integration-tests) @ 
streams-examples ---
[INFO] Tests are skipped.
[INFO] 
[INFO] --- maven-failsafe-plugin:2.19.1:verify (integration-tests) @ 
streams-examples ---
[INFO] Tests are skipped.
[INFO] 
[INFO] --- maven-install-plugin:2.5.2:install (default-install) @ 
streams-examples ---
[INFO] Installing  
to 

[GitHub] incubator-streams pull request #344: Trivial Anonymous -> Java 8 lambdas, re...

[smarthi]

GitHub user smarthi opened a pull request:

https://github.com/apache/incubator-streams/pull/344

Trivial Anonymous -> Java 8 lambdas, replace assert with TestNg.Assert in 
Integration tests



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/smarthi/incubator-streams master

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams/pull/344.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #344


commit e4605bf43540df95a050743140add4dcdc8fd56f
Author: smarthi 
Date:   2016-12-17T22:29:40Z

Trivial Anonymous -> Java 8 lambdas, replace assert with TestNg.Assert in 
Integration tests




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Commented] (STREAMS-462) Migrate website graphviz diagrams from git to confluence

[Steve Blackmon (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15757694#comment-15757694
 ] 

Steve Blackmon commented on STREAMS-462:


i have had no luck getting SVGs served up out of from confluence to render on 
the website.  i've tried everything i can think of (http vs https, 4 different 
ways of embedding).  we might be able to set up maven to download them from 
confluence into the web site file system while running the site plugin.

> Migrate website graphviz diagrams from git to confluence
> 
>
> Key: STREAMS-462
> URL: https://issues.apache.org/jira/browse/STREAMS-462
> Project: Streams
>  Issue Type: Task
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> a) migrate dot files out of our source control repos and into confluence
> b) place them in a page hierarchy aligned with our source hierarchy
> c) we'll manage their content from here on out in confluence
> d) we embed them in the web page as we currently do, using links such as 
> https://cwiki.apache.org/confluence/download/attachments/66854246/integration.svg.svg?api=v2
> e) the SVG representation of each diagram gets created by the confluence 
> plugin and exposed to the web by confluence CMS.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] incubator-streams pull request #341: Replace Guava API calls with Java 8 API

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/341


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

incubator-streams git commit: closes apache/incubator-streams#341 *Already Merged*

[smarthi]

Repository: incubator-streams
Updated Branches:
  refs/heads/master 5e1bd10be -> 00363f213


closes apache/incubator-streams#341 *Already Merged*


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/00363f21
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/00363f21
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/00363f21

Branch: refs/heads/master
Commit: 00363f213880f333d8d3d6d21a7369198e70b37d
Parents: 5e1bd10
Author: smarthi 
Authored: Sat Dec 17 16:58:28 2016 -0500
Committer: smarthi 
Committed: Sat Dec 17 16:58:28 2016 -0500

--

--

Build failed in Jenkins: streams-examples-site #55

[Apache Jenkins Server]

See 

Changes:

[sblackmon] switch elasticsearch-hdfs to testng

[sblackmon] switch elasticsearch-reindex to testng

[sblackmon] switch mongo-elasticsearch-sync to testng

[sblackmon] switch twitter-history-elasticsearch to testng

[sblackmon] switch twitter-history-elasticsearch to testng

[sblackmon] switch twitter-follow-neo4j to testng

[sblackmon] STREAMS-474: Apply check style requirements to examples

[sblackmon] accomodate STREAMS-465,466,467

--
Started by an SCM change
[EnvInject] - Loading node environment variables.
Building remotely on ubuntu-4 (ubuntu) in workspace 

Wiping out workspace first.
Cloning the remote Git repository
Cloning repository 
https://git-wip-us.apache.org/repos/asf/incubator-streams-examples.git
 > git init  # 
 > timeout=10
Fetching upstream changes from 
https://git-wip-us.apache.org/repos/asf/incubator-streams-examples.git
 > git --version # timeout=10
 > git -c core.askpass=true fetch --tags --progress 
 > https://git-wip-us.apache.org/repos/asf/incubator-streams-examples.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git config remote.origin.url 
 > https://git-wip-us.apache.org/repos/asf/incubator-streams-examples.git # 
 > timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # 
 > timeout=10
 > git config remote.origin.url 
 > https://git-wip-us.apache.org/repos/asf/incubator-streams-examples.git # 
 > timeout=10
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=10
No valid HEAD. Skipping the resetting
 > git clean -fdx # timeout=10
Fetching upstream changes from 
https://git-wip-us.apache.org/repos/asf/incubator-streams-examples.git
 > git -c core.askpass=true fetch --tags --progress 
 > https://git-wip-us.apache.org/repos/asf/incubator-streams-examples.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 1fb1e0e11afee3f76e4eb3b61dcd70884a738043 (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 1fb1e0e11afee3f76e4eb3b61dcd70884a738043
 > git rev-list 3eb2e35260b8922dc24c208abf70799c41557d2d # timeout=10
Parsing POMs
using settings config with name simple-deploy-settings-no-mirror
Replacing all maven server entries not found in credentials list is true
Downloaded artifact 
https://repository.apache.org/content/repositories/snapshots/org/apache/streams/streams-master/0.5-incubating-SNAPSHOT/maven-metadata.xml
Downloaded artifact 
https://repository.apache.org/content/repositories/snapshots/org/apache/streams/streams-master/0.5-incubating-SNAPSHOT/streams-master-0.5-incubating-20161217.193142-38.pom
Downloaded artifact 
https://repository.apache.org/snapshots/org/apache/streams/streams-master/0.5-incubating-SNAPSHOT/maven-metadata.xml
Modules changed, recalculating dependency graph
Established TCP socket on 36453
maven32-agent.jar already up to date
maven32-interceptor.jar already up to date
maven3-interceptor-commons.jar already up to date
[streams-examples-site] $ /home/jenkins/tools/java/latest1.8/bin/java -Xmx2g 
-Xms256m -XX:MaxPermSize=512m -Dfile.encoding=UTF-8 -cp 
/home/jenkins/jenkins-slave/maven32-agent.jar:/home/jenkins/tools/maven/apache-maven-3.3.9/boot/plexus-classworlds-2.5.2.jar:/home/jenkins/tools/maven/apache-maven-3.3.9/conf/logging
 jenkins.maven3.agent.Maven32Main /home/jenkins/tools/maven/apache-maven-3.3.9 
/home/jenkins/jenkins-slave/slave.jar 
/home/jenkins/jenkins-slave/maven32-interceptor.jar 
/home/jenkins/jenkins-slave/maven3-interceptor-commons.jar 36453
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; 
support was removed in 8.0
<===[JENKINS REMOTING CAPACITY]===>   channel started
using settings config with name simple-deploy-settings-no-mirror
Replacing all maven server entries not found in credentials list is true
Executing Maven:  -B -f 
 
-Dmaven.repo.local=/home/jenkins/jenkins-slave/maven-repositories/1 -s 
/tmp/settings3432845627816218939.xml -q -U generate-sources site:site site:stage
Saving to 
outputFile=
Processed 0 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 241 ms
[JENKINS] Archiving site from 
 to 
/x1/jenkins/jenkins-home/jobs/streams-examples-site/site
file:// 
- Session: Opened  
file:// 
- Session: Disconnecting  
file:// 
- Session: Disconnected
Saving to 

Build failed in Jenkins: streams-examples #165

[Apache Jenkins Server]

See 

--
[...truncated 16 lines...]
Parsing POMs
using settings config with name simple-deploy-settings-no-mirror
Replacing all maven server entries not found in credentials list is true
Modules changed, recalculating dependency graph
Established TCP socket on 51209
maven32-agent.jar already up to date
maven32-interceptor.jar already up to date
maven3-interceptor-commons.jar already up to date
[streams-examples] $ /home/jenkins/tools/java/latest1.8/bin/java -Xmx2g 
-Xms256m -XX:MaxPermSize=512m -Dfile.encoding=ISO-8859-1 -cp 
/home/jenkins/jenkins-slave/maven32-agent.jar:/home/jenkins/tools/maven/apache-maven-3.3.9/boot/plexus-classworlds-2.5.2.jar:/home/jenkins/tools/maven/apache-maven-3.3.9/conf/logging
 jenkins.maven3.agent.Maven32Main /home/jenkins/tools/maven/apache-maven-3.3.9 
/home/jenkins/jenkins-slave/slave.jar 
/home/jenkins/jenkins-slave/maven32-interceptor.jar 
/home/jenkins/jenkins-slave/maven3-interceptor-commons.jar 51209
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; 
support was removed in 8.0
<===[JENKINS REMOTING CAPACITY]===>   channel started
using settings config with name simple-deploy-settings-no-mirror
Replacing all maven server entries not found in credentials list is true
Executing Maven:  -B -f 
 
-Dmaven.repo.local=/home/jenkins/jenkins-slave/maven-repositories/1 -s 
/tmp/settings5464325553470508121.xml clean install verify
[INFO] Scanning for projects...
[INFO] 
[INFO] Reactor Build Order:
[INFO] 
[INFO] streams-examples
[INFO] streams-examples-flink
[INFO] flink-twitter-collection
[INFO] streams-examples-local
[INFO] elasticsearch-hdfs
[INFO] elasticsearch-reindex
[INFO] mongo-elasticsearch-sync
[INFO] twitter-follow-neo4j
[INFO] twitter-history-elasticsearch
[INFO] twitter-userstream-elasticsearch
[INFO] 
[INFO] 
[INFO] Building streams-examples 0.5-incubating-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-clean-plugin:2.6:clean (default-clean) @ streams-examples ---
[INFO] Deleting 
[INFO] 
[INFO] --- maven-resources-plugin:2.7:copy-resources (copy-resources) @ 
streams-examples ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] 
[INFO] --- maven-checkstyle-plugin:2.17:check (validate) @ streams-examples ---
[INFO] Starting audit...
Audit done.
[INFO] 
[INFO] --- scalastyle-maven-plugin:0.8.0:check (validate) @ streams-examples ---
[WARNING] sourceDirectory is not specified or does not exist 
value=
[WARNING] testSourceDirectory is not specified or does not exist 
value=
Saving to 
outputFile=
Processed 0 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 183 ms
[INFO] 
[INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-java) @ 
streams-examples ---
[INFO] 
[INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-banned-dependencies) @ 
streams-examples ---
[INFO] 
[INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-no-snapshots) @ 
streams-examples ---
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.4:process (default) @ 
streams-examples ---
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.4:process (process-resource-bundles) 
@ streams-examples ---
[INFO] 
[INFO] --- maven-surefire-plugin:2.19.1:test (test) @ streams-examples ---
[INFO] No tests to run.
[JENKINS] Recording test results[INFO] 
[INFO] --- maven-site-plugin:3.5:attach-descriptor (attach-descriptor) @ 
streams-examples ---

[INFO] 
[INFO] --- maven-failsafe-plugin:2.19.1:integration-test (integration-tests) @ 
streams-examples ---
[INFO] Tests are skipped.
[INFO] 
[INFO] --- maven-failsafe-plugin:2.19.1:verify (integration-tests) @ 
streams-examples ---
[INFO] Tests are skipped.
[INFO] 
[INFO] --- maven-install-plugin:2.5.2:install (default-install) @ 
streams-examples ---
[INFO] Installing  
to 
/home/jenkins/jenkins-slave/maven-repositories/1/org/apache/streams/streams-examples/0.5-incubating-SNAPSHOT/streams-examples-0.5-incubating-SNAPSHOT.pom
[INFO] Installing 

 to 

[jira] [Updated] (STREAMS-48) Complete, test, and document hbase persist

[Steve Blackmon (JIRA)]

 [ 
https://issues.apache.org/jira/browse/STREAMS-48?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Blackmon updated STREAMS-48:
--
Fix Version/s: (was: 0.4.1)
   0.5

> Complete, test, and document hbase persist
> --
>
> Key: STREAMS-48
> URL: https://issues.apache.org/jira/browse/STREAMS-48
> Project: Streams
>  Issue Type: Story
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
>Priority: Minor
> Fix For: 0.5
>
>  Time Spent: 2h 52m
>  Remaining Estimate: 0h
>
> Complete, test, and document hbase persist



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (STREAMS-48) Complete, test, and document hbase persist

[Steve Blackmon (JIRA)]

 [ 
https://issues.apache.org/jira/browse/STREAMS-48?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Blackmon reopened STREAMS-48:
---

> Complete, test, and document hbase persist
> --
>
> Key: STREAMS-48
> URL: https://issues.apache.org/jira/browse/STREAMS-48
> Project: Streams
>  Issue Type: Story
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
>Priority: Minor
> Fix For: 0.4.1
>
>  Time Spent: 2h 52m
>  Remaining Estimate: 0h
>
> Complete, test, and document hbase persist



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Build failed in Jenkins: streams-examples #164

[Apache Jenkins Server]

See 

Changes:

[sblackmon] switch elasticsearch-hdfs to testng

[sblackmon] switch elasticsearch-reindex to testng

[sblackmon] switch mongo-elasticsearch-sync to testng

[sblackmon] switch twitter-history-elasticsearch to testng

[sblackmon] switch twitter-history-elasticsearch to testng

[sblackmon] switch twitter-follow-neo4j to testng

[sblackmon] STREAMS-474: Apply check style requirements to examples

[sblackmon] accomodate STREAMS-465,466,467

--
[...truncated 18 lines...]
Established TCP socket on 42877
maven32-agent.jar already up to date
maven32-interceptor.jar already up to date
maven3-interceptor-commons.jar already up to date
[streams-examples] $ /home/jenkins/tools/java/latest1.8/bin/java -Xmx2g 
-Xms256m -XX:MaxPermSize=512m -Dfile.encoding=ISO-8859-1 -cp 
/home/jenkins/jenkins-slave/maven32-agent.jar:/home/jenkins/tools/maven/apache-maven-3.3.9/boot/plexus-classworlds-2.5.2.jar:/home/jenkins/tools/maven/apache-maven-3.3.9/conf/logging
 jenkins.maven3.agent.Maven32Main /home/jenkins/tools/maven/apache-maven-3.3.9 
/home/jenkins/jenkins-slave/slave.jar 
/home/jenkins/jenkins-slave/maven32-interceptor.jar 
/home/jenkins/jenkins-slave/maven3-interceptor-commons.jar 42877
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; 
support was removed in 8.0
<===[JENKINS REMOTING CAPACITY]===>   channel started
using settings config with name simple-deploy-settings-no-mirror
Replacing all maven server entries not found in credentials list is true
Executing Maven:  -B -f 
 
-Dmaven.repo.local=/home/jenkins/jenkins-slave/maven-repositories/1 -s 
/tmp/settings1295632398731888971.xml clean install verify
[INFO] Scanning for projects...
[INFO] 
[INFO] Reactor Build Order:
[INFO] 
[INFO] streams-examples
[INFO] streams-examples-flink
[INFO] flink-twitter-collection
[INFO] streams-examples-local
[INFO] elasticsearch-hdfs
[INFO] elasticsearch-reindex
[INFO] mongo-elasticsearch-sync
[INFO] twitter-follow-neo4j
[INFO] twitter-history-elasticsearch
[INFO] twitter-userstream-elasticsearch
[INFO] 
[INFO] 
[INFO] Building streams-examples 0.5-incubating-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-clean-plugin:2.6:clean (default-clean) @ streams-examples ---
[INFO] Deleting 
[INFO] 
[INFO] --- maven-resources-plugin:2.7:copy-resources (copy-resources) @ 
streams-examples ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] 
[INFO] --- maven-checkstyle-plugin:2.17:check (validate) @ streams-examples ---
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/puppycrawl/tools/checkstyle/7.2/checkstyle-7.2.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/puppycrawl/tools/checkstyle/7.2/checkstyle-7.2.pom
 (71 KB at 170.3 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/com/puppycrawl/tools/checkstyle/7.2/checkstyle-7.2.jar
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/com/puppycrawl/tools/checkstyle/7.2/checkstyle-7.2.jar
 (1163 KB at 7223.4 KB/sec)
[INFO] Starting audit...
Audit done.
[INFO] 
[INFO] --- scalastyle-maven-plugin:0.8.0:check (validate) @ streams-examples ---
[WARNING] sourceDirectory is not specified or does not exist 
value=
[WARNING] testSourceDirectory is not specified or does not exist 
value=
Saving to 
outputFile=
Processed 0 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 147 ms
[INFO] 
[INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-java) @ 
streams-examples ---
[INFO] 
[INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-banned-dependencies) @ 
streams-examples ---
[INFO] 
[INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-no-snapshots) @ 
streams-examples ---
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.4:process (default) @ 
streams-examples ---
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.4:process (process-resource-bundles) 
@ streams-examples ---
[INFO] 
[INFO] --- maven-surefire-plugin:2.19.1:test (test) @ streams-examples ---
[INFO] No tests to run.
[JENKINS] Recording test results[INFO] 
[INFO] --- maven-site-plugin:3.5:attach-descriptor (attach-descriptor) @ 
streams-examples ---

[INFO] 
[INFO] --- 

[jira] [Updated] (STREAMS-441) Remove compile dependency on guava for core packages

[Steve Blackmon (JIRA)]

 [ 
https://issues.apache.org/jira/browse/STREAMS-441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Blackmon updated STREAMS-441:
---
Sprint: 0.4.1

> Remove compile dependency on guava for core packages
> 
>
> Key: STREAMS-441
> URL: https://issues.apache.org/jira/browse/STREAMS-441
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Suneel Marthi
> Fix For: 0.4.1
>
>
> To simplify the transitive dependency tree and reduce odds of users hitting 
> shading issues.
> streams-util
> streams-config
> streams-core
> streams-pojo
> streams-pojo-extensions
> streams-schemas/*
> streams-verbs



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (STREAMS-470) Permit use of streams-persist-hdfs to read/write s3

[Steve Blackmon (JIRA)]

 [ 
https://issues.apache.org/jira/browse/STREAMS-470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Blackmon updated STREAMS-470:
---
Sprint: 0.4.1

> Permit use of streams-persist-hdfs to read/write s3
> ---
>
> Key: STREAMS-470
> URL: https://issues.apache.org/jira/browse/STREAMS-470
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4.1
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Add s3, s3n, s3a, emrfs to scheme enumeration.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (STREAMS-155) Build hadoop modules with Apache artifacts

[Steve Blackmon (JIRA)]

 [ 
https://issues.apache.org/jira/browse/STREAMS-155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Blackmon updated STREAMS-155:
---
Sprint: 0.4.1  (was: 0.5.0)

> Build hadoop modules with Apache artifacts
> --
>
> Key: STREAMS-155
> URL: https://issues.apache.org/jira/browse/STREAMS-155
> Project: Streams
>  Issue Type: Bug
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4.1
>
>
> Rather than cloudera.  Ensure README for those modules documents what to 
> change in order to build and run on a cloudera cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (STREAMS-475) LocalRuntimeConfiguration does not properly extend StreamsRuntimeConfiguration

[Steve Blackmon (JIRA)]

 [ 
https://issues.apache.org/jira/browse/STREAMS-475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Blackmon updated STREAMS-475:
---
Sprint: 0.4.1

> LocalRuntimeConfiguration does not properly extend StreamsRuntimeConfiguration
> --
>
> Key: STREAMS-475
> URL: https://issues.apache.org/jira/browse/STREAMS-475
> Project: Streams
>  Issue Type: Bug
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4.1
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Resolved] (STREAMS-467) Twitter Providers should be smarter when deciding whether another fetch is necessary.

[Steve Blackmon (JIRA)]

 [ 
https://issues.apache.org/jira/browse/STREAMS-467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Blackmon resolved STREAMS-467.

Resolution: Fixed

> Twitter Providers should be smarter when deciding whether another fetch is 
> necessary.
> -
>
> Key: STREAMS-467
> URL: https://issues.apache.org/jira/browse/STREAMS-467
> Project: Streams
>  Issue Type: Bug
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4.1
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Currently fetches for page 2 get performed unnecessarily when page.size < 
> max_items 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Work started] (STREAMS-465) Twitter providers make extraneous requests

[Steve Blackmon (JIRA)]

 [ 
https://issues.apache.org/jira/browse/STREAMS-465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on STREAMS-465 started by Steve Blackmon.
--
> Twitter providers make extraneous requests
> --
>
> Key: STREAMS-465
> URL: https://issues.apache.org/jira/browse/STREAMS-465
> Project: Streams
>  Issue Type: Bug
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4.1
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> twitter providers should not request page 2 when page 1 returns fewer items 
> than expected.  these requests are a waste of time and resources and can be 
> easily prevented



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Work started] (STREAMS-474) Apply check style requirements to examples

[Steve Blackmon (JIRA)]

 [ 
https://issues.apache.org/jira/browse/STREAMS-474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on STREAMS-474 started by Steve Blackmon.
--
> Apply check style requirements to examples
> --
>
> Key: STREAMS-474
> URL: https://issues.apache.org/jira/browse/STREAMS-474
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4.1
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Apply new check style requirements to format the streams-examples repo



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Resolved] (STREAMS-473) Switch example ITs from unit to testng

[Steve Blackmon (JIRA)]

 [ 
https://issues.apache.org/jira/browse/STREAMS-473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Blackmon resolved STREAMS-473.

Resolution: Fixed

> Switch example ITs from unit to testng
> --
>
> Key: STREAMS-473
> URL: https://issues.apache.org/jira/browse/STREAMS-473
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4.1
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Switch ITs from junit to testng, check that most (hopefully all) tests remain 
> in the test plan and continue to pass.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Work started] (STREAMS-466) Twitter Providers should be smarter about setting count based on value of max_items and other context

[Steve Blackmon (JIRA)]

 [ 
https://issues.apache.org/jira/browse/STREAMS-466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on STREAMS-466 started by Steve Blackmon.
--
> Twitter Providers should be smarter about setting count based on value of 
> max_items and other context
> -
>
> Key: STREAMS-466
> URL: https://issues.apache.org/jira/browse/STREAMS-466
> Project: Streams
>  Issue Type: Bug
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4.1
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Twitter Providers should be smarter about setting count based on value of 
> max_items and other context.
> Currently count gets set to 200 by TwitterFollowingProvider even when idsOnly 
> is true and max_items is 5000



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Resolved] (STREAMS-465) Twitter providers make extraneous requests

[Steve Blackmon (JIRA)]

 [ 
https://issues.apache.org/jira/browse/STREAMS-465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Blackmon resolved STREAMS-465.

Resolution: Fixed

> Twitter providers make extraneous requests
> --
>
> Key: STREAMS-465
> URL: https://issues.apache.org/jira/browse/STREAMS-465
> Project: Streams
>  Issue Type: Bug
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4.1
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> twitter providers should not request page 2 when page 1 returns fewer items 
> than expected.  these requests are a waste of time and resources and can be 
> easily prevented



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Resolved] (STREAMS-474) Apply check style requirements to examples

[Steve Blackmon (JIRA)]

 [ 
https://issues.apache.org/jira/browse/STREAMS-474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Blackmon resolved STREAMS-474.

Resolution: Fixed

> Apply check style requirements to examples
> --
>
> Key: STREAMS-474
> URL: https://issues.apache.org/jira/browse/STREAMS-474
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4.1
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Apply new check style requirements to format the streams-examples repo



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (STREAMS-474) Apply check style requirements to examples

[Steve Blackmon (JIRA)]

 [ 
https://issues.apache.org/jira/browse/STREAMS-474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Blackmon updated STREAMS-474:
---
Fix Version/s: 0.4.1

> Apply check style requirements to examples
> --
>
> Key: STREAMS-474
> URL: https://issues.apache.org/jira/browse/STREAMS-474
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4.1
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Apply new check style requirements to format the streams-examples repo



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (STREAMS-448) TwitterUserInformationConfiguration only accepts Twitter IDs not usernames

[Steve Blackmon (JIRA)]

 [ 
https://issues.apache.org/jira/browse/STREAMS-448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Blackmon updated STREAMS-448:
---
Sprint: 0.5.0

> TwitterUserInformationConfiguration only accepts Twitter IDs not usernames
> --
>
> Key: STREAMS-448
> URL: https://issues.apache.org/jira/browse/STREAMS-448
> Project: Streams
>  Issue Type: Bug
>Reporter: Trevor Grant
>
> When attempting to create a stream with a Twitter provider, the `info` field 
> should contain numerical TwitterIDs or usernames, however when using twitter 
> usernames an error is generated
> ```
> java.lang.IllegalArgumentException
>   at 
> com.google.common.base.Preconditions.checkArgument(Preconditions.java:108)
>   at 
> org.apache.streams.twitter.provider.TwitterTimelineProvider.startStream(TwitterTimelineProvider.java:110)
> ```
> TO RECREATE:
> ```scala
> import com.typesafe.config._
> import org.apache.streams.config._
> import org.apache.streams.core._
> import java.util.Iterator
> import org.apache.streams.twitter.TwitterUserInformationConfiguration
> import org.apache.streams.twitter.pojo._
> import org.apache.streams.twitter.provider._
> val hocon = s"""
> twitter {
>   oauth {
>consumerKey = ""
> consumerSecret = ""
> accessToken = ""
> accessTokenSecret = ""
>   }
>   retrySleepMs = 5000
>   retryMax = 250
>   info = [
> rawkintrevo   <--- This will create an error
> 1566016094 <--- this will not
>   ]
> }
> """
> val buf = scala.collection.mutable.ArrayBuffer.empty[Object]
> val typesafe = ConfigFactory.parseString(hocon)
> val config = new 
> ComponentConfigurator(classOf[TwitterUserInformationConfiguration]).detectConfiguration(typesafe,
>  "twitter");
> val provider = new TwitterTimelineProvider(config);
> provider.prepare(null)
> provider.startStream()
> while(provider.isRunning()) {
> val resultSet = provider.readCurrent()
> resultSet.size()
> val iterator = resultSet.iterator();
> while(iterator.hasNext()) {
> val datum = iterator.next();
> println(datum.getDocument)
> buf += datum.getDocument
> }   
> }
> ```



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Work started] (STREAMS-467) Twitter Providers should be smarter when deciding whether another fetch is necessary.

[Steve Blackmon (JIRA)]

 [ 
https://issues.apache.org/jira/browse/STREAMS-467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on STREAMS-467 started by Steve Blackmon.
--
> Twitter Providers should be smarter when deciding whether another fetch is 
> necessary.
> -
>
> Key: STREAMS-467
> URL: https://issues.apache.org/jira/browse/STREAMS-467
> Project: Streams
>  Issue Type: Bug
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4.1
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Currently fetches for page 2 get performed unnecessarily when page.size < 
> max_items 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (STREAMS-473) Switch example ITs from unit to testng

[Steve Blackmon (JIRA)]

 [ 
https://issues.apache.org/jira/browse/STREAMS-473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Blackmon updated STREAMS-473:
---
Fix Version/s: 0.4.1

> Switch example ITs from unit to testng
> --
>
> Key: STREAMS-473
> URL: https://issues.apache.org/jira/browse/STREAMS-473
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4.1
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Switch ITs from junit to testng, check that most (hopefully all) tests remain 
> in the test plan and continue to pass.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (STREAMS-448) TwitterUserInformationConfiguration only accepts Twitter IDs not usernames

[Steve Blackmon (JIRA)]

 [ 
https://issues.apache.org/jira/browse/STREAMS-448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Blackmon updated STREAMS-448:
---
Sprint: 0.4.1  (was: 0.5.0)

> TwitterUserInformationConfiguration only accepts Twitter IDs not usernames
> --
>
> Key: STREAMS-448
> URL: https://issues.apache.org/jira/browse/STREAMS-448
> Project: Streams
>  Issue Type: Bug
>Reporter: Trevor Grant
>
> When attempting to create a stream with a Twitter provider, the `info` field 
> should contain numerical TwitterIDs or usernames, however when using twitter 
> usernames an error is generated
> ```
> java.lang.IllegalArgumentException
>   at 
> com.google.common.base.Preconditions.checkArgument(Preconditions.java:108)
>   at 
> org.apache.streams.twitter.provider.TwitterTimelineProvider.startStream(TwitterTimelineProvider.java:110)
> ```
> TO RECREATE:
> ```scala
> import com.typesafe.config._
> import org.apache.streams.config._
> import org.apache.streams.core._
> import java.util.Iterator
> import org.apache.streams.twitter.TwitterUserInformationConfiguration
> import org.apache.streams.twitter.pojo._
> import org.apache.streams.twitter.provider._
> val hocon = s"""
> twitter {
>   oauth {
>consumerKey = ""
> consumerSecret = ""
> accessToken = ""
> accessTokenSecret = ""
>   }
>   retrySleepMs = 5000
>   retryMax = 250
>   info = [
> rawkintrevo   <--- This will create an error
> 1566016094 <--- this will not
>   ]
> }
> """
> val buf = scala.collection.mutable.ArrayBuffer.empty[Object]
> val typesafe = ConfigFactory.parseString(hocon)
> val config = new 
> ComponentConfigurator(classOf[TwitterUserInformationConfiguration]).detectConfiguration(typesafe,
>  "twitter");
> val provider = new TwitterTimelineProvider(config);
> provider.prepare(null)
> provider.startStream()
> while(provider.isRunning()) {
> val resultSet = provider.readCurrent()
> resultSet.size()
> val iterator = resultSet.iterator();
> while(iterator.hasNext()) {
> val datum = iterator.next();
> println(datum.getDocument)
> buf += datum.getDocument
> }   
> }
> ```



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (STREAMS-473) Switch example ITs from unit to testng

[Steve Blackmon (JIRA)]

 [ 
https://issues.apache.org/jira/browse/STREAMS-473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Blackmon updated STREAMS-473:
---
Sprint: 0.4.1

> Switch example ITs from unit to testng
> --
>
> Key: STREAMS-473
> URL: https://issues.apache.org/jira/browse/STREAMS-473
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Switch ITs from junit to testng, check that most (hopefully all) tests remain 
> in the test plan and continue to pass.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (STREAMS-257) Remove incomplete DEPENDENCIES file from src zip artifact

[Steve Blackmon (JIRA)]

 [ 
https://issues.apache.org/jira/browse/STREAMS-257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Blackmon updated STREAMS-257:
---
Sprint: 0.4.1

> Remove incomplete DEPENDENCIES file from src zip artifact
> -
>
> Key: STREAMS-257
> URL: https://issues.apache.org/jira/browse/STREAMS-257
> Project: Streams
>  Issue Type: Bug
>Affects Versions: 0.3
>Reporter: Steve Blackmon
> Fix For: 0.5
>
>
> Remove incomplete DEPENDENCIES file from src zip artifact.
> It is not necessary for a source/binary release.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (STREAMS-474) Apply check style requirements to examples

[Steve Blackmon (JIRA)]

 [ 
https://issues.apache.org/jira/browse/STREAMS-474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Blackmon updated STREAMS-474:
---
Sprint: 0.4.1

> Apply check style requirements to examples
> --
>
> Key: STREAMS-474
> URL: https://issues.apache.org/jira/browse/STREAMS-474
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Apply new check style requirements to format the streams-examples repo



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (STREAMS-465) Twitter providers make extraneous requests

[Steve Blackmon (JIRA)]

 [ 
https://issues.apache.org/jira/browse/STREAMS-465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Blackmon updated STREAMS-465:
---
Sprint: 0.4.1

> Twitter providers make extraneous requests
> --
>
> Key: STREAMS-465
> URL: https://issues.apache.org/jira/browse/STREAMS-465
> Project: Streams
>  Issue Type: Bug
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4.1
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> twitter providers should not request page 2 when page 1 returns fewer items 
> than expected.  these requests are a waste of time and resources and can be 
> easily prevented



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (STREAMS-465) Twitter providers make extraneous requests

[Steve Blackmon (JIRA)]

 [ 
https://issues.apache.org/jira/browse/STREAMS-465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Blackmon updated STREAMS-465:
---
Fix Version/s: 0.4.1

> Twitter providers make extraneous requests
> --
>
> Key: STREAMS-465
> URL: https://issues.apache.org/jira/browse/STREAMS-465
> Project: Streams
>  Issue Type: Bug
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4.1
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> twitter providers should not request page 2 when page 1 returns fewer items 
> than expected.  these requests are a waste of time and resources and can be 
> easily prevented



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (STREAMS-467) Twitter Providers should be smarter when deciding whether another fetch is necessary.

[Steve Blackmon (JIRA)]

 [ 
https://issues.apache.org/jira/browse/STREAMS-467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Blackmon updated STREAMS-467:
---
Fix Version/s: 0.4.1

> Twitter Providers should be smarter when deciding whether another fetch is 
> necessary.
> -
>
> Key: STREAMS-467
> URL: https://issues.apache.org/jira/browse/STREAMS-467
> Project: Streams
>  Issue Type: Bug
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4.1
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Currently fetches for page 2 get performed unnecessarily when page.size < 
> max_items 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (STREAMS-467) Twitter Providers should be smarter when deciding whether another fetch is necessary.

[Steve Blackmon (JIRA)]

 [ 
https://issues.apache.org/jira/browse/STREAMS-467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Blackmon updated STREAMS-467:
---
Sprint: 0.4.1

> Twitter Providers should be smarter when deciding whether another fetch is 
> necessary.
> -
>
> Key: STREAMS-467
> URL: https://issues.apache.org/jira/browse/STREAMS-467
> Project: Streams
>  Issue Type: Bug
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4.1
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Currently fetches for page 2 get performed unnecessarily when page.size < 
> max_items 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (STREAMS-466) Twitter Providers should be smarter about setting count based on value of max_items and other context

[Steve Blackmon (JIRA)]

 [ 
https://issues.apache.org/jira/browse/STREAMS-466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Blackmon updated STREAMS-466:
---
Sprint: 0.4.1

> Twitter Providers should be smarter about setting count based on value of 
> max_items and other context
> -
>
> Key: STREAMS-466
> URL: https://issues.apache.org/jira/browse/STREAMS-466
> Project: Streams
>  Issue Type: Bug
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4.1
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Twitter Providers should be smarter about setting count based on value of 
> max_items and other context.
> Currently count gets set to 200 by TwitterFollowingProvider even when idsOnly 
> is true and max_items is 5000



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (STREAMS-469) Fix failing ITs in streams-provider-rss

[Steve Blackmon (JIRA)]

 [ 
https://issues.apache.org/jira/browse/STREAMS-469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Blackmon updated STREAMS-469:
---
Fix Version/s: 0.4.1

> Fix failing ITs in streams-provider-rss
> ---
>
> Key: STREAMS-469
> URL: https://issues.apache.org/jira/browse/STREAMS-469
> Project: Streams
>  Issue Type: Bug
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4.1
>
>
> https://builds.apache.org/job/streams-project-verify/org.apache.streams$streams-provider-rss/56/testReport/



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (STREAMS-468) Fix failing IT in streams-persist-elasticsearch

[Steve Blackmon (JIRA)]

 [ 
https://issues.apache.org/jira/browse/STREAMS-468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Blackmon updated STREAMS-468:
---
Fix Version/s: 0.4.1

> Fix failing IT in streams-persist-elasticsearch
> ---
>
> Key: STREAMS-468
> URL: https://issues.apache.org/jira/browse/STREAMS-468
> Project: Streams
>  Issue Type: Bug
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4.1
>
>
> https://builds.apache.org/job/streams-project-verify/org.apache.streams$streams-persist-elasticsearch/56/testReport/



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[5/9] incubator-streams-examples git commit: switch twitter-history-elasticsearch to testng

[sblackmon]

switch twitter-history-elasticsearch to testng


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/repo
Commit: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/commit/846b5cb5
Tree: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/tree/846b5cb5
Diff: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/diff/846b5cb5

Branch: refs/heads/master
Commit: 846b5cb5c3a258abc22a24d5232d738d145dece1
Parents: f49b3a1
Author: Steve Blackmon @steveblackmon 
Authored: Thu Dec 15 13:01:25 2016 -0600
Committer: Steve Blackmon @steveblackmon 
Committed: Thu Dec 15 13:01:25 2016 -0600

--
 local/twitter-userstream-elasticsearch/pom.xml  | 19 +
 .../test/TwitterUserstreamElasticsearchIT.java  | 29 +---
 2 files changed, 26 insertions(+), 22 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/blob/846b5cb5/local/twitter-userstream-elasticsearch/pom.xml
--
diff --git a/local/twitter-userstream-elasticsearch/pom.xml 
b/local/twitter-userstream-elasticsearch/pom.xml
index 8442d4b..c13f610 100644
--- a/local/twitter-userstream-elasticsearch/pom.xml
+++ b/local/twitter-userstream-elasticsearch/pom.xml
@@ -59,6 +59,12 @@
 test-jar
 
 
+org.testng
+testng
+${testng.version}
+test
+
+
 org.hamcrest
 hamcrest-all
 1.3
@@ -206,21 +212,10 @@
 
 org.apache.maven.plugins
 maven-failsafe-plugin
-
-
-
-**/*Test.java
-**/*Tests.java
-
-
-**/*IT.java
-**/*ITs.java
-
-
 
 
 org.apache.maven.surefire
-surefire-junit47
+surefire-testng
 ${failsafe.plugin.version}
 
 

http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/blob/846b5cb5/local/twitter-userstream-elasticsearch/src/test/java/org/apache/streams/example/test/TwitterUserstreamElasticsearchIT.java
--
diff --git 
a/local/twitter-userstream-elasticsearch/src/test/java/org/apache/streams/example/test/TwitterUserstreamElasticsearchIT.java
 
b/local/twitter-userstream-elasticsearch/src/test/java/org/apache/streams/example/test/TwitterUserstreamElasticsearchIT.java
index f2dc6a8..2fd26db 100644
--- 
a/local/twitter-userstream-elasticsearch/src/test/java/org/apache/streams/example/test/TwitterUserstreamElasticsearchIT.java
+++ 
b/local/twitter-userstream-elasticsearch/src/test/java/org/apache/streams/example/test/TwitterUserstreamElasticsearchIT.java
@@ -18,15 +18,19 @@
 
 package org.apache.streams.example.test;
 
-import com.typesafe.config.Config;
-import com.typesafe.config.ConfigFactory;
-import com.typesafe.config.ConfigParseOptions;
 import org.apache.streams.config.ComponentConfigurator;
 import org.apache.streams.elasticsearch.ElasticsearchClientManager;
 import org.apache.streams.example.TwitterUserstreamElasticsearch;
 import org.apache.streams.example.TwitterUserstreamElasticsearchConfiguration;
+
+import com.typesafe.config.Config;
+import com.typesafe.config.ConfigFactory;
+import com.typesafe.config.ConfigParseOptions;
+
 import org.elasticsearch.action.admin.cluster.health.ClusterHealthRequest;
 import org.elasticsearch.action.admin.cluster.health.ClusterHealthResponse;
+import org.elasticsearch.action.admin.indices.delete.DeleteIndexRequest;
+import org.elasticsearch.action.admin.indices.delete.DeleteIndexResponse;
 import 
org.elasticsearch.action.admin.indices.exists.indices.IndicesExistsRequest;
 import 
org.elasticsearch.action.admin.indices.exists.indices.IndicesExistsResponse;
 import org.elasticsearch.action.search.SearchRequestBuilder;
@@ -34,15 +38,16 @@ import org.elasticsearch.action.search.SearchResponse;
 import org.elasticsearch.client.Client;
 import org.elasticsearch.client.Requests;
 import org.elasticsearch.cluster.health.ClusterHealthStatus;
-import org.junit.Before;
-import org.junit.Test;
 import org.slf4j.Logger;
 import org.slf4j.LoggerFactory;
+import org.testng.annotations.BeforeClass;
+import org.testng.annotations.Test;
 
 import java.io.File;
 
-import static org.junit.Assert.assertFalse;
-import static org.junit.Assert.assertNotEquals;
+import static org.testng.Assert.assertFalse;
+import static org.testng.Assert.assertNotEquals;

[1/9] incubator-streams-examples git commit: switch elasticsearch-hdfs to testng

[sblackmon]

Repository: incubator-streams-examples
Updated Branches:
  refs/heads/master 3eb2e3526 -> 1fb1e0e11


switch elasticsearch-hdfs to testng


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/repo
Commit: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/commit/47f159e1
Tree: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/tree/47f159e1
Diff: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/diff/47f159e1

Branch: refs/heads/master
Commit: 47f159e1e3ba01ce24fbb80a20223be2f1c1efd5
Parents: 3eb2e35
Author: Steve Blackmon @steveblackmon 
Authored: Thu Dec 15 12:20:51 2016 -0600
Committer: Steve Blackmon @steveblackmon 
Committed: Thu Dec 15 12:20:51 2016 -0600

--
 local/elasticsearch-hdfs/pom.xml|  77 +
 .../streams/example/ElasticsearchHdfs.java  |  11 +-
 .../streams/example/HdfsElasticsearch.java  |  13 +-
 .../example/test/ElasticsearchHdfsIT.java   |  25 +--
 .../apache/streams/example/test/ExampleITs.java |  35 
 .../example/test/HdfsElasticsearchIT.java   |  26 +--
 .../src/test/resources/testng.xml   |  24 +++
 .../src/main/scala/facebook.scala   | 143 +++
 .../src/main/scala/gplus.scala  |  68 
 .../src/main/scala/setup.scala  |   9 +
 .../src/main/scala/twitter.scala| 173 +++
 .../src/main/scala/youtube.scala| 102 +++
 12 files changed, 603 insertions(+), 103 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/blob/47f159e1/local/elasticsearch-hdfs/pom.xml
--
diff --git a/local/elasticsearch-hdfs/pom.xml b/local/elasticsearch-hdfs/pom.xml
index 5830d34..1eabd45 100644
--- a/local/elasticsearch-hdfs/pom.xml
+++ b/local/elasticsearch-hdfs/pom.xml
@@ -39,31 +39,37 @@
 
 
 
-
-
-org.apache.lucene
-lucene-test-framework
-${lucene.version}
-test
-
-
-org.apache.lucene
-lucene-codecs
-${lucene.version}
-test
-
-
-org.elasticsearch
-elasticsearch
-${elasticsearch.version}
-test-jar
-
-
-org.hamcrest
-hamcrest-all
-1.3
-test
-
+
+
+org.apache.lucene
+lucene-test-framework
+${lucene.version}
+test
+
+
+org.apache.lucene
+lucene-codecs
+${lucene.version}
+test
+
+
+org.elasticsearch
+elasticsearch
+${elasticsearch.version}
+test-jar
+
+
+org.testng
+testng
+${testng.version}
+test
+
+
+org.hamcrest
+hamcrest-all
+1.3
+test
+
 
 org.apache.streams
 streams-core
@@ -284,19 +290,22 @@
 maven-failsafe-plugin
 
 
-
-**/*Test.java
-**/*Tests.java
-**/*IT.java
-
-
-**/*ITs.java
-
+
+
target/test-classes/testng.xml
+
+
+
+
+
+
+
+
+
 
 
 
 org.apache.maven.surefire
-surefire-junit47
+surefire-testng
 ${failsafe.plugin.version}
 
 

http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/blob/47f159e1/local/elasticsearch-hdfs/src/main/java/org/apache/streams/example/ElasticsearchHdfs.java
--
diff --git 
a/local/elasticsearch-hdfs/src/main/java/org/apache/streams/example/ElasticsearchHdfs.java
 
b/local/elasticsearch-hdfs/src/main/java/org/apache/streams/example/ElasticsearchHdfs.java
index 8d3cf36..be79f4a 100644
--- 
a/local/elasticsearch-hdfs/src/main/java/org/apache/streams/example/ElasticsearchHdfs.java
+++ 
b/local/elasticsearch-hdfs/src/main/java/org/apache/streams/example/ElasticsearchHdfs.java
@@ -18,14 +18,15 @@
 
 package org.apache.streams.example;
 
-import com.google.common.collect.Maps;
 import org.apache.streams.config.ComponentConfigurator;
 

[9/9] incubator-streams-examples git commit: accomodate STREAMS-465, 466, 467

[sblackmon]

accomodate STREAMS-465,466,467


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/repo
Commit: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/commit/1fb1e0e1
Tree: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/tree/1fb1e0e1
Diff: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/diff/1fb1e0e1

Branch: refs/heads/master
Commit: 1fb1e0e11afee3f76e4eb3b61dcd70884a738043
Parents: cb7c0b9
Author: Steve Blackmon @steveblackmon 
Authored: Sat Dec 17 13:58:43 2016 -0600
Committer: Steve Blackmon @steveblackmon 
Committed: Sat Dec 17 13:58:43 2016 -0600

--
 .../src/main/jsonschema/TwitterPostsPipelineConfiguration.json | 2 +-
 .../flink/twitter/collection/FlinkTwitterPostsPipeline.scala   | 6 +++---
 .../twitter/TwitterHistoryElasticsearchConfiguration.json  | 2 +-
 3 files changed, 5 insertions(+), 5 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/blob/1fb1e0e1/flink/flink-twitter-collection/src/main/jsonschema/TwitterPostsPipelineConfiguration.json
--
diff --git 
a/flink/flink-twitter-collection/src/main/jsonschema/TwitterPostsPipelineConfiguration.json
 
b/flink/flink-twitter-collection/src/main/jsonschema/TwitterPostsPipelineConfiguration.json
index 628d7ee..e994ad5 100644
--- 
a/flink/flink-twitter-collection/src/main/jsonschema/TwitterPostsPipelineConfiguration.json
+++ 
b/flink/flink-twitter-collection/src/main/jsonschema/TwitterPostsPipelineConfiguration.json
@@ -12,7 +12,7 @@
   "properties": {
 "twitter": {
   "type": "object",
-  "javaType": 
"org.apache.streams.twitter.TwitterUserInformationConfiguration"
+  "javaType": 
"org.apache.streams.twitter.TwitterTimelineProviderConfiguration"
 },
 "source": {
   "type": "object",

http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/blob/1fb1e0e1/flink/flink-twitter-collection/src/main/scala/org/apache/streams/examples/flink/twitter/collection/FlinkTwitterPostsPipeline.scala
--
diff --git 
a/flink/flink-twitter-collection/src/main/scala/org/apache/streams/examples/flink/twitter/collection/FlinkTwitterPostsPipeline.scala
 
b/flink/flink-twitter-collection/src/main/scala/org/apache/streams/examples/flink/twitter/collection/FlinkTwitterPostsPipeline.scala
index 549e048..eb7f2c1 100644
--- 
a/flink/flink-twitter-collection/src/main/scala/org/apache/streams/examples/flink/twitter/collection/FlinkTwitterPostsPipeline.scala
+++ 
b/flink/flink-twitter-collection/src/main/scala/org/apache/streams/examples/flink/twitter/collection/FlinkTwitterPostsPipeline.scala
@@ -36,6 +36,7 @@ import org.apache.streams.examples.flink.FlinkBase
 import 
org.apache.streams.examples.flink.twitter.TwitterPostsPipelineConfiguration
 import org.apache.streams.flink.FlinkStreamingConfiguration
 import org.apache.streams.jackson.StreamsJacksonMapper
+import org.apache.streams.twitter.TwitterTimelineProviderConfiguration
 import org.apache.streams.twitter.pojo.Tweet
 import org.apache.streams.twitter.provider.TwitterTimelineProvider
 import org.slf4j.{Logger, LoggerFactory}
@@ -152,10 +153,9 @@ class FlinkTwitterPostsPipeline(config: 
TwitterPostsPipelineConfiguration = new
 }
 def collectPosts(id : String, out : Collector[StreamsDatum]) = {
   val twitterConfiguration = config.getTwitter
+  twitterConfiguration.setInfo(List(toProviderId(id)))
   val twitProvider: TwitterTimelineProvider =
-new TwitterTimelineProvider(
-  twitterConfiguration.withInfo(List(toProviderId(id)))
-)
+new TwitterTimelineProvider(twitterConfiguration)
   twitProvider.prepare(twitProvider)
   twitProvider.startStream()
   var iterator: Iterator[StreamsDatum] = null

http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/blob/1fb1e0e1/local/twitter-history-elasticsearch/src/main/jsonschema/org/apache/streams/example/twitter/TwitterHistoryElasticsearchConfiguration.json
--
diff --git 
a/local/twitter-history-elasticsearch/src/main/jsonschema/org/apache/streams/example/twitter/TwitterHistoryElasticsearchConfiguration.json
 
b/local/twitter-history-elasticsearch/src/main/jsonschema/org/apache/streams/example/twitter/TwitterHistoryElasticsearchConfiguration.json
index eaf8028..1886325 100644
--- 
a/local/twitter-history-elasticsearch/src/main/jsonschema/org/apache/streams/example/twitter/TwitterHistoryElasticsearchConfiguration.json
+++ 
b/local/twitter-history-elasticsearch/src/main/jsonschema/org/apache/streams/example/twitter/TwitterHistoryElasticsearchConfiguration.json
@@ -7,7 +7,7 @@
 "javaType" : 

[3/9] incubator-streams-examples git commit: switch mongo-elasticsearch-sync to testng

[sblackmon]

switch mongo-elasticsearch-sync to testng


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/repo
Commit: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/commit/e7bcb0d1
Tree: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/tree/e7bcb0d1
Diff: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/diff/e7bcb0d1

Branch: refs/heads/master
Commit: e7bcb0d143e8b51900eedce32b60af25d3b5b209
Parents: e234e24
Author: Steve Blackmon @steveblackmon 
Authored: Thu Dec 15 12:50:11 2016 -0600
Committer: Steve Blackmon @steveblackmon 
Committed: Thu Dec 15 12:50:11 2016 -0600

--
 local/mongo-elasticsearch-sync/pom.xml  | 19 +--
 .../streams/example/MongoElasticsearchSync.java | 21 ++--
 .../example/test/MongoElasticsearchSyncIT.java  | 26 ---
 .../apache/streams/example/test/SyncITs.java| 34 
 .../src/test/resources/testng.xml   | 18 +++
 .../test/resources/TwitterFollowGraphIT.conf| 28 
 .../test/resources/TwitterFollowNeo4jIT.conf| 28 
 7 files changed, 82 insertions(+), 92 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/blob/e7bcb0d1/local/mongo-elasticsearch-sync/pom.xml
--
diff --git a/local/mongo-elasticsearch-sync/pom.xml 
b/local/mongo-elasticsearch-sync/pom.xml
index 25e0a21..7639011 100644
--- a/local/mongo-elasticsearch-sync/pom.xml
+++ b/local/mongo-elasticsearch-sync/pom.xml
@@ -58,6 +58,12 @@
 test-jar
 
 
+org.testng
+testng
+${testng.version}
+test
+
+
 org.hamcrest
 hamcrest-all
 1.3
@@ -252,19 +258,14 @@
 maven-failsafe-plugin
 
 
-
-**/*Test.java
-**/*Tests.java
-**/*IT.java
-
-
-**/*ITs.java
-
+
+
target/test-classes/testng.xml
+
 
 
 
 org.apache.maven.surefire
-surefire-junit47
+surefire-testng
 ${failsafe.plugin.version}
 
 

http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/blob/e7bcb0d1/local/mongo-elasticsearch-sync/src/main/java/org/apache/streams/example/MongoElasticsearchSync.java
--
diff --git 
a/local/mongo-elasticsearch-sync/src/main/java/org/apache/streams/example/MongoElasticsearchSync.java
 
b/local/mongo-elasticsearch-sync/src/main/java/org/apache/streams/example/MongoElasticsearchSync.java
index e89318c..4527a6b 100644
--- 
a/local/mongo-elasticsearch-sync/src/main/java/org/apache/streams/example/MongoElasticsearchSync.java
+++ 
b/local/mongo-elasticsearch-sync/src/main/java/org/apache/streams/example/MongoElasticsearchSync.java
@@ -18,14 +18,16 @@
 
 package org.apache.streams.example;
 
-import com.google.common.collect.Maps;
 import org.apache.streams.config.ComponentConfigurator;
 import org.apache.streams.config.StreamsConfigurator;
-import org.apache.streams.elasticsearch.*;
 import org.apache.streams.core.StreamBuilder;
-import org.apache.streams.example.MongoElasticsearchSyncConfiguration;
+import org.apache.streams.elasticsearch.ElasticsearchPersistWriter;
+import org.apache.streams.local.LocalRuntimeConfiguration;
 import org.apache.streams.local.builders.LocalStreamBuilder;
 import org.apache.streams.mongo.MongoPersistReader;
+
+import com.google.common.collect.Maps;
+
 import org.slf4j.Logger;
 import org.slf4j.LoggerFactory;
 
@@ -67,13 +69,14 @@ public class MongoElasticsearchSync implements Runnable {
 
 ElasticsearchPersistWriter elasticsearchPersistWriter = new 
ElasticsearchPersistWriter(config.getDestination());
 
-Map streamConfig = Maps.newHashMap();
-streamConfig.put(LocalStreamBuilder.STREAM_IDENTIFIER_KEY, STREAMS_ID);
-streamConfig.put(LocalStreamBuilder.TIMEOUT_KEY, 7 * 24 * 60 * 1000);
-StreamBuilder builder = new LocalStreamBuilder(1000, streamConfig);
+LocalRuntimeConfiguration localRuntimeConfiguration = new 
LocalRuntimeConfiguration();
+localRuntimeConfiguration.setIdentifier(STREAMS_ID);
+localRuntimeConfiguration.setTaskTimeoutMs((long)(60 * 1000));
+localRuntimeConfiguration.setQueueSize((long)1000);
+

[2/9] incubator-streams-examples git commit: switch elasticsearch-reindex to testng

[sblackmon]

switch elasticsearch-reindex to testng


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/repo
Commit: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/commit/e234e248
Tree: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/tree/e234e248
Diff: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/diff/e234e248

Branch: refs/heads/master
Commit: e234e2480c6816fb9e202273a711e48d6d4e91e2
Parents: 47f159e
Author: Steve Blackmon @steveblackmon 
Authored: Thu Dec 15 12:27:58 2016 -0600
Committer: Steve Blackmon @steveblackmon 
Committed: Thu Dec 15 12:30:29 2016 -0600

--
 local/elasticsearch-reindex/pom.xml | 67 ++--
 .../streams/example/ElasticsearchReindex.java   |  9 +--
 .../test/ElasticsearchReindexChildIT.java   | 26 
 .../example/test/ElasticsearchReindexIT.java| 44 ++---
 .../test/ElasticsearchReindexParentIT.java  | 40 ++--
 .../apache/streams/example/test/ReindexITs.java | 38 ---
 .../src/test/resources/testng.xml   | 36 +++
 7 files changed, 128 insertions(+), 132 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/blob/e234e248/local/elasticsearch-reindex/pom.xml
--
diff --git a/local/elasticsearch-reindex/pom.xml 
b/local/elasticsearch-reindex/pom.xml
index 348564b..626c6b9 100644
--- a/local/elasticsearch-reindex/pom.xml
+++ b/local/elasticsearch-reindex/pom.xml
@@ -39,30 +39,36 @@
 
 
 
-
-org.apache.lucene
-lucene-test-framework
-${lucene.version}
-test
-
-
-org.apache.lucene
-lucene-codecs
-${lucene.version}
-test
-
-
-org.elasticsearch
-elasticsearch
-${elasticsearch.version}
-test-jar
-
-
-org.hamcrest
-hamcrest-all
-1.3
-test
-
+
+org.apache.lucene
+lucene-test-framework
+${lucene.version}
+test
+
+
+org.apache.lucene
+lucene-codecs
+${lucene.version}
+test
+
+
+org.elasticsearch
+elasticsearch
+${elasticsearch.version}
+test-jar
+
+
+org.testng
+testng
+${testng.version}
+test
+
+
+org.hamcrest
+hamcrest-all
+1.3
+test
+
 
 com.typesafe
 config
@@ -244,19 +250,14 @@
 maven-failsafe-plugin
 
 
-
-**/*Test.java
-**/*Tests.java
-**/*IT.java
-
-
-**/*ITs.java
-
+
+
target/test-classes/testng.xml
+
 
 
 
 org.apache.maven.surefire
-surefire-junit47
+surefire-testng
 ${failsafe.plugin.version}
 
 

http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/blob/e234e248/local/elasticsearch-reindex/src/main/java/org/apache/streams/example/ElasticsearchReindex.java
--
diff --git 
a/local/elasticsearch-reindex/src/main/java/org/apache/streams/example/ElasticsearchReindex.java
 
b/local/elasticsearch-reindex/src/main/java/org/apache/streams/example/ElasticsearchReindex.java
index dfb2a98..676a272 100644
--- 
a/local/elasticsearch-reindex/src/main/java/org/apache/streams/example/ElasticsearchReindex.java
+++ 
b/local/elasticsearch-reindex/src/main/java/org/apache/streams/example/ElasticsearchReindex.java
@@ -18,14 +18,15 @@
 
 package org.apache.streams.example;
 
-import com.google.common.collect.Maps;
 import org.apache.streams.config.ComponentConfigurator;
 import org.apache.streams.config.StreamsConfigurator;
 import org.apache.streams.core.StreamBuilder;
 import org.apache.streams.elasticsearch.ElasticsearchPersistReader;
 import org.apache.streams.elasticsearch.ElasticsearchPersistWriter;
-import org.apache.streams.example.ElasticsearchReindexConfiguration;
 import org.apache.streams.local.builders.LocalStreamBuilder;
+
+import com.google.common.collect.Maps;
+
 import org.slf4j.Logger;
 import org.slf4j.LoggerFactory;
 
@@ -73,8 +74,8 @@ public class ElasticsearchReindex implements Runnable {
 

[4/9] incubator-streams-examples git commit: switch twitter-history-elasticsearch to testng

[sblackmon]

switch twitter-history-elasticsearch to testng


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/repo
Commit: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/commit/f49b3a11
Tree: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/tree/f49b3a11
Diff: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/diff/f49b3a11

Branch: refs/heads/master
Commit: f49b3a11497402c8ef141e88bad2a594024f99d3
Parents: e7bcb0d
Author: Steve Blackmon @steveblackmon 
Authored: Thu Dec 15 12:57:02 2016 -0600
Committer: Steve Blackmon @steveblackmon 
Committed: Thu Dec 15 12:57:02 2016 -0600

--
 local/twitter-history-elasticsearch/pom.xml | 19 +
 .../test/TwitterHistoryElasticsearchIT.java | 30 +---
 2 files changed, 26 insertions(+), 23 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/blob/f49b3a11/local/twitter-history-elasticsearch/pom.xml
--
diff --git a/local/twitter-history-elasticsearch/pom.xml 
b/local/twitter-history-elasticsearch/pom.xml
index a220568..6fb6048 100644
--- a/local/twitter-history-elasticsearch/pom.xml
+++ b/local/twitter-history-elasticsearch/pom.xml
@@ -61,6 +61,12 @@
 test-jar
 
 
+org.testng
+testng
+${testng.version}
+test
+
+
 org.hamcrest
 hamcrest-all
 1.3
@@ -258,21 +264,10 @@
 
 org.apache.maven.plugins
 maven-failsafe-plugin
-
-
-
-**/*Test.java
-**/*Tests.java
-
-
-**/*IT.java
-**/*ITs.java
-
-
 
 
 org.apache.maven.surefire
-surefire-junit47
+surefire-testng
 ${failsafe.plugin.version}
 
 

http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/blob/f49b3a11/local/twitter-history-elasticsearch/src/test/java/org/apache/streams/example/test/TwitterHistoryElasticsearchIT.java
--
diff --git 
a/local/twitter-history-elasticsearch/src/test/java/org/apache/streams/example/test/TwitterHistoryElasticsearchIT.java
 
b/local/twitter-history-elasticsearch/src/test/java/org/apache/streams/example/test/TwitterHistoryElasticsearchIT.java
index dc1b443..07c1d88 100644
--- 
a/local/twitter-history-elasticsearch/src/test/java/org/apache/streams/example/test/TwitterHistoryElasticsearchIT.java
+++ 
b/local/twitter-history-elasticsearch/src/test/java/org/apache/streams/example/test/TwitterHistoryElasticsearchIT.java
@@ -18,15 +18,19 @@
 
 package org.apache.streams.example.test;
 
-import com.typesafe.config.Config;
-import com.typesafe.config.ConfigFactory;
-import com.typesafe.config.ConfigParseOptions;
 import org.apache.streams.config.ComponentConfigurator;
 import org.apache.streams.elasticsearch.ElasticsearchClientManager;
 import org.apache.streams.example.TwitterHistoryElasticsearch;
 import org.apache.streams.example.TwitterHistoryElasticsearchConfiguration;
+
+import com.typesafe.config.Config;
+import com.typesafe.config.ConfigFactory;
+import com.typesafe.config.ConfigParseOptions;
+
 import org.elasticsearch.action.admin.cluster.health.ClusterHealthRequest;
 import org.elasticsearch.action.admin.cluster.health.ClusterHealthResponse;
+import org.elasticsearch.action.admin.indices.delete.DeleteIndexRequest;
+import org.elasticsearch.action.admin.indices.delete.DeleteIndexResponse;
 import 
org.elasticsearch.action.admin.indices.exists.indices.IndicesExistsRequest;
 import 
org.elasticsearch.action.admin.indices.exists.indices.IndicesExistsResponse;
 import org.elasticsearch.action.search.SearchRequestBuilder;
@@ -34,15 +38,16 @@ import org.elasticsearch.action.search.SearchResponse;
 import org.elasticsearch.client.Client;
 import org.elasticsearch.client.Requests;
 import org.elasticsearch.cluster.health.ClusterHealthStatus;
-import org.junit.Before;
-import org.junit.Test;
 import org.slf4j.Logger;
 import org.slf4j.LoggerFactory;
+import org.testng.annotations.BeforeClass;
+import org.testng.annotations.Test;
 
 import java.io.File;
 
-import static org.junit.Assert.assertFalse;
-import static org.junit.Assert.assertNotEquals;
+import static org.testng.Assert.assertFalse;
+import static org.testng.Assert.assertNotEquals;
+import static org.testng.AssertJUnit.assertTrue;
 
 /**

[6/9] incubator-streams-examples git commit: switch twitter-follow-neo4j to testng

[sblackmon]

switch twitter-follow-neo4j to testng


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/repo
Commit: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/commit/c4821b6f
Tree: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/tree/c4821b6f
Diff: 
http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/diff/c4821b6f

Branch: refs/heads/master
Commit: c4821b6f3d4c36e92e63cf5b4db115bef7cc2d61
Parents: 846b5cb
Author: Steve Blackmon @steveblackmon 
Authored: Thu Dec 15 13:01:57 2016 -0600
Committer: Steve Blackmon @steveblackmon 
Committed: Thu Dec 15 13:01:57 2016 -0600

--
 local/twitter-follow-neo4j/pom.xml  | 29 +---
 .../example/test/TwitterFollowNeo4jIT.java  | 15 --
 2 files changed, 24 insertions(+), 20 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/blob/c4821b6f/local/twitter-follow-neo4j/pom.xml
--
diff --git a/local/twitter-follow-neo4j/pom.xml 
b/local/twitter-follow-neo4j/pom.xml
index 30bbb24..0921867 100644
--- a/local/twitter-follow-neo4j/pom.xml
+++ b/local/twitter-follow-neo4j/pom.xml
@@ -39,6 +39,18 @@
 
 
 
+org.testng
+testng
+${testng.version}
+test
+
+
+org.hamcrest
+hamcrest-all
+1.3
+test
+
+
 com.typesafe
 config
 
@@ -223,16 +235,13 @@
 
 org.apache.maven.plugins
 maven-failsafe-plugin
-2.12.4
-
-
-integration-tests
-
-integration-test
-verify
-
-
-
+
+
+org.apache.maven.surefire
+surefire-testng
+${failsafe.plugin.version}
+
+
 
 
 

http://git-wip-us.apache.org/repos/asf/incubator-streams-examples/blob/c4821b6f/local/twitter-follow-neo4j/src/test/java/org/apache/streams/example/test/TwitterFollowNeo4jIT.java
--
diff --git 
a/local/twitter-follow-neo4j/src/test/java/org/apache/streams/example/test/TwitterFollowNeo4jIT.java
 
b/local/twitter-follow-neo4j/src/test/java/org/apache/streams/example/test/TwitterFollowNeo4jIT.java
index 0eed291..51593b0 100644
--- 
a/local/twitter-follow-neo4j/src/test/java/org/apache/streams/example/test/TwitterFollowNeo4jIT.java
+++ 
b/local/twitter-follow-neo4j/src/test/java/org/apache/streams/example/test/TwitterFollowNeo4jIT.java
@@ -26,18 +26,13 @@ import org.apache.streams.config.StreamsConfiguration;
 import org.apache.streams.config.StreamsConfigurator;
 import org.apache.streams.example.TwitterFollowNeo4j;
 import org.apache.streams.example.TwitterFollowNeo4jConfiguration;
-import org.junit.Before;
-import org.junit.Test;
+
 import org.slf4j.Logger;
 import org.slf4j.LoggerFactory;
+import org.testng.annotations.BeforeClass;
+import org.testng.annotations.Test;
 
 import java.io.File;
-import java.io.FileInputStream;
-import java.io.InputStream;
-import java.util.Properties;
-
-import static org.junit.Assert.assertFalse;
-import static org.junit.Assert.assertNotEquals;
 
 /**
  * Example stream that populates elasticsearch with activities from twitter 
userstream in real-time
@@ -50,11 +45,11 @@ public class TwitterFollowNeo4jIT {
 
 private int count = 0;
 
-@Before
+@BeforeClass
 public void prepareTest() throws Exception {
 
 Config reference  = ConfigFactory.load();
-File conf_file = new 
File("target/test-classes/TwitterFollowGraphIT.conf");
+File conf_file = new 
File("target/test-classes/TwitterFollowNeo4jIT.conf");
 assert(conf_file.exists());
 Config testResourceConfig  = 
ConfigFactory.parseFileAnySyntax(conf_file, 
ConfigParseOptions.defaults().setAllowMissing(false));
 Config typesafe  = 
testResourceConfig.withFallback(reference).resolve();

Build failed in Jenkins: streams-project-site #116

[Apache Jenkins Server]

See 

--
Started by upstream project "streams-project" build number 332
originally caused by:
 Started by upstream project "streams-master" build number 107
 originally caused by:
  Started by an SCM change
[EnvInject] - Loading node environment variables.
Building remotely on H11 (ubuntu) in workspace 

Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://git-wip-us.apache.org/repos/asf/incubator-streams.git
 > git init  # 
 > timeout=10
Fetching upstream changes from 
https://git-wip-us.apache.org/repos/asf/incubator-streams.git
 > git --version # timeout=10
 > git -c core.askpass=true fetch --tags --progress 
 > https://git-wip-us.apache.org/repos/asf/incubator-streams.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git config remote.origin.url 
 > https://git-wip-us.apache.org/repos/asf/incubator-streams.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # 
 > timeout=10
 > git config remote.origin.url 
 > https://git-wip-us.apache.org/repos/asf/incubator-streams.git # timeout=10
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=10
No valid HEAD. Skipping the resetting
 > git clean -fdx # timeout=10
Fetching upstream changes from 
https://git-wip-us.apache.org/repos/asf/incubator-streams.git
 > git -c core.askpass=true fetch --tags --progress 
 > https://git-wip-us.apache.org/repos/asf/incubator-streams.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision fb0b51c209bd1a028aae9b1ba9af065eefd6dc07 (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f fb0b51c209bd1a028aae9b1ba9af065eefd6dc07
 > git rev-list fb0b51c209bd1a028aae9b1ba9af065eefd6dc07 # timeout=10
Parsing POMs
using settings config with name simple-deploy-settings-no-mirror
Replacing all maven server entries not found in credentials list is true
Downloaded artifact 
https://repository.apache.org/content/repositories/snapshots/org/apache/streams/streams-master/0.5-incubating-SNAPSHOT/maven-metadata.xml
Downloaded artifact 
https://repository.apache.org/content/repositories/snapshots/org/apache/streams/streams-master/0.5-incubating-SNAPSHOT/streams-master-0.5-incubating-20161217.193142-38.pom
Failed to transfer Could not find metadata 
org.apache.streams:streams-master:0.5-incubating-SNAPSHOT/maven-metadata.xml in 
sonatype (https://oss.sonatype.org/content/repositories/snapshots)
Failed to transfer Could not find metadata 
org.apache.streams:streams-master:0.5-incubating-SNAPSHOT/maven-metadata.xml in 
typesafe (http://repo.typesafe.com/typesafe/repo)
Failed to transfer Could not find metadata 
org.apache.streams:streams-master:0.5-incubating-SNAPSHOT/maven-metadata.xml in 
google-api-services (http://google-api-client-libraries.appspot.com/mavenrepo)
Downloaded artifact 
https://repository.apache.org/snapshots/org/apache/streams/streams-master/0.5-incubating-SNAPSHOT/maven-metadata.xml
Modules changed, recalculating dependency graph
Established TCP socket on 35675
maven32-agent.jar already up to date
maven32-interceptor.jar already up to date
maven3-interceptor-commons.jar already up to date
[streams-project-site] $ /home/jenkins/tools/java/latest1.8/bin/java -Xmx2g 
-Xms256m -XX:MaxPermSize=512m -Dfile.encoding=UTF-8 -cp 
/home/jenkins/jenkins-slave/maven32-agent.jar:/home/jenkins/tools/maven/apache-maven-3.3.9/boot/plexus-classworlds-2.5.2.jar:/home/jenkins/tools/maven/apache-maven-3.3.9/conf/logging
 jenkins.maven3.agent.Maven32Main /home/jenkins/tools/maven/apache-maven-3.3.9 
/home/jenkins/jenkins-slave/slave.jar 
/home/jenkins/jenkins-slave/maven32-interceptor.jar 
/home/jenkins/jenkins-slave/maven3-interceptor-commons.jar 35675
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; 
support was removed in 8.0
<===[JENKINS REMOTING CAPACITY]===>   channel started
using settings config with name simple-deploy-settings-no-mirror
Replacing all maven server entries not found in credentials list is true
Executing Maven:  -B -f 
 
-Dmaven.repo.local=/home/jenkins/jenkins-slave/maven-repositories/1 -s 
/tmp/settings1628975006934831982.xml -q -U generate-sources site:site site:stage
Saving to 
outputFile=
Processed 0 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 145 ms
[JENKINS] Archiving site from 
 to 
/x1/jenkins/jenkins-home/jobs/streams-project-site/site
file:// 
- Session: Opened  

incubator-streams git commit: streams-provider-twitter bug fixes & related improvements.

[sblackmon]

Repository: incubator-streams
Updated Branches:
  refs/heads/master 92c5504dc -> 5e1bd10be


streams-provider-twitter bug fixes & related improvements.

STREAMS-465
STREAMS-466
STREAMS-467


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/5e1bd10b
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/5e1bd10b
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/5e1bd10b

Branch: refs/heads/master
Commit: 5e1bd10be6b2b45b91c0cdc26e22508d6445e021
Parents: 92c5504
Author: Steve Blackmon @steveblackmon 
Authored: Tue Dec 13 15:29:28 2016 -0600
Committer: Steve Blackmon @steveblackmon 
Committed: Sat Dec 17 13:30:12 2016 -0600

--
 .../provider/TwitterFollowingProvider.java  |  5 ++
 .../provider/TwitterFollowingProviderTask.java  | 65 +---
 .../provider/TwitterTimelineProvider.java   | 22 +++
 .../provider/TwitterTimelineProviderTask.java   | 29 ++---
 .../twitter/TwitterFollowingConfiguration.json  | 15 +
 .../TwitterTimelineProviderConfiguration.json   | 23 +++
 .../TwitterUserInformationConfiguration.json|  6 +-
 7 files changed, 119 insertions(+), 46 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/5e1bd10b/streams-contrib/streams-provider-twitter/src/main/java/org/apache/streams/twitter/provider/TwitterFollowingProvider.java
--
diff --git 
a/streams-contrib/streams-provider-twitter/src/main/java/org/apache/streams/twitter/provider/TwitterFollowingProvider.java
 
b/streams-contrib/streams-provider-twitter/src/main/java/org/apache/streams/twitter/provider/TwitterFollowingProvider.java
index 40a0957..16b6c03 100644
--- 
a/streams-contrib/streams-provider-twitter/src/main/java/org/apache/streams/twitter/provider/TwitterFollowingProvider.java
+++ 
b/streams-contrib/streams-provider-twitter/src/main/java/org/apache/streams/twitter/provider/TwitterFollowingProvider.java
@@ -38,6 +38,7 @@ import com.typesafe.config.ConfigFactory;
 import com.typesafe.config.ConfigParseOptions;
 import org.slf4j.Logger;
 import org.slf4j.LoggerFactory;
+import twitter4j.Status;
 import twitter4j.Twitter;
 
 import java.io.BufferedOutputStream;
@@ -215,6 +216,10 @@ public class TwitterFollowingProvider extends 
TwitterUserInformationProvider {
 
   }
 
+  public boolean shouldContinuePulling(List users) {
+return (users != null) && (users.size() == config.getPageSize());
+  }
+
   @Override
   public boolean isRunning() {
 if (providerQueue.isEmpty() && executor.isTerminated() && 
Futures.allAsList(futures).isDone()) {

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/5e1bd10b/streams-contrib/streams-provider-twitter/src/main/java/org/apache/streams/twitter/provider/TwitterFollowingProviderTask.java
--
diff --git 
a/streams-contrib/streams-provider-twitter/src/main/java/org/apache/streams/twitter/provider/TwitterFollowingProviderTask.java
 
b/streams-contrib/streams-provider-twitter/src/main/java/org/apache/streams/twitter/provider/TwitterFollowingProviderTask.java
index 1607da4..313416a 100644
--- 
a/streams-contrib/streams-provider-twitter/src/main/java/org/apache/streams/twitter/provider/TwitterFollowingProviderTask.java
+++ 
b/streams-contrib/streams-provider-twitter/src/main/java/org/apache/streams/twitter/provider/TwitterFollowingProviderTask.java
@@ -33,6 +33,7 @@ import twitter4j.Twitter;
 import twitter4j.TwitterException;
 import twitter4j.TwitterObjectFactory;
 
+import java.util.List;
 import java.util.Objects;
 
 /**
@@ -75,6 +76,8 @@ public class TwitterFollowingProviderTask implements Runnable 
{
 this.screenName = screenName;
   }
 
+  int page_count = 0;
+  int item_count = 0;
 
   @Override
   public void run() {
@@ -119,26 +122,27 @@ public class TwitterFollowingProviderTask implements 
Runnable {
 
   private void collectUsers(Long id) {
 int keepTrying = 0;
-
+List list = null;
 long curser = -1;
 
+twitter4j.User user;
+String userJson;
+try {
+  user = client.users().showUser(id);
+  userJson = TwitterObjectFactory.getRawJSON(user);
+} catch (TwitterException ex) {
+  LOGGER.error("Failure looking up " + id);
+  return;
+}
+
 do {
   try {
-twitter4j.User user;
-String userJson;
-try {
-  user = client.users().showUser(id);
-  userJson = TwitterObjectFactory.getRawJSON(user);
-} catch (TwitterException ex) {
-  LOGGER.error("Failure looking up " + id);
-  break;
-}
 
-PagableResponseList list = null;
+PagableResponseList page = null;

Build failed in Jenkins: streams-examples #163

[Apache Jenkins Server]

See 

--
Started by upstream project "streams-project" build number 332
originally caused by:
 Started by upstream project "streams-master" build number 107
 originally caused by:
  Started by an SCM change
[EnvInject] - Loading node environment variables.
Building remotely on ubuntu-1 (ubuntu) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url 
 > https://git-wip-us.apache.org/repos/asf/incubator-streams-examples.git # 
 > timeout=10
Fetching upstream changes from 
https://git-wip-us.apache.org/repos/asf/incubator-streams-examples.git
 > git --version # timeout=10
 > git -c core.askpass=true fetch --tags --progress 
 > https://git-wip-us.apache.org/repos/asf/incubator-streams-examples.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 3eb2e35260b8922dc24c208abf70799c41557d2d (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 3eb2e35260b8922dc24c208abf70799c41557d2d
 > git rev-list 3eb2e35260b8922dc24c208abf70799c41557d2d # timeout=10
Parsing POMs
using settings config with name simple-deploy-settings-no-mirror
Replacing all maven server entries not found in credentials list is true
Downloaded artifact 
https://repository.apache.org/content/repositories/snapshots/org/apache/streams/streams-master/0.5-incubating-SNAPSHOT/maven-metadata.xml
Downloaded artifact 
https://repository.apache.org/content/repositories/snapshots/org/apache/streams/streams-master/0.5-incubating-SNAPSHOT/streams-master-0.5-incubating-20161217.193142-38.pom
Downloaded artifact 
https://repository.apache.org/snapshots/org/apache/streams/streams-master/0.5-incubating-SNAPSHOT/maven-metadata.xml
Modules changed, recalculating dependency graph
Established TCP socket on 41068
maven32-agent.jar already up to date
maven32-interceptor.jar already up to date
maven3-interceptor-commons.jar already up to date
[streams-examples] $ /home/jenkins/tools/java/latest1.8/bin/java -Xmx2g 
-Xms256m -XX:MaxPermSize=512m -Dfile.encoding=ISO-8859-1 -cp 
/home/jenkins/jenkins-slave/maven32-agent.jar:/home/jenkins/tools/maven/apache-maven-3.3.9/boot/plexus-classworlds-2.5.2.jar:/home/jenkins/tools/maven/apache-maven-3.3.9/conf/logging
 jenkins.maven3.agent.Maven32Main /home/jenkins/tools/maven/apache-maven-3.3.9 
/home/jenkins/jenkins-slave/slave.jar 
/home/jenkins/jenkins-slave/maven32-interceptor.jar 
/home/jenkins/jenkins-slave/maven3-interceptor-commons.jar 41068
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; 
support was removed in 8.0
<===[JENKINS REMOTING CAPACITY]===>   channel started
using settings config with name simple-deploy-settings-no-mirror
Replacing all maven server entries not found in credentials list is true
Executing Maven:  -B -f 
 
-Dmaven.repo.local=/home/jenkins/jenkins-slave/maven-repositories/1 -s 
/tmp/settings4592955439714919926.xml clean install verify
[INFO] Scanning for projects...
[INFO] 
[INFO] Reactor Build Order:
[INFO] 
[INFO] streams-examples
[INFO] streams-examples-flink
[INFO] flink-twitter-collection
[INFO] streams-examples-local
[INFO] elasticsearch-hdfs
[INFO] elasticsearch-reindex
[INFO] mongo-elasticsearch-sync
[INFO] twitter-follow-neo4j
[INFO] twitter-history-elasticsearch
[INFO] twitter-userstream-elasticsearch
[INFO] 
[INFO] 
[INFO] Building streams-examples 0.5-incubating-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-clean-plugin:2.6:clean (default-clean) @ streams-examples ---
[INFO] Deleting 
[INFO] 
[INFO] --- maven-resources-plugin:2.7:copy-resources (copy-resources) @ 
streams-examples ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] 
[INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-java) @ 
streams-examples ---
[INFO] 
[INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-banned-dependencies) @ 
streams-examples ---
[INFO] 
[INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-no-snapshots) @ 
streams-examples ---
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.4:process (default) @ 
streams-examples ---
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.4:process (process-resource-bundles) 
@ streams-examples ---
[INFO] 
[INFO] --- maven-surefire-plugin:2.19.1:test (test) @ streams-examples ---

[3/4] incubator-streams git commit: Replace Guava API calls with Java 8 API

[sblackmon]

Replace Guava API calls with Java 8 API


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/db897a21
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/db897a21
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/db897a21

Branch: refs/heads/master
Commit: db897a21283aecc1c0e26211c00e4b9c3657c0f8
Parents: fb0b51c
Author: smarthi 
Authored: Wed Dec 14 02:23:33 2016 -0500
Committer: smarthi 
Committed: Sat Dec 17 11:59:22 2016 -0500

--
 .../converter/ActivityConverterUtil.java|  3 +-
 .../converter/ActivityObjectConverterUtil.java  |  4 +-
 .../BaseObjectNodeActivityConverter.java|  8 +--
 streams-config/pom.xml  |  4 --
 .../kinesis/KinesisPersistReaderTask.java   |  4 +-
 .../org/apache/streams/s3/S3PersistWriter.java  |  4 +-
 streams-contrib/streams-persist-console/pom.xml |  4 --
 .../streams-persist-elasticsearch/pom.xml   |  4 --
 .../MetadataFromDocumentProcessor.java  | 14 ++--
 .../streams/mongo/MongoPersistReader.java   |  9 +--
 .../streams/mongo/MongoPersistWriter.java   | 16 ++---
 .../apache/streams/json/JsonPathExtractor.java  |  4 +-
 .../streams/regex/RegexMentionsExtractor.java   |  4 +-
 .../org/apache/streams/regex/RegexUtils.java| 11 +--
 .../streams/urls/LinkResolverProcessor.java | 17 ++---
 .../streams-provider-facebook/pom.xml   |  5 --
 .../processor/FacebookTypeConverter.java| 10 +--
 .../serializer/FacebookActivityUtil.java|  7 +-
 .../providers/page/FacebookPageProviderIT.java  |  4 +-
 .../google-gmail/pom.xml|  4 --
 .../GMailMessageActivitySerializer.java | 21 ++
 .../google-gplus/pom.xml|  4 --
 .../processor/GooglePlusCommentProcessor.java   |  6 +-
 .../processor/GooglePlusTypeConverter.java  |  8 ++-
 .../util/GPlusActivityDeserializer.java |  4 +-
 .../util/GPlusCommentDeserializer.java  |  4 +-
 .../util/GPlusPersonDeserializer.java   | 10 ++-
 .../serializer/util/GooglePlusActivityUtil.java |  8 ++-
 .../google/gplus/GooglePlusCommentSerDeIT.java  |  3 +-
 .../test/providers/GPlusUserDataProviderIT.java |  7 +-
 .../streams-provider-instagram/pom.xml  |  4 --
 .../processor/InstagramTypeConverter.java   | 10 +--
 .../userinfo/InstagramUserInfoCollector.java|  4 +-
 .../serializer/util/InstagramActivityUtil.java  |  6 +-
 .../streams-provider-moreover/pom.xml   |  4 --
 .../test/provider/MoreoverProviderIT.java   |  3 +-
 streams-contrib/streams-provider-rss/pom.xml|  4 --
 .../streams-provider-sysomos/pom.xml|  4 --
 .../sysomos/processor/SysomosTypeConverter.java |  8 ++-
 .../test/provider/SysomosProviderIT.java|  3 +-
 .../streams-provider-twitter/pom.xml|  4 --
 .../TwitterFollowActivityConverter.java |  5 +-
 .../TwitterJsonDeleteActivityConverter.java |  5 +-
 .../TwitterJsonRetweetActivityConverter.java|  8 ++-
 .../TwitterJsonTweetActivityConverter.java  |  8 ++-
 ...terJsonUserstreameventActivityConverter.java | 18 ++---
 .../converter/util/TwitterActivityUtil.java |  6 +-
 .../FetchAndReplaceTwitterProcessor.java|  5 +-
 .../processor/TwitterUrlApiProcessor.java   |  5 +-
 .../provider/TwitterTimelineProvider.java   | 20 +++---
 .../provider/TwitterTimelineProviderTask.java   |  8 +--
 .../test/data/TwitterObjectMapperIT.java| 12 ++--
 .../utils/TwitterActivityConvertersTest.java|  9 +--
 .../TwitterActivityObjectsConvertersTest.java   | 11 +--
 .../provider/YoutubeUserActivityCollector.java  |  6 +-
 .../youtube/serializer/YoutubeActivityUtil.java |  7 +-
 .../persist/impl/BroadcastMessagePersister.java |  6 +-
 .../impl/BroadcastMessagePersisterTest.java |  6 +-
 .../impl/LogstashUdpMessagePersisterTest.java   | 14 ++--
 .../streams-plugin-cassandra/pom.xml|  5 --
 ...treamsCassandraResourceGeneratorCLITest.java | 30 +++-
 ...StreamsCassandraResourceGeneratorMojoIT.java | 28 +++-
 .../StreamsCassandraResourceGeneratorTest.java  | 41 ---
 .../streams-plugin-elasticsearch/pom.xml|  5 --
 ...msElasticsearchResourceGeneratorCLITest.java | 22 +++---
 ...amsElasticsearchResourceGeneratorMojoIT.java | 11 ++-
 ...reamsElasticsearchResourceGeneratorTest.java | 75 +++-
 streams-plugins/streams-plugin-hbase/pom.xml|  5 --
 .../hbase/StreamsHbaseGenerationConfig.java |  6 +-
 .../StreamsHbaseResourceGeneratorCLITest.java   | 15 ++--
 .../StreamsHbaseResourceGeneratorMojoIT.java| 17 ++---
 .../test/StreamsHbaseResourceGeneratorTest.java | 45 ++--
 streams-plugins/streams-plugin-hive/pom.xml |  5 --
 .../StreamsHiveResourceGeneratorCLITest.java| 22 +++---
 

[1/4] incubator-streams git commit: Replace Guava API calls with Java 8 API

[sblackmon]

Repository: incubator-streams
Updated Branches:
  refs/heads/master fb0b51c20 -> 92c5504dc


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/db897a21/streams-plugins/streams-plugin-pojo/src/test/java/org/apache/streams/plugins/test/StreamsPojoSourceGeneratorMojoIT.java
--
diff --git 
a/streams-plugins/streams-plugin-pojo/src/test/java/org/apache/streams/plugins/test/StreamsPojoSourceGeneratorMojoIT.java
 
b/streams-plugins/streams-plugin-pojo/src/test/java/org/apache/streams/plugins/test/StreamsPojoSourceGeneratorMojoIT.java
index 5df2f8e..96cd066 100644
--- 
a/streams-plugins/streams-plugin-pojo/src/test/java/org/apache/streams/plugins/test/StreamsPojoSourceGeneratorMojoIT.java
+++ 
b/streams-plugins/streams-plugin-pojo/src/test/java/org/apache/streams/plugins/test/StreamsPojoSourceGeneratorMojoIT.java
@@ -19,22 +19,20 @@
 
 package org.apache.streams.plugins.test;
 
-import com.google.common.collect.Lists;
-import com.google.common.io.Files;
+import org.apache.commons.io.FileUtils;
 import org.apache.maven.it.Verifier;
 import org.apache.maven.it.util.ResourceExtractor;
 import org.slf4j.Logger;
 import org.slf4j.LoggerFactory;
 import org.testng.Assert;
-import org.testng.annotations.BeforeClass;
 import org.testng.annotations.Test;
 
 import java.io.File;
 import java.util.ArrayList;
 import java.util.Collection;
 import java.util.List;
-
-import static 
org.apache.streams.plugins.test.StreamsPojoSourceGeneratorTest.javaFilter;
+import java.util.stream.Collectors;
+import java.util.stream.Stream;
 
 /**
  * Tests that streams-plugin-pojo running via maven can convert activity 
schemas into pojos
@@ -61,13 +59,13 @@ public class StreamsPojoSourceGeneratorMojoIT {
 
 verifier = new Verifier( testDir.getAbsolutePath() );
 
-List cliOptions = new ArrayList<>();
+List cliOptions = new ArrayList<>();
 cliOptions.add( "-N" );
-verifier.executeGoals( Lists.newArrayList(
+verifier.executeGoals(Stream.of(
 "clean",
 "dependency:unpack-dependencies",
 "generate-sources",
-"compile"));
+"compile").collect(Collectors.toList()));
 
 verifier.verifyErrorFreeLog();
 
@@ -79,9 +77,7 @@ public class StreamsPojoSourceGeneratorMojoIT {
 Assert.assertTrue(testOutput.exists());
 Assert.assertTrue(testOutput.isDirectory());
 
-Iterable outputIterator = 
Files.fileTreeTraverser().breadthFirstTraversal(testOutput).filter(javaFilter);
-Collection outputCollection = Lists.newArrayList(outputIterator);
-Assert.assertTrue( outputCollection.size() > 133);
-
+Collection testOutputFiles = FileUtils.listFiles(testOutput, 
StreamsPojoSourceGeneratorTest.javaFilter, true);
+Assert.assertTrue( testOutputFiles.size() > 133);
   }
 }
\ No newline at end of file

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/db897a21/streams-plugins/streams-plugin-pojo/src/test/java/org/apache/streams/plugins/test/StreamsPojoSourceGeneratorTest.java
--
diff --git 
a/streams-plugins/streams-plugin-pojo/src/test/java/org/apache/streams/plugins/test/StreamsPojoSourceGeneratorTest.java
 
b/streams-plugins/streams-plugin-pojo/src/test/java/org/apache/streams/plugins/test/StreamsPojoSourceGeneratorTest.java
index a16c1da..bb4b608 100644
--- 
a/streams-plugins/streams-plugin-pojo/src/test/java/org/apache/streams/plugins/test/StreamsPojoSourceGeneratorTest.java
+++ 
b/streams-plugins/streams-plugin-pojo/src/test/java/org/apache/streams/plugins/test/StreamsPojoSourceGeneratorTest.java
@@ -22,9 +22,8 @@ package org.apache.streams.plugins.test;
 import org.apache.streams.plugins.StreamsPojoGenerationConfig;
 import org.apache.streams.plugins.StreamsPojoSourceGenerator;
 
-import com.google.common.base.Predicate;
-import com.google.common.collect.Lists;
-import com.google.common.io.Files;
+import org.apache.commons.io.FileUtils;
+import org.junit.Assert;
 import org.junit.Test;
 import org.slf4j.Logger;
 import org.slf4j.LoggerFactory;
@@ -32,27 +31,18 @@ import org.slf4j.LoggerFactory;
 import java.io.File;
 import java.util.Collection;
 import java.util.List;
-import javax.annotation.Nullable;
+import java.util.stream.Collectors;
+import java.util.stream.Stream;
 
 /**
  * Tests that StreamsPojoSourceGenerator via SDK generates java sources.
  *
- * @throws Exception Exception
  */
 public class StreamsPojoSourceGeneratorTest {
 
   private static final Logger LOGGER = 
LoggerFactory.getLogger(StreamsPojoSourceGeneratorTest.class);
 
-  public static final Predicate javaFilter = new Predicate() {
-@Override
-public boolean apply(@Nullable File file) {
-  if ( file.getName().endsWith(".java") ) {
-return true;
-  } else {
-return false;
-  }
-}
-  };
+  public static final String[] javaFilter = new String[]{"java"};
 
   /**
* Tests that StreamsPojoSourceGenerator 

[2/4] incubator-streams git commit: Replace Guava API calls with Java 8 API

[sblackmon]

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/db897a21/streams-contrib/streams-provider-twitter/src/main/java/org/apache/streams/twitter/processor/TwitterUrlApiProcessor.java
--
diff --git 
a/streams-contrib/streams-provider-twitter/src/main/java/org/apache/streams/twitter/processor/TwitterUrlApiProcessor.java
 
b/streams-contrib/streams-provider-twitter/src/main/java/org/apache/streams/twitter/processor/TwitterUrlApiProcessor.java
index 0dd43bb..c8d439d 100644
--- 
a/streams-contrib/streams-provider-twitter/src/main/java/org/apache/streams/twitter/processor/TwitterUrlApiProcessor.java
+++ 
b/streams-contrib/streams-provider-twitter/src/main/java/org/apache/streams/twitter/processor/TwitterUrlApiProcessor.java
@@ -25,11 +25,12 @@ import org.apache.streams.core.StreamsProcessor;
 import org.apache.streams.pojo.json.Activity;
 
 import com.google.common.base.Preconditions;
-import com.google.common.collect.Lists;
 
 import java.util.HashMap;
 import java.util.List;
 import java.util.Map;
+import java.util.stream.Collectors;
+import java.util.stream.Stream;
 
 /**
  * Class gets a global share count from Twitter API for links on Activity 
datums.
@@ -72,7 +73,7 @@ public class TwitterUrlApiProcessor extends 
SimpleHTTPGetProcessor implements St
 if ( activity.getLinks() != null && activity.getLinks().size() > 0) {
   return super.process(entry);
 } else {
-  return Lists.newArrayList(entry);
+  return Stream.of(entry).collect(Collectors.toList());
 }
   }
 

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/db897a21/streams-contrib/streams-provider-twitter/src/main/java/org/apache/streams/twitter/provider/TwitterTimelineProvider.java
--
diff --git 
a/streams-contrib/streams-provider-twitter/src/main/java/org/apache/streams/twitter/provider/TwitterTimelineProvider.java
 
b/streams-contrib/streams-provider-twitter/src/main/java/org/apache/streams/twitter/provider/TwitterTimelineProvider.java
index e3875d5..88642f8 100644
--- 
a/streams-contrib/streams-provider-twitter/src/main/java/org/apache/streams/twitter/provider/TwitterTimelineProvider.java
+++ 
b/streams-contrib/streams-provider-twitter/src/main/java/org/apache/streams/twitter/provider/TwitterTimelineProvider.java
@@ -32,7 +32,6 @@ import 
org.apache.streams.twitter.converter.TwitterDateTimeFormat;
 import com.fasterxml.jackson.core.JsonProcessingException;
 import com.fasterxml.jackson.databind.ObjectMapper;
 import com.google.common.base.Preconditions;
-import com.google.common.collect.Lists;
 import com.google.common.util.concurrent.Futures;
 import com.google.common.util.concurrent.ListenableFuture;
 import com.google.common.util.concurrent.ListeningExecutorService;
@@ -60,7 +59,6 @@ import java.io.Serializable;
 import java.math.BigInteger;
 import java.util.ArrayList;
 import java.util.Collection;
-import java.util.Iterator;
 import java.util.List;
 import java.util.Objects;
 import java.util.Queue;
@@ -70,6 +68,8 @@ import java.util.concurrent.TimeUnit;
 import java.util.concurrent.atomic.AtomicBoolean;
 import java.util.concurrent.locks.ReadWriteLock;
 import java.util.concurrent.locks.ReentrantReadWriteLock;
+import java.util.stream.Collectors;
+import java.util.stream.Stream;
 
 import static java.util.concurrent.Executors.newSingleThreadExecutor;
 
@@ -156,7 +156,7 @@ public class TwitterTimelineProvider implements 
StreamsProvider, Serializable {
 TwitterUserInformationConfiguration config = new 
ComponentConfigurator<>(TwitterUserInformationConfiguration.class).detectConfiguration(typesafe,
 "twitter");
 TwitterTimelineProvider provider = new TwitterTimelineProvider(config);
 
-ObjectMapper mapper = new 
StreamsJacksonMapper(Lists.newArrayList(TwitterDateTimeFormat.TWITTER_FORMAT));
+ObjectMapper mapper = new 
StreamsJacksonMapper(Stream.of(TwitterDateTimeFormat.TWITTER_FORMAT).collect(Collectors.toList()));
 
 PrintStream outStream = new PrintStream(new BufferedOutputStream(new 
FileOutputStream(outfile)));
 provider.prepare(config);
@@ -253,7 +253,7 @@ public class TwitterTimelineProvider implements 
StreamsProvider, Serializable {
   private Collection retrieveIds(String[] screenNames) {
 Twitter client = getTwitterClient();
 
-List ids = Lists.newArrayList();
+List ids = new ArrayList<>();
 try {
   for (User twitterUser : client.lookupUsers(screenNames)) {
 ids.add(twitterUser.getId());
@@ -313,8 +313,8 @@ public class TwitterTimelineProvider implements 
StreamsProvider, Serializable {
* account identifiers are converted to IDs (Longs) instead of screenNames 
(Strings).
*/
   protected void consolidateToIDs() {
-List screenNames = Lists.newArrayList();
-ids = Lists.newArrayList();
+List screenNames = new ArrayList<>();
+ids = new ArrayList<>();
 
 for (String account : 

[4/4] incubator-streams git commit: STREAMS-441: clean up asserts

[sblackmon]

STREAMS-441: clean up asserts

had a failure in TwitterTimelineProviderIT while building,
passed on second execution.


Project: http://git-wip-us.apache.org/repos/asf/incubator-streams/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-streams/commit/92c5504d
Tree: http://git-wip-us.apache.org/repos/asf/incubator-streams/tree/92c5504d
Diff: http://git-wip-us.apache.org/repos/asf/incubator-streams/diff/92c5504d

Branch: refs/heads/master
Commit: 92c5504dc85316d6b90a54e1c48b81cb90a25d05
Parents: db897a2
Author: Steve Blackmon @steveblackmon 
Authored: Sat Dec 17 13:28:20 2016 -0600
Committer: Steve Blackmon @steveblackmon 
Committed: Sat Dec 17 13:28:20 2016 -0600

--
 .../twitter/test/providers/TwitterFollowingProviderIT.java   | 2 +-
 .../streams/twitter/test/providers/TwitterStreamProviderIT.java  | 4 +++-
 .../twitter/test/providers/TwitterTimelineProviderIT.java| 4 +++-
 .../twitter/test/providers/TwitterUserInformationProviderIT.java | 4 +++-
 4 files changed, 10 insertions(+), 4 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/92c5504d/streams-contrib/streams-provider-twitter/src/test/java/org/apache/streams/twitter/test/providers/TwitterFollowingProviderIT.java
--
diff --git 
a/streams-contrib/streams-provider-twitter/src/test/java/org/apache/streams/twitter/test/providers/TwitterFollowingProviderIT.java
 
b/streams-contrib/streams-provider-twitter/src/test/java/org/apache/streams/twitter/test/providers/TwitterFollowingProviderIT.java
index 7385aa3..f0f6f76 100644
--- 
a/streams-contrib/streams-provider-twitter/src/test/java/org/apache/streams/twitter/test/providers/TwitterFollowingProviderIT.java
+++ 
b/streams-contrib/streams-provider-twitter/src/test/java/org/apache/streams/twitter/test/providers/TwitterFollowingProviderIT.java
@@ -65,7 +65,7 @@ public class TwitterFollowingProviderIT {
 
 while (outCounter.readLine() != null) {}
 
-assertEquals (1, outCounter.getLineNumber());
+assertEquals (outCounter.getLineNumber(), 1);
 
   }
 }

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/92c5504d/streams-contrib/streams-provider-twitter/src/test/java/org/apache/streams/twitter/test/providers/TwitterStreamProviderIT.java
--
diff --git 
a/streams-contrib/streams-provider-twitter/src/test/java/org/apache/streams/twitter/test/providers/TwitterStreamProviderIT.java
 
b/streams-contrib/streams-provider-twitter/src/test/java/org/apache/streams/twitter/test/providers/TwitterStreamProviderIT.java
index 08720f9..d0a99a9 100644
--- 
a/streams-contrib/streams-provider-twitter/src/test/java/org/apache/streams/twitter/test/providers/TwitterStreamProviderIT.java
+++ 
b/streams-contrib/streams-provider-twitter/src/test/java/org/apache/streams/twitter/test/providers/TwitterStreamProviderIT.java
@@ -28,6 +28,8 @@ import java.io.File;
 import java.io.FileReader;
 import java.io.LineNumberReader;
 
+import static org.hamcrest.MatcherAssert.assertThat;
+import static org.hamcrest.Matchers.greaterThan;
 import static org.testng.Assert.assertTrue;
 
 public class TwitterStreamProviderIT {
@@ -64,7 +66,7 @@ public class TwitterStreamProviderIT {
 
 while (outCounter.readLine() != null) {}
 
-assertTrue (outCounter.getLineNumber() > 25);
+assertThat (outCounter.getLineNumber(), greaterThan(25));
 
   }
 }

http://git-wip-us.apache.org/repos/asf/incubator-streams/blob/92c5504d/streams-contrib/streams-provider-twitter/src/test/java/org/apache/streams/twitter/test/providers/TwitterTimelineProviderIT.java
--
diff --git 
a/streams-contrib/streams-provider-twitter/src/test/java/org/apache/streams/twitter/test/providers/TwitterTimelineProviderIT.java
 
b/streams-contrib/streams-provider-twitter/src/test/java/org/apache/streams/twitter/test/providers/TwitterTimelineProviderIT.java
index 40f412c..750c7be 100644
--- 
a/streams-contrib/streams-provider-twitter/src/test/java/org/apache/streams/twitter/test/providers/TwitterTimelineProviderIT.java
+++ 
b/streams-contrib/streams-provider-twitter/src/test/java/org/apache/streams/twitter/test/providers/TwitterTimelineProviderIT.java
@@ -28,6 +28,8 @@ import java.io.File;
 import java.io.FileReader;
 import java.io.LineNumberReader;
 
+import static org.testng.Assert.assertEquals;
+
 public class TwitterTimelineProviderIT {
 
   private static final Logger LOGGER = 
LoggerFactory.getLogger(TwitterTimelineProviderIT.class);
@@ -62,7 +64,7 @@ public class TwitterTimelineProviderIT {
 
 while (outCounter.readLine() != null) {}
 
-assert (outCounter.getLineNumber() == 1000);
+assertEquals 

[jira] [Commented] (STREAMS-465) Twitter providers make extraneous requests

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15757484#comment-15757484
 ] 

ASF GitHub Bot commented on STREAMS-465:


Github user steveblackmon closed the pull request at:

https://github.com/apache/incubator-streams/pull/340


> Twitter providers make extraneous requests
> --
>
> Key: STREAMS-465
> URL: https://issues.apache.org/jira/browse/STREAMS-465
> Project: Streams
>  Issue Type: Bug
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> twitter providers should not request page 2 when page 1 returns fewer items 
> than expected.  these requests are a waste of time and resources and can be 
> easily prevented



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] incubator-streams pull request #340: streams-provider-twitter bug fixes & re...

[steveblackmon]

Github user steveblackmon closed the pull request at:

https://github.com/apache/incubator-streams/pull/340


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---