This is an automated email from the ASF dual-hosted git repository.
nkruber pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/flink-benchmarks.git.
from c1db02d [init] Add ASL 2.0 License
new e16896a Add skeleton for micro benchmarks twith first benchmark
new 0134b6a Add KeyByBenchmark
new 72afb9b Add TimeWindowBenchmark
new a68dca7 Dump results to csv file
new 0016349 Add benchmarks for different state backends
new 469188b make KeyByBenchmark#SumReduce a static inner class
new e4e9024 Extract user functions
new a7947c4 Improve codespeed
new 0c33a3e Extract StateBackendBenchmark
new c03925f Reduce number of parameters
new 90ab919 Bump number of iterations to production ready values
new e1267b6 Remove fork value from pom file
new 2953086 Change units in benchmarks
new 35aeff7 Extract common logic for IntLong benchmarks
new d42afaf Benchmark state using tumbling windows
new df6a089 Use different number of operations per invocation in memory
and rocks benchmarks
new 621f73e Make all benchmark inherite from BenchmarkBase
new 8fd1ae4 Extract BenchmarkBase for non integration Flink benchmarks
new b662f8e Clean up pom.xml
new ca39899 Update Flink to 1.5-SNAPSHOT
new 58687db Run NetworkBenchmarks from flink
new aca8216 Ignore empty parameters in benchmark name generation
new 313bfd7 add benchmarks for the keyBy() operation on tuples and arrays
new 4a453df Remove incorrect comment from pom
new 062f96b Add README.md
new 9e6eee1 [hotfix] make KeyByBenchmarks#IncreasingBaseSource more
generic, creating BaseSourceWithKeyRange
new 8cd86ae add SerializationFrameworkBenchmarks for Pojo, Tuple, Kryo,
and Avro
new 426ac4c Update default JVM options and bump default Flink version to
1.7
new a1d2ebe Add network 1000,1ms benchmark
new a8bc679 cleanup pom.xml (#8)
new da30375 Add broadcast network 100,100ms benchmark
new 9a95e89 clarify licensing situation with respect to jmh
new 84532bd add SSL network benchmarks and change overall benchmark set
new 2ddbb7a Add general remarks to the README
new 21b97fe [FLINK-11986] [state backend, tests] Add micro benchmark for
state operations
new 8b71d9c Add support to generate shaded benchmark package to allow run
specific case in command line
new 5d7aec8 [hotfix] Missing quotes in example maven command in README
new 97ffd65 [hotfix] Exclude state benchmark from the Flink suit
new c25d921 [hotfix] Fix NoClassDefFoundError when running network
related benchmarks
new 136c166 Run all benchmarks once on Travis CI
new ca2d06b Use maven profile to differentiate travis and jenkins run
new cd16e99 Update the dependent flink version to 1.9-SNAPSHOT
new 4372ba0 Add InputBenchmark
new 70fb9bd Explain naming convention in the README
new 9c338a9 Add couple of details to the README and a note how to pick
length of a new benchmark
new b2c1aa2 Add TwoInputBenchmark
new 75d7b6e [FLINK-11877] Add an input idle benchmark for two input
operators
new caf4917 [hotfix] Fix typo in static variable
new 3b55f59 [hotfix] Fix formatting of pom.xml
new 9e3833a [hotfix] Add missing dependencies
new ab0015d [FLINK-12818] Improve stability of twoInputMapSink benchmark
new a4ae3ae [hotfix] adapt StreamNetworkThroughputBenchmarkExecutor to
latest changes in Flink
new c2f6793 Delete root directory when teardown the benchmark
new 15064ae Let list state benchmark stable
new d47b530 Update flink-tests artifact id
new 6ba88de Adding benchmark for AsyncWaitOperator
new 707905f [FLINK-14118] Add throughput benchmark executor for data skew
scenario. (#31)
new 46b7ce9 [FLINK-14118] Bump number of writer threads in network data
skew Benchmark to 10
new 735bd06 [hotfix] Update flink version from 1.9 to 1.10.
new 91d5e0b [hotfix] Increase max memory of the test jvm to 6g.
new fd337c6 [FLINK-14783] Add ContinuousFileReaderOperator benchmark (#34)
new cb73ac5 [FLINK-13846] Add benchmark of mapstate isEmpty
new 4625672 [FLINK-14346] [serialization] Add string-heavy version of
SerializationFrameworkMiniBenchmark
new cd6f0a3 [hotfix] Make StateBackendContext extends
FlinkEnvironmentContext for deduplication.
new f54e93b [FLINK-15103] Set number of network buffers to be the same as
before flip49 for all benchmarks using local executor.
new 322d34d [hotfix] Bump default Flink version to 1.11-SNAPSHOT
new bbac57c [FLINK-15199] Fix compile error after FLINK-14926
new e64a0e0 [FLINK-15070] Add benchmarks for blocking partition
new a63a4bc fixup! [FLINK-15103] Set number of network buffers to be the
same as before flip49 for all benchmarks using local executor.
new cfcbb96 fixup! [FLINK-15070] Add benchmarks for blocking partition
new cb3cf85 [FLINK-15069][benchmark] Supplement the streaming compressed
shuffle case for benchmark
new 995cb12 [FLINK-15340][network] Remove the executor of pipelined
compression benchmark
new ba41d99 [FLINK-15222] Move state benchmark utils into core repository
new f241ef0 [FLINK-15103] Set number of network buffers to 1000
new 5ef6381 [hotfix] Change the parallelism and the temp directory used
to benchmark the blocking partition
new dbd2c94 [FLINK-15748][benchmark] Set explicit managed memory for
RocksDBStateBenchmark
new e9303a4 [FLINK-16019][benchmark] use NoRestartStrategyConfiguration
in ContinuousFileReaderOperatorBenchmark
new 2c8586b [FLINK-16019][benchmark] use factory to create
ContinuousFileReaderOperator
new 227cb16 add listAppend to test add in AppendingState
new 22d670b [FLINK-16459][benchmark] add Apache Thrift based
serialization benchmarks (#52)
new 88a0f42 [FLINK-16460][benchmark] add Protobuf-based serialization
benchmarks
new 085c3d8 [hotfix] fix import order in
SerializationFrameworkMiniBenchmarks
new a750b97 [FLINK-16890] add Avro GenericRecord benchmark
new 60f37be [FLINK-17056][JMH] fix main methods running unrelated
benchmarks
new 3b4f044 [FLINK-17299][benchmarks] Add remote channel rebalance
benchmark with frequent checkpoint (#57)
new 2ede3ae [FLINK-17410][benchmarks] Adapt BlockingPartitionBenchmark to
latest StreamGraph interface
new f5e05fb [FLINK-17057][network] add OpenSSL-based benchmarks
new 48536f7 [FLINK-17703][mvn] fix 'benchmark' profile not active by
default anymore
new 1b53311 [FLINK-17704][mvn] allow execution of arbitrary benchmarks
via a property
new 6c0362f [hotfix] update flink version in README
new f80ee0e [FLINK-16057] Don't end input in ContinuousFileReaderOperator
Benchmark
new 5efc936 [hotfix] Apply workaround for JDK.11 TLS issue
new a37619d [FLINK-17705][license] set up apache-rat-plugin in mvn
The 93 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.gitignore | 21 +
.travis.yml | 10 +
README.md | 90 ++
pom.xml | 554 +++++++++
save_jmh_result.py | 116 ++
.../benchmark/AsyncWaitOperatorBenchmark.java | 115 ++
.../org/apache/flink/benchmark/BenchmarkBase.java | 44 +
.../benchmark/BlockingPartitionBenchmark.java | 140 +++
.../org/apache/flink/benchmark/CollectSink.java | 36 +
.../ContinuousFileReaderOperatorBenchmark.java | 157 +++
.../flink/benchmark/FlinkEnvironmentContext.java | 68 ++
.../org/apache/flink/benchmark/InputBenchmark.java | 82 ++
.../apache/flink/benchmark/KeyByBenchmarks.java | 104 ++
.../benchmark/MemoryStateBackendBenchmark.java | 76 ++
.../RemoteChannelThroughputBenchmark.java | 92 ++
.../benchmark/RocksStateBackendBenchmark.java | 87 ++
.../SerializationFrameworkMiniBenchmarks.java | 513 +++++++++
.../flink/benchmark/StateBackendBenchmarkBase.java | 94 ++
.../apache/flink/benchmark/TwoInputBenchmark.java | 100 ++
.../apache/flink/benchmark/WindowBenchmarks.java | 95 ++
.../benchmark/full/PojoSerializationBenchmark.java | 145 +++
.../full/SerializationFrameworkAllBenchmarks.java | 303 +++++
.../full/StringSerializationBenchmark.java | 118 ++
.../apache/flink/benchmark/full/package-info.java | 25 +
.../functions/BaseSourceWithKeyRange.java | 64 ++
.../benchmark/functions/IntLongApplications.java | 37 +
.../benchmark/functions/IntegerLongSource.java | 77 ++
.../flink/benchmark/functions/LongSource.java | 51 +
.../flink/benchmark/functions/MultiplyByTwo.java | 28 +
.../benchmark/functions/MultiplyIntLongByTwo.java | 28 +
.../benchmark/functions/QueuingLongSource.java | 53 +
.../benchmark/functions/SuccessException.java | 22 +
.../flink/benchmark/functions/SumReduce.java | 28 +
.../benchmark/functions/SumReduceIntLong.java | 28 +
.../flink/benchmark/functions/TestUtils.java | 55 +
.../benchmark/functions/ValidatingCounter.java | 39 +
.../operators/MultiplyByTwoCoStreamMap.java | 38 +
.../apache/flink/benchmark/thrift/MyOperation.java | 477 ++++++++
.../org/apache/flink/benchmark/thrift/MyPojo.java | 1188 ++++++++++++++++++++
.../flink/state/benchmark/ListStateBenchmark.java | 149 +++
.../flink/state/benchmark/MapStateBenchmark.java | 164 +++
.../flink/state/benchmark/StateBenchmarkBase.java | 99 ++
.../state/benchmark/StateBenchmarkConstants.java | 84 ++
.../flink/state/benchmark/ValueStateBenchmark.java | 84 ++
src/main/resources/avro/mypojo.avsc | 76 ++
src/main/resources/log4j.properties | 23 +
src/main/resources/protobuf/MyPojo.proto | 36 +
src/main/resources/thrift/mypojo.thrift | 52 +
...ewStreamNetworkThroughputBenchmarkExecutor.java | 78 ++
...etworkBroadcastThroughputBenchmarkExecutor.java | 75 ++
.../StreamNetworkLatencyBenchmarkExecutor.java | 78 ++
.../StreamNetworkThroughputBenchmarkExecutor.java | 128 +++
src/test/log4j.properties | 23 +
src/test/resources/local127.keystore | Bin 0 -> 2130 bytes
src/test/resources/local127.truststore | Bin 0 -> 840 bytes
55 files changed, 6547 insertions(+)
create mode 100644 .gitignore
create mode 100644 .travis.yml
create mode 100644 README.md
create mode 100644 pom.xml
create mode 100755 save_jmh_result.py
create mode 100644
src/main/java/org/apache/flink/benchmark/AsyncWaitOperatorBenchmark.java
create mode 100644 src/main/java/org/apache/flink/benchmark/BenchmarkBase.java
create mode 100644
src/main/java/org/apache/flink/benchmark/BlockingPartitionBenchmark.java
create mode 100644 src/main/java/org/apache/flink/benchmark/CollectSink.java
create mode 100644
src/main/java/org/apache/flink/benchmark/ContinuousFileReaderOperatorBenchmark.java
create mode 100644
src/main/java/org/apache/flink/benchmark/FlinkEnvironmentContext.java
create mode 100644 src/main/java/org/apache/flink/benchmark/InputBenchmark.java
create mode 100644
src/main/java/org/apache/flink/benchmark/KeyByBenchmarks.java
create mode 100644
src/main/java/org/apache/flink/benchmark/MemoryStateBackendBenchmark.java
create mode 100644
src/main/java/org/apache/flink/benchmark/RemoteChannelThroughputBenchmark.java
create mode 100644
src/main/java/org/apache/flink/benchmark/RocksStateBackendBenchmark.java
create mode 100644
src/main/java/org/apache/flink/benchmark/SerializationFrameworkMiniBenchmarks.java
create mode 100644
src/main/java/org/apache/flink/benchmark/StateBackendBenchmarkBase.java
create mode 100644
src/main/java/org/apache/flink/benchmark/TwoInputBenchmark.java
create mode 100644
src/main/java/org/apache/flink/benchmark/WindowBenchmarks.java
create mode 100644
src/main/java/org/apache/flink/benchmark/full/PojoSerializationBenchmark.java
create mode 100644
src/main/java/org/apache/flink/benchmark/full/SerializationFrameworkAllBenchmarks.java
create mode 100644
src/main/java/org/apache/flink/benchmark/full/StringSerializationBenchmark.java
create mode 100644
src/main/java/org/apache/flink/benchmark/full/package-info.java
create mode 100644
src/main/java/org/apache/flink/benchmark/functions/BaseSourceWithKeyRange.java
create mode 100644
src/main/java/org/apache/flink/benchmark/functions/IntLongApplications.java
create mode 100644
src/main/java/org/apache/flink/benchmark/functions/IntegerLongSource.java
create mode 100644
src/main/java/org/apache/flink/benchmark/functions/LongSource.java
create mode 100644
src/main/java/org/apache/flink/benchmark/functions/MultiplyByTwo.java
create mode 100644
src/main/java/org/apache/flink/benchmark/functions/MultiplyIntLongByTwo.java
create mode 100644
src/main/java/org/apache/flink/benchmark/functions/QueuingLongSource.java
create mode 100644
src/main/java/org/apache/flink/benchmark/functions/SuccessException.java
create mode 100644
src/main/java/org/apache/flink/benchmark/functions/SumReduce.java
create mode 100644
src/main/java/org/apache/flink/benchmark/functions/SumReduceIntLong.java
create mode 100644
src/main/java/org/apache/flink/benchmark/functions/TestUtils.java
create mode 100644
src/main/java/org/apache/flink/benchmark/functions/ValidatingCounter.java
create mode 100644
src/main/java/org/apache/flink/benchmark/operators/MultiplyByTwoCoStreamMap.java
create mode 100644
src/main/java/org/apache/flink/benchmark/thrift/MyOperation.java
create mode 100644 src/main/java/org/apache/flink/benchmark/thrift/MyPojo.java
create mode 100644
src/main/java/org/apache/flink/state/benchmark/ListStateBenchmark.java
create mode 100644
src/main/java/org/apache/flink/state/benchmark/MapStateBenchmark.java
create mode 100644
src/main/java/org/apache/flink/state/benchmark/StateBenchmarkBase.java
create mode 100644
src/main/java/org/apache/flink/state/benchmark/StateBenchmarkConstants.java
create mode 100644
src/main/java/org/apache/flink/state/benchmark/ValueStateBenchmark.java
create mode 100644 src/main/resources/avro/mypojo.avsc
create mode 100644 src/main/resources/log4j.properties
create mode 100644 src/main/resources/protobuf/MyPojo.proto
create mode 100644 src/main/resources/thrift/mypojo.thrift
create mode 100644
src/test/java/org/apache/flink/benchmark/DataSkewStreamNetworkThroughputBenchmarkExecutor.java
create mode 100644
src/test/java/org/apache/flink/benchmark/StreamNetworkBroadcastThroughputBenchmarkExecutor.java
create mode 100644
src/test/java/org/apache/flink/benchmark/StreamNetworkLatencyBenchmarkExecutor.java
create mode 100644
src/test/java/org/apache/flink/benchmark/StreamNetworkThroughputBenchmarkExecutor.java
create mode 100644 src/test/log4j.properties
create mode 100644 src/test/resources/local127.keystore
create mode 100644 src/test/resources/local127.truststore
