GitHub user Jicaar opened a pull request:
https://github.com/apache/flink/pull/5876
[FLINK-9126] New CassandraPojoInputFormat to output data as a custom
annotated Cassandra Pojo
## What is the purpose of the change
Committing the new CassandraPojoInputFormat class. This works similarly to
the CassandraInputClass, but allows the data that is read from Cassandra to be
output as a custom POJO that the user has created whichhas been annotated using
Datastax API.
## Brief change log
-Initial commit of the CassandraPojoInputFormat class and validation test.
## Verifying this change
-CassandraPojoInputFormat can be validated with the
testCassandraBatchPojoFormat test in the CassandraConnectorITCaseTest.java file.
## Does this pull request potentially affect one of the following parts:
- Dependencies (does it add or upgrade a dependency): no
- The public API, i.e., is any changed class annotated with
`@Public(Evolving)`: no
- The serializers: no
- The runtime per-record code paths (performance sensitive): don't know
- Anything that affects deployment or recovery: JobManager (and its
components), Checkpointing, Yarn/Mesos, ZooKeeper: no
- The S3 file system connector: no
## Documentation
- Does this pull request introduce a new feature? yes
- If yes, how is the feature documented? JavaDocs
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/Jicaar/flink master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/5876.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #5876
----
commit 5a9f1795a61c7f27b2e5170c275a10e8ce269d77
Author: Jicaar <jpcarterara@...>
Date: 2018-04-09T19:25:56Z
Also adding in code for CassandraPojoInputFormat class in connection with
Jira task FLINK-9126
Merge remote-tracking branch 'upstream/master'
# Conflicts:
# README.md
#
flink-annotations/src/main/java/org/apache/flink/annotation/docs/ConfigGroup.java
#
flink-annotations/src/main/java/org/apache/flink/annotation/docs/ConfigGroups.java
#
flink-connectors/flink-connector-kafka-0.11/src/test/java/org/apache/flink/streaming/connectors/kafka/Kafka011ITCase.java
#
flink-connectors/flink-connector-kafka-base/src/test/java/org/apache/flink/streaming/connectors/kafka/KafkaConsumerTestBase.java
#
flink-connectors/flink-connector-kafka-base/src/test/java/org/apache/flink/streaming/connectors/kafka/KafkaTestBase.java
#
flink-core/src/main/java/org/apache/flink/configuration/ConfigConstants.java
#
flink-core/src/main/java/org/apache/flink/configuration/TaskManagerOptions.java
# flink-docs/pom.xml
#
flink-docs/src/main/java/org/apache/flink/docs/configuration/ConfigOptionsDocGenerator.java
#
flink-docs/src/test/java/org/apache/flink/docs/configuration/ConfigOptionsDocGeneratorTest.java
# flink-libraries/flink-sql-client/conf/sql-client-defaults.yaml
#
flink-libraries/flink-sql-client/src/main/java/org/apache/flink/table/client/config/Environment.java
#
flink-libraries/flink-sql-client/src/main/java/org/apache/flink/table/client/gateway/local/ExecutionContext.java
#
flink-libraries/flink-sql-client/src/test/resources/test-sql-client-defaults.yaml
#
flink-libraries/flink-sql-client/src/test/resources/test-sql-client-factory.yaml
#
flink-libraries/flink-table/src/main/scala/org/apache/flink/table/descriptors/TableDescriptorValidator.scala
#
flink-libraries/flink-table/src/main/scala/org/apache/flink/table/descriptors/TableSourceDescriptor.scala
#
flink-libraries/flink-table/src/test/scala/org/apache/flink/table/sources/TableSourceFactoryServiceTest.scala
#
flink-libraries/flink-table/src/test/scala/org/apache/flink/table/sources/TestTableSourceFactory.scala
#
flink-queryable-state/flink-queryable-state-client-java/src/main/java/org/apache/flink/queryablestate/network/messages/MessageType.java
#
flink-runtime/src/main/java/org/apache/flink/runtime/clusterframework/BootstrapTools.java
#
flink-runtime/src/main/java/org/apache/flink/runtime/io/network/netty/NettyConfig.java
#
flink-runtime/src/main/java/org/apache/flink/runtime/query/netty/message/KvStateRequestType.java
#
flink-runtime/src/main/java/org/apache/flink/runtime/taskexecutor/TaskManagerConfiguration.java
#
flink-runtime/src/main/scala/org/apache/flink/runtime/taskmanager/TaskManager.scala
#
flink-runtime/src/test/java/org/apache/flink/runtime/taskmanager/TaskManagerRegistrationTest.java
#
flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBKeyedStateBackend.java
#
flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBMapState.java
#
flink-state-backends/flink-statebackend-rocksdb/src/test/java/org/apache/flink/contrib/streaming/state/RocksDBStateBackendConfigTest.java
#
flink-streaming-java/src/main/java/org/apache/flink/streaming/api/datastream/DataStreamUtils.java
#
flink-streaming-java/src/main/java/org/apache/flink/streaming/experimental/CollectSink.java
#
flink-streaming-java/src/main/java/org/apache/flink/streaming/experimental/SocketStreamIterator.java
#
flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/io/InputProcessorUtil.java
#
flink-streaming-scala/src/main/scala/org/apache/flink/streaming/api/scala/DataStreamUtils.scala
#
flink-tests/src/test/scala/org/apache/flink/api/scala/runtime/jobmanager/JobManagerFailsITCase.scala
commit 8390239beb88315dff895372157dd87759e048f2
Author: Jicaar <jpcarterara@...>
Date: 2018-04-09T19:26:49Z
Adding code for the class CassandraPojoInputFormat as well as code for
setting up the test setup.
commit ad89310c9fa7d5188a68524d3de3f4c5e7b91a49
Author: Jicaar <jpcarterara@...>
Date: 2018-04-10T22:53:25Z
Added test for CasandraPojoInputFormat class and ran successfully.
commit d392c5faaf6479b5d7a0f1adb54d4d6b3303cefa
Author: Jicaar <jpcarterara@...>
Date: 2018-04-18T19:22:41Z
Merge branch 'master' of git://github.com/apache/flink
commit 32c328c9668e8ed7a2efdf06a100f8b82e98b1c5
Author: Jicaar <jpcarterara@...>
Date: 2018-04-18T20:06:28Z
Removing leftover system.print lines that were from testing.
----
---
