This is an automated email from the ASF dual-hosted git repository.
martinzink pushed a change to branch minifi-api-property
in repository https://gitbox.apache.org/repos/asf/nifi-minifi-cpp.git
omit 060290afa MINIFICPP-2519 Property refactor based on minifi-api
add 9f2dc55c7 MINIFICPP-2370 Add support for parameter providers
add 22013fa93 MINIFICPP-2524 Add FIPS compliancy support
add 357cc6e8a MINIFICPP-2522 Various CI improvements
add 76b55885f MINIFICPP-2520 Expand the CPACK_SOURCE_IGNORE_FILES list
add 4431f959b MINIFICPP-2508 Generate PARAMETER_PROVIDERS.md
new 725ad867d MINIFICPP-2519 Property refactor based on minifi-api
new db7ccd3ba getUnitMultiplier KIB, MIB, GIB, TIB, PIB
new 9e87de19e add missing namespace comment in ParsingUtils.cpp
new f82537002 use string_view in
ParsingUtils.cpp::getUnitMultipler::unit_map
new e57f22d22 remove unused NotAFlowFile from ProcessContext.h
new 10f9b36d1
ListingStateManager::getLatestListedKeyTimestampInMilliseconds shouldnt throw
new d65654bad simplify parseOptionalProperty
new b08ea19f3 renamed from parse[Optional]MsProperty to
parse[Optional]DurationProperty
new a1d8247d1 EndpointOverrideURL should have a NON_BLANK_VALIDATOR
new cad360883 make exceptions in MultipartUploadStateStorage.cpp more
readable
new 5cc90f1c1 PropertyType.h refactors
new af72292a3 orThrow and orTerminate
new 267ac2dce linter fix
new cfacd92b0 orThrow, orTerminate formatter
new 9b36fa3c2 rebase fixes
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (060290afa)
\
N -- N -- N refs/heads/minifi-api-property (9b36fa3c2)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 15 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/workflows/ci.yml | 130 +-------
.github/workflows/verify-package.yml | 46 +--
.gitignore | 4 +
CMakeLists.txt | 49 ++-
CONFIGURE.md | 305 +++++++++++++-----
PARAMETER_PROVIDERS.md | 39 +++
cmake/BuildTests.cmake | 1 +
cmake/BundledOpenSSL.cmake | 95 +++++-
cmake/DockerConfig.cmake | 3 +-
cmake/Fetchlibrdkafka.cmake | 4 +-
cmake/PahoMqttC.cmake | 4 +-
cmake/VerifyPackageWithDocker.cmake | 2 +-
cmake/VerifyPythonCompatibility.cmake | 72 -----
cmake/ssl/FindOpenSSL.cmake | 2 +-
conf/minifi.properties | 3 +
docker/test/integration/cluster/ContainerStore.py | 3 +
.../test/integration/cluster/DockerTestCluster.py | 3 +
.../cluster/containers/MinifiContainer.py | 11 +
.../features/MiNiFi_integration_test_driver.py | 3 +
docker/test/integration/features/couchbase.feature | 8 +
docker/test/integration/features/https.feature | 3 +-
docker/test/integration/features/kafka.feature | 18 +-
.../integration/features/minifi_c2_server.feature | 6 +-
.../test/integration/features/opensearch.feature | 9 +-
.../test/integration/features/prometheus.feature | 3 +-
.../features/python_with_modules.feature | 30 --
docker/test/integration/features/s2s.feature | 12 +-
docker/test/integration/features/splunk.feature | 3 +-
docker/test/integration/features/steps/steps.py | 5 +
encrypt-config/tests/ConfigFileEncryptorTests.cpp | 2 +-
encrypt-config/tests/ConfigFileTests.cpp | 8 +-
encrypt-config/tests/resources/minifi.properties | 3 +
...th-additional-sensitive-props.minifi.properties | 3 +
extension-utils/include/core/AbstractProcessor.h | 8 +-
.../include/utils/ListingStateManager.h | 2 +-
.../include/utils/ProcessorConfigUtils.h | 4 +-
extension-utils/src/utils/ListingStateManager.cpp | 5 +-
extension-utils/src/utils/ProcessorConfigUtils.cpp | 31 +-
extensions/aws/processors/ListS3.cpp | 2 +-
extensions/aws/processors/PutS3Object.cpp | 8 +-
extensions/aws/processors/S3Processor.cpp | 4 +-
extensions/aws/processors/S3Processor.h | 1 +
extensions/aws/s3/MultipartUploadStateStorage.cpp | 10 +-
extensions/civetweb/processors/ListenHTTP.cpp | 2 +-
.../controllerservices/CouchbaseClusterService.cpp | 2 +-
extensions/execute-process/ExecuteProcess.cpp | 2 +-
extensions/grafana-loki/PushGrafanaLoki.cpp | 2 +-
extensions/grafana-loki/PushGrafanaLokiGrpc.cpp | 6 +-
extensions/grafana-loki/PushGrafanaLokiREST.cpp | 4 +-
extensions/kafka/ConsumeKafka.cpp | 7 +-
extensions/kafka/PublishKafka.cpp | 6 +-
extensions/libarchive/BinFiles.cpp | 2 +-
.../mqtt/processors/AbstractMQTTProcessor.cpp | 6 +-
extensions/mqtt/processors/ConsumeMQTT.cpp | 4 +-
extensions/mqtt/processors/PublishMQTT.cpp | 5 +-
extensions/rocksdb-repos/ProvenanceRepository.cpp | 2 +-
.../controllers/RocksDbStateStorage.cpp | 6 +-
extensions/sftp/processors/ListSFTP.cpp | 4 +-
extensions/sftp/processors/SFTPProcessorBase.cpp | 4 +-
extensions/smb/ListSmb.cpp | 4 +-
extensions/smb/SmbConnectionControllerService.cpp | 4 +-
extensions/splunk/QuerySplunkIndexingStatus.cpp | 2 +-
.../controllers/JsonRecordSetWriter.cpp | 4 +-
.../standard-processors/modbus/FetchModbusTcp.cpp | 6 +-
.../modbus/ReadModbusFunctions.cpp | 1 +
.../modbus/ReadModbusFunctions.h | 4 +-
.../processors/AppendHostInfo.cpp | 4 +-
.../processors/AttributesToJSON.cpp | 4 +-
.../processors/DefragmentText.cpp | 2 +-
.../standard-processors/processors/ExtractText.cpp | 2 +-
.../standard-processors/processors/GetFile.cpp | 6 +-
.../standard-processors/processors/GetTCP.cpp | 4 +-
.../standard-processors/processors/HashContent.cpp | 6 +-
.../standard-processors/processors/InvokeHTTP.cpp | 4 +-
.../standard-processors/processors/ListFile.cpp | 4 +-
.../standard-processors/processors/PutTCP.cpp | 4 +-
.../standard-processors/processors/RouteText.cpp | 6 +-
.../standard-processors/processors/TailFile.cpp | 4 +-
.../tests/unit/FlowJsonTests.cpp | 348 ++++++++++++++++++---
.../tests/unit/SegmentContentTests.cpp | 2 +-
.../tests/unit/SplitContentTests.cpp | 2 +-
.../tests/unit/SplitTextTests.cpp | 2 +-
.../tests/unit/YamlConfigurationTests.cpp | 327 ++++++++++++++++---
.../tests/ConsumeWindowsEventLogTests.cpp | 2 +-
fips/openssl.cnf | 13 +
libminifi/CMakeLists.txt | 3 +-
libminifi/include/core/FlowConfiguration.h | 4 +
libminifi/include/core/ParameterContext.h | 10 +
libminifi/include/core/ParameterProvider.h | 86 +++++
libminifi/include/core/flow/FlowSchema.h | 4 +
libminifi/include/core/flow/FlowSerializer.h | 3 +-
.../include/core/flow/StructuredConfiguration.h | 5 +-
libminifi/include/core/json/JsonFlowSerializer.h | 8 +-
libminifi/include/core/yaml/YamlFlowSerializer.h | 5 +-
.../EnvironmentVariableParameterProvider.h | 92 ++++++
libminifi/src/Configuration.cpp | 3 +-
libminifi/src/RemoteProcessorGroupPort.cpp | 2 +-
libminifi/src/core/FlowConfiguration.cpp | 20 ++
libminifi/src/core/ParameterProvider.cpp | 72 +++++
libminifi/src/core/flow/AdaptiveConfiguration.cpp | 2 +-
libminifi/src/core/flow/FlowSchema.cpp | 12 +-
.../src/core/flow/StructuredConfiguration.cpp | 87 ++++--
libminifi/src/core/json/JsonFlowSerializer.cpp | 58 +++-
libminifi/src/core/yaml/YamlFlowSerializer.cpp | 57 +++-
.../EnvironmentVariableParameterProvider.cpp | 94 ++++++
libminifi/src/sitetosite/HTTPProtocol.cpp | 8 +-
...mmyProcessor.cpp => DummyParameterProvider.cpp} | 4 +-
.../test/libtest/unit/DummyParameterProvider.h | 62 ++++
libminifi/test/libtest/unit/DummyProcessor.h | 14 +-
libminifi/test/libtest/unit/MockClasses.h | 2 +-
.../test/resources/encrypted.minifi.properties | 3 +
.../EnvironmentVariableParameterProviderTest.cpp | 101 ++++++
libminifi/test/unit/ExpectedTest.cpp | 6 +-
libminifi/test/unit/JsonFlowSerializerTests.cpp | 211 +++++++++++--
libminifi/test/unit/OptionalTest.cpp | 8 +
libminifi/test/unit/ParameterTokenParserTest.cpp | 18 +-
libminifi/test/unit/YamlFlowSerializerTests.cpp | 179 +++++++++--
minifi-api/include/minifi-cpp/agent/agent_docs.h | 5 +-
.../include/minifi-cpp/core/ParameterContext.h | 66 ----
.../include/minifi-cpp/core/ProcessContext.h | 5 -
.../include/minifi-cpp/properties/Configuration.h | 2 +
minifi_main/AgentDocs.cpp | 21 +-
minifi_main/CMakeLists.txt | 2 +-
minifi_main/Fips.cpp | 131 ++++++++
.../properties/Configure.h => minifi_main/Fips.h | 9 +
minifi_main/MiNiFiMain.cpp | 3 +
msi/WixWin.wsi.in | 7 +
thirdparty/paho-mqtt/cmake-openssl.patch | 90 +++---
utils/include/agent/agent_docs.h | 8 +
utils/include/core/PropertyType.h | 26 +-
utils/include/utils/Environment.h | 17 +-
utils/include/utils/Error.h | 10 +
utils/include/utils/OptionalUtils.h | 27 +-
utils/include/utils/StringUtils.h | 3 +
.../utils/detail/MonadicOperationWrappers.h | 14 +-
utils/include/utils/expected.h | 17 +-
utils/src/core/PropertyType.cpp | 22 --
utils/src/utils/Environment.cpp | 48 +++
utils/src/utils/ParsingUtils.cpp | 14 +-
utils/src/utils/StringUtils.cpp | 38 ++-
140 files changed, 2737 insertions(+), 893 deletions(-)
create mode 100644 PARAMETER_PROVIDERS.md
delete mode 100644 cmake/VerifyPythonCompatibility.cmake
delete mode 100644 docker/test/integration/features/python_with_modules.feature
create mode 100644 fips/openssl.cnf
create mode 100644 libminifi/include/core/ParameterProvider.h
create mode 100644
libminifi/include/parameter-providers/EnvironmentVariableParameterProvider.h
create mode 100644 libminifi/src/core/ParameterProvider.cpp
create mode 100644
libminifi/src/parameter-providers/EnvironmentVariableParameterProvider.cpp
copy libminifi/test/libtest/unit/{DummyProcessor.cpp =>
DummyParameterProvider.cpp} (90%)
create mode 100644 libminifi/test/libtest/unit/DummyParameterProvider.h
create mode 100644
libminifi/test/unit/EnvironmentVariableParameterProviderTest.cpp
delete mode 100644 minifi-api/include/minifi-cpp/core/ParameterContext.h
create mode 100644 minifi_main/Fips.cpp
copy extension-utils/include/properties/Configure.h => minifi_main/Fips.h (71%)
delete mode 100644 utils/src/core/PropertyType.cpp
