[jira] [Created] (MINIFICPP-1345) Add linter for scripts
Gabor Gyimesi created MINIFICPP-1345: Summary: Add linter for scripts Key: MINIFICPP-1345 URL: https://issues.apache.org/jira/browse/MINIFICPP-1345 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Gabor Gyimesi * Add a new target for running shellcheck for shell scripts and flake8/pylint for python scripts * Fix existing issues * Run the target as a github check -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (MINIFICPP-1349) ConsumeWindowsEventLogs should honor batch commit size in a single session
[ https://issues.apache.org/jira/browse/MINIFICPP-1349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi reassigned MINIFICPP-1349: Assignee: Gabor Gyimesi > ConsumeWindowsEventLogs should honor batch commit size in a single session > -- > > Key: MINIFICPP-1349 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1349 > Project: Apache NiFi MiNiFi C++ > Issue Type: Bug >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Minor > Time Spent: 10m > Remaining Estimate: 0h > > CWEL currently commits logs in a single session in commits with the given > batch size until there are no more events left. In a single session the CWEL > processor should only commit "Batch Commit Size" number of events or the > number of events since the last bookmark if it is less than the batch commit > size. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1349) ConsumeWindowsEventLogs should honor batch commit size in a single session
Gabor Gyimesi created MINIFICPP-1349: Summary: ConsumeWindowsEventLogs should honor batch commit size in a single session Key: MINIFICPP-1349 URL: https://issues.apache.org/jira/browse/MINIFICPP-1349 Project: Apache NiFi MiNiFi C++ Issue Type: Bug Reporter: Gabor Gyimesi CWEL currently commits logs in a single session in commits with the given batch size until there are no more events left. In a single session the CWEL processor should only commit "Batch Commit Size" number of events or the number of events since the last bookmark if it is less than the batch commit size. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1360) Make scheduling strategy configurable in integration tests
Gabor Gyimesi created MINIFICPP-1360: Summary: Make scheduling strategy configurable in integration tests Key: MINIFICPP-1360 URL: https://issues.apache.org/jira/browse/MINIFICPP-1360 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Gabor Gyimesi In docker/test/integration/minifi/__init__.py the scheduling strategy is hard coded to be TIMER_DRIVEN for all processors. This should be configurable and updated for all processors used by integration tests. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (MINIFICPP-1357) Proxy properties of invokehttp are not respected
[ https://issues.apache.org/jira/browse/MINIFICPP-1357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi resolved MINIFICPP-1357. -- Resolution: Fixed > Proxy properties of invokehttp are not respected > > > Key: MINIFICPP-1357 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1357 > Project: Apache NiFi MiNiFi C++ > Issue Type: Bug >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Major > Time Spent: 2.5h > Remaining Estimate: 0h > > All the proxy properties (host, port, use, pass) are ignored. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (MINIFICPP-1347) Do not override MergeContent output attributes
[ https://issues.apache.org/jira/browse/MINIFICPP-1347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi resolved MINIFICPP-1347. -- Resolution: Fixed > Do not override MergeContent output attributes > -- > > Key: MINIFICPP-1347 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1347 > Project: Apache NiFi MiNiFi C++ > Issue Type: Bug >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Minor > Time Spent: 20m > Remaining Estimate: 0h > > In case when flowfiles processed by MergeContent could have common > attributes, with the same value in each flowfile (like mime type), the > attribute merge overrides the individually set output attributes. The > override of the previously set output attributes should not happen. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1357) Proxy properties of invokehttp are not respected
Gabor Gyimesi created MINIFICPP-1357: Summary: Proxy properties of invokehttp are not respected Key: MINIFICPP-1357 URL: https://issues.apache.org/jira/browse/MINIFICPP-1357 Project: Apache NiFi MiNiFi C++ Issue Type: Bug Reporter: Gabor Gyimesi Assignee: Gabor Gyimesi All the proxy properties (host, port, use, pass) are ignored. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (MINIFICPP-1364) Don't use rsync in docker build
[ https://issues.apache.org/jira/browse/MINIFICPP-1364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi reassigned MINIFICPP-1364: Assignee: Gabor Gyimesi > Don't use rsync in docker build > --- > > Key: MINIFICPP-1364 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1364 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Minor > Time Spent: 10m > Remaining Estimate: 0h > > Using rsync to move source code under the docker folder makes it hard to use > the Dockerfiles separately without the need of the provided build script also > makes it impossible to provide custom parameters to the docker build command. > It also unnecessarily duplicates the source files in every docker build run. > Rsync should be removed and the defined excludes can be moved to a > .dockerignore file. The docker build commands can be changed to use a > specific Dockerfile with the -f option and use the root directory (..) as > the context or simply moved to the root of the repository. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (MINIFICPP-1365) Use minimal docker image in integration tests
[ https://issues.apache.org/jira/browse/MINIFICPP-1365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi resolved MINIFICPP-1365. -- Resolution: Fixed > Use minimal docker image in integration tests > - > > Key: MINIFICPP-1365 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1365 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Minor > Time Spent: 20m > Remaining Estimate: 0h > > As the supported functionality of the minimal docker image is enough for our > integration tests, it can be used instead of the release image to speed up > the docker image build process in the CI. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (MINIFICPP-1365) Use minimal docker image in integration tests
[ https://issues.apache.org/jira/browse/MINIFICPP-1365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi reassigned MINIFICPP-1365: Assignee: Gabor Gyimesi > Use minimal docker image in integration tests > - > > Key: MINIFICPP-1365 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1365 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Minor > Time Spent: 20m > Remaining Estimate: 0h > > As the supported functionality of the minimal docker image is enough for our > integration tests, it can be used instead of the release image to speed up > the docker image build process in the CI. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (MINIFICPP-1364) Don't use rsync in docker build
[ https://issues.apache.org/jira/browse/MINIFICPP-1364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi resolved MINIFICPP-1364. -- Resolution: Fixed > Don't use rsync in docker build > --- > > Key: MINIFICPP-1364 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1364 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Minor > Time Spent: 20m > Remaining Estimate: 0h > > Using rsync to move source code under the docker folder makes it hard to use > the Dockerfiles separately without the need of the provided build script also > makes it impossible to provide custom parameters to the docker build command. > It also unnecessarily duplicates the source files in every docker build run. > Rsync should be removed and the defined excludes can be moved to a > .dockerignore file. The docker build commands can be changed to use a > specific Dockerfile with the -f option and use the root directory (..) as > the context or simply moved to the root of the repository. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (MINIFICPP-1321) MergeContent processor should support multiple attribute strategies
[ https://issues.apache.org/jira/browse/MINIFICPP-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi resolved MINIFICPP-1321. -- Fix Version/s: 0.7.0 Resolution: Fixed > MergeContent processor should support multiple attribute strategies > --- > > Key: MINIFICPP-1321 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1321 > Project: Apache NiFi MiNiFi C++ > Issue Type: New Feature >Affects Versions: 0.7.0 >Reporter: Arpad Boda >Assignee: Gabor Gyimesi >Priority: Major > Fix For: 0.7.0 > > Time Spent: 15h > Remaining Estimate: 0h > > This part should be on par with NiFi implementation. > https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.6.0/org.apache.nifi.processors.standard.MergeContent/index.html -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (MINIFICPP-1347) Do not override MergeContent output attributes
[ https://issues.apache.org/jira/browse/MINIFICPP-1347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi reassigned MINIFICPP-1347: Assignee: Gabor Gyimesi > Do not override MergeContent output attributes > -- > > Key: MINIFICPP-1347 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1347 > Project: Apache NiFi MiNiFi C++ > Issue Type: Bug >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Minor > > In case when flowfiles processed by MergeContent could have common > attributes, with the same value in each flowfile (like mime type), the > attribute merge overrides the individually set output attributes. The > override of the previously set output attributes should not happen. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1347) Do not override MergeContent output attributes
Gabor Gyimesi created MINIFICPP-1347: Summary: Do not override MergeContent output attributes Key: MINIFICPP-1347 URL: https://issues.apache.org/jira/browse/MINIFICPP-1347 Project: Apache NiFi MiNiFi C++ Issue Type: Bug Reporter: Gabor Gyimesi In case when flowfiles processed by MergeContent could have common attributes, with the same value in each flowfile (like mime type), the attribute merge overrides the individually set output attributes. The override of the previously set output attributes should not happen. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1358) SendBody property is unused in InvokeHTTP
Gabor Gyimesi created MINIFICPP-1358: Summary: SendBody property is unused in InvokeHTTP Key: MINIFICPP-1358 URL: https://issues.apache.org/jira/browse/MINIFICPP-1358 Project: Apache NiFi MiNiFi C++ Issue Type: Bug Reporter: Gabor Gyimesi SendBody attribute is defined but never used in InvokeHTTP processor. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1359) FollowRedirects feature is unavailable in InvokeHTTP
Gabor Gyimesi created MINIFICPP-1359: Summary: FollowRedirects feature is unavailable in InvokeHTTP Key: MINIFICPP-1359 URL: https://issues.apache.org/jira/browse/MINIFICPP-1359 Project: Apache NiFi MiNiFi C++ Issue Type: New Feature Reporter: Gabor Gyimesi InvokeHTTP processor does not use FollowRedirects property, so if a HTTP request is moved, it does not follow the redirect. In Nifi and Java MiNiFi this feature is turned on by default, which means we have a different default behavior then other NiFi projects. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (MINIFICPP-1359) FollowRedirects feature is unavailable in InvokeHTTP
[ https://issues.apache.org/jira/browse/MINIFICPP-1359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi updated MINIFICPP-1359: - Description: InvokeHTTP processor does not use FollowRedirects property, so if a HTTP request is moved, it does not follow the redirect. In Nifi and Java MiNiFi this feature is turned on by default, which means we have a different default behavior than other NiFi projects. (was: InvokeHTTP processor does not use FollowRedirects property, so if a HTTP request is moved, it does not follow the redirect. In Nifi and Java MiNiFi this feature is turned on by default, which means we have a different default behavior then other NiFi projects.) > FollowRedirects feature is unavailable in InvokeHTTP > > > Key: MINIFICPP-1359 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1359 > Project: Apache NiFi MiNiFi C++ > Issue Type: New Feature >Reporter: Gabor Gyimesi >Priority: Minor > > InvokeHTTP processor does not use FollowRedirects property, so if a HTTP > request is moved, it does not follow the redirect. In Nifi and Java MiNiFi > this feature is turned on by default, which means we have a different default > behavior than other NiFi projects. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1364) Don't use rsync in docker build
Gabor Gyimesi created MINIFICPP-1364: Summary: Don't use rsync in docker build Key: MINIFICPP-1364 URL: https://issues.apache.org/jira/browse/MINIFICPP-1364 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Gabor Gyimesi Using rsync to move source code under the docker folder makes it hard to use the Dockerfiles separately without the need of the provided build script also makes it impossible to provide custom parameters to the docker build command. It also unnecessarily duplicates the source files in every docker build run. Rsync should be removed and the defined excludes can be moved to a .dockerignore file. The docker build commands can be changed to use a specific Dockerfile with the -f option and use the root directory (..) as the context or simply moved to the root of the repository. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1365) Use minimal docker image in integration tests
Gabor Gyimesi created MINIFICPP-1365: Summary: Use minimal docker image in integration tests Key: MINIFICPP-1365 URL: https://issues.apache.org/jira/browse/MINIFICPP-1365 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Gabor Gyimesi As the supported functionality of the minimal docker image is enough for our integration tests, it can be used instead of the release image to speed up the docker image build process in the CI. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (MINIFICPP-1104) SSL docker tests for PublishKafka
[ https://issues.apache.org/jira/browse/MINIFICPP-1104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi resolved MINIFICPP-1104. -- Resolution: Fixed > SSL docker tests for PublishKafka > - > > Key: MINIFICPP-1104 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1104 > Project: Apache NiFi MiNiFi C++ > Issue Type: Task >Reporter: Nghia Le >Assignee: Gabor Gyimesi >Priority: Major > Time Spent: 7h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (MINIFICPP-1343) Create a minimal docker image target
[ https://issues.apache.org/jira/browse/MINIFICPP-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi resolved MINIFICPP-1343. -- Resolution: Fixed > Create a minimal docker image target > > > Key: MINIFICPP-1343 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1343 > Project: Apache NiFi MiNiFi C++ > Issue Type: New Feature >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Minor > Time Spent: 1h 50m > Remaining Estimate: 0h > > Create a build target which would create a minimal size docker image which > should only contain the kafka and http-curl extensions. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1390) Create DeleteS3Object processor
Gabor Gyimesi created MINIFICPP-1390: Summary: Create DeleteS3Object processor Key: MINIFICPP-1390 URL: https://issues.apache.org/jira/browse/MINIFICPP-1390 Project: Apache NiFi MiNiFi C++ Issue Type: New Feature Reporter: Gabor Gyimesi Assignee: Gabor Gyimesi Create new processor to delete existing S3 object with similar functionality defined in Nifi: https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.12.1/org.apache.nifi.processors.aws.s3.DeleteS3Object/index.html -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (MINIFICPP-1390) Create DeleteS3Object processor
[ https://issues.apache.org/jira/browse/MINIFICPP-1390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216698#comment-17216698 ] Gabor Gyimesi commented on MINIFICPP-1390: -- Note: Currently adobe/S3Mock server does not support versioning for deletion, so versioned delete is only tested manually on the official AWS S3 service. > Create DeleteS3Object processor > --- > > Key: MINIFICPP-1390 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1390 > Project: Apache NiFi MiNiFi C++ > Issue Type: New Feature >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Major > > Create new processor to delete existing S3 object with similar functionality > defined in Nifi: > https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.12.1/org.apache.nifi.processors.aws.s3.DeleteS3Object/index.html -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1396) Create FetchS3Object processor
Gabor Gyimesi created MINIFICPP-1396: Summary: Create FetchS3Object processor Key: MINIFICPP-1396 URL: https://issues.apache.org/jira/browse/MINIFICPP-1396 Project: Apache NiFi MiNiFi C++ Issue Type: New Feature Reporter: Gabor Gyimesi Assignee: Gabor Gyimesi Create new processor to fetch existing S3 object with similar functionality defined in Nifi: https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.12.1/org.apache.nifi.processors.aws.s3.FetchS3Object/index.html -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (MINIFICPP-1388) Introduce buffer for HTTP requests in ListenHTTP processor
[ https://issues.apache.org/jira/browse/MINIFICPP-1388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi updated MINIFICPP-1388: - Issue Type: Improvement (was: New Feature) > Introduce buffer for HTTP requests in ListenHTTP processor > -- > > Key: MINIFICPP-1388 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1388 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Major > > ListenHTTP processor starts a web server for handling HTTP requests and for > every HTTP request creates and commits a new session. This is wasteful and > ignores the scheduler, as these commits do not happen when the processor is > triggered. A buffer needs to be introduced so that the requests are buffered > by the web server and processed later when the ontrigger event is called. If > the buffer becomes full the request should be refused. The processing should > be done in batches where the maximum batch size can be configured. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1388) Introduce buffer for HTTP requests in ListenHTTP processor
Gabor Gyimesi created MINIFICPP-1388: Summary: Introduce buffer for HTTP requests in ListenHTTP processor Key: MINIFICPP-1388 URL: https://issues.apache.org/jira/browse/MINIFICPP-1388 Project: Apache NiFi MiNiFi C++ Issue Type: New Feature Reporter: Gabor Gyimesi Assignee: Gabor Gyimesi ListenHTTP processor starts a web server for handling HTTP requests and for every HTTP request creates and commits a new session. This is wasteful and ignores the scheduler, as these commits do not happen when the processor is triggered. A buffer needs to be introduced so that the requests are buffered by the web server and processed later when the ontrigger event is called. If the buffer becomes full the request should be refused. The processing should be done in batches where the maximum batch size can be configured. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1343) Create a minimal docker image target
Gabor Gyimesi created MINIFICPP-1343: Summary: Create a minimal docker image target Key: MINIFICPP-1343 URL: https://issues.apache.org/jira/browse/MINIFICPP-1343 Project: Apache NiFi MiNiFi C++ Issue Type: New Feature Reporter: Gabor Gyimesi Assignee: Gabor Gyimesi Create a build target which would create a minimal size docker image which should only contain the kafka and http-curl extensions. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (MINIFICPP-1376) Create PutS3Object processor
[ https://issues.apache.org/jira/browse/MINIFICPP-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi updated MINIFICPP-1376: - Description: Create a new processor that can put flow files to AWS S3 buckets. Functionality should be similar to NiFi's PutS3Object processor https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.5.0/org.apache.nifi.processors.aws.s3.PutS3Object/index.html Unneeded features from NiFi's processor: * Multipart upload - only single part upload needs to be implemented at the moment with maximum of 5GB data threshold. * Signer Override parameter implementation not needed. was: Create a new processor that can put flow files to AWS S3 buckets. Functionality should be similar to NiFi's PutS3Object processor [https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.5.0/org.apache.nifi.processors.aws.s3.PutS3Object/index.html.] Unneeded features from NiFi's processor: * Multipart upload - only single part upload needs to be implemented at the moment with maximum of 5GB data threshold. * Signer Override parameter implementation not needed. > Create PutS3Object processor > > > Key: MINIFICPP-1376 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1376 > Project: Apache NiFi MiNiFi C++ > Issue Type: New Feature >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Major > > Create a new processor that can put flow files to AWS S3 buckets. > Functionality should be similar to NiFi's PutS3Object processor > https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.5.0/org.apache.nifi.processors.aws.s3.PutS3Object/index.html > Unneeded features from NiFi's processor: > * Multipart upload - only single part upload needs to be implemented at the > moment with maximum of 5GB data threshold. > * Signer Override parameter implementation not needed. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (MINIFICPP-1376) Create PutS3Object processor
[ https://issues.apache.org/jira/browse/MINIFICPP-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi updated MINIFICPP-1376: - Description: Create a new processor that can put flow files to AWS S3 buckets. Functionality should be similar to NiFi's PutS3Object processor [https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.5.0/org.apache.nifi.processors.aws.s3.PutS3Object/index.html] Unneeded features from NiFi's processor: * Multipart upload - only single part upload needs to be implemented at the moment with maximum of 5GB data threshold. * Signer Override parameter implementation not needed. AWS C++ SDK also does not support: * Expiration Time Rule IDs * Write access setting in put object requests * Owner setting in put object requests was: Create a new processor that can put flow files to AWS S3 buckets. Functionality should be similar to NiFi's PutS3Object processor [https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.5.0/org.apache.nifi.processors.aws.s3.PutS3Object/index.html] Unneeded features from NiFi's processor: * Multipart upload - only single part upload needs to be implemented at the moment with maximum of 5GB data threshold. * Signer Override parameter implementation not needed. AWS C++ SDK also does not support: * Expiration Time Rule IDs * Write access setting in put object requests > Create PutS3Object processor > > > Key: MINIFICPP-1376 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1376 > Project: Apache NiFi MiNiFi C++ > Issue Type: New Feature >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Major > > Create a new processor that can put flow files to AWS S3 buckets. > Functionality should be similar to NiFi's PutS3Object processor > [https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.5.0/org.apache.nifi.processors.aws.s3.PutS3Object/index.html] > Unneeded features from NiFi's processor: > * Multipart upload - only single part upload needs to be implemented at the > moment with maximum of 5GB data threshold. > * Signer Override parameter implementation not needed. > AWS C++ SDK also does not support: > * Expiration Time Rule IDs > * Write access setting in put object requests > * Owner setting in put object requests -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (MINIFICPP-1376) Create PutS3Object processor
[ https://issues.apache.org/jira/browse/MINIFICPP-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi updated MINIFICPP-1376: - Description: Create a new processor that can put flow files to AWS S3 buckets. Functionality should be similar to NiFi's PutS3Object processor [https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.5.0/org.apache.nifi.processors.aws.s3.PutS3Object/index.html] Unneeded features from NiFi's processor: * Multipart upload - only single part upload needs to be implemented at the moment with maximum of 5GB data threshold. * Signer Override parameter implementation not needed. AWS C++ SDK also does not support: * Expiration Time Rule IDs * Write access setting in put object requests was: Create a new processor that can put flow files to AWS S3 buckets. Functionality should be similar to NiFi's PutS3Object processor https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.5.0/org.apache.nifi.processors.aws.s3.PutS3Object/index.html Unneeded features from NiFi's processor: * Multipart upload - only single part upload needs to be implemented at the moment with maximum of 5GB data threshold. * Signer Override parameter implementation not needed. > Create PutS3Object processor > > > Key: MINIFICPP-1376 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1376 > Project: Apache NiFi MiNiFi C++ > Issue Type: New Feature >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Major > > Create a new processor that can put flow files to AWS S3 buckets. > Functionality should be similar to NiFi's PutS3Object processor > [https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.5.0/org.apache.nifi.processors.aws.s3.PutS3Object/index.html] > Unneeded features from NiFi's processor: > * Multipart upload - only single part upload needs to be implemented at the > moment with maximum of 5GB data threshold. > * Signer Override parameter implementation not needed. > AWS C++ SDK also does not support: > * Expiration Time Rule IDs > * Write access setting in put object requests -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (MINIFICPP-1377) Add build number parameter for linux distribution builds
[
https://issues.apache.org/jira/browse/MINIFICPP-1377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Gyimesi resolved MINIFICPP-1377.
--
Resolution: Fixed
> Add build number parameter for linux distribution builds
>
>
> Key: MINIFICPP-1377
> URL: https://issues.apache.org/jira/browse/MINIFICPP-1377
> Project: Apache NiFi MiNiFi C++
> Issue Type: New Feature
>Reporter: Gabor Gyimesi
>Assignee: Gabor Gyimesi
>Priority: Major
> Time Spent: 1h
> Remaining Estimate: 0h
>
> A new parameter should be added to the build process that would represent the
> build number. This number should be found in every linux distribution build
> target's tar.gz output.
> This parameter could be supplied as a build parameter for CMake with a new -D
> option.
> Supplying the MINIFI_BUILD_NUMBER parameter to any distribution target should
> result in the
> nifi-minifi-cpp-${DISTRO_NAME}-${MINIFI_VERSION}-${MINIFI_BUILD_NUMBER}-bin.tar.gz
> output, so for example supplying a build number "1234" for a "make centos"
> target with 0.7.0 minifi version should result in
> minifi-cpp-centos-0.7.0-1234-bin.tar.gz output.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Resolved] (MINIFICPP-1349) ConsumeWindowsEventLogs should honor batch commit size in a single session
[ https://issues.apache.org/jira/browse/MINIFICPP-1349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi resolved MINIFICPP-1349. -- Resolution: Fixed > ConsumeWindowsEventLogs should honor batch commit size in a single session > -- > > Key: MINIFICPP-1349 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1349 > Project: Apache NiFi MiNiFi C++ > Issue Type: Bug >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Minor > Time Spent: 2h 40m > Remaining Estimate: 0h > > CWEL currently commits logs in a single session in commits with the given > batch size until there are no more events left. In a single session the CWEL > processor should only commit "Batch Commit Size" number of events or the > number of events since the last bookmark if it is less than the batch commit > size. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1376) Create PutS3Object processor
Gabor Gyimesi created MINIFICPP-1376: Summary: Create PutS3Object processor Key: MINIFICPP-1376 URL: https://issues.apache.org/jira/browse/MINIFICPP-1376 Project: Apache NiFi MiNiFi C++ Issue Type: New Feature Reporter: Gabor Gyimesi Assignee: Gabor Gyimesi Create a new processor that can put flow files to AWS S3 buckets. Functionality should be similar to NiFi's PutS3Object processor [https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.5.0/org.apache.nifi.processors.aws.s3.PutS3Object/index.html.] Unneeded features from NiFi's processor: * Multipart upload - only single part upload needs to be implemented at the moment with maximum of 5GB data threshold. * Signer Override parameter implementation not needed. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1377) Add build number parameter for linux distribution builds
Gabor Gyimesi created MINIFICPP-1377:
Summary: Add build number parameter for linux distribution builds
Key: MINIFICPP-1377
URL: https://issues.apache.org/jira/browse/MINIFICPP-1377
Project: Apache NiFi MiNiFi C++
Issue Type: New Feature
Reporter: Gabor Gyimesi
Assignee: Gabor Gyimesi
A new parameter should be added to the build process that would represent the
build number. This number should be found in every linux distribution build
target's tar.gz output.
This parameter could be supplied as a build parameter for CMake with a new -D
option.
Supplying the MINIFI_BUILD_NUMBER parameter to any distribution target should
result in the
nifi-minifi-cpp-${DISTRO_NAME}-${MINIFI_VERSION}-${MINIFI_BUILD_NUMBER}-bin.tar.gz
output, so for example supplying a build number "1234" for a "make centos"
target with 0.7.0 minifi version should result in
minifi-cpp-centos-0.7.0-1234-bin.tar.gz output.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (MINIFICPP-1382) Upload logs as artifacts for docker integration tests on failure
Gabor Gyimesi created MINIFICPP-1382: Summary: Upload logs as artifacts for docker integration tests on failure Key: MINIFICPP-1382 URL: https://issues.apache.org/jira/browse/MINIFICPP-1382 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Gabor Gyimesi Currently if a docker integration test fails in CI we have no way to check the reason of the failure other then reproducing the test failure locally. The container and application logs should be uploaded as artifacts to github in case of test failure before the test cleanup. These logs could be used to debug the test failure without reproduction. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (MINIFICPP-1400) Create ListS3 processor
[ https://issues.apache.org/jira/browse/MINIFICPP-1400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi updated MINIFICPP-1400: - Description: Create new processor to list S3 objects of a bucket with similar functionality defined in Nifi: [https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.12.1/org.apache.nifi.processors.aws.s3.ListS3/index.html] was: Create new processor to fetch existing S3 object with similar functionality defined in Nifi: https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.12.1/org.apache.nifi.processors.aws.s3.ListS3/index.html > Create ListS3 processor > --- > > Key: MINIFICPP-1400 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1400 > Project: Apache NiFi MiNiFi C++ > Issue Type: New Feature >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Major > > Create new processor to list S3 objects of a bucket with similar > functionality defined in Nifi: > [https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.12.1/org.apache.nifi.processors.aws.s3.ListS3/index.html] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (MINIFICPP-1400) Create ListS3 processor
[ https://issues.apache.org/jira/browse/MINIFICPP-1400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi updated MINIFICPP-1400: - Summary: Create ListS3 processor (was: Create ListS3Object processor) > Create ListS3 processor > --- > > Key: MINIFICPP-1400 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1400 > Project: Apache NiFi MiNiFi C++ > Issue Type: New Feature >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Major > > Create new processor to fetch existing S3 object with similar functionality > defined in Nifi: > https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.12.1/org.apache.nifi.processors.aws.s3.ListS3/index.html -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1400) Create ListS3Object processor
Gabor Gyimesi created MINIFICPP-1400: Summary: Create ListS3Object processor Key: MINIFICPP-1400 URL: https://issues.apache.org/jira/browse/MINIFICPP-1400 Project: Apache NiFi MiNiFi C++ Issue Type: New Feature Reporter: Gabor Gyimesi Assignee: Gabor Gyimesi Create new processor to fetch existing S3 object with similar functionality defined in Nifi: https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.12.1/org.apache.nifi.processors.aws.s3.ListS3/index.html -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (MINIFICPP-1388) Introduce buffer for HTTP requests in ListenHTTP processor
[ https://issues.apache.org/jira/browse/MINIFICPP-1388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi resolved MINIFICPP-1388. -- Resolution: Fixed > Introduce buffer for HTTP requests in ListenHTTP processor > -- > > Key: MINIFICPP-1388 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1388 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Major > Time Spent: 4h 10m > Remaining Estimate: 0h > > ListenHTTP processor starts a web server for handling HTTP requests and for > every HTTP request creates and commits a new session. This is wasteful and > ignores the scheduler, as these commits do not happen when the processor is > triggered. A buffer needs to be introduced so that the requests are buffered > by the web server and processed later when the ontrigger event is called. If > the buffer becomes full the request should be refused. The processing should > be done in batches where the maximum batch size can be configured. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (MINIFICPP-1376) Create PutS3Object processor
[ https://issues.apache.org/jira/browse/MINIFICPP-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi resolved MINIFICPP-1376. -- Resolution: Fixed > Create PutS3Object processor > > > Key: MINIFICPP-1376 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1376 > Project: Apache NiFi MiNiFi C++ > Issue Type: New Feature >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Major > Time Spent: 6h 20m > Remaining Estimate: 0h > > Create a new processor that can put flow files to AWS S3 buckets. > Functionality should be similar to NiFi's PutS3Object processor > [https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.5.0/org.apache.nifi.processors.aws.s3.PutS3Object/index.html] > Unneeded features from NiFi's processor: > * Multipart upload - only single part upload needs to be implemented at the > moment with maximum of 5GB data threshold. > * Signer Override parameter implementation not needed. > AWS C++ SDK also does not support: > * Expiration Time Rule IDs > * Write access setting in put object requests > * Owner setting in put object requests -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (MINIFICPP-1321) MergeContent processor should support multiple attribute strategies
[ https://issues.apache.org/jira/browse/MINIFICPP-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi reassigned MINIFICPP-1321: Assignee: Gabor Gyimesi > MergeContent processor should support multiple attribute strategies > --- > > Key: MINIFICPP-1321 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1321 > Project: Apache NiFi MiNiFi C++ > Issue Type: New Feature >Affects Versions: 0.7.0 >Reporter: Arpad Boda >Assignee: Gabor Gyimesi >Priority: Major > > This part should be on par with NiFi implementation. > https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.6.0/org.apache.nifi.processors.standard.MergeContent/index.html -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (MINIFICPP-1104) SSL docker tests for PublishKafka
[ https://issues.apache.org/jira/browse/MINIFICPP-1104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi reassigned MINIFICPP-1104: Assignee: Gabor Gyimesi (was: Nghia Le) > SSL docker tests for PublishKafka > - > > Key: MINIFICPP-1104 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1104 > Project: Apache NiFi MiNiFi C++ > Issue Type: Task >Reporter: Nghia Le >Assignee: Gabor Gyimesi >Priority: Major > Time Spent: 5h 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (MINIFICPP-1449) Add pause and resume command to C2
[ https://issues.apache.org/jira/browse/MINIFICPP-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi reassigned MINIFICPP-1449: Assignee: Gabor Gyimesi > Add pause and resume command to C2 > -- > > Key: MINIFICPP-1449 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1449 > Project: Apache NiFi MiNiFi C++ > Issue Type: New Feature >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Major > > It should be possible to send a PAUSE command to an agent through C2 so that > the execution of flows is stopped on the agent while the agent is still > running and heartbeating. It should also be possible send a RESUME command to > resume the agent's workflow. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1449) Add pause and resume command to C2
Gabor Gyimesi created MINIFICPP-1449: Summary: Add pause and resume command to C2 Key: MINIFICPP-1449 URL: https://issues.apache.org/jira/browse/MINIFICPP-1449 Project: Apache NiFi MiNiFi C++ Issue Type: New Feature Reporter: Gabor Gyimesi It should be possible to send a PAUSE command to an agent through C2 so that the execution of flows is stopped on the agent while the agent is still running and heartbeating. It should also be possible send a RESUME command to resume the agent's workflow. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (MINIFICPP-1390) Create DeleteS3Object processor
[ https://issues.apache.org/jira/browse/MINIFICPP-1390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi resolved MINIFICPP-1390. -- Resolution: Fixed > Create DeleteS3Object processor > --- > > Key: MINIFICPP-1390 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1390 > Project: Apache NiFi MiNiFi C++ > Issue Type: New Feature >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Major > Time Spent: 4.5h > Remaining Estimate: 0h > > Create new processor to delete existing S3 object with similar functionality > defined in Nifi: > https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.12.1/org.apache.nifi.processors.aws.s3.DeleteS3Object/index.html -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (MINIFICPP-1441) Specify Lua version instead of default
[ https://issues.apache.org/jira/browse/MINIFICPP-1441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi resolved MINIFICPP-1441. -- Resolution: Fixed > Specify Lua version instead of default > -- > > Key: MINIFICPP-1441 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1441 > Project: Apache NiFi MiNiFi C++ > Issue Type: Bug >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Minor > Time Spent: 3.5h > Remaining Estimate: 0h > > Current default Lua version 5.4 on Mac environments in Github actions is > unsupported by third party component sol2 2.20. We need to specify version > 5.3 in the environment to fix the issue. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1419) Stabilize docker tests in Github Actions
Gabor Gyimesi created MINIFICPP-1419: Summary: Stabilize docker tests in Github Actions Key: MINIFICPP-1419 URL: https://issues.apache.org/jira/browse/MINIFICPP-1419 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Gabor Gyimesi test_zero_file.py tests sometimes time out and fail in the CI environment, so it should be stabilized. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (MINIFICPP-1409) Add default credential provider chain support to AWS authentication
[ https://issues.apache.org/jira/browse/MINIFICPP-1409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi resolved MINIFICPP-1409. -- Resolution: Fixed > Add default credential provider chain support to AWS authentication > --- > > Key: MINIFICPP-1409 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1409 > Project: Apache NiFi MiNiFi C++ > Issue Type: New Feature >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Major > Time Spent: 1.5h > Remaining Estimate: 0h > > Currently access key and secret key authentication is supported for AWS > authentication through properties or credentials property file. Supporting > the default credential provider chain of AWS would allow customers to use > environment variable, profile config file or instance profiles (in that > order) for AWS authentication. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (MINIFICPP-1419) Stabilize docker tests in Github Actions
[ https://issues.apache.org/jira/browse/MINIFICPP-1419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi reassigned MINIFICPP-1419: Assignee: Gabor Gyimesi > Stabilize docker tests in Github Actions > > > Key: MINIFICPP-1419 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1419 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Minor > Time Spent: 20m > Remaining Estimate: 0h > > test_zero_file.py tests sometimes time out and fail in the CI environment, so > it should be stabilized. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (MINIFICPP-1419) Stabilize docker tests in Github Actions
[ https://issues.apache.org/jira/browse/MINIFICPP-1419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi resolved MINIFICPP-1419. -- Resolution: Fixed > Stabilize docker tests in Github Actions > > > Key: MINIFICPP-1419 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1419 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Minor > Time Spent: 20m > Remaining Estimate: 0h > > test_zero_file.py tests sometimes time out and fail in the CI environment, so > it should be stabilized. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1424) Stabilize flaky test cases
Gabor Gyimesi created MINIFICPP-1424: Summary: Stabilize flaky test cases Key: MINIFICPP-1424 URL: https://issues.apache.org/jira/browse/MINIFICPP-1424 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Gabor Gyimesi Multiple test cases have been failing intermittently in the CI environment. The root causes need to be identified and fixed to have a stable and reliable test suite for the project. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (MINIFICPP-1410) Add permissions property support for Putfile processor
[ https://issues.apache.org/jira/browse/MINIFICPP-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi resolved MINIFICPP-1410. -- Resolution: Fixed > Add permissions property support for Putfile processor > -- > > Key: MINIFICPP-1410 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1410 > Project: Apache NiFi MiNiFi C++ > Issue Type: New Feature >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Minor > Time Spent: 1h > Remaining Estimate: 0h > > The Putfile processor when not using the Boost library, creates directories > with a default 700 permissions on non Windows systems. This is too > restricting in some use cases which should be remedied, but also should b > configurable. A Permissions property needs to be added which to specify the > permissions of the created files and directories. The boost implementation > should also be updated and tested separately to be in sync with the native > implementation. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (MINIFICPP-1424) Stabilize several flaky test suites
[ https://issues.apache.org/jira/browse/MINIFICPP-1424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi updated MINIFICPP-1424: - Summary: Stabilize several flaky test suites (was: Stabilize flaky test cases) > Stabilize several flaky test suites > --- > > Key: MINIFICPP-1424 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1424 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Major > Labels: MiNiFi-CPP-Hygiene > Time Spent: 20m > Remaining Estimate: 0h > > Multiple test cases have been failing intermittently in the CI environment. > The root causes need to be identified and fixed to have a stable and reliable > test suite for the project. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (MINIFICPP-1424) Stabilize flaky test cases
[ https://issues.apache.org/jira/browse/MINIFICPP-1424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi reassigned MINIFICPP-1424: Assignee: Gabor Gyimesi > Stabilize flaky test cases > -- > > Key: MINIFICPP-1424 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1424 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Major > Labels: MiNiFi-CPP-Hygiene > Time Spent: 20m > Remaining Estimate: 0h > > Multiple test cases have been failing intermittently in the CI environment. > The root causes need to be identified and fixed to have a stable and reliable > test suite for the project. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (MINIFICPP-1436) VerifyInvokeHTTPTest and VerifyInvokeHTTPTestSecure fail transiently
[ https://issues.apache.org/jira/browse/MINIFICPP-1436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi updated MINIFICPP-1436: - Attachment: VerifyInvokeHTTPTest-mac-2.log > VerifyInvokeHTTPTest and VerifyInvokeHTTPTestSecure fail transiently > > > Key: MINIFICPP-1436 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1436 > Project: Apache NiFi MiNiFi C++ > Issue Type: Bug >Reporter: Gabor Gyimesi >Priority: Minor > Labels: MiNiFi-CPP-Hygiene > Attachments: VerifyInvokeHTTPTest-mac-2.log, > VerifyInvokeHTTPTest-mac.log, VerifyInvokeHTTPTestSecure-win.log > > > VerifyInvokeHTTPTest and VerifyInvokeHTTPTestSecure sometimes fail in Github > actions. According to the logs the curl call becomes idle after 1 second and > reaches a timeout. See attached logs for more information. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (MINIFICPP-1442) Uplift sol2 to newer version to support LUA version 5.4
[ https://issues.apache.org/jira/browse/MINIFICPP-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi updated MINIFICPP-1442: - Summary: Uplift sol2 to newer version to support LUA version 5.4 (was: Uplift sol2 to latest release version) > Uplift sol2 to newer version to support LUA version 5.4 > --- > > Key: MINIFICPP-1442 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1442 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Reporter: Gabor Gyimesi >Priority: Minor > Time Spent: 10m > Remaining Estimate: 0h > > Current sol2 library version is 2 years old. We should uplift sol2 to support > newer LUA versions. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1442) Uplift sol2 to latest release version
Gabor Gyimesi created MINIFICPP-1442: Summary: Uplift sol2 to latest release version Key: MINIFICPP-1442 URL: https://issues.apache.org/jira/browse/MINIFICPP-1442 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Gabor Gyimesi Current sol2 library version is 2 years old. We should uplift sol2 to support newer LUA versions. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (MINIFICPP-1442) Uplift sol2 to newer version to support LUA version 5.4
[ https://issues.apache.org/jira/browse/MINIFICPP-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi updated MINIFICPP-1442: - Description: We should uplift sol2 to support newer LUA versions. (was: Current sol2 library version is 2 years old. We should uplift sol2 to support newer LUA versions.) > Uplift sol2 to newer version to support LUA version 5.4 > --- > > Key: MINIFICPP-1442 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1442 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Reporter: Gabor Gyimesi >Priority: Minor > Time Spent: 10m > Remaining Estimate: 0h > > We should uplift sol2 to support newer LUA versions. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (MINIFICPP-1441) Specify Lua version instead of default
[ https://issues.apache.org/jira/browse/MINIFICPP-1441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi reassigned MINIFICPP-1441: Assignee: Gabor Gyimesi > Specify Lua version instead of default > -- > > Key: MINIFICPP-1441 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1441 > Project: Apache NiFi MiNiFi C++ > Issue Type: Bug >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Minor > Time Spent: 10m > Remaining Estimate: 0h > > Current default Lua version 5.4 on Mac environments in Github actions is > unsupported by third party component sol2 2.20. We need to specify version > 5.3 in the environment to fix the issue. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1441) Specify Lua version instead of default
Gabor Gyimesi created MINIFICPP-1441: Summary: Specify Lua version instead of default Key: MINIFICPP-1441 URL: https://issues.apache.org/jira/browse/MINIFICPP-1441 Project: Apache NiFi MiNiFi C++ Issue Type: Bug Reporter: Gabor Gyimesi Current default Lua version 5.4 on Mac environments in Github actions is unsupported by third party component sol2 2.20. We need to specify version 5.3 in the environment to fix the issue. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (MINIFICPP-1295) ListenHTTP tests are unstable
[ https://issues.apache.org/jira/browse/MINIFICPP-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi reassigned MINIFICPP-1295: Assignee: Gabor Gyimesi > ListenHTTP tests are unstable > - > > Key: MINIFICPP-1295 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1295 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Affects Versions: 0.7.0 >Reporter: Arpad Boda >Assignee: Gabor Gyimesi >Priority: Major > Labels: MiNiFi-CPP-Hygiene > > ListenHTTP tests sometimes fail in CI: > https://travis-ci.org/github/apache/nifi-minifi-cpp/jobs/708711586 > Should be investigated. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (MINIFICPP-1295) ListenHTTP tests are unstable
[ https://issues.apache.org/jira/browse/MINIFICPP-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi resolved MINIFICPP-1295. -- Resolution: Fixed ListenHTTP tests seem to be stable with no transient failures in Github actions. > ListenHTTP tests are unstable > - > > Key: MINIFICPP-1295 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1295 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Affects Versions: 0.7.0 >Reporter: Arpad Boda >Assignee: Gabor Gyimesi >Priority: Major > Labels: MiNiFi-CPP-Hygiene > > ListenHTTP tests sometimes fail in CI: > https://travis-ci.org/github/apache/nifi-minifi-cpp/jobs/708711586 > Should be investigated. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1434) CSite2SiteTests transiently fail on Mac
Gabor Gyimesi created MINIFICPP-1434: Summary: CSite2SiteTests transiently fail on Mac Key: MINIFICPP-1434 URL: https://issues.apache.org/jira/browse/MINIFICPP-1434 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Gabor Gyimesi Attachments: csite2sitetests-mac.log CSite2SiteTests sometimes fail with SIGPIPE***Exception in Mac environments. Unfortunately no logs are generated. Needs to be reproduced and fixed. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1436) VerifyInvokeHTTPTest and VerifyInvokeHTTPTestSecure fail transiently
Gabor Gyimesi created MINIFICPP-1436: Summary: VerifyInvokeHTTPTest and VerifyInvokeHTTPTestSecure fail transiently Key: MINIFICPP-1436 URL: https://issues.apache.org/jira/browse/MINIFICPP-1436 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Gabor Gyimesi Attachments: VerifyInvokeHTTPTest-mac.log, VerifyInvokeHTTPTestSecure-win.log VerifyInvokeHTTPTest and VerifyInvokeHTTPTestSecure sometimes fail in Github actions. According to the logs the curl call becomes idle after 1 second and reaches a timeout. See attached logs for more information. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1437) ExecutePythonProcessorTests fail transiently
Gabor Gyimesi created MINIFICPP-1437: Summary: ExecutePythonProcessorTests fail transiently Key: MINIFICPP-1437 URL: https://issues.apache.org/jira/browse/MINIFICPP-1437 Project: Apache NiFi MiNiFi C++ Issue Type: Bug Reporter: Gabor Gyimesi Attachments: ExecutePythonProcessorTests-mac.log As a rare occurrence ExecutePythonProcessorTests fail with SegFault in Github actions. See more information in attached logs. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (MINIFICPP-1436) VerifyInvokeHTTPTest and VerifyInvokeHTTPTestSecure fail transiently
[ https://issues.apache.org/jira/browse/MINIFICPP-1436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi updated MINIFICPP-1436: - Issue Type: Bug (was: Improvement) > VerifyInvokeHTTPTest and VerifyInvokeHTTPTestSecure fail transiently > > > Key: MINIFICPP-1436 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1436 > Project: Apache NiFi MiNiFi C++ > Issue Type: Bug >Reporter: Gabor Gyimesi >Priority: Minor > Attachments: VerifyInvokeHTTPTest-mac.log, > VerifyInvokeHTTPTestSecure-win.log > > > VerifyInvokeHTTPTest and VerifyInvokeHTTPTestSecure sometimes fail in Github > actions. According to the logs the curl call becomes idle after 1 second and > reaches a timeout. See attached logs for more information. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (MINIFICPP-1435) SFTP tests trainsiently fail
[ https://issues.apache.org/jira/browse/MINIFICPP-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi updated MINIFICPP-1435: - Issue Type: Bug (was: Improvement) > SFTP tests trainsiently fail > > > Key: MINIFICPP-1435 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1435 > Project: Apache NiFi MiNiFi C++ > Issue Type: Bug >Reporter: Gabor Gyimesi >Priority: Minor > Attachments: SFTPTests-ubuntu1604.log > > > SFTP tests rarely fail in CI. According to the logs the port file of the SFTP > server does not get created so the server probably does not start. See > attachment for logs. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (MINIFICPP-1424) Stabilize several flaky test suites
[ https://issues.apache.org/jira/browse/MINIFICPP-1424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi updated MINIFICPP-1424: - Description: Multiple test cases have been failing intermittently in the CI environment. The root causes need to be identified and fixed to have a stable and reliable test suite for the project. Flaky tests included in this ticket: * FileUtilsTests * RepoTests and PersistanceTests * SecureSocketGetTCP tests * TailFileTests * GetTCPTests * Flow-Tests * DBProvenanceRepositoryTests * Fedora build was:Multiple test cases have been failing intermittently in the CI environment. The root causes need to be identified and fixed to have a stable and reliable test suite for the project. > Stabilize several flaky test suites > --- > > Key: MINIFICPP-1424 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1424 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Major > Labels: MiNiFi-CPP-Hygiene > Time Spent: 1h 40m > Remaining Estimate: 0h > > Multiple test cases have been failing intermittently in the CI environment. > The root causes need to be identified and fixed to have a stable and reliable > test suite for the project. Flaky tests included in this ticket: > * FileUtilsTests > * RepoTests and PersistanceTests > * SecureSocketGetTCP tests > * TailFileTests > * GetTCPTests > * Flow-Tests > * DBProvenanceRepositoryTests > * Fedora build > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1435) SFTP tests trainsiently fail
Gabor Gyimesi created MINIFICPP-1435: Summary: SFTP tests trainsiently fail Key: MINIFICPP-1435 URL: https://issues.apache.org/jira/browse/MINIFICPP-1435 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Gabor Gyimesi Attachments: SFTPTests-ubuntu1604.log SFTP tests rarely fail in CI. According to the logs the port file of the SFTP server does not get created so the server probably does not start. See attachment for logs. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (MINIFICPP-1434) CSite2SiteTests transiently fail on Mac
[ https://issues.apache.org/jira/browse/MINIFICPP-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi updated MINIFICPP-1434: - Issue Type: Bug (was: Improvement) > CSite2SiteTests transiently fail on Mac > --- > > Key: MINIFICPP-1434 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1434 > Project: Apache NiFi MiNiFi C++ > Issue Type: Bug >Reporter: Gabor Gyimesi >Priority: Minor > Attachments: csite2sitetests-mac.log > > > CSite2SiteTests sometimes fail with SIGPIPE***Exception in Mac environments. > Unfortunately no logs are generated. Needs to be reproduced and fixed. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1438) FlowControllerTests fail transiently
Gabor Gyimesi created MINIFICPP-1438: Summary: FlowControllerTests fail transiently Key: MINIFICPP-1438 URL: https://issues.apache.org/jira/browse/MINIFICPP-1438 Project: Apache NiFi MiNiFi C++ Issue Type: Bug Reporter: Gabor Gyimesi Attachments: FlowControllerTests-ubuntu1604.log, FlowControllerTests-win.log FlowControllerTests transiently fail in Github actions with multiple problems. See attached logs for more information. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1404) Add option to disable unity build of AWS lib
Gabor Gyimesi created MINIFICPP-1404: Summary: Add option to disable unity build of AWS lib Key: MINIFICPP-1404 URL: https://issues.apache.org/jira/browse/MINIFICPP-1404 Project: Apache NiFi MiNiFi C++ Issue Type: New Feature Reporter: Gabor Gyimesi AWS library is built with unity build option ON by default to make the library smaller. The library is built using a single generated cpp file, which is generated thus recompiled in every single build event. Because of this if we build iteratively (for example while developing on a local machine) we have to rebuild the library every single time even if no change has occurred. We should add an option to disable the unity build in this case. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (MINIFICPP-1404) Add option to disable unity build of AWS lib
[ https://issues.apache.org/jira/browse/MINIFICPP-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi reassigned MINIFICPP-1404: Assignee: Gabor Gyimesi > Add option to disable unity build of AWS lib > > > Key: MINIFICPP-1404 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1404 > Project: Apache NiFi MiNiFi C++ > Issue Type: New Feature >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Trivial > Time Spent: 10m > Remaining Estimate: 0h > > AWS library is built with unity build option ON by default to make the > library smaller. The library is built using a single generated cpp file, > which is generated thus recompiled in every single build event. Because of > this if we build iteratively (for example while developing on a local > machine) we have to rebuild the library every single time even if no change > has occurred. We should add an option to disable the unity build in this case. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (MINIFICPP-1404) Add option to disable unity build of AWS lib
[ https://issues.apache.org/jira/browse/MINIFICPP-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi resolved MINIFICPP-1404. -- Resolution: Fixed > Add option to disable unity build of AWS lib > > > Key: MINIFICPP-1404 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1404 > Project: Apache NiFi MiNiFi C++ > Issue Type: New Feature >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Trivial > Time Spent: 1h > Remaining Estimate: 0h > > AWS library is built with unity build option ON by default to make the > library smaller. The library is built using a single generated cpp file, > which is generated thus recompiled in every single build event. Because of > this if we build iteratively (for example while developing on a local > machine) we have to rebuild the library every single time even if no change > has occurred. We should add an option to disable the unity build in this case. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1410) Add permissions property support for Putfile processor
Gabor Gyimesi created MINIFICPP-1410: Summary: Add permissions property support for Putfile processor Key: MINIFICPP-1410 URL: https://issues.apache.org/jira/browse/MINIFICPP-1410 Project: Apache NiFi MiNiFi C++ Issue Type: New Feature Reporter: Gabor Gyimesi Assignee: Gabor Gyimesi The Putfile processor when not using the Boost library, creates directories with a default 700 permissions on non Windows systems. This is too restricting in some use cases which should be remedied, but also should b configurable. A Permissions property needs to be added which to specify the permissions of the created files and directories. The boost implementation should also be updated and tested separately to be in sync with the native implementation. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1409) Add default credential provider chain support to AWS authentication
Gabor Gyimesi created MINIFICPP-1409: Summary: Add default credential provider chain support to AWS authentication Key: MINIFICPP-1409 URL: https://issues.apache.org/jira/browse/MINIFICPP-1409 Project: Apache NiFi MiNiFi C++ Issue Type: New Feature Reporter: Gabor Gyimesi Assignee: Gabor Gyimesi Currently access key and secret key authentication is supported for AWS authentication through properties or credentials property file. Supporting the default credential provider chain of AWS would allow customers to use environment variable, profile config file or instance profiles (in that order) for AWS authentication. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1403) Create TagS3Object processor
Gabor Gyimesi created MINIFICPP-1403: Summary: Create TagS3Object processor Key: MINIFICPP-1403 URL: https://issues.apache.org/jira/browse/MINIFICPP-1403 Project: Apache NiFi MiNiFi C++ Issue Type: New Feature Reporter: Gabor Gyimesi Create new processor to tag S3 objects of a bucket with similar functionality defined in Nifi: [https://nifi.apache.org/docs/nifi-docs/components/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.9.0/org.apache.nifi.processors.aws.s3.TagS3Object/index.htmlhttps://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.12.1/org.apache.nifi.processors.aws.s3.ListS3/index.html|https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.12.1/org.apache.nifi.processors.aws.s3.ListS3/index.html] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1406) Check for swig dependency for docker integration tests
Gabor Gyimesi created MINIFICPP-1406: Summary: Check for swig dependency for docker integration tests Key: MINIFICPP-1406 URL: https://issues.apache.org/jira/browse/MINIFICPP-1406 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Gabor Gyimesi Swig is a compile time dependency for m2crypto pip package used in docker integration tests. This dependency is not explicit in the code and can be problematic to find for users of the test framework. It needs to have a more explicit error message if the package is missing and should also be documented. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (MINIFICPP-1396) Create FetchS3Object processor
[ https://issues.apache.org/jira/browse/MINIFICPP-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi resolved MINIFICPP-1396. -- Resolution: Fixed > Create FetchS3Object processor > -- > > Key: MINIFICPP-1396 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1396 > Project: Apache NiFi MiNiFi C++ > Issue Type: New Feature >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Major > Time Spent: 5h 10m > Remaining Estimate: 0h > > Create new processor to fetch existing S3 object with similar functionality > defined in Nifi: > https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.12.1/org.apache.nifi.processors.aws.s3.FetchS3Object/index.html -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1452) Parameterize Docker image build
Gabor Gyimesi created MINIFICPP-1452: Summary: Parameterize Docker image build Key: MINIFICPP-1452 URL: https://issues.apache.org/jira/browse/MINIFICPP-1452 Project: Apache NiFi MiNiFi C++ Issue Type: New Feature Reporter: Gabor Gyimesi Assignee: Gabor Gyimesi As a project user it should be possible to pass the following parameters to a docker image build: * Which Alpine based Docker image should be used as the base image. * What extensions should be built in the Docker image The parameters should be passed as CMake options and these options shall be forwarded when making the docker target. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1451) ThreadPoolAdjust test transiently fails
Gabor Gyimesi created MINIFICPP-1451: Summary: ThreadPoolAdjust test transiently fails Key: MINIFICPP-1451 URL: https://issues.apache.org/jira/browse/MINIFICPP-1451 Project: Apache NiFi MiNiFi C++ Issue Type: New Feature Reporter: Gabor Gyimesi Attachments: threadpooladjust-failure-vs2019.txt ThreadPoolAdjust test was seen failing in CI with the VS2019 build. See logs attached. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (MINIFICPP-1451) ThreadPoolAdjust test transiently fails
[ https://issues.apache.org/jira/browse/MINIFICPP-1451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi updated MINIFICPP-1451: - Issue Type: Bug (was: New Feature) > ThreadPoolAdjust test transiently fails > --- > > Key: MINIFICPP-1451 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1451 > Project: Apache NiFi MiNiFi C++ > Issue Type: Bug >Reporter: Gabor Gyimesi >Priority: Minor > Attachments: threadpooladjust-failure-vs2019.txt > > > ThreadPoolAdjust test was seen failing in CI with the VS2019 build. See logs > attached. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1454) Reduce duplication of CMake parameters in docker arguments
Gabor Gyimesi created MINIFICPP-1454: Summary: Reduce duplication of CMake parameters in docker arguments Key: MINIFICPP-1454 URL: https://issues.apache.org/jira/browse/MINIFICPP-1454 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Gabor Gyimesi MINIFICPP-1452 introduced the ability for Docker builds to consume the configured CMake options. This way CMake options set regarding extension availability are passed to Docker builds when the docker target is built. Unfortunately these options need to be defined and passed through DockerConfig.cmake, DockerBuild.sh and finally the Dockerfile, which causes duplication of these arguments. We need to find a way to reduced this duplication. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (MINIFICPP-1424) Stabilize several flaky test suites
[ https://issues.apache.org/jira/browse/MINIFICPP-1424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi resolved MINIFICPP-1424. -- Resolution: Fixed > Stabilize several flaky test suites > --- > > Key: MINIFICPP-1424 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1424 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Major > Labels: MiNiFi-CPP-Hygiene > Time Spent: 5h > Remaining Estimate: 0h > > Multiple test cases have been failing intermittently in the CI environment. > The root causes need to be identified and fixed to have a stable and reliable > test suite for the project. Flaky tests included in this ticket: > * FileUtilsTests > * RepoTests and PersistanceTests > * SecureSocketGetTCP tests > * TailFileTests > * GetTCPTests > * Flow-Tests > * DBProvenanceRepositoryTests > * Fedora build > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (MINIFICPP-1461) Enable Curl specific EL tests on Windows
[ https://issues.apache.org/jira/browse/MINIFICPP-1461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi updated MINIFICPP-1461: - Description: After merging the changes of MINIFICPP-1446, there should be no problems anymore from compiling and running EL tests using CURL library features on Windows. (was: After merging the changes of MINIFICPP-1446, there should be no problems anymore from compiling and running EL tests using CURL library features.) > Enable Curl specific EL tests on Windows > > > Key: MINIFICPP-1461 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1461 > Project: Apache NiFi MiNiFi C++ > Issue Type: Test >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Trivial > > After merging the changes of MINIFICPP-1446, there should be no problems > anymore from compiling and running EL tests using CURL library features on > Windows. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1461) Enable Curl specific EL tests on Windows
Gabor Gyimesi created MINIFICPP-1461: Summary: Enable Curl specific EL tests on Windows Key: MINIFICPP-1461 URL: https://issues.apache.org/jira/browse/MINIFICPP-1461 Project: Apache NiFi MiNiFi C++ Issue Type: Test Reporter: Gabor Gyimesi Assignee: Gabor Gyimesi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1459) Cleanup temporary files after test runs
Gabor Gyimesi created MINIFICPP-1459: Summary: Cleanup temporary files after test runs Key: MINIFICPP-1459 URL: https://issues.apache.org/jira/browse/MINIFICPP-1459 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Gabor Gyimesi Assignee: Gabor Gyimesi Running MiNiFiCPP tests creates more than 200 temporal test directories with test resources, that are kept after test runs and need to be manually cleaned up. After multiple test runs these resources can mount up to a lot of storage and can be cumbersome to deal with. It would be a better solution to clean up test resources automatically after each run. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (MINIFICPP-1461) Enable Curl specific EL tests on Windows
[ https://issues.apache.org/jira/browse/MINIFICPP-1461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi updated MINIFICPP-1461: - Description: After merging the changes of MINIFICPP-1446, there should be no problems anymore from compiling and running EL tests using CURL library features. > Enable Curl specific EL tests on Windows > > > Key: MINIFICPP-1461 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1461 > Project: Apache NiFi MiNiFi C++ > Issue Type: Test >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Trivial > > After merging the changes of MINIFICPP-1446, there should be no problems > anymore from compiling and running EL tests using CURL library features. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1468) test_delete_s3_object_proxy transiently fails
Gabor Gyimesi created MINIFICPP-1468: Summary: test_delete_s3_object_proxy transiently fails Key: MINIFICPP-1468 URL: https://issues.apache.org/jira/browse/MINIFICPP-1468 Project: Apache NiFi MiNiFi C++ Issue Type: Bug Reporter: Gabor Gyimesi Assignee: Gabor Gyimesi Mock S3 server needs some time to delete the S3 object after the delete request succeeds. Our check should wait for this to succeed, to avoid transient failures. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (MINIFICPP-1466) Fine tune configuration to save system resources
[ https://issues.apache.org/jira/browse/MINIFICPP-1466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi resolved MINIFICPP-1466. -- Resolution: Fixed > Fine tune configuration to save system resources > > > Key: MINIFICPP-1466 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1466 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Minor > Time Spent: 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (MINIFICPP-1465) Add AWS extension to docker minimal image
[ https://issues.apache.org/jira/browse/MINIFICPP-1465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi resolved MINIFICPP-1465. -- Resolution: Fixed > Add AWS extension to docker minimal image > - > > Key: MINIFICPP-1465 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1465 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Minor > Time Spent: 50m > Remaining Estimate: 0h > > AWS should be part of the minimal docker image. It should also be part of the > 16.04-all tests in CI. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (MINIFICPP-1449) Add pause and resume command to C2
[ https://issues.apache.org/jira/browse/MINIFICPP-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi resolved MINIFICPP-1449. -- Resolution: Fixed > Add pause and resume command to C2 > -- > > Key: MINIFICPP-1449 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1449 > Project: Apache NiFi MiNiFi C++ > Issue Type: New Feature >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Major > Time Spent: 4h 20m > Remaining Estimate: 0h > > It should be possible to send a PAUSE command to an agent through C2 so that > the execution of flows is stopped on the agent while the agent is still > running and heartbeating. It should also be possible send a RESUME command to > resume the agent's workflow. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (MINIFICPP-1452) Parameterize Docker image build
[ https://issues.apache.org/jira/browse/MINIFICPP-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi resolved MINIFICPP-1452. -- Resolution: Fixed > Parameterize Docker image build > --- > > Key: MINIFICPP-1452 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1452 > Project: Apache NiFi MiNiFi C++ > Issue Type: New Feature >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Major > Time Spent: 50m > Remaining Estimate: 0h > > As a project user it should be possible to pass the following parameters to a > docker image build: > * Which Alpine based Docker image should be used as the base image. > * What extensions should be built in the Docker image > The parameters should be passed as CMake options and these options shall be > forwarded when making the docker target. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1466) Fine tune configuration to save system resources
Gabor Gyimesi created MINIFICPP-1466: Summary: Fine tune configuration to save system resources Key: MINIFICPP-1466 URL: https://issues.apache.org/jira/browse/MINIFICPP-1466 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Gabor Gyimesi Assignee: Gabor Gyimesi -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1456) Introduce PutAzureBlobStorage processor
Gabor Gyimesi created MINIFICPP-1456: Summary: Introduce PutAzureBlobStorage processor Key: MINIFICPP-1456 URL: https://issues.apache.org/jira/browse/MINIFICPP-1456 Project: Apache NiFi MiNiFi C++ Issue Type: New Feature Reporter: Gabor Gyimesi Assignee: Gabor Gyimesi Introduce PutAzureBlobStorage processor with functionality similar to the NiFi equivalent: [https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-azure-nar/1.12.1/org.apache.nifi.processors.azure.storage.PutAzureBlobStorage/index.html] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (MINIFICPP-1461) Enable Expression Language tests on Windows
[ https://issues.apache.org/jira/browse/MINIFICPP-1461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi reassigned MINIFICPP-1461: Assignee: (was: Gabor Gyimesi) Description: Expression language tests are disabled on Windows due to multiple issues, which need to be investigated and fixed before the tests can be enabled on that platform. (was: After merging the changes of MINIFICPP-1446, there should be no problems anymore from compiling and running EL tests using CURL library features on Windows.) Labels: MiNiFi-CPP-Hygiene (was: ) Priority: Minor (was: Trivial) Summary: Enable Expression Language tests on Windows (was: Enable Curl specific EL tests on Windows) > Enable Expression Language tests on Windows > --- > > Key: MINIFICPP-1461 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1461 > Project: Apache NiFi MiNiFi C++ > Issue Type: Test >Reporter: Gabor Gyimesi >Priority: Minor > Labels: MiNiFi-CPP-Hygiene > Time Spent: 0.5h > Remaining Estimate: 0h > > Expression language tests are disabled on Windows due to multiple issues, > which need to be investigated and fixed before the tests can be enabled on > that platform. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1465) Add AWS extension to docker minimal image
Gabor Gyimesi created MINIFICPP-1465: Summary: Add AWS extension to docker minimal image Key: MINIFICPP-1465 URL: https://issues.apache.org/jira/browse/MINIFICPP-1465 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Gabor Gyimesi AWS should be part of the minimal docker image. It should also be part of the 16.04-all tests in CI. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (MINIFICPP-1465) Add AWS extension to docker minimal image
[ https://issues.apache.org/jira/browse/MINIFICPP-1465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi reassigned MINIFICPP-1465: Assignee: Gabor Gyimesi > Add AWS extension to docker minimal image > - > > Key: MINIFICPP-1465 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1465 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Minor > > AWS should be part of the minimal docker image. It should also be part of the > 16.04-all tests in CI. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (MINIFICPP-1476) Improve parallel S3 request handling in S3 processors
Gabor Gyimesi created MINIFICPP-1476: Summary: Improve parallel S3 request handling in S3 processors Key: MINIFICPP-1476 URL: https://issues.apache.org/jira/browse/MINIFICPP-1476 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Gabor Gyimesi Only 1 S3 request is allowed to be sent at a time in each S3 processor to avoid overwriting the internal state (used credentials, proxy info etc.) of the S3 wrapper by an overlapping onTrigger call. Because of this we need to wait for the response of the S3 service before another request can be sent. This should be improved either by introducing an async API or making the making the S3Wrapper stateless to allow overlapping calls, or any further solution that is available. It needs to be investigated and an optimal solution shall be chosen for implementation. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (MINIFICPP-1568) PerformanceDataMonitorTests transiently fail
[ https://issues.apache.org/jira/browse/MINIFICPP-1568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gyimesi resolved MINIFICPP-1568. -- Resolution: Fixed > PerformanceDataMonitorTests transiently fail > > > Key: MINIFICPP-1568 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1568 > Project: Apache NiFi MiNiFi C++ > Issue Type: Bug >Reporter: Gabor Gyimesi >Assignee: Gabor Gyimesi >Priority: Minor > Labels: MiNiFi-CPP-Hygiene > Fix For: 0.10.0 > > Attachments: PerformanceDataMonitorTests_failure_win_vs2017.log > > Time Spent: 1h 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
