[jira] [Commented] (MINIFI-403) Unable to start FetchDistributedMapCache/PutDistributedMapCache in Minifi
[ https://issues.apache.org/jira/browse/MINIFI-403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16190722#comment-16190722 ] ASF GitHub Bot commented on MINIFI-403: --- GitHub user apiri opened a pull request: https://github.com/apache/nifi-minifi/pull/91 MINIFI-403 - Adjusting included NiFi dependencies MINIFI-403 - Adjusting included NiFi dependencies and remove those APIJARs that were treated as System bundles preventing dependent NARs from finding a compatible API NAR. You can merge this pull request into a Git repository by running: $ git pull https://github.com/apiri/nifi-minifi MINIFI-403 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/nifi-minifi/pull/91.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #91 commit 2e91cbeafd1881a99c4e9b87b841bfb5fe91c0f0 Author: Aldrin PiriDate: 2017-10-04T01:42:49Z MINIFI-403 - Adjusting included NiFi dependencies and remove those API JARs that were treated as System bundles preventing dependent NARs from finding a compatible API NAR. > Unable to start FetchDistributedMapCache/PutDistributedMapCache in Minifi > - > > Key: MINIFI-403 > URL: https://issues.apache.org/jira/browse/MINIFI-403 > Project: Apache NiFi MiNiFi > Issue Type: Bug > Components: Agent Configuration/Installation >Affects Versions: 0.2.0 > Environment: Minifi - 0.2.0 > Nifi - 1.2.0/1.3.0 > OS - Windows 7 >Reporter: Nishant Gupta >Assignee: Aldrin Piri >Priority: Minor > Attachments: config.yml, minifi-app.log, minifi-bootstrap.log, Minifi > Lib.png, Minifi_RTS_M.xml > > > Description: > Unable to start FetchDistributedMapCache/PutDistributedMapCache in Minifi > Steps: > 1. Created config.yml from xml template in Nifi (Without any validation > errors) > 2. Copied NARs from Nifi and Copied in Minif Lib > 3. Started Minifi > Snapshot of Result: > 2017-09-21 18:01:04,842 INFO [StandardProcessScheduler Thread-5] > o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled > AttributesToJSON[id=89a3f404-af13-3b2a--] to run with 1 > threads > 2017-09-21 18:01:04,857 INFO [StandardProcessScheduler Thread-3] > o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled > EvaluateJsonPath[id=b1a92b2b-2a07-3d1a--] to run with 1 > threads > 2017-09-21 18:01:04,857 INFO [StandardProcessScheduler Thread-7] > o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled > EvaluateJsonPath[id=c73f92f1-124c-372e--] to run with 1 > threads > 2017-09-21 18:01:04,857 INFO [StandardProcessScheduler Thread-1] > o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled > ExecuteSQL[id=36b76b6f-5aac-3f44--] to run with 1 threads > 2017-09-21 18:01:04,857 INFO [StandardProcessScheduler Thread-2] > o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled > ExtractText[id=90eb5f1e-50fe-3a53--] to run with 1 threads > *2017-09-21 18:01:04,862 ERROR [main] o.apache.nifi.controller.FlowController > Unable to start > FetchDistributedMapCache[id=fb275d4d-36e6-3483--] due to > java.lang.IllegalStateException: Processor FetchDistributedMapCache is not in > a valid state due to ['Distributed Cache Service' validated against > '139d7094-b6c2-3a41--' is invalid because > DistributedMapCacheClientService - 1.2.0 from org.apache.nifi - > nifi-distributed-cache-services-nar is not compatible with > DistributedMapCacheClient - unversioned from default - system] > 2017-09-21 18:01:04,862 ERROR [main] o.apache.nifi.controller.FlowController > Unable to start > PutDistributedMapCache[id=ba406dd0-bced-3954--] due to > java.lang.IllegalStateException: Processor PutDistributedMapCache is not in a > valid state due to ['Distributed Cache Service' validated against > '139d7094-b6c2-3a41--' is invalid because > DistributedMapCacheClientService - 1.2.0 from org.apache.nifi - > nifi-distributed-cache-services-nar is not compatible with > DistributedMapCacheClient - unversioned from default - system]* > 2017-09-21 18:01:04,862 INFO [StandardProcessScheduler Thread-6] > o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled > PutFile[id=2a75ec11-50ea-3285--] to run with 1 threads > 2017-09-21 18:01:04,873 INFO [StandardProcessScheduler Thread-4] > o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled > ReplaceText[id=e7e92fc1-18ec-33a1--] to run with 1 threads > 2017-09-21 18:01:04,878 INFO [StandardProcessScheduler Thread-5] > o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled > SplitText[id=b865d9b7-c9ff-3741--] to run
[jira] [Commented] (MINIFI-403) Unable to start FetchDistributedMapCache/PutDistributedMapCache in Minifi
[ https://issues.apache.org/jira/browse/MINIFI-403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16190685#comment-16190685 ] Aldrin Piri commented on MINIFI-403: [~nishant.gupta] Was able to sit down and work through this and believe I have the issue figured out. There were some issues with some extraneous libraries that were being included that are more appropriately bundled with NARs. When this happens, they are treated by the bundling work with a BundleCoordinate of the default System approach. I've done some work to take care of this and am evaluating similar libraries to perform any additional cleanup that may be needed through similar circumstances. Thank you for reporting and the detailed information. A PR to resolve this will be available soon. > Unable to start FetchDistributedMapCache/PutDistributedMapCache in Minifi > - > > Key: MINIFI-403 > URL: https://issues.apache.org/jira/browse/MINIFI-403 > Project: Apache NiFi MiNiFi > Issue Type: Bug > Components: Agent Configuration/Installation >Affects Versions: 0.2.0 > Environment: Minifi - 0.2.0 > Nifi - 1.2.0/1.3.0 > OS - Windows 7 >Reporter: Nishant Gupta >Assignee: Aldrin Piri >Priority: Minor > Attachments: config.yml, minifi-app.log, minifi-bootstrap.log, Minifi > Lib.png, Minifi_RTS_M.xml > > > Description: > Unable to start FetchDistributedMapCache/PutDistributedMapCache in Minifi > Steps: > 1. Created config.yml from xml template in Nifi (Without any validation > errors) > 2. Copied NARs from Nifi and Copied in Minif Lib > 3. Started Minifi > Snapshot of Result: > 2017-09-21 18:01:04,842 INFO [StandardProcessScheduler Thread-5] > o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled > AttributesToJSON[id=89a3f404-af13-3b2a--] to run with 1 > threads > 2017-09-21 18:01:04,857 INFO [StandardProcessScheduler Thread-3] > o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled > EvaluateJsonPath[id=b1a92b2b-2a07-3d1a--] to run with 1 > threads > 2017-09-21 18:01:04,857 INFO [StandardProcessScheduler Thread-7] > o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled > EvaluateJsonPath[id=c73f92f1-124c-372e--] to run with 1 > threads > 2017-09-21 18:01:04,857 INFO [StandardProcessScheduler Thread-1] > o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled > ExecuteSQL[id=36b76b6f-5aac-3f44--] to run with 1 threads > 2017-09-21 18:01:04,857 INFO [StandardProcessScheduler Thread-2] > o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled > ExtractText[id=90eb5f1e-50fe-3a53--] to run with 1 threads > *2017-09-21 18:01:04,862 ERROR [main] o.apache.nifi.controller.FlowController > Unable to start > FetchDistributedMapCache[id=fb275d4d-36e6-3483--] due to > java.lang.IllegalStateException: Processor FetchDistributedMapCache is not in > a valid state due to ['Distributed Cache Service' validated against > '139d7094-b6c2-3a41--' is invalid because > DistributedMapCacheClientService - 1.2.0 from org.apache.nifi - > nifi-distributed-cache-services-nar is not compatible with > DistributedMapCacheClient - unversioned from default - system] > 2017-09-21 18:01:04,862 ERROR [main] o.apache.nifi.controller.FlowController > Unable to start > PutDistributedMapCache[id=ba406dd0-bced-3954--] due to > java.lang.IllegalStateException: Processor PutDistributedMapCache is not in a > valid state due to ['Distributed Cache Service' validated against > '139d7094-b6c2-3a41--' is invalid because > DistributedMapCacheClientService - 1.2.0 from org.apache.nifi - > nifi-distributed-cache-services-nar is not compatible with > DistributedMapCacheClient - unversioned from default - system]* > 2017-09-21 18:01:04,862 INFO [StandardProcessScheduler Thread-6] > o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled > PutFile[id=2a75ec11-50ea-3285--] to run with 1 threads > 2017-09-21 18:01:04,873 INFO [StandardProcessScheduler Thread-4] > o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled > ReplaceText[id=e7e92fc1-18ec-33a1--] to run with 1 threads > 2017-09-21 18:01:04,878 INFO [StandardProcessScheduler Thread-5] > o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled > SplitText[id=b865d9b7-c9ff-3741--] to run with 1 threads > 2017-09-21 18:01:04,879 INFO [StandardProcessScheduler Thread-2] > org.eclipse.jetty.util.log Logging initialized @87844ms to > org.eclipse.jetty.util.log.Slf4jLog > 2017-09-21 18:01:04,890 INFO [main] o.apache.nifi.controller.FlowController > Started 0 Remote Group Ports transmitting > 2017-09-21 18:01:04,890 INFO [StandardProcessScheduler Thread-7] > o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled >
[1/5] nifi git commit: NIFI-4328: - Upgrading swagger and the corresponding maven plugin to address issues discovered in recursive domain models.
Repository: nifi Updated Branches: refs/heads/master 58e4fb576 -> e773fa551 http://git-wip-us.apache.org/repos/asf/nifi/blob/697c382d/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-api/src/main/java/org/apache/nifi/web/api/LabelResource.java -- diff --git a/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-api/src/main/java/org/apache/nifi/web/api/LabelResource.java b/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-api/src/main/java/org/apache/nifi/web/api/LabelResource.java index 2816d25..d34eb74 100644 --- a/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-api/src/main/java/org/apache/nifi/web/api/LabelResource.java +++ b/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-api/src/main/java/org/apache/nifi/web/api/LabelResource.java @@ -16,12 +16,12 @@ */ package org.apache.nifi.web.api; -import com.wordnik.swagger.annotations.Api; -import com.wordnik.swagger.annotations.ApiOperation; -import com.wordnik.swagger.annotations.ApiParam; -import com.wordnik.swagger.annotations.ApiResponse; -import com.wordnik.swagger.annotations.ApiResponses; -import com.wordnik.swagger.annotations.Authorization; +import io.swagger.annotations.Api; +import io.swagger.annotations.ApiOperation; +import io.swagger.annotations.ApiParam; +import io.swagger.annotations.ApiResponse; +import io.swagger.annotations.ApiResponses; +import io.swagger.annotations.Authorization; import org.apache.commons.lang3.StringUtils; import org.apache.nifi.authorization.Authorizer; import org.apache.nifi.authorization.RequestAction; @@ -102,7 +102,7 @@ public class LabelResource extends ApplicationResource { value = "Gets a label", response = LabelEntity.class, authorizations = { -@Authorization(value = "Read - /labels/{uuid}", type = "") +@Authorization(value = "Read - /labels/{uuid}") } ) @ApiResponses( @@ -154,7 +154,7 @@ public class LabelResource extends ApplicationResource { value = "Updates a label", response = LabelEntity.class, authorizations = { -@Authorization(value = "Write - /labels/{uuid}", type = "") +@Authorization(value = "Write - /labels/{uuid}") } ) @ApiResponses( @@ -244,8 +244,8 @@ public class LabelResource extends ApplicationResource { value = "Deletes a label", response = LabelEntity.class, authorizations = { -@Authorization(value = "Write - /labels/{uuid}", type = ""), -@Authorization(value = "Write - Parent Process Group - /process-groups/{uuid}", type = "") +@Authorization(value = "Write - /labels/{uuid}"), +@Authorization(value = "Write - Parent Process Group - /process-groups/{uuid}") } ) @ApiResponses( http://git-wip-us.apache.org/repos/asf/nifi/blob/697c382d/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-api/src/main/java/org/apache/nifi/web/api/OutputPortResource.java -- diff --git a/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-api/src/main/java/org/apache/nifi/web/api/OutputPortResource.java b/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-api/src/main/java/org/apache/nifi/web/api/OutputPortResource.java index 0c49b0a..bccca57 100644 --- a/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-api/src/main/java/org/apache/nifi/web/api/OutputPortResource.java +++ b/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-api/src/main/java/org/apache/nifi/web/api/OutputPortResource.java @@ -16,12 +16,12 @@ */ package org.apache.nifi.web.api; -import com.wordnik.swagger.annotations.Api; -import com.wordnik.swagger.annotations.ApiOperation; -import com.wordnik.swagger.annotations.ApiParam; -import com.wordnik.swagger.annotations.ApiResponse; -import com.wordnik.swagger.annotations.ApiResponses; -import com.wordnik.swagger.annotations.Authorization; +import io.swagger.annotations.Api; +import io.swagger.annotations.ApiOperation; +import io.swagger.annotations.ApiParam; +import io.swagger.annotations.ApiResponse; +import io.swagger.annotations.ApiResponses; +import io.swagger.annotations.Authorization; import org.apache.commons.lang3.StringUtils; import org.apache.nifi.authorization.Authorizer; import org.apache.nifi.authorization.RequestAction; @@ -102,7 +102,7 @@ public class OutputPortResource extends ApplicationResource { value = "Gets an output port", response = PortEntity.class, authorizations = { -@Authorization(value = "Read -
[3/5] nifi git commit: NIFI-4328: - Upgrading swagger and the corresponding maven plugin to address issues discovered in recursive domain models.
http://git-wip-us.apache.org/repos/asf/nifi/blob/697c382d/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/dto/TenantDTO.java -- diff --git a/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/dto/TenantDTO.java b/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/dto/TenantDTO.java index cc44403..1dd1d6c 100644 --- a/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/dto/TenantDTO.java +++ b/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/dto/TenantDTO.java @@ -16,7 +16,7 @@ */ package org.apache.nifi.web.api.dto; -import com.wordnik.swagger.annotations.ApiModelProperty; +import io.swagger.annotations.ApiModelProperty; import javax.xml.bind.annotation.XmlType; http://git-wip-us.apache.org/repos/asf/nifi/blob/697c382d/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/dto/UserDTO.java -- diff --git a/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/dto/UserDTO.java b/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/dto/UserDTO.java index e86630c..3a2113e 100644 --- a/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/dto/UserDTO.java +++ b/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/dto/UserDTO.java @@ -16,7 +16,7 @@ */ package org.apache.nifi.web.api.dto; -import com.wordnik.swagger.annotations.ApiModelProperty; +import io.swagger.annotations.ApiModelProperty; import org.apache.nifi.web.api.entity.AccessPolicySummaryEntity; import org.apache.nifi.web.api.entity.TenantEntity; http://git-wip-us.apache.org/repos/asf/nifi/blob/697c382d/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/dto/UserGroupDTO.java -- diff --git a/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/dto/UserGroupDTO.java b/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/dto/UserGroupDTO.java index 17de4de..7978445 100644 --- a/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/dto/UserGroupDTO.java +++ b/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/dto/UserGroupDTO.java @@ -16,7 +16,7 @@ */ package org.apache.nifi.web.api.dto; -import com.wordnik.swagger.annotations.ApiModelProperty; +import io.swagger.annotations.ApiModelProperty; import org.apache.nifi.web.api.entity.AccessPolicyEntity; import org.apache.nifi.web.api.entity.TenantEntity; http://git-wip-us.apache.org/repos/asf/nifi/blob/697c382d/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/dto/VariableDTO.java -- diff --git a/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/dto/VariableDTO.java b/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/dto/VariableDTO.java index 89ea27a..f119e10 100644 --- a/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/dto/VariableDTO.java +++ b/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/dto/VariableDTO.java @@ -17,7 +17,7 @@ package org.apache.nifi.web.api.dto; -import com.wordnik.swagger.annotations.ApiModelProperty; +import io.swagger.annotations.ApiModelProperty; import org.apache.nifi.web.api.entity.AffectedComponentEntity; import javax.xml.bind.annotation.XmlType; http://git-wip-us.apache.org/repos/asf/nifi/blob/697c382d/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/dto/VariableRegistryDTO.java -- diff --git a/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/dto/VariableRegistryDTO.java b/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/dto/VariableRegistryDTO.java index 8f37532..87af557 100644 ---
[5/5] nifi git commit: NIFI-4328: Fix to pom.xml for swagger maven plugin. This closes #2191.
NIFI-4328: Fix to pom.xml for swagger maven plugin. This closes #2191. Project: http://git-wip-us.apache.org/repos/asf/nifi/repo Commit: http://git-wip-us.apache.org/repos/asf/nifi/commit/e773fa55 Tree: http://git-wip-us.apache.org/repos/asf/nifi/tree/e773fa55 Diff: http://git-wip-us.apache.org/repos/asf/nifi/diff/e773fa55 Branch: refs/heads/master Commit: e773fa551362d9adf9c9544b1525fd38e9c07887 Parents: 697c382 Author: Mark PayneAuthored: Tue Oct 3 13:23:14 2017 -0400 Committer: Mark Payne Committed: Tue Oct 3 13:23:58 2017 -0400 -- .../nifi-framework/nifi-web/nifi-web-api/pom.xml| 9 +++-- 1 file changed, 7 insertions(+), 2 deletions(-) -- http://git-wip-us.apache.org/repos/asf/nifi/blob/e773fa55/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-api/pom.xml -- diff --git a/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-api/pom.xml b/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-api/pom.xml index 4dfc2cd..e61bfa8 100644 --- a/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-api/pom.xml +++ b/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-api/pom.xml @@ -69,8 +69,13 @@ - org.apache.nifi.web.api -http,https + + org.apache.nifi.web.api + + +http +https + /nifi-api NiFi Rest Api
[2/5] nifi git commit: NIFI-4328: - Upgrading swagger and the corresponding maven plugin to address issues discovered in recursive domain models.
http://git-wip-us.apache.org/repos/asf/nifi/blob/697c382d/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/entity/CreateTemplateRequestEntity.java -- diff --git a/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/entity/CreateTemplateRequestEntity.java b/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/entity/CreateTemplateRequestEntity.java index 865631a..1e0ffb3 100644 --- a/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/entity/CreateTemplateRequestEntity.java +++ b/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/entity/CreateTemplateRequestEntity.java @@ -16,7 +16,7 @@ */ package org.apache.nifi.web.api.entity; -import com.wordnik.swagger.annotations.ApiModelProperty; +import io.swagger.annotations.ApiModelProperty; import javax.xml.bind.annotation.XmlRootElement; http://git-wip-us.apache.org/repos/asf/nifi/blob/697c382d/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/entity/CurrentUserEntity.java -- diff --git a/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/entity/CurrentUserEntity.java b/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/entity/CurrentUserEntity.java index d24ce67..6b8e28f 100644 --- a/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/entity/CurrentUserEntity.java +++ b/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/entity/CurrentUserEntity.java @@ -16,7 +16,7 @@ */ package org.apache.nifi.web.api.entity; -import com.wordnik.swagger.annotations.ApiModelProperty; +import io.swagger.annotations.ApiModelProperty; import org.apache.nifi.web.api.dto.PermissionsDTO; import javax.xml.bind.annotation.XmlRootElement; http://git-wip-us.apache.org/repos/asf/nifi/blob/697c382d/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/entity/FlowBreadcrumbEntity.java -- diff --git a/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/entity/FlowBreadcrumbEntity.java b/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/entity/FlowBreadcrumbEntity.java index 4b042f7..b97b9b3 100644 --- a/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/entity/FlowBreadcrumbEntity.java +++ b/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/entity/FlowBreadcrumbEntity.java @@ -16,7 +16,7 @@ */ package org.apache.nifi.web.api.entity; -import com.wordnik.swagger.annotations.ApiModelProperty; +import io.swagger.annotations.ApiModelProperty; import org.apache.nifi.web.api.dto.PermissionsDTO; import org.apache.nifi.web.api.dto.flow.FlowBreadcrumbDTO; http://git-wip-us.apache.org/repos/asf/nifi/blob/697c382d/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/entity/FlowConfigurationEntity.java -- diff --git a/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/entity/FlowConfigurationEntity.java b/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/entity/FlowConfigurationEntity.java index 54af4d4..52b01d4 100644 --- a/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/entity/FlowConfigurationEntity.java +++ b/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/entity/FlowConfigurationEntity.java @@ -16,7 +16,7 @@ */ package org.apache.nifi.web.api.entity; -import com.wordnik.swagger.annotations.ApiModelProperty; +import io.swagger.annotations.ApiModelProperty; import org.apache.nifi.web.api.dto.FlowConfigurationDTO; import javax.xml.bind.annotation.XmlRootElement; http://git-wip-us.apache.org/repos/asf/nifi/blob/697c382d/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-client-dto/src/main/java/org/apache/nifi/web/api/entity/InstantiateTemplateRequestEntity.java -- diff --git
[4/5] nifi git commit: NIFI-4328: - Upgrading swagger and the corresponding maven plugin to address issues discovered in recursive domain models.
NIFI-4328: - Upgrading swagger and the corresponding maven plugin to address issues discovered in recursive domain models. Project: http://git-wip-us.apache.org/repos/asf/nifi/repo Commit: http://git-wip-us.apache.org/repos/asf/nifi/commit/697c382d Tree: http://git-wip-us.apache.org/repos/asf/nifi/tree/697c382d Diff: http://git-wip-us.apache.org/repos/asf/nifi/diff/697c382d Branch: refs/heads/master Commit: 697c382d9bd4a3aaa05bc28b64a5e74592101c61 Parents: 58e4fb5 Author: Matt GilmanAuthored: Thu Sep 28 11:02:27 2017 -0400 Committer: Matt Gilman Committed: Tue Oct 3 09:50:11 2017 -0400 -- .../nifi-framework/nifi-client-dto/pom.xml | 2 +- .../org/apache/nifi/web/api/dto/AboutDTO.java | 2 +- .../web/api/dto/AccessConfigurationDTO.java | 3 +- .../nifi/web/api/dto/AccessPolicyDTO.java | 2 +- .../web/api/dto/AccessPolicySummaryDTO.java | 2 +- .../nifi/web/api/dto/AccessStatusDTO.java | 3 +- .../nifi/web/api/dto/AffectedComponentDTO.java | 2 +- .../nifi/web/api/dto/AllowableValueDTO.java | 2 +- .../org/apache/nifi/web/api/dto/BannerDTO.java | 3 +- .../nifi/web/api/dto/BatchSettingsDTO.java | 2 +- .../nifi/web/api/dto/BulletinBoardDTO.java | 10 +- .../apache/nifi/web/api/dto/BulletinDTO.java| 2 +- .../nifi/web/api/dto/BulletinQueryDTO.java | 3 +- .../org/apache/nifi/web/api/dto/BundleDTO.java | 2 +- .../org/apache/nifi/web/api/dto/ClusterDTO.java | 8 +- .../nifi/web/api/dto/ClusterSummaryDTO.java | 2 +- .../apache/nifi/web/api/dto/ComponentDTO.java | 3 +- .../nifi/web/api/dto/ComponentHistoryDTO.java | 5 +- .../nifi/web/api/dto/ComponentReferenceDTO.java | 2 +- .../nifi/web/api/dto/ComponentStateDTO.java | 2 +- .../apache/nifi/web/api/dto/ConnectableDTO.java | 3 +- .../apache/nifi/web/api/dto/ConnectionDTO.java | 5 +- .../web/api/dto/ControllerConfigurationDTO.java | 2 +- .../apache/nifi/web/api/dto/ControllerDTO.java | 5 +- .../web/api/dto/ControllerServiceApiDTO.java| 2 +- .../nifi/web/api/dto/ControllerServiceDTO.java | 2 +- ...ontrollerServiceReferencingComponentDTO.java | 2 +- .../org/apache/nifi/web/api/dto/CounterDTO.java | 2 +- .../apache/nifi/web/api/dto/CountersDTO.java| 5 +- .../nifi/web/api/dto/CountersSnapshotDTO.java | 13 +-- .../apache/nifi/web/api/dto/DimensionsDTO.java | 2 +- .../nifi/web/api/dto/DocumentedTypeDTO.java | 2 +- .../apache/nifi/web/api/dto/DropRequestDTO.java | 7 +- .../nifi/web/api/dto/FlowConfigurationDTO.java | 2 +- .../apache/nifi/web/api/dto/FlowFileDTO.java| 2 +- .../nifi/web/api/dto/FlowFileSummaryDTO.java| 2 +- .../apache/nifi/web/api/dto/FlowSnippetDTO.java | 2 +- .../org/apache/nifi/web/api/dto/LabelDTO.java | 4 +- .../nifi/web/api/dto/ListingRequestDTO.java | 12 +-- .../web/api/dto/NodeCountersSnapshotDTO.java| 4 +- .../org/apache/nifi/web/api/dto/NodeDTO.java| 2 +- .../apache/nifi/web/api/dto/NodeEventDTO.java | 7 +- .../dto/NodeSystemDiagnosticsSnapshotDTO.java | 4 +- .../apache/nifi/web/api/dto/PermissionsDTO.java | 2 +- .../org/apache/nifi/web/api/dto/PortDTO.java| 5 +- .../apache/nifi/web/api/dto/PositionDTO.java| 3 +- .../nifi/web/api/dto/PreviousValueDTO.java | 2 +- .../nifi/web/api/dto/ProcessGroupDTO.java | 5 +- .../nifi/web/api/dto/ProcessorConfigDTO.java| 6 +- .../apache/nifi/web/api/dto/ProcessorDTO.java | 2 +- .../nifi/web/api/dto/PropertyDescriptorDTO.java | 2 +- .../nifi/web/api/dto/PropertyHistoryDTO.java| 5 +- .../apache/nifi/web/api/dto/QueueSizeDTO.java | 2 +- .../nifi/web/api/dto/ReadablePermission.java| 2 +- .../nifi/web/api/dto/RelationshipDTO.java | 3 +- .../api/dto/RemoteProcessGroupContentsDTO.java | 5 +- .../nifi/web/api/dto/RemoteProcessGroupDTO.java | 2 +- .../web/api/dto/RemoteProcessGroupPortDTO.java | 3 +- .../nifi/web/api/dto/ReportingTaskDTO.java | 2 +- .../apache/nifi/web/api/dto/ResourceDTO.java| 2 +- .../apache/nifi/web/api/dto/RevisionDTO.java| 2 +- .../org/apache/nifi/web/api/dto/SnippetDTO.java | 7 +- .../apache/nifi/web/api/dto/StateEntryDTO.java | 2 +- .../apache/nifi/web/api/dto/StateMapDTO.java| 2 +- .../nifi/web/api/dto/SystemDiagnosticsDTO.java | 5 +- .../api/dto/SystemDiagnosticsSnapshotDTO.java | 2 +- .../apache/nifi/web/api/dto/TemplateDTO.java| 2 +- .../org/apache/nifi/web/api/dto/TenantDTO.java | 2 +- .../org/apache/nifi/web/api/dto/UserDTO.java| 2 +- .../apache/nifi/web/api/dto/UserGroupDTO.java | 2 +- .../apache/nifi/web/api/dto/VariableDTO.java| 2 +- .../nifi/web/api/dto/VariableRegistryDTO.java | 2 +- .../dto/VariableRegistryUpdateRequestDTO.java | 2 +-
[nifi] Git Push Summary
Repository: nifi Updated Tags: refs/tags/rel/nifi-1.4.0 [created] beae8b81c
svn commit: r1811008 [36/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compo
Added: nifi/site/trunk/docs/nifi-docs/html/overview.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/html/overview.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/html/overview.html (added) +++ nifi/site/trunk/docs/nifi-docs/html/overview.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1,923 @@ + + + + + + + + + +Apache NiFi Overview + +/* Asciidoctor default stylesheet | MIT License | http://asciidoctor.org */ +/* Copyright (C) 2012-2015 Dan Allen, Ryan Waldron and the Asciidoctor Project + +Permission is hereby granted, free of charge, to any person obtaining a copy +of this software and associated documentation files (the "Software"), to deal +in the Software without restriction, including without limitation the rights +to use, copy, modify, merge, publish, distribute, sublicense, and/or sell +copies of the Software, and to permit persons to whom the Software is +furnished to do so, subject to the following conditions: + +The above copyright notice and this permission notice shall be included in +all copies or substantial portions of the Software. + +THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR +IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, +FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE +AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER +LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, +OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN +THE SOFTWARE. */ +/* Remove the comments around the @import statement below when using this as a custom stylesheet */ +@import "https://fonts.googleapis.com/css?family=Open+Sans:300,300italic,400,400italic,600,600italic%7CNoto+Serif:400,400italic,700,700italic%7CDroid+Sans+Mono:400"; +article,aside,details,figcaption,figure,footer,header,hgroup,main,nav,section,summary{display:block} +audio,canvas,video{display:inline-block} +audio:not([controls]){display:none;height:0} +[hidden],template{display:none} +script{display:none!important} +html{font-family:sans-serif;-ms-text-size-adjust:100%;-webkit-text-size-adjust:100%} +body{margin:0} +a{background:transparent} +a:focus{outline:thin dotted} +a:active,a:hover{outline:0} +h1{font-size:2em;margin:.67em 0} +abbr[title]{border-bottom:1px dotted} +b,strong{font-weight:bold} +dfn{font-style:italic} +hr{-moz-box-sizing:content-box;box-sizing:content-box;height:0} +mark{background:#ff0;color:#000} +code,kbd,pre,samp{font-family:monospace;font-size:1em} +pre{white-space:pre-wrap} +q{quotes:"\201C" "\201D" "\2018" "\2019"} +small{font-size:80%} +sub,sup{font-size:75%;line-height:0;position:relative;vertical-align:baseline} +sup{top:-.5em} +sub{bottom:-.25em} +img{border:0} +svg:not(:root){overflow:hidden} +figure{margin:0} +fieldset{border:1px solid silver;margin:0 2px;padding:.35em .625em .75em} +legend{border:0;padding:0} +button,input,select,textarea{font-family:inherit;font-size:100%;margin:0} +button,input{line-height:normal} +button,select{text-transform:none} +button,html input[type="button"],input[type="reset"],input[type="submit"]{-webkit-appearance:button;cursor:pointer} +button[disabled],html input[disabled]{cursor:default} +input[type="checkbox"],input[type="radio"]{box-sizing:border-box;padding:0} +input[type="search"]{-webkit-appearance:textfield;-moz-box-sizing:content-box;-webkit-box-sizing:content-box;box-sizing:content-box} +input[type="search"]::-webkit-search-cancel-button,input[type="search"]::-webkit-search-decoration{-webkit-appearance:none} +button::-moz-focus-inner,input::-moz-focus-inner{border:0;padding:0} +textarea{overflow:auto;vertical-align:top} +table{border-collapse:collapse;border-spacing:0} +*,*:before,*:after{-moz-box-sizing:border-box;-webkit-box-sizing:border-box;box-sizing:border-box} +html,body{font-size:100%} +body{background:#fff;color:rgba(0,0,0,.8);padding:0;margin:0;font-family:"Noto Serif","DejaVu Serif",serif;font-weight:400;font-style:normal;line-height:1;position:relative;cursor:auto} +a:hover{cursor:pointer} +img,object,embed{max-width:100%;height:auto} +object,embed{height:100%} +img{-ms-interpolation-mode:bicubic} +#map_canvas img,#map_canvas embed,#map_canvas object,.map_canvas img,.map_canvas embed,.map_canvas object{max-width:none!important} +.left{float:left!important} +.right{float:right!important} +.text-left{text-align:left!important} +.text-right{text-align:right!important} +.text-center{text-align:center!important} +.text-justify{text-align:justify!important} +.hide{display:none} +.antialiased,body{-webkit-font-smoothing:antialiased}
svn commit: r1811008 [8/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compon
Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-gcp-nar/1.4.0/org.apache.nifi.processors.gcp.storage.PutGCSObject/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-gcp-nar/1.4.0/org.apache.nifi.processors.gcp.storage.PutGCSObject/index.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-gcp-nar/1.4.0/org.apache.nifi.processors.gcp.storage.PutGCSObject/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-gcp-nar/1.4.0/org.apache.nifi.processors.gcp.storage.PutGCSObject/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1 @@ +PutGCSObjectwindow.onload = function(){if(self==top) { document.getElementById('nameHeader').style.display = "inherit"; } }PutGCSObjectDescription: Puts flow files to a Google Cloud Bucket.Tags: google, google cloud, gcs, archive, putProperties: In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values, whether a property supports the NiFi Expression Language, and whether a property is considered "sensitive", meaning that its value will be encrypted. Before entering a value in a sensitive property, ensure that the nifi.properties file has an entry for the property nifi.sensitive.props.key.NameDefault ValueAllowable ValuesDescriptionGCP Credentials Provider ServiceController Service API: GCPCredentialsServiceImplementation: GCPCredentialsControllerServiceThe Controller Service used to obtain Google Cloud Platform credentials.Project IDGoogle Cloud Project IDNumber of retries6How many retry attempts should be made before routing to the failure relationship.Bucket${gcs.bucket}Bucket of the object.Supports Expression Language: trueKey${filename}Name of the object.Supports Expression Language: trueContent Type${mime.type}Content Type for the file, i.e. text/plainSupports Expression Language: trueMD5 HashMD5 Hash (encoded in Base64) of the file for server-side validatio n.Supports Expression Language: trueCRC32C ChecksumCRC32C Checksum (encoded in Base64, big-Endian order) of the file for server-side validation.Supports Expression Language: trueObject ACLAll Authenticated Users Authenticated Read Bucket Owner Full Control Bucket Owner Read Only Private Project Private Public Read Only Access Control to be attached to the object uploaded. Not providing this will revert to bucket defaults.Server Side Encryption KeyAn AES256 Encryption Key (encoded in base64) for server-side encryption of the object.Sensitive Property: trueSuppor ts Expression Language: trueOverwrite ObjecttruetruefalseIf false, the upload to GCS will succeed only if the object does not exist.Content Disposition TypeInline Attachment Type of RFC-6266 Content Disposition to be attached to the objectDynamic Properties: Dynamic Properties allow the user to specify both the name and value of a property.NameValueDescriptionThe name of a User-Defined Metadata field to add to the GCS ObjectThe value of a User-Defined Metadata field to add to the GCS ObjectAllows user-defined metadata to be added to the GCS object as key/value pairsSupports Expression Language: trueRelationships: NameDescriptionsuccessFlowFiles are routed to this relationship after a successful Google Cloud Storage operation.failureFlowFiles are routed to this relationship if the Google Cloud Storage operation fails.Reads Attributes : NameDescriptionfilenameUses the FlowFile's filename as the filename for the GCS objectmime.typeUses the FlowFile's MIME type as the content-type for the GCS objectWrites Attributes: NameDescriptiongcs.bucketBucket of the object.gcs.keyName of the object.gcs.sizeSize of the object.gcs.cache.controlData cache control of the object.gcs.component.countThe number of components which make up the object.gcs.content.dispositionThe data content disposition of the object.gcs.content.encodingThe content encoding of the object.gcs.content.languageThe content language of the object.mime.t ypeThe MIME/Content-Type of the objectgcs.crc32cThe CRC32C checksum of object's data, encoded in base64 in big-endian order.gcs.create.timeThe creation time of the object (milliseconds)gcs.update.timeThe last modification time of the object (milliseconds)gcs.encryption.algorithmThe algorithm used to encrypt the object.gcs.encryption.sha256The SHA256 hash of the key used to encrypt the objectgcs.etagThe HTTP 1.1 Entity tag for the object.gcs.generated.idThe service-generated for the objectgcs.generationThe data generation of the object.gcs.md5The MD5 hash of the object's data encoded in base64.gcs.media.linkThe media download link to the object.gcs.metagenerationThe metageneration of the object.gcs.ownerThe owner (uploader) of the object.gcs.owner.typeThe
svn commit: r1811008 [6/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compon
Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-elasticsearch-5-nar/1.4.0/org.apache.nifi.processors.elasticsearch.PutElasticsearch5/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-elasticsearch-5-nar/1.4.0/org.apache.nifi.processors.elasticsearch.PutElasticsearch5/index.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-elasticsearch-5-nar/1.4.0/org.apache.nifi.processors.elasticsearch.PutElasticsearch5/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-elasticsearch-5-nar/1.4.0/org.apache.nifi.processors.elasticsearch.PutElasticsearch5/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1 @@ +PutElasticsearch5window.onload = function(){if(self==top) { document.getElementById('nameHeader').style.display = "inherit"; } }PutElasticsearch5Description: Writes the contents of a FlowFile to Elasticsearch, using the specified parameters such as the index to insert into and the type of the document. If the cluster has been configured for authorization and/or secure transport (SSL/TLS), and the X-Pack plugin is available, secure connections can be made. This processor supports Elasticsearch 5.x clusters.Tags: elasticsearch, elasticsearch 5, insert, update, write, putProperties: In the list below, the names of required properties appear in bold. Any oth er properties (not in bold) are considered optional. The table also indicates any default values, whether a property supports the NiFi Expression Language, and whether a property is considered "sensitive", meaning that its value will be encrypted. Before entering a value in a sensitive property, ensure that the nifi.properties file has an entry for the property nifi.sensitive.props.key.NameDefault ValueAllowable ValuesDescriptionCluster NameelasticsearchName of the ES cluster (for example, elasticsearch_brew). Defaults to 'elasticsearch'Supports Expression Language: trueElasticSearch HostsElasticSearch Hosts, which should be comma separated and colon for hostname/port host1:port,host2:port, For example testcluster:9300. This processor uses the Transport Client to connect to hosts. The default transport client port is 9300.Supports Expression Language: trueSSL Context ServiceController Service API: SSLContextServiceImplementations: StandardSSLContextServiceStandardRestrictedSSLContextServiceThe SSL Context Service used to provide client certificate information for TLS/SSL connections. This service only app lies if the Elasticsearch endpoint(s) have been secured with TLS/SSL.X-Pack Transport LocationSpecifies the path to the JAR(s) for the Elasticsearch X-Pack Transport feature. If the Elasticsearch cluster has been secured with the X-Pack plugin, then the X-Pack Transport JARs must also be available to this processor. Note: Do NOT place the X-Pack JARs into NiFi's lib/ directory, doing so will prevent the X-Pack Transport JARs from being loaded.Supports Expression Language: trueUsernameUsername to access the Elasticsearch clusterSupports Expression Language: truePasswordPassword to access the Elasticsearch cl usterSensitive Property: trueElasticSearch Ping Timeout5sThe ping timeout used to determine when a node is unreachable. For example, 5s (5 seconds). If non-local recommended is 30sSupports Expression Language: trueSampler Interval5sHow often to sample / ping the nodes listed and connected. For example, 5s (5 seconds). If non-local recommended is 30s.Supports Expression Language: trueIdentifier AttributeThe name of the attribute containing the identifier for each FlowFileIndexThe name of the index to insert intoSupports Expression Language: trueTypeThe type of this document (used by Elasticsearch for indexing and searching)Supports Expression Language: trueCharacter SetUTF-8Specifies the character set of the document data.Supports Expression Language: trueBatch Size100The preferred number of FlowFiles to put to the database in a single transactionSupports Expression Language: trueIn dex OperationindexThe type of the operation used to index (index, update, upsert)Supports Expression Language: trueRelationships: NameDescriptionretryA FlowFile is routed to this relationship if the database cannot be updated but attempting the operation again may succeedsuccessAll FlowFiles that are written to Elasticsearch are routed to this relationshipfailureAll FlowFiles that cannot be written to Elasticsearch are routed to this relationshipReads Attributes: None specified.Writes Attributes: None specified.State management: This component does not store state.Restricted: This component is not restricted.Input requirement: This component requires an incom ing relationship.See Also:FetchElasticsearch5, PutElasticsearch5 \ No newline at end of file Added:
svn commit: r1811008 [15/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compo
Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-record-serialization-services-nar/1.4.0/org.apache.nifi.avro.AvroRecordSetWriter/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-record-serialization-services-nar/1.4.0/org.apache.nifi.avro.AvroRecordSetWriter/index.html?rev=1811008&view=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-record-serialization-services-nar/1.4.0/org.apache.nifi.avro.AvroRecordSetWriter/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-record-serialization-services-nar/1.4.0/org.apache.nifi.avro.AvroRecordSetWriter/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1 @@ +AvroRecordSetWriter AvroRecordSetWriter
Description:
Writes the contents of a RecordSet in Binary Avro format.
Tags:
avro, result, set, writer, serializer, record, recordset, row
Properties:
In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.
Name Default Value Allowable Values Description id="name">Schema Write Strategy id="default-value">avro-embedded
- Embed >Avro Schema
- Set 'schema.name' Attribute >
- Set 'avro.schema' Attribute
- HWX Schema Reference Attributes
- HWX Content-Encoded Schema Reference
svn commit: r1811008 [18/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compo
Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-social-media-nar/1.4.0/org.apache.nifi.processors.twitter.GetTwitter/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-social-media-nar/1.4.0/org.apache.nifi.processors.twitter.GetTwitter/index.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-social-media-nar/1.4.0/org.apache.nifi.processors.twitter.GetTwitter/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-social-media-nar/1.4.0/org.apache.nifi.processors.twitter.GetTwitter/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1 @@ +GetTwitterwindow.onload = function(){if(self==top) { document.getElementById('nameHeader').style.display = "inherit"; } }GetTwitterDescription: Pulls status changes from Twitter's streaming APITags: twitter, tweets, social media, status, jsonProperties: In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values, and whether a property is considered "sensitive", meaning that its value will be encrypted. Before entering a value in a sensitive property, ensure that the nifi.properties file has an entry for the property ni fi.sensitive.props.key.NameDefault ValueAllowable ValuesDescriptionTwitter EndpointSample EndpointSample Endpoint Firehose Endpoint Filter Endpoint Specifies which endpoint data should be pulled fromConsumer KeyThe Consumer Key provided by TwitterConsumer SecretThe Consumer Secret provided by TwitterSensitive Property: trueAccess TokenThe Access Token provided by TwitterAccess Token SecretThe Access Token Secret provided by TwitterSensitive Property: trueLanguagesA comma-separated list of lan guages for which tweets should be fetchedTerms to Filter OnA comma-separated list of terms to filter on. Ignored unless Endpoint is set to 'Filter Endpoint'. The filter works such that if any term matches, the status update will be retrieved; multiple terms separated by a space function as an 'AND'. I.e., 'it was, hello' will retrieve status updates that have either 'hello' or both 'it' AND 'was'IDs to FollowA comma-separated list of Twitter User ID's to follow. Ignored unless Endpoint is set to 'Filter Endpoint'.Locations to Filter OnA comma-separated list of coordinates specifying one or more bounding boxes to filter on.Each bounding box is specifi ed by a pair of coordinates in the format: swLon,swLat,neLon,neLat. Multiple bounding boxes can be specified as such: swLon1,swLat1,neLon1,neLat1,swLon2,swLat2,neLon2,neLat2.Ignored unless Endpoint is set to 'Filter Endpoint'.Relationships: NameDescriptionsuccessAll status updates will be routed to this relationshipReads Attributes: None specified.Writes Attributes: NameDescriptionmime.typeSets mime type to application/jsonState management: This component does not store state.Restricted: This component is not restricted.Input requirement: This component does not allow an incoming relationship. \ No newline at end of file Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-solr-nar/1.4.0/org.apache.nifi.processors.solr.GetSolr/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-solr-nar/1.4.0/org.apache.nifi.processors.solr.GetSolr/index.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-solr-nar/1.4.0/org.apache.nifi.processors.solr.GetSolr/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-solr-nar/1.4.0/org.apache.nifi.processors.solr.GetSolr/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1 @@ +GetSolrwindow.onload = function(){if(self==top) { document.getElementById('nameHeader').style.display = "inherit"; } }GetSolrDescription: Queries Solr and outputs the results as a FlowFileTags: Apache, Solr, Get, PullProperties: In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values, whether a property supports the NiFi Expression Language, and whether a property is considered "sensitive", meaning that its value will be encrypted. Before entering a value in a sensitive proper ty, ensure that the nifi.properties file has an entry for the property nifi.sensitive.props.key.NameDefault ValueAllowable ValuesDescriptionSolr TypeStandardCloud Standard The type of Solr instance, Cloud or Standard.Solr LocationThe Solr url for a Solr Type of Standard (ex: http://localhost:8984/solr/gettingstarted), or the ZooKeeper hosts for a Solr Type of Cloud (e x: localhost:9983).Supports Expression Language:
svn commit: r1811008 [33/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compo
Added: nifi/site/trunk/docs/nifi-docs/html/getting-started.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/html/getting-started.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/html/getting-started.html (added) +++ nifi/site/trunk/docs/nifi-docs/html/getting-started.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1,1630 @@ + + + + + + + + + +Getting Started with Apache NiFi + +/* Asciidoctor default stylesheet | MIT License | http://asciidoctor.org */ +/* Copyright (C) 2012-2015 Dan Allen, Ryan Waldron and the Asciidoctor Project + +Permission is hereby granted, free of charge, to any person obtaining a copy +of this software and associated documentation files (the "Software"), to deal +in the Software without restriction, including without limitation the rights +to use, copy, modify, merge, publish, distribute, sublicense, and/or sell +copies of the Software, and to permit persons to whom the Software is +furnished to do so, subject to the following conditions: + +The above copyright notice and this permission notice shall be included in +all copies or substantial portions of the Software. + +THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR +IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, +FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE +AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER +LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, +OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN +THE SOFTWARE. */ +/* Remove the comments around the @import statement below when using this as a custom stylesheet */ +@import "https://fonts.googleapis.com/css?family=Open+Sans:300,300italic,400,400italic,600,600italic%7CNoto+Serif:400,400italic,700,700italic%7CDroid+Sans+Mono:400"; +article,aside,details,figcaption,figure,footer,header,hgroup,main,nav,section,summary{display:block} +audio,canvas,video{display:inline-block} +audio:not([controls]){display:none;height:0} +[hidden],template{display:none} +script{display:none!important} +html{font-family:sans-serif;-ms-text-size-adjust:100%;-webkit-text-size-adjust:100%} +body{margin:0} +a{background:transparent} +a:focus{outline:thin dotted} +a:active,a:hover{outline:0} +h1{font-size:2em;margin:.67em 0} +abbr[title]{border-bottom:1px dotted} +b,strong{font-weight:bold} +dfn{font-style:italic} +hr{-moz-box-sizing:content-box;box-sizing:content-box;height:0} +mark{background:#ff0;color:#000} +code,kbd,pre,samp{font-family:monospace;font-size:1em} +pre{white-space:pre-wrap} +q{quotes:"\201C" "\201D" "\2018" "\2019"} +small{font-size:80%} +sub,sup{font-size:75%;line-height:0;position:relative;vertical-align:baseline} +sup{top:-.5em} +sub{bottom:-.25em} +img{border:0} +svg:not(:root){overflow:hidden} +figure{margin:0} +fieldset{border:1px solid silver;margin:0 2px;padding:.35em .625em .75em} +legend{border:0;padding:0} +button,input,select,textarea{font-family:inherit;font-size:100%;margin:0} +button,input{line-height:normal} +button,select{text-transform:none} +button,html input[type="button"],input[type="reset"],input[type="submit"]{-webkit-appearance:button;cursor:pointer} +button[disabled],html input[disabled]{cursor:default} +input[type="checkbox"],input[type="radio"]{box-sizing:border-box;padding:0} +input[type="search"]{-webkit-appearance:textfield;-moz-box-sizing:content-box;-webkit-box-sizing:content-box;box-sizing:content-box} +input[type="search"]::-webkit-search-cancel-button,input[type="search"]::-webkit-search-decoration{-webkit-appearance:none} +button::-moz-focus-inner,input::-moz-focus-inner{border:0;padding:0} +textarea{overflow:auto;vertical-align:top} +table{border-collapse:collapse;border-spacing:0} +*,*:before,*:after{-moz-box-sizing:border-box;-webkit-box-sizing:border-box;box-sizing:border-box} +html,body{font-size:100%} +body{background:#fff;color:rgba(0,0,0,.8);padding:0;margin:0;font-family:"Noto Serif","DejaVu Serif",serif;font-weight:400;font-style:normal;line-height:1;position:relative;cursor:auto} +a:hover{cursor:pointer} +img,object,embed{max-width:100%;height:auto} +object,embed{height:100%} +img{-ms-interpolation-mode:bicubic} +#map_canvas img,#map_canvas embed,#map_canvas object,.map_canvas img,.map_canvas embed,.map_canvas object{max-width:none!important} +.left{float:left!important} +.right{float:right!important} +.text-left{text-align:left!important} +.text-right{text-align:right!important} +.text-center{text-align:center!important} +.text-justify{text-align:justify!important} +.hide{display:none}
svn commit: r1811008 [21/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compo
Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.GenerateFlowFile/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.GenerateFlowFile/index.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.GenerateFlowFile/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.GenerateFlowFile/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1 @@ +GenerateFlowFilewindow.onload = function(){if(self==top) { document.getElementById('nameHeader').style.display = "inherit"; } }GenerateFlowFileDescription: This processor creates FlowFiles with random data or custom content. GenerateFlowFile is usefulfor load testing, configuration, and simulation.Tags: test, random, generateProperties: In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.NameDefault ValueAllowable ValuesDescriptionFile Size0BThe size of the file that will be usedBatch Size1The number of FlowFiles to be transferred in each invocationData FormatTextBinaryTextSpecifies whether the data should be Text or BinaryUnique FlowFilesfalsetruefalseIf true, each FlowFile that is generated will be unique. If false, a random value will be generated and all FlowFil es will get the same content but this offers much higher throughputCustom TextIf Data Format is text and if Unique FlowFiles is false, then this custom text will be used as content of the generated FlowFiles and the File Size will be ignored. Finally, if Expression Language is used, evaluation will be performed only once per batch of generated FlowFilesSupports Expression Language: trueCharacter SetUTF-8Specifies the character set to use when writing the bytes of Custom Text to a flow file.Dynamic Properties: Dynamic Properties allow the user to specify both the name and value of a property.NameValueDescriptionGenerated FlowFile attribute nameGenerated FlowFile >attribute valueSpecifies an attribute on generated FlowFiles defined >by the Dynamic Property's key and value. If Expression Language is used, >evaluation will be performed only once per batch of generated >FlowFiles.Supports Expression Language: >trueRelationships: id="relationships">NameDescriptionsuccessReads > Attributes: None specified.Writes Attributes: None >specified.State management: This component does not store >state.Restricted: This component is not restricted.Input >requirement: This component does not allow an incoming >relationship. \ No newline at end of file Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.GenerateTableFetch/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.GenerateTableFetch/index.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.GenerateTableFetch/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.GenerateTableFetch/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1,6 @@ +GenerateTableFetchwindow.onload = function(){if(self==top) { document.getElementById('nameHeader').style.display = "inherit"; } }GenerateTableFetchDescription: Generates SQL select queries that fetch "pages" of rows from a table. The partition size property, along with the table's row count, determine the size and number of pages and generated FlowFiles. In addition, incremental fetching can be achieved by setting Maximum-Value Columns, which causes the processor to track the columns' maximum values, thus only fetching rows whose columns' values exceed the observed maximums. This processor is intended to be run on the Primary Node only. + +This processor can accept incoming connections; the behavior of the processor is different whether incoming connections are provided: + - If no incoming connection(s) are specified, the processor will generate SQL queries on the specified processor schedule. Expression Language is supported for many fields, but no flow file attributes are available. However the properties will be evaluated using the Variable Registry. + - If incoming connection(s) are specified and no flow file is available to a
svn commit: r1811008 [11/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compo
Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-kafka-0-10-nar/1.4.0/org.apache.nifi.processors.kafka.pubsub.ConsumeKafka_0_10/additionalDetails.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-kafka-0-10-nar/1.4.0/org.apache.nifi.processors.kafka.pubsub.ConsumeKafka_0_10/additionalDetails.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-kafka-0-10-nar/1.4.0/org.apache.nifi.processors.kafka.pubsub.ConsumeKafka_0_10/additionalDetails.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-kafka-0-10-nar/1.4.0/org.apache.nifi.processors.kafka.pubsub.ConsumeKafka_0_10/additionalDetails.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1,142 @@ + + + + + +ConsumeKafka + + + + + +Description: + +This Processor polls http://kafka.apache.org/;>Apache Kafka +for data using KafkaConsumer API available with Kafka 0.10.x. When a message is received +from Kafka, this Processor emits a FlowFile where the content of the FlowFile is the value +of the Kafka message. + +Security Configuration: + +The Security Protocol property allows the user to specify the protocol for communicating +with the Kafka broker. The following sections describe each of the protocols in further detail. + +PLAINTEXT + +This option provides an unsecured connection to the broker, with no client authentication and no encryption. +In order to use this option the broker must be configured with a listener of the form: + +PLAINTEXT://host.name:port + + +SSL + +This option provides an encrypted connection to the broker, with optional client authentication. In order +to use this option the broker must be configured with a listener of the form: + +SSL://host.name:port + +In addition, the processor must have an SSL Context Service selected. + + +If the broker specifies ssl.client.auth=none, or does not specify ssl.client.auth, then the client will +not be required to present a certificate. In this case, the SSL Context Service selected may specify only +a truststore containing the public key of the certificate authority used to sign the broker's key. + + +If the broker specifies ssl.client.auth=required then the client will be required to present a certificate. +In this case, the SSL Context Service must also specify a keystore containing a client key, in addition to +a truststore as described above. + +SASL_PLAINTEXT + +This option uses SASL with a PLAINTEXT transport layer to authenticate to the broker. In order to use this +option the broker must be configured with a listener of the form: + +SASL_PLAINTEXT://host.name:port + +In addition, the Kerberos Service Name must be specified in the processor. + +SASL_PLAINTEXT - GSSAPI + +If the SASL mechanism is GSSAPI, then the client must provide a JAAS configuration to authenticate. The +JAAS configuration can be provided by specifying the java.security.auth.login.config system property in +NiFi's bootstrap.conf, such as: + + java.arg.16=-Djava.security.auth.login.config=/path/to/kafka_client_jaas.conf + + + +An example of the JAAS config file would be the following: + +KafkaClient { +com.sun.security.auth.module.Krb5LoginModule required +useKeyTab=true +storeKey=true +keyTab="/path/to/nifi.keytab" +serviceName="kafka" +principal="n...@yourrealm.com"; +}; + +NOTE: The serviceName in the JAAS file must match the Kerberos Service Name in the processor. + + +Alternatively, starting with Apache NiFi 1.2.0 which uses the Kafka 0.10.2 client, the JAAS +configuration when using GSSAPI can be provided by specifying the Kerberos Principal and Kerberos Keytab +directly in the processor properties. This will dynamically create a JAAS configuration like above, and +will take precedence over the java.security.auth.login.config system property. + +SASL_PLAINTEXT - PLAIN + +If the SASL mechanism is PLAIN, then client must provide a JAAS configuration to authenticate, but +the JAAS configuration must use Kafka's PlainLoginModule. An example of the JAAS config file would +be the following: +
svn commit: r1811008 [14/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compo
Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-media-nar/1.4.0/org.apache.nifi.processors.media.ExtractMediaMetadata/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-media-nar/1.4.0/org.apache.nifi.processors.media.ExtractMediaMetadata/index.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-media-nar/1.4.0/org.apache.nifi.processors.media.ExtractMediaMetadata/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-media-nar/1.4.0/org.apache.nifi.processors.media.ExtractMediaMetadata/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1 @@ +ExtractMediaMetadatawindow.onload = function(){if(self==top) { document.getElementById('nameHeader').style.display = "inherit"; } }ExtractMediaMetadataDescription: Extract the content metadata from flowfiles containing audio, video, image, and other file types. This processor relies on the Apache Tika project for file format detection and parsing. It extracts a long list of metadata types for media files including audio, video, and print media formats.NOTE: the attribute names and content extracted may vary across upgrades because parsing is performed by the external Tika tools which in turn depend on other projects for metadata extraction. For the more details and the list of supported file types, visit the library's website at http://tika.apache.org/.Tags: media, file, format, metadata, audio, video, image, document, pdfProperties: In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.NameDefault ValueAllowable ValuesDescriptionMax Number of Attributes100Specify the max number of attributes to add to the flowfile. There is no guarantee in what order the tags will be processed. By default it will process all of them.Max Attribute Length100 Specifies the maximum length of a single attribute value. When a metadata item has multiple values, they will be merged until this length is reached and then ", ..." will be added as an indicator that additional values where dropped. If a single value is longer than this, it will be truncated and "(truncated)" appended to indicate that truncation occurred.Metadata Key FilterA regular expression identifying which metadata keys received from the parser should be added to the flowfile attributes. If left blank, all metadata keys parsed will be added to the flowfile attributes.Metadata Key PrefixText to be prefixed to metadata keys as the are added to the flowfile attributes. It is recommended to end with with a separator character like '.' or '-', this is not automatically added by the processor.Supports Expression Language: trueRelationships: NameDescriptionsuccessAny FlowFile that successfully has media metadata extracted will be routed to successfailureAny FlowFile that fails to have media metadata extracted will be routed to failureReads Attributes: None specified.Writes Attributes: NameDescriptionMetadata Key PrefixattributeThe extracted content metadata will be inserted with the attribute name "Metadata Key Prefixattribute", or "attribute" if "Metadata Key Prefix" is not provided.State management: This component does not store state.Restricted: This comp onent is not restricted.Input requirement: This component requires an incoming relationship. \ No newline at end of file Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-mongodb-nar/1.4.0/org.apache.nifi.processors.mongodb.GetMongo/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-mongodb-nar/1.4.0/org.apache.nifi.processors.mongodb.GetMongo/index.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-mongodb-nar/1.4.0/org.apache.nifi.processors.mongodb.GetMongo/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-mongodb-nar/1.4.0/org.apache.nifi.processors.mongodb.GetMongo/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1 @@ +GetMongowindow.onload = function(){if(self==top) { document.getElementById('nameHeader').style.display = "inherit"; } }GetMongoDescription: Creates FlowFiles from documents in MongoDBTags: mongodb, read, getProperties: In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.NameDefault ValueAllowable ValuesDescriptionMo ngo URIMongoURI, typically of the form:
svn commit: r1811008 [29/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compo
Added: nifi/site/trunk/docs/nifi-docs/css/main.css URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/css/main.css?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/css/main.css (added) +++ nifi/site/trunk/docs/nifi-docs/css/main.css Tue Oct 3 13:30:16 2017 @@ -0,0 +1,217 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + * contributor license agreements. See the NOTICE file distributed with + * this work for additional information regarding copyright ownership. + * The ASF licenses this file to You under the Apache License, Version 2.0 + * (the "License"); you may not use this file except in compliance with + * the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, software + * distributed under the License is distributed on an "AS IS" BASIS, + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + * See the License for the specific language governing permissions and + * limitations under the License. + */ +* { +margin: 0; +padding: 0; +} + +#documentation-body { +width: 100%; +position: absolute; +top: 0; +right: 0; +bottom: 0; +left: 0; +} + +/* banners */ + +div.main-banner-header { +display: none; +font-weight: bold; +font-size: 1em; +text-align: center; +line-height: 15px; +color: #7e7e7e; +margin: 0px auto; +width: 100%; +height: 1em; +background-color: #fff; +background-image: url(../images/bgHeader.png); +background-position: center; +background-repeat: no-repeat; +} + +div.main-banner-footer { +display: none; +color: #fff; +text-align: center; +font-weight: bold; +font-size: 1em; +overflow: visible; +background-color: #9eb9c7; +background-image: url(../images/bgBannerFoot.png); +background-repeat: repeat-x; +background-position: left top; +} + +/* documentation */ + +div.documentation-header { +border-bottom: 1px solid #d1dee5; +color: #365c6a; +font-size: 13px; +display: flex; +} + +#component-list-toggle-link { +padding: 4px; +font-size: 14px; +font-weight: bold; +color: #264c58; +cursor: pointer; +width: 12px; +text-align: center; +align-self: flex-end; +} + +#header-contents { +display: flex; +flex-wrap: wrap; +} + +#nf-title { +font-size: 20px; +margin: 5px 5px 0px 5px; +} + +#nf-version { +font-size: 14px; +margin: 11px 5px 0px 5px; +flex-grow: 1; +} + +.version { +font-style: italic; +color: #aaa; +} + +#selected-component { +font-size: 20px; +margin: 5px 5px 0px 5px; +} + +/* content flex-box containers */ + +#component-root-container { +display: flex; +flex-wrap: wrap; +align-items: stretch; +width: 100%; +} + +#component-listing-container { +flex-grow: 1; +min-width: 312px; +max-width: 350px; +padding: 0px 4px 0px 4px; +} + +#component-usage-container { +flex-grow: 4; +min-width: 300px; +padding: 0px 4px 0px 4px; +} + +/* component listing */ + +div.component-listing { +overflow: auto; +font-size: 16px; +} + +div.component-listing div.section { +margin-bottom: 15px; +} + +div.component-listing div.header { +font-weight: bold; +color: #264c58; +} + +div.component-links ul { +list-style: none; +} + +li.component-item { +padding: 2px; +padding-left: 4px; +border-left: 8px solid transparent; +font-family: "Open Sans","DejaVu Sans",sans-serif; +font-size: 15px; +} + +li.component-item a { +color: #1e373f; +} + +li.component-item:hover { +border-left: 8px solid #d1dee5; +} + +li.component-item:hover a { +color: #264c58; +} + +li.component-item.selected { +border-left: 8px solid #7098ad; +} + +div.component-links span.no-components { +font-style: italic; +color: #777; +} + +/* component filter control */ + +#component-filter-controls { +} + +#component-filter-container { +margin-left: 2px; +} + +#component-filter { +font-size: 12px; +height: 18px; +line-height: 20px; +width: 98%; +float: left; +} + +input.component-filter-list { +color: #888; +font-style: italic; +} + +#component-filter-stats { +font-size: 9px; +font-weight: bold; +color: #9f6000; +clear: left; +line-height: normal; +margin-left: 7px; +} + +/* component usage */ + +#component-usage { +overflow: auto; +width: 100%; +height: 100%; +position: absolute; +} \ No newline at end of file
svn commit: r1811008 [2/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compon
Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-ambari-nar/1.4.0/org.apache.nifi.reporting.ambari.AmbariReportingTask/additionalDetails.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-ambari-nar/1.4.0/org.apache.nifi.reporting.ambari.AmbariReportingTask/additionalDetails.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-ambari-nar/1.4.0/org.apache.nifi.reporting.ambari.AmbariReportingTask/additionalDetails.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-ambari-nar/1.4.0/org.apache.nifi.reporting.ambari.AmbariReportingTask/additionalDetails.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1,57 @@ + + + + + +AmbariReportingTask + + + + +AmbariReportingTask + +This ReportingTask sends the following metrics to Ambari: + +FlowFilesReceivedLast5Minutes +BytesReceivedLast5Minutes +FlowFilesSentLast5Minutes +BytesSentLast5Minutes +FlowFilesQueued +BytesQueued +BytesReadLast5Minutes +BytesWrittenLast5Minutes +ActiveThreads +TotalTaskDurationSeconds +jvm.uptime +jvm.heap_used +jvm.heap_usage +jvm.non_heap_usage +jvm.thread_states.runnable +jvm.thread_states.blocked +jvm.thread_states.timed_waiting +jvm.thread_states.terminated +jvm.thread_count +jvm.daemon_thread_count +jvm.file_descriptor_usage +jvm.gc.runs +jvm.gc.time + + +In order to make use of these metrics in Ambari, a NIFI service must be created and installed +in Ambari. Please consult the Ambari and NiFi documentation for further details. + + + Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-ambari-nar/1.4.0/org.apache.nifi.reporting.ambari.AmbariReportingTask/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-ambari-nar/1.4.0/org.apache.nifi.reporting.ambari.AmbariReportingTask/index.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-ambari-nar/1.4.0/org.apache.nifi.reporting.ambari.AmbariReportingTask/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-ambari-nar/1.4.0/org.apache.nifi.reporting.ambari.AmbariReportingTask/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1 @@ +AmbariReportingTaskwindow.onload = function(){if(self==top) { document.getElementById('nameHeader').style.display = "inherit"; } }AmbariReportingTaskDescription: Publishes metrics from NiFi to Ambari Metrics Service (AMS). Due to how the Ambari Metrics Service works, this reporting task should be scheduled to run every 60 seconds. Each iteration it will send the metrics from the previous iteration, and calculate the current metrics to be sent on next iteration. Scheduling this reporting task at a frequency other than 60 seconds may produce unexpected results.Additional Details...Tags: reporting, ambari, metricsProperties: In th e list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.NameDefault ValueAllowable ValuesDescriptionMetrics Collector URLhttp://localhost:6188/ws/v1/timeline/metricsThe URL of the Ambari Metrics Collector ServiceSupports Expression Language: trueApplication IDnifiThe Application ID to be included in the metrics sent to AmbariSupports Expression Language: true< td id="name">Hostname${hostname(true)}The Hostname of this NiFi instance to be included in the metrics sent to AmbariSupports Expression Language: trueProcess Group IDIf specified, the reporting task will send metrics about this process group only. If not, the root process group is used and global metrics are sent.Supports Expression Language: trueState management: This component does not store state.Restricted: This component is not restricted. \ No newline at end of file Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-amqp-nar/1.4.0/org.apache.nifi.amqp.processors.ConsumeAMQP/additionalDetails.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-amqp-nar/1.4.0/org.apache.nifi.amqp.processors.ConsumeAMQP/additionalDetails.html?rev=1811008=auto == ---
svn commit: r1811008 [24/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compo
Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.MergeRecord/additionalDetails.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.MergeRecord/additionalDetails.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.MergeRecord/additionalDetails.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.MergeRecord/additionalDetails.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1,229 @@ + + + + + +MergeRecord + + + + + + +Introduction + + The MergeRecord Processor allows the user to take many FlowFiles that consist of record-oriented data (any data format for which there is + a Record Reader available) and combine the FlowFiles into one larger FlowFile. This may be preferable before pushing the data to a downstream + system that prefers larger batches of data, such as HDFS, or in order to improve performance of a NiFi flow by reducing the number of FlowFiles + that flow through the system (thereby reducing the contention placed on the FlowFile Repository, Provenance Repository, Content Repository, and + FlowFile Queues). + + + + The Processor creates several 'bins' to put the FlowFiles in. The maximum number of bins to use is set to 5 by default, but this can be changed + by updating the value of the Maximum number of Bins property. The number of bins is bound in order to avoid running out of Java heap space. + Note: while the contents of a FlowFile are stored in the Content Repository and not in the Java heap space, the Processor must hold the FlowFile + objects themselves in memory. As a result, these FlowFiles with their attributes can potentially take up a great deal of heap space and cause + OutOfMemoryError's to be thrown. In order to avoid this, if you expect to merge many small FlowFiles together, it is advisable to instead use a + MergeContent that merges no more than say 1,000 FlowFiles into a bundle and then use a second MergeContent to merges these small bundles into + larger bundles. For example, to merge 1,000,000 FlowFiles together, use MergeRecord that uses a Maximum Number of Records of 1,000 and route the + "merged" Relationship to a second MergeRecord that also sets the Maximum Number of Records to 1,000. The second MergeRecord will then merge 1,000 bundles + of 1,000, which in effect produces bundles of 1,000,000. + + + + + How FlowFiles are Binned + + How the Processor determines which bin to place a FlowFile in depends on a few different configuration options. Firstly, the Merge Strategy + is considered. The Merge Strategy can be set to one of two options: Bin Packing Algorithm, or Defragment. When the goal is to simply combine + smaller FlowFiles into one larger FlowFiles, the Bin Packing Algorithm should be used. This algorithm picks a bin based on whether or not the FlowFile + can fit in the bin according to its size and the Maximum Bin Size property and whether or not the FlowFile is 'like' the other FlowFiles in + the bin. What it means for two FlowFiles to be 'like FlowFiles' is discussed at the end of this section. + + + + The "Defragment" Merge Strategy can be used when records need to be explicitly assigned to the same bin. For example, if data is split apart using + the SplitRecord Processor, each 'split' can be processed independently and later merged back together using this Processor with the + Merge Strategy set to Defragment. In order for FlowFiles to be added to the same bin when using this configuration, the FlowFiles must have the same + value for the "fragment.identifier" attribute. Each FlowFile with the same identifier must also have the same value for the "fragment.count" attribute + (which indicates how many FlowFiles belong in the bin) and a unique value for the "fragment.index" attribute so that the FlowFiles can be ordered + correctly. + + + + In order to be added to the same bin, two FlowFiles must be 'like FlowFiles.' In order for two FlowFiles to be like FlowFiles, they must have the same + schema, and if the Correlation Attribute Name property is set, they must have the same value for the specified attribute. For example, if the + Correlation Attribute Name is set
svn commit: r1811008 [3/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compon
Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.4.0/org.apache.nifi.processors.aws.dynamodb.PutDynamoDB/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.4.0/org.apache.nifi.processors.aws.dynamodb.PutDynamoDB/index.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.4.0/org.apache.nifi.processors.aws.dynamodb.PutDynamoDB/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.4.0/org.apache.nifi.processors.aws.dynamodb.PutDynamoDB/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1 @@ +PutDynamoDBwindow.onload = function(){if(self==top) { document.getElementById('nameHeader').style.display = "inherit"; } }PutDynamoDBDescription: Puts a document from DynamoDB based on hash and range key. The table can have either hash and range or hash key alone. Currently the keys supported are string and number and value can be json document. In case of hash and range keys both key are required for the operation. The FlowFile content must be JSON. FlowFile content is mapped to the specified Json Document attribute in the DynamoDB item.Tags: Amazon, DynamoDB, AWS, Put, InsertProperties: In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also >indicates any default values, whether a property supports the href="../../../../../html/expression-language-guide.html">NiFi Expression >Language, and whether a property is considered "sensitive", meaning that >its value will be encrypted. Before entering a value in a sensitive property, >ensure that the nifi.properties file has an entry for the >property nifi.sensitive.props.key.id="properties">NameDefault ValueAllowable >ValuesDescriptionTable >Nameid="allowable-values">The DynamoDB table >nameSupports Expression Language: trueid="name">Hash Key Nameid="allowable-values">The hash key name of the >itemSupports Expression Language: trueRange Key NameThe range key name of the itemSupports Expression Language: trueHash Key Value${dynamodb.item.hash.key.value}The hash key value of the itemSupports Expression Language: trueRange Key Value${dynamodb.item.range.key.value}No Description Provided.Supports Expression Language: trueHash Key Value TypestringstringnumberThe hash key value type of the item Range Key Value TypestringstringnumberThe range key value type of the itemJson Document attributeThe Json document to be retrieved from the dynamodb itemSupports Expression Language: trueCharacter set of documentUTF-8Character set of data in the documentSupports Expression Language: trueBatch items for each request (between 1 and 50)1The items to be retrieved in one batchSupports Expression Language: trueRegionus-west-2us-gov-west-1 us-east-1 us-east-2 us-west-1 us-west-2 eu-west-1 eu-west-2 eu-central-1 ap-south-1 ap-southeast-1 ap-southeast-2 ap-northeast-1 ap-northeast-2 sa-east-1 cn-north-1 ca-central-1 No Description Provided.Access KeyNo Description Provided.Sensitive Property: trueSupports Expression Language: trueSecret KeyNo Description Provided.Sensitive Property: trueSupports Expression Language: trueCredentials FilePath to a file containing AWS access key and secret key in properties file format.AWS Credentials Provider serviceController Service API: AWSCredentialsProviderServiceImplementation: AWSCredentialsProviderControllerServiceThe Controller Service that is used to obtain aws credentials providerCommunications Timeout30 secsNo Description Provided.SSL Context ServiceController Service API: SSLContextServiceImplementations: StandardSSLContextServiceStandardRestrictedSSLContextServiceSpecifies an optional SSL Context Service that, if provided, will be used to create connectionsRelationships: NameDescriptionunprocessedFlowFiles are routed to unprocessed relationship when DynamoDB is not able to process all the items in the request. Typical reasons are insufficient table throughput capacity and exceeding the maximum bytes per request. Unprocessed FlowFiles can be retried with a new request.successFlowFiles are routed to success relationshipfailureFlowFiles are routed to failure relationshipReads Attributes: NameDescription dynamodb.item.hash.key.valueItems hash key value dynamodb.item.range.key.valueItems range key valueWrites Attributes: NameDescriptiondynamodb.key.error.unprocessedDynamo db unprocessed keysdynmodb.range.key.value.errorDynamod db range key errordynamodb.key.error.not.foundDynamo db key not founddynamodb.error.exception.messageDynamo db exception messagedynamodb.error.codeDynamo db error codedynamodb.error.messageDynamo db error messagedynamodb.error.typeDynamo db error typedynamodb.error.serviceDynamo db error
svn commit: r1811008 [27/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compo
Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.SplitText/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.SplitText/index.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.SplitText/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.SplitText/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1,2 @@ +SplitTextwindow.onload = function(){if(self==top) { document.getElementById('nameHeader').style.display = "inherit"; } }SplitTextDescription: Splits a text file into multiple smaller text files on line boundaries limited by maximum number of lines or total size of fragment. Each output split file will contain no more than the configured number of lines or bytes. If both Line Split Count and Maximum Fragment Size are specified, the split occurs at whichever limit is reached first. If the first line of a fragment exceeds the Maximum Fragment Size, that line will be output in a single split file which exceeds the configured maximum size limit. This component also allows one to specify that each split shou ld include a header lines. Header lines can be computed by either specifying the amount of lines that should constitute a header or by using header marker to match against the read lines. If such match happens then the corresponding line will be treated as header. Keep in mind that upon the first failure of header marker match, no more matches will be performed and the rest of the data will be parsed as regular lines for a given split. If after computation of the header there are no more data, the resulting split will consists of only header lines.Tags: split, textProperties: In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values.NameDefault ValueAllowable ValuesDescriptionLine Split CountThe number of lines that will be added to each split file, excluding header lines. A value of zero requires Maximum Fragment Size to be set, and line count will not be considered in determining splits.Maximum Fragment SizeThe maximum size of each split file, including header lines. NOTE: in the case where a single line exceeds this property (including headers, if applicable), that line will be output in a split of its own which exceeds this Maximum Fragment Size setting.Header Line Count0The number of lines that should be considered part of the header; the header lines will be duplicated to all split filesHeader Line Marker CharactersThe first character(s) on the line of the datafile which signifies a header line. This value is ignored when Header Line Count is non-zero. The first line not containing the Header Line Marker Characters and all subsequent lines are considered non-headerRemove Trailing NewlinestruetruefalseWhether to remove newlines at the end of each split file. This should be false if you intend to merge the split files later. If this is set to 'true' and a FlowFile is generated that contains only 'empty lines' (i.e., consists only of and + characters), the FlowFile will not be emitted. Note, however, that if header lines are specified, the resultant FlowFile will never be empty as it will consist of the header lines, so a FlowFile may be emitted that contains only the header lines.Relationships: NameDescriptionfailureIf a file cannot be split for some reason, the original file will be routed to this destination and nothing will be routed elsewhereoriginalThe original input file will be routed to this destination when it has been successfully split into 1 or more filessplitsThe split files will be routed to this destination when an input file is successfully split into 1 or more split filesReads Attributes: None specified.Writes Attributes: NameDescriptiontext.line.count The number of lines of text from the original FlowFile that were copied to this FlowFilefragment.sizeThe number of bytes from the original FlowFile that were copied to this FlowFile, including header, if applicable, which is duplicated in each split FlowFilefragment.identifierAll split FlowFiles produced from the same parent FlowFile will have the same randomly generated UUID added for this attributefragment.indexA one-up number that indicates the ordering of the split FlowFiles that were created from a single parent FlowFilefragment.countThe number of split FlowFiles generated from the parent FlowFilesegment.original.filename The filename of the parent FlowFileState management: This component does not store
svn commit: r1811008 [38/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compo
Added: nifi/site/trunk/docs/nifi-docs/html/user-guide.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/html/user-guide.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/html/user-guide.html (added) +++ nifi/site/trunk/docs/nifi-docs/html/user-guide.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1,3745 @@ + + + + + + + + + +Apache NiFi User Guide + +/* Asciidoctor default stylesheet | MIT License | http://asciidoctor.org */ +/* Copyright (C) 2012-2015 Dan Allen, Ryan Waldron and the Asciidoctor Project + +Permission is hereby granted, free of charge, to any person obtaining a copy +of this software and associated documentation files (the "Software"), to deal +in the Software without restriction, including without limitation the rights +to use, copy, modify, merge, publish, distribute, sublicense, and/or sell +copies of the Software, and to permit persons to whom the Software is +furnished to do so, subject to the following conditions: + +The above copyright notice and this permission notice shall be included in +all copies or substantial portions of the Software. + +THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR +IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, +FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE +AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER +LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, +OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN +THE SOFTWARE. */ +/* Remove the comments around the @import statement below when using this as a custom stylesheet */ +@import "https://fonts.googleapis.com/css?family=Open+Sans:300,300italic,400,400italic,600,600italic%7CNoto+Serif:400,400italic,700,700italic%7CDroid+Sans+Mono:400"; +article,aside,details,figcaption,figure,footer,header,hgroup,main,nav,section,summary{display:block} +audio,canvas,video{display:inline-block} +audio:not([controls]){display:none;height:0} +[hidden],template{display:none} +script{display:none!important} +html{font-family:sans-serif;-ms-text-size-adjust:100%;-webkit-text-size-adjust:100%} +body{margin:0} +a{background:transparent} +a:focus{outline:thin dotted} +a:active,a:hover{outline:0} +h1{font-size:2em;margin:.67em 0} +abbr[title]{border-bottom:1px dotted} +b,strong{font-weight:bold} +dfn{font-style:italic} +hr{-moz-box-sizing:content-box;box-sizing:content-box;height:0} +mark{background:#ff0;color:#000} +code,kbd,pre,samp{font-family:monospace;font-size:1em} +pre{white-space:pre-wrap} +q{quotes:"\201C" "\201D" "\2018" "\2019"} +small{font-size:80%} +sub,sup{font-size:75%;line-height:0;position:relative;vertical-align:baseline} +sup{top:-.5em} +sub{bottom:-.25em} +img{border:0} +svg:not(:root){overflow:hidden} +figure{margin:0} +fieldset{border:1px solid silver;margin:0 2px;padding:.35em .625em .75em} +legend{border:0;padding:0} +button,input,select,textarea{font-family:inherit;font-size:100%;margin:0} +button,input{line-height:normal} +button,select{text-transform:none} +button,html input[type="button"],input[type="reset"],input[type="submit"]{-webkit-appearance:button;cursor:pointer} +button[disabled],html input[disabled]{cursor:default} +input[type="checkbox"],input[type="radio"]{box-sizing:border-box;padding:0} +input[type="search"]{-webkit-appearance:textfield;-moz-box-sizing:content-box;-webkit-box-sizing:content-box;box-sizing:content-box} +input[type="search"]::-webkit-search-cancel-button,input[type="search"]::-webkit-search-decoration{-webkit-appearance:none} +button::-moz-focus-inner,input::-moz-focus-inner{border:0;padding:0} +textarea{overflow:auto;vertical-align:top} +table{border-collapse:collapse;border-spacing:0} +*,*:before,*:after{-moz-box-sizing:border-box;-webkit-box-sizing:border-box;box-sizing:border-box} +html,body{font-size:100%} +body{background:#fff;color:rgba(0,0,0,.8);padding:0;margin:0;font-family:"Noto Serif","DejaVu Serif",serif;font-weight:400;font-style:normal;line-height:1;position:relative;cursor:auto} +a:hover{cursor:pointer} +img,object,embed{max-width:100%;height:auto} +object,embed{height:100%} +img{-ms-interpolation-mode:bicubic} +#map_canvas img,#map_canvas embed,#map_canvas object,.map_canvas img,.map_canvas embed,.map_canvas object{max-width:none!important} +.left{float:left!important} +.right{float:right!important} +.text-left{text-align:left!important} +.text-right{text-align:right!important} +.text-center{text-align:center!important} +.text-justify{text-align:justify!important} +.hide{display:none}
svn commit: r1811008 [12/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compo
Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-kafka-0-11-nar/1.4.0/org.apache.nifi.processors.kafka.pubsub.ConsumeKafka_0_11/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-kafka-0-11-nar/1.4.0/org.apache.nifi.processors.kafka.pubsub.ConsumeKafka_0_11/index.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-kafka-0-11-nar/1.4.0/org.apache.nifi.processors.kafka.pubsub.ConsumeKafka_0_11/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-kafka-0-11-nar/1.4.0/org.apache.nifi.processors.kafka.pubsub.ConsumeKafka_0_11/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1 @@ +ConsumeKafka_0_11window.onload = function(){if(self==top) { document.getElementById('nameHeader').style.display = "inherit"; } }ConsumeKafka_0_11Description: Consumes messages from Apache Kafka specifically built against the Kafka 0.11.x Consumer API. Please note there are cases where the publisher can get into an indefinite stuck state. We are closely monitoring how this evolves in the Kafka community and will take advantage of those fixes as soon as we can. In the meantime it is possible to enter states where the only resolution will be to restart the JVM NiFi runs on. The complementary NiFi processor for sending messages is PublishKafka_0_11.Tags: Kafka, Get, Ingest, Ingress, Topi c, PubSub, Consume, 0.11.xProperties: In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.NameDefault ValueAllowable ValuesDescriptionKafka Brokerslocalhost:9092A comma-separated list of known Kafka Brokers in the format host:portSupports Expression Language: trueSecurity ProtocolPLAINTEXTPLAINTEXT SSL SASL_PLAINTEXT SASL_SSL Protocol used to communicate with brokers. Corresponds to Kafka's 'security.protocol' property.Kerberos Service NameThe Kerberos principal name that Kafka runs as. This can be defined either in Kafka's JAAS config or in Kafka's config. Corresponds to Kafka's 'security.protocol' property.It is ignored unless one of the SASL options of the Security Protocol are selected.Kerberos PrincipalThe Kerberos principal that will be used to connect to brokers. If not set, it is expected to set a JAAS configuration file in the JVM properties defined in the bootstrap.conf file. This principal will be set into 'sasl.jaas.config' Kafka's property.Kerberos KeytabThe Kerberos keytab that will be used to connect to brokers. If not set, it is expected to set a JAAS configuration file in the JVM properties defined in the bootstrap.conf file. This principal will be set into 'sasl.jaas.config' Kafka's property.SSL Context ServiceController Service API: SSLContextServiceImplementations: StandardSSLContextServiceStandardRestrictedSSLContextServiceSpecifies the SSL Context Service to use for communicating with Kafka.Topic Name(s)The name of the Kafka Topic(s) to pull from. More than one can be supplied if comma separated.Supports Expression Language: trueTopic Name Formatnamesnames pattern Specifies whether the Topic(s) provided are a comma separated list of names or a single regular expressionHonor TransactionstruetruefalseSpecifies whether or not NiFi should honor transactional guarantees when communicating with Kafka. If false, the Processor will use an "isolation level" of read_uncomitted. This means that messages will be received as soon as they are written to Kafka but will be pulled, even if the producer cancels the transactions. If this value is true, NiFi will not receive any messages for which the producer's transaction was canceled, but this can result in some latency since the consumer must wait for the producer to finish its entire transaction instead of pulling as the messages become available.Group IDA Group ID is used to identify consumers that are within the same consumer group. Corresponds to Kafka's 'group.id' property.Offset Resetlatestearliest latest none Allows you to manage the condition when there is no initial offset in Kafka or if the current offset does not exist any more on the server (e.g. because that data has been deleted). Corresponds to Kafka's 'auto.offset.reset' property.Key Attribute Encodingutf-8UTF-8 Encoded Hex Encoded FlowFiles that are emitted have a n attribute named 'kafka.key'. This property dictates how the value of the attribute should be encoded.Message DemarcatorSince KafkaConsumer receives messages in batches, you have an option to output FlowFiles which contains all Kafka messages in a single batch for a given topic and partition and this property allows you to provide a string (interpreted as UTF-8) to use for demarcating apart multiple Kafka
svn commit: r1811008 [13/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compo
Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-kafka-0-9-nar/1.4.0/org.apache.nifi.processors.kafka.pubsub.PublishKafka/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-kafka-0-9-nar/1.4.0/org.apache.nifi.processors.kafka.pubsub.PublishKafka/index.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-kafka-0-9-nar/1.4.0/org.apache.nifi.processors.kafka.pubsub.PublishKafka/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-kafka-0-9-nar/1.4.0/org.apache.nifi.processors.kafka.pubsub.PublishKafka/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1 @@ +PublishKafkawindow.onload = function(){if(self==top) { document.getElementById('nameHeader').style.display = "inherit"; } }PublishKafkaDescription: Sends the contents of a FlowFile as a message to Apache Kafka using the Kafka 0.9.x Producer. The messages to send may be individual FlowFiles or may be delimited, using a user-specified delimiter, such as a new-line. Please note there are cases where the publisher can get into an indefinite stuck state. We are closely monitoring how this evolves in the Kafka community and will take advantage of those fixes as soon as we can. In the mean time it is possible to enter states where the only resolution will be to restart the JVM NiFi runs on. The complementa ry NiFi processor for fetching messages is ConsumeKafka.Additional Details...Tags: Apache, Kafka, Put, Send, Message, PubSub, 0.9.xProperties: In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.NameDefault ValueAllowable ValuesDescriptionKafka Brokerslocalhost:9092A comma-separated list of known Kafka Brokers in the format host:portSupports Expression Language: trueSecurity ProtocolPLAINTEXTPLAINTEXT SSL SASL_PLAINTEXT SASL_SSL Protocol used to communicate with brokers. Corresponds to Kafka's 'security.protocol' property.Kerberos Service NameThe Kerberos principal name that Kafka runs as. This can be defined either in Kafka's JAAS config or in Kafka's config. Corresponds to Kafka's 'security.protocol' property.It is ignored unless one of the SASL options of the ;Security Protocol are selected.SSL Context ServiceController Service API: SSLContextServiceImplementations: StandardSSLContextServiceStandardRestrictedSSLContextServiceSpecifies the SSL Context Service to use for communicating with Kafka.Topic NameThe name of the Kafka Topic to publish to.Supports Expression Language: trueDelivery Guarantee0Best Effort Guarantee Single Node Delivery Guarantee Replicated Delivery Specifies the requirement for guaranteeing that a message is sent to Kafka. Corresponds to Kafka's 'acks' property.Kafka KeyThe Key to use for the Message. If not specified, the flow file attribute 'kafka.key' is used as the message key, if it is present and we're not demarcating.Supports Expression Language: trueKey Attribute Encodingutf-8UTF-8 Encoded Hex Encoded FlowFiles that are emitted have an attribute named 'kafka.key'. This property dictates how the value of the attribute should be encoded.Message DemarcatorSpecifies the string (interpreted as UTF-8) to use for demarcating multiple messages within a single FlowFi le. If not specified, the entire content of the FlowFile will be used as a single message. If specified, the contents of the FlowFile will be split on this delimiter and each section sent as a separate Kafka message. To enter special character such as 'new line' use CTRL+Enter or Shift+Enter, depending on your OS.Supports Expression Language: trueMax Request Size1 MBThe maximum size of a request in bytes. Corresponds to Kafka's 'max.request.size' property and defaults to 1 MB (1048576).Acknowledgment Wait Time5 secsAfter sending a message to Kafka, this indicates the amount of time that we are willing to wait for a response from Kafka. If Kafka does not acknowledge the message within this time period, the FlowFile will be routed to 'failure'.Max Metadata Wait Time5 secThe amount of time publisher will wait to obtain metadata or wait for the buffer to flush during the 'send' call before failing the entire 'send' call. Corresponds to Kafka's 'max.block.ms' propertySupports Expression Language: truePartitioner classorg.apache.kafka.clients.producer.internals.DefaultPartitionerRoundRobinPartitioner DefaultPartitioner Specifies which class to use to compute a partition id for a message. Corresponds to Kafka's 'partitioner.class' property.Compression Typenonenonegzipsnappylz4This parameter allows you to specify the compression codec for all data generated by this producer.Dynamic Properties: Dynamic Properties
svn commit: r1811008 [39/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compo
Added: nifi/site/trunk/docs/nifi-docs/images/bgBannerFoot.png URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/images/bgBannerFoot.png?rev=1811008=auto == Binary file - no diff available. Propchange: nifi/site/trunk/docs/nifi-docs/images/bgBannerFoot.png -- svn:mime-type = application/octet-stream Added: nifi/site/trunk/docs/nifi-docs/images/bgHeader.png URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/images/bgHeader.png?rev=1811008=auto == Binary file - no diff available. Propchange: nifi/site/trunk/docs/nifi-docs/images/bgHeader.png -- svn:mime-type = application/octet-stream
svn commit: r1811008 [41/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compo
Added: nifi/site/trunk/docs/nifi-docs/js/application.js URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/js/application.js?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/js/application.js (added) +++ nifi/site/trunk/docs/nifi-docs/js/application.js Tue Oct 3 13:30:16 2017 @@ -0,0 +1,400 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + * contributor license agreements. See the NOTICE file distributed with + * this work for additional information regarding copyright ownership. + * The ASF licenses this file to You under the Apache License, Version 2.0 + * (the "License"); you may not use this file except in compliance with + * the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, software + * distributed under the License is distributed on an "AS IS" BASIS, + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + * See the License for the specific language governing permissions and + * limitations under the License. + */ + +/* global top */ + +$(document).ready(function () { + +var isUndefined = function (obj) { +return typeof obj === 'undefined'; +}; + +var isNull = function (obj) { +return obj === null; +}; + +var isDefinedAndNotNull = function (obj) { +return !isUndefined(obj) && !isNull(obj); +}; + +/** + * Get the filter text. + * + * @returns {unresolved} + */ +var getFilterText = function () { +var filter = ''; +var ruleFilter = $('#component-filter'); +if (!ruleFilter.hasClass('component-filter-list')) { +filter = ruleFilter.val(); +} +return filter; +}; + +var applyComponentFilter = function (componentContainer) { +var matchingComponents = 0; +var componentLinks = $(componentContainer).find('a.component-link, a.document-link'); + +if (componentLinks.length === 0) { +return matchingComponents; +} + +// get the filter text +var filter = getFilterText(); +if (filter !== '') { +var filterExp = new RegExp(filter, 'i'); + +// update the displayed rule count +$.each(componentLinks, function (_, componentLink) { +var a = $(componentLink); +var li = a.closest('li.component-item'); + +// get the rule text for matching +var componentName = a.text(); + +// see if any of the text from this rule matches +var componentMatches = componentName.search(filterExp) >= 0; + +// handle whether the rule matches +if (componentMatches === true) { +li.show(); +matchingComponents++; +} else { +// hide the rule +li.hide(); +} +}); +} else { +// ensure every rule is visible +componentLinks.closest('li.component-item').show(); + +// set the number of displayed rules +matchingComponents = componentLinks.length; +} + +// show whether there are status if appropriate +var noMatching = componentContainer.find('span.no-matching'); +if (matchingComponents === 0) { +noMatching.show(); +} else { +noMatching.hide(); +} + +return matchingComponents; +}; + +var applyFilter = function () { +var matchingGeneral = applyComponentFilter($('#general-links')); +var matchingProcessors = applyComponentFilter($('#processor-links')); +var matchingControllerServices = applyComponentFilter($('#controller-service-links')); +var matchingReportingTasks = applyComponentFilter($('#reporting-task-links')); +var matchingDeveloper = applyComponentFilter($('#developer-links')); + +// update the rule count +$('#displayed-components').text(matchingGeneral + matchingProcessors + matchingControllerServices + matchingReportingTasks + matchingDeveloper); +}; + +var selectComponent = function (selectedExtension, selectedBundleGroup, selectedBundleArtifact, selectedArtifactVersion) { +var componentLinks = $('a.component-link'); + +// consider each link +$.each(componentLinks, function () { +var componentLink = $(this); +var item = componentLink.closest('li.component-item'); +var extension = item.find('span.extension-class').text(); +var group = item.find('span.bundle-group').text(); +var artifact = item.find('span.bundle-artifact').text(); +var version = item.find('span.bundle-version').text(); + +if
svn commit: r1811008 [35/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compo
Added: nifi/site/trunk/docs/nifi-docs/html/nifi-in-depth.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/html/nifi-in-depth.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/html/nifi-in-depth.html (added) +++ nifi/site/trunk/docs/nifi-docs/html/nifi-in-depth.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1,872 @@ + + + + + + + + + +Apache NiFi In Depth + +/* Asciidoctor default stylesheet | MIT License | http://asciidoctor.org */ +/* Copyright (C) 2012-2015 Dan Allen, Ryan Waldron and the Asciidoctor Project + +Permission is hereby granted, free of charge, to any person obtaining a copy +of this software and associated documentation files (the "Software"), to deal +in the Software without restriction, including without limitation the rights +to use, copy, modify, merge, publish, distribute, sublicense, and/or sell +copies of the Software, and to permit persons to whom the Software is +furnished to do so, subject to the following conditions: + +The above copyright notice and this permission notice shall be included in +all copies or substantial portions of the Software. + +THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR +IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, +FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE +AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER +LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, +OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN +THE SOFTWARE. */ +/* Remove the comments around the @import statement below when using this as a custom stylesheet */ +@import "https://fonts.googleapis.com/css?family=Open+Sans:300,300italic,400,400italic,600,600italic%7CNoto+Serif:400,400italic,700,700italic%7CDroid+Sans+Mono:400"; +article,aside,details,figcaption,figure,footer,header,hgroup,main,nav,section,summary{display:block} +audio,canvas,video{display:inline-block} +audio:not([controls]){display:none;height:0} +[hidden],template{display:none} +script{display:none!important} +html{font-family:sans-serif;-ms-text-size-adjust:100%;-webkit-text-size-adjust:100%} +body{margin:0} +a{background:transparent} +a:focus{outline:thin dotted} +a:active,a:hover{outline:0} +h1{font-size:2em;margin:.67em 0} +abbr[title]{border-bottom:1px dotted} +b,strong{font-weight:bold} +dfn{font-style:italic} +hr{-moz-box-sizing:content-box;box-sizing:content-box;height:0} +mark{background:#ff0;color:#000} +code,kbd,pre,samp{font-family:monospace;font-size:1em} +pre{white-space:pre-wrap} +q{quotes:"\201C" "\201D" "\2018" "\2019"} +small{font-size:80%} +sub,sup{font-size:75%;line-height:0;position:relative;vertical-align:baseline} +sup{top:-.5em} +sub{bottom:-.25em} +img{border:0} +svg:not(:root){overflow:hidden} +figure{margin:0} +fieldset{border:1px solid silver;margin:0 2px;padding:.35em .625em .75em} +legend{border:0;padding:0} +button,input,select,textarea{font-family:inherit;font-size:100%;margin:0} +button,input{line-height:normal} +button,select{text-transform:none} +button,html input[type="button"],input[type="reset"],input[type="submit"]{-webkit-appearance:button;cursor:pointer} +button[disabled],html input[disabled]{cursor:default} +input[type="checkbox"],input[type="radio"]{box-sizing:border-box;padding:0} +input[type="search"]{-webkit-appearance:textfield;-moz-box-sizing:content-box;-webkit-box-sizing:content-box;box-sizing:content-box} +input[type="search"]::-webkit-search-cancel-button,input[type="search"]::-webkit-search-decoration{-webkit-appearance:none} +button::-moz-focus-inner,input::-moz-focus-inner{border:0;padding:0} +textarea{overflow:auto;vertical-align:top} +table{border-collapse:collapse;border-spacing:0} +*,*:before,*:after{-moz-box-sizing:border-box;-webkit-box-sizing:border-box;box-sizing:border-box} +html,body{font-size:100%} +body{background:#fff;color:rgba(0,0,0,.8);padding:0;margin:0;font-family:"Noto Serif","DejaVu Serif",serif;font-weight:400;font-style:normal;line-height:1;position:relative;cursor:auto} +a:hover{cursor:pointer} +img,object,embed{max-width:100%;height:auto} +object,embed{height:100%} +img{-ms-interpolation-mode:bicubic} +#map_canvas img,#map_canvas embed,#map_canvas object,.map_canvas img,.map_canvas embed,.map_canvas object{max-width:none!important} +.left{float:left!important} +.right{float:right!important} +.text-left{text-align:left!important} +.text-right{text-align:right!important} +.text-center{text-align:center!important} +.text-justify{text-align:justify!important} +.hide{display:none}
svn commit: r1811008 [26/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compo
Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.QueryDatabaseTable/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.QueryDatabaseTable/index.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.QueryDatabaseTable/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.QueryDatabaseTable/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1 @@ +QueryDatabaseTablewindow.onload = function(){if(self==top) { document.getElementById('nameHeader').style.display = "inherit"; } }QueryDatabaseTableDescription: Generates and executes a SQL select query to fetch all rows whose values in the specified Maximum Value column(s) are larger than the previously-seen maxima. Query result will be converted to Avro format. Expression Language is supported for several properties, but no incoming connections are permitted. The Variable Registry may be used to provide values for any property containing Expression Language. If it is desired to leverage flow file attributes to perform these queries, the GenerateTableFetch and/or ExecuteSQL processors can be used for t his purpose. Streaming is used so arbitrarily large result sets are supported. This processor can be scheduled to run on a timer or cron expression, using the standard scheduling methods. This processor is intended to be run on the Primary Node only. FlowFile attribute 'querydbtable.row.count' indicates how many rows were selected.Tags: sql, select, jdbc, query, databaseProperties: In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.NameDefault ValueAllowable ValuesDescriptionDatabase Connection Pooling ServiceController Service API: DBCPServiceImplementations: DBCPConnectionPoolHiveConnectionPoolThe Controller Service that is used to obtain a connection to the database.Database TypeGenericGeneric Oracle Oracle 12+ MS SQL 2012+ MS SQL 2008 The type/flavor of database, used for generating database-specific code. In many cases the Generic type should suffice, but some databases (such as Oracle) require custom SQL clauses. Table NameThe name of the database table to be queried.Supports Expression Language: trueColumns to Return< /td>A comma-separated list of column names to be used in the query. If your database requires special treatment of the names (quoting, e.g.), each name should include such treatment. If no column names are supplied, all columns in the specified table will be returned. NOTE: It is important to use consistent column names for a given table for incremental fetch to work properly.Supports Expression Language: trueMaximum-value ColumnsA comma-separated list of column names. The processor will keep track of the maximum value for each column that has been returned since the processor started running. Using multiple columns implies an order to the column list, and each column's values are expected to increase more slowly than the previous columns' values. Thus, using multiple columns implies a hierarchical structure of columns, which is usually used for partitioning tables. This processor can be used to retrieve only those rows that have been added/updated since the last retrieval. Note that some JDBC types such as bit/boolean are not conducive to maintaining maximum value, so columns of these types should not be listed in this property, and will result in error(s) during processing. If no columns are provided, all rows from the table will be considered, which could have a performance impact. NOTE: It is important to use consistent max-value column names for a given table for incremental fetch to work properly.Supports Expression Language: trueMax Wait Time0 secondsThe maximum amount of time allowed for a running SQL select query , zero means there is no limit. Max time less than 1 second will be equal to zero.Supports Expression Language: true Fetch Size0The number of result rows to be fetched from the result set at a time. This is a hint to the driver and may not be honored and/or exact. If the value specified is zero, then the hint is ignored.Supports Expression Language: trueMax Rows Per Flow File0The maximum number of result rows that will be included in a single FlowFile. This will allow you to break up very large result sets into multiple FlowFiles. If the value specified is zero, then all rows are returned in a single FlowFile.Supports Expression Language: trueMaximum
svn commit: r1811008 [17/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compo
Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-riemann-nar/1.4.0/org.apache.nifi.processors.riemann.PutRiemann/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-riemann-nar/1.4.0/org.apache.nifi.processors.riemann.PutRiemann/index.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-riemann-nar/1.4.0/org.apache.nifi.processors.riemann.PutRiemann/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-riemann-nar/1.4.0/org.apache.nifi.processors.riemann.PutRiemann/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1 @@ +PutRiemannwindow.onload = function(){if(self==top) { document.getElementById('nameHeader').style.display = "inherit"; } }PutRiemannDescription: Send events to Riemann (http://riemann.io) when FlowFiles pass through this processor. You can use events to notify Riemann that a FlowFile passed through, or you can attach a more meaningful metric, such as, the time a FlowFile took to get to this processor. All attributes attached to events support the NiFi Expression Language.Tags: riemann, monitoring, metricsProperties: In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table als o indicates any default values, and whether a property supports the NiFi Expression Language.NameDefault ValueAllowable ValuesDescriptionRiemann AddressHostname of Riemann serverRiemann PortPort that Riemann is listening onTransport ProtocolTCPTCPUDPTransport protocol to speak to Riemann inTimeout1000Timeout in millis econds when writing events to RiemannBatch Size100Batch size for incoming FlowFilesDescriptionDescription associated to the eventSupports Expression Language: trueServiceName of service associated to this event (e.g. FTP File Fetched)Supports Expression Language: trueStateState of service associated to this event in string form (e.g. ok, warning, foo)Supports Expression Language: trueMetricFloating point number associated to this >eventSupports Expression Language: >trueTTLid="default-value">id="description">Floating point value in seconds until Riemann considers this >event as "expired"Supports Expression Language: >trueTagsid="default-value">id="description">Comma separated list of tags associated to the >eventSupports Expression Language: >trueHostid="default-value">${hostname()}id="description">A hostname associated to this event (e.g. >nifi-app1)Supports Expression Language: >trueTimeid="default-value">id="description">Time of event in unix epoch seconds ( long), default: (current time)Supports Expression Language: trueDynamic Properties: Dynamic Properties allow the user to specify both the name and value of a property.NameValueDescriptionCustom Event AttributeAny value or expressionThese values will be attached to the Riemann event as a custom attributeSupports Expression Language: trueRelationships: NameDescriptionsuccessMetrics successfully written to RiemannfailureMetrics which failed to write to RiemannReads Attributes: None specified.Writes Attributes: None specified.State management: This component does not store state.Restricted: This component is not restricted. Input requirement: This component requires an incoming relationship. \ No newline at end of file Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-scripting-nar/1.4.0/org.apache.nifi.lookup.script.ScriptedLookupService/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-scripting-nar/1.4.0/org.apache.nifi.lookup.script.ScriptedLookupService/index.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-scripting-nar/1.4.0/org.apache.nifi.lookup.script.ScriptedLookupService/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-scripting-nar/1.4.0/org.apache.nifi.lookup.script.ScriptedLookupService/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1 @@ +ScriptedLookupServicewindow.onload = function(){if(self==top) { document.getElementById('nameHeader').style.display = "inherit"; } }ScriptedLookupServiceDescription: Allows the user to provide a scripted LookupService instance in order to enrich records from an incoming flow file.Tags: lookup, record, script, invoke, groovy, python, jython, jruby, ruby, javascript, js, lua, luaj, restrictedProperties: In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.NameDefault ValueAllowable ValuesDescriptionScript
svn commit: r1811008 [28/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compo
Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.Wait/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.Wait/index.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.Wait/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.Wait/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1 @@ +Waitwindow.onload = function(){if(self==top) { document.getElementById('nameHeader').style.display = "inherit"; } }WaitDescription: Routes incoming FlowFiles to the 'wait' relationship until a matching release signal is stored in the distributed cache from a corresponding Notify processor. When a matching release signal is identified, a waiting FlowFile is routed to the 'success' relationship, with attributes copied from the FlowFile that produced the release signal from the Notify processor. The release signal entry is then removed from the cache. Waiting FlowFiles will be routed to 'expired' if they exceed the Expiration Duration. If you need to wait for more than one signal, specify the desired num ber of signals via the 'Target Signal Count' property. This is particularly useful with processors that split a source FlowFile into multiple fragments, such as SplitText. In order to wait for all fragments to be processed, connect the 'original' relationship to a Wait processor, and the 'splits' relationship to a corresponding Notify processor. Configure the Notify and Wait processors to use the '${fragment.identifier}' as the value of 'Release Signal Identifier', and specify '${fragment.count}' as the value of 'Target Signal Count' in the Wait processor.Tags: map, cache, wait, hold, distributed, signal, releaseProperties: In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.NameDefault ValueAllowable ValuesDescriptionRelease Signal IdentifierA value, or the results of an Attribute Expression Language statement, which will be evaluated against a FlowFile in order to determine the release signal cache keySupports Expression Language: trueTarget Signal Count1A value, or the results of an Attribute Expression Language statement, which will be evaluated against a FlowFile in order to determine the target signal count. This processor checks whether the signal count has reached this number. If Signal Counter Name is specified, this processor checks a particular counter, otherwise checks against total count in a signal.Support s Expression Language: trueSignal Counter NameA value, or the results of an Attribute Expression Language statement, which will be evaluated against a FlowFile in order to determine the signal counter name. If not specified, this processor checks the total count in a signal.Supports Expression Language: trueWait Buffer Count1Specify the maximum number of incoming FlowFiles that can be buffered to check whether it can move forward. The more buffer can provide the better performance, as it reduces the number of interactions with cache service by grouping FlowFiles by signal identifier. Only a signal identifier can be processed at a processor execution.Releasable FlowFile Count1A value, or the results of an Attribute Expression Language statement, which will be evaluated against a FlowFile in order to determine the releasable FlowFile count. This specifies how many FlowFiles can be released when a target count reaches target signal count. Zero (0) has a special meaning, any number of FlowFiles can be released as long as signal count matches target.Supports Expression Language: trueExpiration Duration10 minIndicates the duration after which waiting FlowFiles will be routed to the 'expired' relationshipDistributed Cache ServiceController Service API: AtomicDistributedMapCacheClientIm plementations: RedisDistributedMapCacheClientServiceDistributedMapCacheClientServiceThe Controller Service that is used to check for release signals from a corresponding Notify processorAttribute Copy ModekeeporiginalReplace if present Keep original Specifies how to handle attributes copied from FlowFiles entering the Notify processorWait ModewaitTransfer to wait relationship Keep in the upstream connection Specifies how to handle a FlowFile waiting for a notify signalRelationships: NameDescriptionexpiredA FlowFile that has exceeded the configured Expiration Duration will be routed to this relationship successA FlowFile with a matching release signal in
svn commit: r1811008 [20/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compo
Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.EvaluateJsonPath/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.EvaluateJsonPath/index.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.EvaluateJsonPath/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.EvaluateJsonPath/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1 @@ +EvaluateJsonPathwindow.onload = function(){if(self==top) { document.getElementById('nameHeader').style.display = "inherit"; } }EvaluateJsonPathDescription: Evaluates one or more JsonPath expressions against the content of a FlowFile. The results of those expressions are assigned to FlowFile Attributes or are written to the content of the FlowFile itself, depending on configuration of the Processor. JsonPaths are entered by adding user-defined properties; the name of the property maps to the Attribute Name into which the result will be placed (if the Destination is flowfile-attribute; otherwise, the property name is ignored). The value of the property must be a valid JsonPath expression. A Return Type o f 'auto-detect' will make a determination based off the configured destination. When 'Destination' is set to 'flowfile-attribute,' a return type of 'scalar' will be used. When 'Destination' is set to 'flowfile-content,' a return type of 'JSON' will be used.If the JsonPath evaluates to a JSON array or JSON object and the Return Type is set to 'scalar' the FlowFile will be unmodified and will be routed to failure. A Return Type of JSON can return scalar values if the provided JsonPath evaluates to the specified value and will be routed as a match.If Destination is 'flowfile-content' and the JsonPath does not evaluate to a defined path, the FlowFile will be routed to 'unmatched' without having its contents modified. If Destination is flowfile-attribute and the expression matches nothing, attributes will be created with empty strings as the value, and the FlowFile will always be routed to 'matched.'Additional Details...Tags: JS ON, evaluate, JsonPathProperties: In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values.NameDefault ValueAllowable ValuesDescriptionDestinationflowfile-contentflowfile-contentflowfile-attributeIndicates whether the results of the JsonPath evaluation are written to the FlowFile content or a FlowFile attribute; if using attribute, must specify the Attribute Name property. If set to flowfile-content, only one JsonPath may be specified, and the property name is ignored.Return Typeauto-detectauto-detectjso nscalarIndicates the desired return type of the JSON Path expressions. Selecting 'auto-detect' will set the return type to 'json' for a Destination of 'flowfile-content', and 'scalar' for a Destination of 'flowfile-attribute'.Path Not Found BehaviorignorewarnignoreIndicates how to handle missing JSON path expressions when destination is set to 'flowfile-attribute'. Selecting 'warn' will generate a warning when a JSON path expression is not found.Null Value Representationempty stringempty stringthe string 'null'Indicates the desired representation of JSON Path expressions resulting in a null value.Dynamic Pro perties: Dynamic Properties allow the user to specify both the name and value of a property.NameValueDescriptionA FlowFile attribute(if Destination is set to 'flowfile-attribute')A JsonPath expressionIf Destination='flowfile-attribute' then that FlowFile attribute will be set to any JSON objects that match the JsonPath. If Destination='flowfile-content' then the FlowFile content will be updated to any JSON objects that match the JsonPath.Relationships: NameDescriptionfailureFlowFiles are routed to this relationship when the JsonPath cannot be evaluated against the content of the FlowFile; for instance, if the FlowFile is not valid JSONunmatchedFlowFiles are routed to this relationship when the JsonPath does not m atch the content of the FlowFile and the Destination is set to flowfile-contentmatchedFlowFiles are routed to this relationship when the JsonPath is successfully evaluated and the FlowFile is modified as a resultReads Attributes: None specified.Writes Attributes: None specified.State management: This component does not store state.Restricted: This component is not restricted.Input requirement: This component requires an incoming relationship. \ No newline at end of file Added:
svn commit: r1811008 [42/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compo
Added: nifi/site/trunk/docs/nifi-docs/rest-api/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/rest-api/index.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/rest-api/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/rest-api/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1,51306 @@ + + + + +NiFi Rest Api-1.4.0 + + + + +if (typeof window.jQuery === 'undefined') { +document.write(unescape('%3Cscript src="https://code.jquery.com/jquery-3.1.1.min.js" type="text/javascript" %3E%3C/script%3E')); +} + + +@import "https://fonts.googleapis.com/css?family=Open+Sans:300,300italic,400,400italic,600,600italic|Noto+Serif:400,400italic,700,700italic|Droid+Sans+Mono:400"; + +html { +overflow-y: scroll; +} + +html, html a { +-webkit-font-smoothing: antialiased; +text-shadow: 1px 1px 1px rgba(0,0,0,0.004); +} + +body { +width: 62.5em; +margin: 0 auto; +display: block; +font-family: "Open Sans", "DejaVu Sans", sans-serif; +} + +div.header { +margin-top: 10px; +} + +img.logo { +float: left; +margin-right: 10px; +} + +div.header > div.title { +font-size: 30px; +height: 50px; +line-height: 50px; +} + +.sub-title { +font-style: italic; +color: #aaa; +} + +div.overview { +margin-top: 10px; +margin-bottom: 15px; +} + +div.endpoint { +margin-bottom: 10px; +} + +/* get */ + +div.endpoint.get { +border: 1px solid #174961; +} + +div.get div.operation-handle { +background-color: rgba(23, 73, 97, .15); +} + +div.get div.method { +background-color: #174961; +} + +div.get div.operation { +border-top: 1px solid #174961; +} + +/* post */ + +div.endpoint.post { +border: 1px solid #7298AC; +} + +div.post div.operation-handle { +background-color: rgba(114, 152, 172, .15); +} + +div.post div.method { +background-color: #7298AC; +} + +div.post div.operation { +border-top: 1px solid #7298AC; +} + +/* put */ + +div.endpoint.put { +border: 1px solid #063046; +} + +div.put div.operation-handle { +background-color: rgba(6, 48, 70, .15); +} + +div.put div.method { +background-color: #063046; +} + +div.put div.operation { +border-top: 1px solid #063046; +} + +/* delete */ + +div.endpoint.delete { +border: 1px solid #47758E; +} + +div.delete div.operation-handle { +background-color: rgba(71, 117, 142, .15); +} + +div.delete div.method { +background-color: #47758E; +} + +div.delete div.operation { +border-top: 1px solid #47758E; +} + +/* operations */ + +div.operation-handle { +cursor: pointer; +padding-right: 5px; +height: 22px; +} + +div.method { +float: left; +width: 75px; +color: #fff; +text-align: center; +background-color: #7098ad; +margin-right: 10px; +font-weight: bold; +} + +div.endpoint div.path { +float: left; +line-height: 22px; +} + +div.summary { +float: right; +font-size: 12px; +
svn commit: r1811008 [40/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compo
Added: nifi/site/trunk/docs/nifi-docs/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/index.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1,5146 @@ + + + + +http://www.w3.org/1999/xhtml;> + + + + +NiFi Documentation + + + + + + + + + + + + + + + + + + + + +- + +NiFi Documentation + + + + + + + + +General + + +Overview +Getting Started +User Guide +Expression Language Guide +RecordPath Guide +Admin Guide + +No matching guides + + + +Processors + + + + + + + +org.apache.nifi +nifi-stateful-analysis-nar +1.4.0 +org.apache.nifi.processors.stateful.analysis.AttributeRollingWindow + + + + + AttributeRollingWindow 1.4.0 + + + + + + + + +org.apache.nifi +nifi-standard-nar +1.4.0 +org.apache.nifi.processors.standard.AttributesToJSON + + + + +AttributesToJSON 1.4.0 + + + + + + + + +org.apache.nifi +nifi-standard-nar +1.4.0 +org.apache.nifi.processors.standard.Base64EncodeContent + + + + + Base64EncodeContent 1.4.0 + + + + + + + + +org.apache.nifi +nifi-cdc-mysql-nar +1.4.0 +org.apache.nifi.cdc.mysql.processors.CaptureChangeMySQL + +
svn commit: r1811008 [19/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compo
Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.Base64EncodeContent/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.Base64EncodeContent/index.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.Base64EncodeContent/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.Base64EncodeContent/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1 @@ +Base64EncodeContentwindow.onload = function(){if(self==top) { document.getElementById('nameHeader').style.display = "inherit"; } }Base64EncodeContentDescription: Encodes or decodes content to and from base64Tags: encode, base64Properties: In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values.NameDefault ValueAllowable ValuesDescriptionModeEncodeEncodeDecodeSpecifies whether the content should be encoded or decodedRelationships: NameDescriptionsuccessAny FlowFile that is successfully encoded or decoded will be routed to successfailureAny FlowFile that cannot be encoded or decoded will be routed to failureReads Attributes: None specified.Writes Attributes: None specified.State management: This component does not store state.Restricted: This component is not restricted.Input requirement: This component requires an incoming relationship. \ No newline at end of file Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.CompressContent/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.CompressContent/index.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.CompressContent/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.CompressContent/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1 @@ +CompressContentwindow.onload = function(){if(self==top) { document.getElementById('nameHeader').style.display = "inherit"; } }CompressContentDescription: Compresses or decompresses the contents of FlowFiles using a user-specified compression algorithm and updates the mime.type attribute as appropriateTags: content, compress, decompress, gzip, bzip2, lzma, xz-lzma2, snappy, snappy framedProperties: In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values.NameDefault ValueAllowable ValuesDescriptionModecompresscompressdecompressIndicates whether the processor should compress content or decompress content. Must be either 'compress' or 'decompress'Compression Formatuse mime.type attributeuse mime.type attributegzipbzip2xz-lzma2lzmasnappysnappy framedThe compression format to use. Valid values are: GZIP, BZIP2, XZ-LZMA2, LZMA, Snappy, and Snappy FramedCompression Level10123456789The com pression level to use; this is valid only when using GZIP compression. A lower value results in faster processing but less compression; a value of 0 indicates no compression but simply archivingUpdate FilenamefalsetruefalseIf true, will remove the filename extension when decompressing data (only if the extension indicates the appropriate compression format) and add the appropriate extension when compressing dataRelationships: NameDescriptionsuccessFlowFiles will be transferred to the success relationship after successfully being compressed or decompressedfailureFlowFiles will be transferred to the failure relationship if they fail to compress/decompressReads Attributes: NameDescriptionmime.typeIf the Compression Format is set to use mime.type attribute, this attribute is used to determine the compression type. Otherwise, this attribute is ignored.Writes Attributes: NameDescriptionmime.typeIf the Mode property is set to compress, the appropriate MIME Type is set. If the Mode property is set to decompress and the file is successfully decompressed, this attribute is removed, as the MIME Type is no longer known.State management: This component does not store state.Restricted: This component is not restricted.Input requirement: This component requires an incoming relationship. \ No newline at end of file Added:
svn commit: r1811008 [23/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compo
Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.ListenSyslog/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.ListenSyslog/index.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.ListenSyslog/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.ListenSyslog/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1 @@ +ListenSyslogwindow.onload = function(){if(self==top) { document.getElementById('nameHeader').style.display = "inherit"; } }ListenSyslogDescription: Listens for Syslog messages being sent to a given port over TCP or UDP. Incoming messages are checked against regular expressions for RFC5424 and RFC3164 formatted messages. The format of each message is: (PRIORITY)(VERSION )(TIMESTAMP) (HOSTNAME) (BODY) where version is optional. The timestamp can be an RFC5424 timestamp with a format of "-MM-dd'T'HH:mm:ss.SZ" or "-MM-dd'T'HH:mm:ss.S+hh:mm", or it can be an RFC3164 timestamp with a format of "MMM d HH:mm:ss". If an incoming messages matches one of these patterns, the message will be parsed and the individual pieces will be placed in FlowFile attributes, with the original message in the content of the FlowFile. If an incoming message does not match one of these patterns it will not be parsed and the syslog.valid attribute will be set to false with the original message in the content of the FlowFile. Valid messages will be transferred on the success relationship, and invalid messages will be transferred on the invalid relationship.Tags: syslog, listen, udp, tcp, logsProperties: In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.NameDefault ValueAllowable ValuesDescriptionProtocolUDPTCPUDPThe protocol for Syslog communication.PortThe port for Syslog communication.Local Network InterfaceThe name of a local network interface to be used to restrict listening to a specific LAN.Supports Expression Language: trueSSL Context ServiceController Service API: RestrictedSSLContextServiceImplementation: StandardRestrictedSSLContextService< td id="description">The Controller Service to use in order to obtain an SSL Context. If this property is set, syslog messages will be received over a secure connection.Client AuthREQUIREDWANTREQUIREDNONEThe client authentication policy to use for the SSL Context. Only used if an SSL Context Service is provided.Receive Buffer Size65507 BThe size of each buffer used to receive Syslog messages. Adjust this value appropriately based on the expected size of the incoming Syslog messages. When UDP is selected each buffer will hold one Syslog message. When TCP is selected messages are read from an incoming connection until the buffer is full, or the connection is closed. Max Size o f Message Queue1The maximum size of the internal queue used to buffer messages being transferred from the underlying channel to the processor. Setting this value higher allows more messages to be buffered in memory during surges of incoming messages, but increases the total memory used by the processor.Max Size of Socket Buffer1 MBThe maximum size of the socket buffer that should be used. This is a suggestion to the Operating System to indicate how big the socket buffer should be. If this value is set too low, the buffer may fill up before the data can be read, and incoming data will be dropped.Max Number of TCP Connections2The max imum number of concurrent connections to accept Syslog messages in TCP mode.Max Batch Size1The maximum number of Syslog events to add to a single FlowFile. If multiple events are available, they will be concatenated along with the Message Delimiter up to this configured maximum number of messagesMessage Delimiter\nSpecifies the delimiter to place between Syslog messages when multiple messages are bundled together (see Max Batch Size property).Parse MessagestruetruefalseIndicates if the processor should parse the Syslog messages. If set to false, each outgoin g FlowFile will only contain the sender, protocol, and port, and no additional attributes.Character SetUTF-8Specifies the character set of the Syslog messagesRelationships: NameDescriptionsuccessSyslog messages that match one of the expected formats will be sent out this relationship as a FlowFile per message.invalidSyslog messages that do not match one of the expected formats will be sent out this relationship as a FlowFile per
svn commit: r1811008 [31/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compo
Added: nifi/site/trunk/docs/nifi-docs/html/developer-guide.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/html/developer-guide.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/html/developer-guide.html (added) +++ nifi/site/trunk/docs/nifi-docs/html/developer-guide.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1,3655 @@ + + + + + + + + + +NiFi Developers Guide + +/* Asciidoctor default stylesheet | MIT License | http://asciidoctor.org */ +/* Copyright (C) 2012-2015 Dan Allen, Ryan Waldron and the Asciidoctor Project + +Permission is hereby granted, free of charge, to any person obtaining a copy +of this software and associated documentation files (the "Software"), to deal +in the Software without restriction, including without limitation the rights +to use, copy, modify, merge, publish, distribute, sublicense, and/or sell +copies of the Software, and to permit persons to whom the Software is +furnished to do so, subject to the following conditions: + +The above copyright notice and this permission notice shall be included in +all copies or substantial portions of the Software. + +THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR +IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, +FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE +AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER +LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, +OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN +THE SOFTWARE. */ +/* Remove the comments around the @import statement below when using this as a custom stylesheet */ +@import "https://fonts.googleapis.com/css?family=Open+Sans:300,300italic,400,400italic,600,600italic%7CNoto+Serif:400,400italic,700,700italic%7CDroid+Sans+Mono:400"; +article,aside,details,figcaption,figure,footer,header,hgroup,main,nav,section,summary{display:block} +audio,canvas,video{display:inline-block} +audio:not([controls]){display:none;height:0} +[hidden],template{display:none} +script{display:none!important} +html{font-family:sans-serif;-ms-text-size-adjust:100%;-webkit-text-size-adjust:100%} +body{margin:0} +a{background:transparent} +a:focus{outline:thin dotted} +a:active,a:hover{outline:0} +h1{font-size:2em;margin:.67em 0} +abbr[title]{border-bottom:1px dotted} +b,strong{font-weight:bold} +dfn{font-style:italic} +hr{-moz-box-sizing:content-box;box-sizing:content-box;height:0} +mark{background:#ff0;color:#000} +code,kbd,pre,samp{font-family:monospace;font-size:1em} +pre{white-space:pre-wrap} +q{quotes:"\201C" "\201D" "\2018" "\2019"} +small{font-size:80%} +sub,sup{font-size:75%;line-height:0;position:relative;vertical-align:baseline} +sup{top:-.5em} +sub{bottom:-.25em} +img{border:0} +svg:not(:root){overflow:hidden} +figure{margin:0} +fieldset{border:1px solid silver;margin:0 2px;padding:.35em .625em .75em} +legend{border:0;padding:0} +button,input,select,textarea{font-family:inherit;font-size:100%;margin:0} +button,input{line-height:normal} +button,select{text-transform:none} +button,html input[type="button"],input[type="reset"],input[type="submit"]{-webkit-appearance:button;cursor:pointer} +button[disabled],html input[disabled]{cursor:default} +input[type="checkbox"],input[type="radio"]{box-sizing:border-box;padding:0} +input[type="search"]{-webkit-appearance:textfield;-moz-box-sizing:content-box;-webkit-box-sizing:content-box;box-sizing:content-box} +input[type="search"]::-webkit-search-cancel-button,input[type="search"]::-webkit-search-decoration{-webkit-appearance:none} +button::-moz-focus-inner,input::-moz-focus-inner{border:0;padding:0} +textarea{overflow:auto;vertical-align:top} +table{border-collapse:collapse;border-spacing:0} +*,*:before,*:after{-moz-box-sizing:border-box;-webkit-box-sizing:border-box;box-sizing:border-box} +html,body{font-size:100%} +body{background:#fff;color:rgba(0,0,0,.8);padding:0;margin:0;font-family:"Noto Serif","DejaVu Serif",serif;font-weight:400;font-style:normal;line-height:1;position:relative;cursor:auto} +a:hover{cursor:pointer} +img,object,embed{max-width:100%;height:auto} +object,embed{height:100%} +img{-ms-interpolation-mode:bicubic} +#map_canvas img,#map_canvas embed,#map_canvas object,.map_canvas img,.map_canvas embed,.map_canvas object{max-width:none!important} +.left{float:left!important} +.right{float:right!important} +.text-left{text-align:left!important} +.text-right{text-align:right!important} +.text-center{text-align:center!important} +.text-justify{text-align:justify!important} +.hide{display:none}
svn commit: r1811008 [1/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compon
Author: jstorck Date: Tue Oct 3 13:30:16 2017 New Revision: 1811008 URL: http://svn.apache.org/viewvc?rev=1811008=rev Log: NIFI-4412 Added 1.4.0 documentation Added: nifi/site/trunk/docs/nifi/ nifi/site/trunk/docs/nifi-docs/ nifi/site/trunk/docs/nifi-docs/components/ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-ambari-nar/1.4.0/ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-ambari-nar/1.4.0/org.apache.nifi.reporting.ambari.AmbariReportingTask/ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-ambari-nar/1.4.0/org.apache.nifi.reporting.ambari.AmbariReportingTask/additionalDetails.html nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-ambari-nar/1.4.0/org.apache.nifi.reporting.ambari.AmbariReportingTask/index.html nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-amqp-nar/ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-amqp-nar/1.4.0/ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-amqp-nar/1.4.0/org.apache.nifi.amqp.processors.ConsumeAMQP/ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-amqp-nar/1.4.0/org.apache.nifi.amqp.processors.ConsumeAMQP/additionalDetails.html nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-amqp-nar/1.4.0/org.apache.nifi.amqp.processors.ConsumeAMQP/index.html nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-amqp-nar/1.4.0/org.apache.nifi.amqp.processors.PublishAMQP/ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-amqp-nar/1.4.0/org.apache.nifi.amqp.processors.PublishAMQP/additionalDetails.html nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-amqp-nar/1.4.0/org.apache.nifi.amqp.processors.PublishAMQP/index.html nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-avro-nar/ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-avro-nar/1.4.0/ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-avro-nar/1.4.0/org.apache.nifi.processors.avro.ConvertAvroToJSON/ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-avro-nar/1.4.0/org.apache.nifi.processors.avro.ConvertAvroToJSON/index.html nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-avro-nar/1.4.0/org.apache.nifi.processors.avro.ExtractAvroMetadata/ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-avro-nar/1.4.0/org.apache.nifi.processors.avro.ExtractAvroMetadata/index.html nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-avro-nar/1.4.0/org.apache.nifi.processors.avro.SplitAvro/ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-avro-nar/1.4.0/org.apache.nifi.processors.avro.SplitAvro/index.html nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.4.0/ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.4.0/org.apache.nifi.processors.aws.cloudwatch.PutCloudWatchMetric/ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.4.0/org.apache.nifi.processors.aws.cloudwatch.PutCloudWatchMetric/index.html nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.4.0/org.apache.nifi.processors.aws.credentials.provider.service.AWSCredentialsProviderControllerService/ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.4.0/org.apache.nifi.processors.aws.credentials.provider.service.AWSCredentialsProviderControllerService/index.html nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.4.0/org.apache.nifi.processors.aws.dynamodb.DeleteDynamoDB/ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.4.0/org.apache.nifi.processors.aws.dynamodb.DeleteDynamoDB/index.html nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.4.0/org.apache.nifi.processors.aws.dynamodb.GetDynamoDB/ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.4.0/org.apache.nifi.processors.aws.dynamodb.GetDynamoDB/index.html nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.4.0/org.apache.nifi.processors.aws.dynamodb.PutDynamoDB/ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.4.0/org.apache.nifi.processors.aws.dynamodb.PutDynamoDB/index.html nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.4.0/org.apache.nifi.processors.aws.kinesis.firehose.PutKinesisFirehose/ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.4.0/org.apache.nifi.processors.aws.kinesis.firehose.PutKinesisFirehose/index.html
svn commit: r1811008 [32/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compo
Added: nifi/site/trunk/docs/nifi-docs/html/expression-language-guide.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/html/expression-language-guide.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/html/expression-language-guide.html (added) +++ nifi/site/trunk/docs/nifi-docs/html/expression-language-guide.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1,3938 @@ + + + + + + + + + +Apache NiFi Expression Language Guide + +/* Asciidoctor default stylesheet | MIT License | http://asciidoctor.org */ +/* Copyright (C) 2012-2015 Dan Allen, Ryan Waldron and the Asciidoctor Project + +Permission is hereby granted, free of charge, to any person obtaining a copy +of this software and associated documentation files (the "Software"), to deal +in the Software without restriction, including without limitation the rights +to use, copy, modify, merge, publish, distribute, sublicense, and/or sell +copies of the Software, and to permit persons to whom the Software is +furnished to do so, subject to the following conditions: + +The above copyright notice and this permission notice shall be included in +all copies or substantial portions of the Software. + +THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR +IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, +FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE +AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER +LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, +OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN +THE SOFTWARE. */ +/* Remove the comments around the @import statement below when using this as a custom stylesheet */ +@import "https://fonts.googleapis.com/css?family=Open+Sans:300,300italic,400,400italic,600,600italic%7CNoto+Serif:400,400italic,700,700italic%7CDroid+Sans+Mono:400"; +article,aside,details,figcaption,figure,footer,header,hgroup,main,nav,section,summary{display:block} +audio,canvas,video{display:inline-block} +audio:not([controls]){display:none;height:0} +[hidden],template{display:none} +script{display:none!important} +html{font-family:sans-serif;-ms-text-size-adjust:100%;-webkit-text-size-adjust:100%} +body{margin:0} +a{background:transparent} +a:focus{outline:thin dotted} +a:active,a:hover{outline:0} +h1{font-size:2em;margin:.67em 0} +abbr[title]{border-bottom:1px dotted} +b,strong{font-weight:bold} +dfn{font-style:italic} +hr{-moz-box-sizing:content-box;box-sizing:content-box;height:0} +mark{background:#ff0;color:#000} +code,kbd,pre,samp{font-family:monospace;font-size:1em} +pre{white-space:pre-wrap} +q{quotes:"\201C" "\201D" "\2018" "\2019"} +small{font-size:80%} +sub,sup{font-size:75%;line-height:0;position:relative;vertical-align:baseline} +sup{top:-.5em} +sub{bottom:-.25em} +img{border:0} +svg:not(:root){overflow:hidden} +figure{margin:0} +fieldset{border:1px solid silver;margin:0 2px;padding:.35em .625em .75em} +legend{border:0;padding:0} +button,input,select,textarea{font-family:inherit;font-size:100%;margin:0} +button,input{line-height:normal} +button,select{text-transform:none} +button,html input[type="button"],input[type="reset"],input[type="submit"]{-webkit-appearance:button;cursor:pointer} +button[disabled],html input[disabled]{cursor:default} +input[type="checkbox"],input[type="radio"]{box-sizing:border-box;padding:0} +input[type="search"]{-webkit-appearance:textfield;-moz-box-sizing:content-box;-webkit-box-sizing:content-box;box-sizing:content-box} +input[type="search"]::-webkit-search-cancel-button,input[type="search"]::-webkit-search-decoration{-webkit-appearance:none} +button::-moz-focus-inner,input::-moz-focus-inner{border:0;padding:0} +textarea{overflow:auto;vertical-align:top} +table{border-collapse:collapse;border-spacing:0} +*,*:before,*:after{-moz-box-sizing:border-box;-webkit-box-sizing:border-box;box-sizing:border-box} +html,body{font-size:100%} +body{background:#fff;color:rgba(0,0,0,.8);padding:0;margin:0;font-family:"Noto Serif","DejaVu Serif",serif;font-weight:400;font-style:normal;line-height:1;position:relative;cursor:auto} +a:hover{cursor:pointer} +img,object,embed{max-width:100%;height:auto} +object,embed{height:100%} +img{-ms-interpolation-mode:bicubic} +#map_canvas img,#map_canvas embed,#map_canvas object,.map_canvas img,.map_canvas embed,.map_canvas object{max-width:none!important} +.left{float:left!important} +.right{float:right!important} +.text-left{text-align:left!important} +.text-right{text-align:right!important} +.text-center{text-align:center!important}
svn commit: r1811008 [22/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compo
Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.HashContent/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.HashContent/index.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.HashContent/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.HashContent/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1 @@ +HashContentwindow.onload = function(){if(self==top) { document.getElementById('nameHeader').style.display = "inherit"; } }HashContentDescription: Calculates a hash value for the Content of a FlowFile and puts that hash value on the FlowFile as an attribute whose name is determined by the Hash Attribute Name propertyTags: hash, content, MD5, SHA-1, SHA-256Properties: In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values.NameDefault ValueAllowable ValuesDescriptionHash Attribute Namehash.valueThe name of the FlowFile Attribute into which the Hash Value should be written. If the value already exists, it will be overwrittenHash AlgorithmMD5SHA-1SHA-384SKEIN-512-256SKEIN-1024-384BLAKE2B-160SHAKECCAK-288WHIRLPOOLSKEIN-512-384SHA-224SM3BLAKE2B-512GOST3411-2012-512SKEIN-512-128KECCAK-256BLAKE2B-384OID.2.16.840.1.101.3.4.2.10SKEIN-256-160SHA-256SHA3-256KECCAK-384SKEIN-256-128KECCAK-224SKEIN-512-512SKEIN-1024-512SKEIN-512-160GOST3411BLAKE2B-256SKEIN-1024-1024SHA3- 384OID.2.16.840.1.101.3.4.2.9SHA-512/224OID.2.16.840.1.101.3.4.2.8OID.2.16.840.1.101.3.4.2.7TIGERRIPEMD256SKEIN-256-256SHA3-224SHA3-512RIPEMD3202.16.840.1.101.3.4.2.9RIPEMD160GOST3411-2012-256KECCAK-512SKEIN-512-2242.16.840.1.101.3.4.2.82.16.840.1.101.3.4.2.72.16.840.1.101.3.4.2.10SHA-512/256MD2RIPEMD128MD4SHA-512SKEIN-256-224MD5Determines what hashing algorithm should be used to perform the hashing functionRelationships: NameDescriptionsuccessFlowFiles that are process successfully will be sent to this relationshipfailureAny FlowFile that cannot be processed successfully will be sent to this relationship without any attribute being addedReads Attributes: None specified.Writes Attributes: NameDescriptionHash Attribute NameThis Processor adds an attribute whose value is the result of Hashing the existing FlowFile content. The name of this attribute is specified by the Hash Attribute Name propertyState management: This component does not store state.Restricted: This component is not restricted.Input requirement: This component requires an incoming relationship. \ No newline at end of file Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.IdentifyMimeType/additionalDetails.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.IdentifyMimeType/additionalDetails.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.IdentifyMimeType/additionalDetails.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.IdentifyMimeType/additionalDetails.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1,64 @@ + + + + + +IdentifyMimeType + + + + + +The following is a non-exhaustive list of MIME Types detected: + + +application/gzip +application/bzip2 +application/flowfile-v3 +application/flowfile-v1 +application/xml +video/mp4 +video/x-m4v +video/mp4a-latm +video/quicktime +video/mpeg +audio/wav +audio/mp3 +image/bmp +image/png +image/jpg +image/gif +image/tif +application/vnd.ms-works +application/msexcel +application/mspowerpoint +application/msaccess +application/x-ms-wmv +application/pdf +application/x-rpm +application/tar +application/x-7z-compressed +application/java-archive +application/zip +application/x-lzh + +For a complete list, please refer to +
svn commit: r1811008 [7/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compon
Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-email-nar/1.4.0/org.apache.nifi.processors.email.ExtractEmailAttachments/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-email-nar/1.4.0/org.apache.nifi.processors.email.ExtractEmailAttachments/index.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-email-nar/1.4.0/org.apache.nifi.processors.email.ExtractEmailAttachments/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-email-nar/1.4.0/org.apache.nifi.processors.email.ExtractEmailAttachments/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1 @@ +ExtractEmailAttachmentswindow.onload = function(){if(self==top) { document.getElementById('nameHeader').style.display = "inherit"; } }ExtractEmailAttachmentsDescription: Extract attachments from a mime formatted email file, splitting them into individual flowfiles.Tags: split, emailProperties: This component has no required or optional properties.Relationships: NameDescriptionfailureFlowfiles that could not be parsedoriginalThe original fileattachmentsEach individual attachment will be routed to the attachments relationshipReads Attributes: None specified.Writes Attributes: NameDescriptionfilename The filename of the attachmentemail.attachment.parent.filename The filename of the parent FlowFileemail.attachment.parent.uuidThe UUID of the original FlowFile.mime.typeThe mime type of the attachment.State management: This component does not store state.Restricted: This component is not restricted.Input requirement: This component requires an incoming relationship. \ No newline at end of file Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-email-nar/1.4.0/org.apache.nifi.processors.email.ExtractEmailHeaders/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-email-nar/1.4.0/org.apache.nifi.processors.email.ExtractEmailHeaders/index.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-email-nar/1.4.0/org.apache.nifi.processors.email.ExtractEmailHeaders/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-email-nar/1.4.0/org.apache.nifi.processors.email.ExtractEmailHeaders/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1 @@ +ExtractEmailHeaderswindow.onload = function(){if(self==top) { document.getElementById('nameHeader').style.display = "inherit"; } }ExtractEmailHeadersDescription: Using the flowfile content as source of data, extract header from an RFC compliant email file adding the relevant attributes to the flowfile. This processor does not perform extensive RFC validation but still requires a bare minimum compliance with RFC 2822Tags: split, emailProperties: In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values.Name< /th>Default ValueAllowable ValuesDescriptionAdditional Header Listx-mailerCOLON separated list of additional headers to be extracted from the flowfile content.NOTE the header key is case insensitive and will be matched as lower-case. Values will respect email contents.Email Address ParsingtrueStrict Address Parsing Non-Strict Address Parsing If "strict", strict address format parsing rules are applied to mailbox and mailbox list fields, such as "to" and "from" headers, and FlowFiles with poorly formed addresses will be routed to the failure relationship, similar to messages that fail RFC compliant format validation. If "non-strict", the processor will extract the contents of mailbox list headers as comma-separated values without attempting to parse each value as well-formed Internet mailbox addresses. This is optional and defaults to Strict Address ParsingRelationships: NameDescriptionsuccessExtraction was successfulfailureFlowfiles that could not be parsed as a RF C-2822 compliant messageReads Attributes: None specified.Writes Attributes: NameDescriptionemail.headers.bcc.*Each individual BCC recipient (if available)email.headers.cc.*Each individual CC recipient (if available)email.headers.from.*Each individual mailbox contained in the From of the Email (array as per RFC-2822)email.headers.message-idThe value of the Message-ID header (if available)email.headers.received_dateThe Received-Date of the message (if available)email.headers.sent_dateDate the message was sentemail.headers.subjectSubject of the message (if available)email.headers.to.*Each individual TO recipient (if available)email.attachment_countNumber of attachm ents of the messageState management: This component does not store state.Restricted: This
svn commit: r1811008 [30/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compo
Added: nifi/site/trunk/docs/nifi-docs/html/administration-guide.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/html/administration-guide.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/html/administration-guide.html (added) +++ nifi/site/trunk/docs/nifi-docs/html/administration-guide.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1,6631 @@ + + + + + + + + + +NiFi System Administrators Guide + +/* Asciidoctor default stylesheet | MIT License | http://asciidoctor.org */ +/* Copyright (C) 2012-2015 Dan Allen, Ryan Waldron and the Asciidoctor Project + +Permission is hereby granted, free of charge, to any person obtaining a copy +of this software and associated documentation files (the "Software"), to deal +in the Software without restriction, including without limitation the rights +to use, copy, modify, merge, publish, distribute, sublicense, and/or sell +copies of the Software, and to permit persons to whom the Software is +furnished to do so, subject to the following conditions: + +The above copyright notice and this permission notice shall be included in +all copies or substantial portions of the Software. + +THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR +IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, +FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE +AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER +LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, +OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN +THE SOFTWARE. */ +/* Remove the comments around the @import statement below when using this as a custom stylesheet */ +@import "https://fonts.googleapis.com/css?family=Open+Sans:300,300italic,400,400italic,600,600italic%7CNoto+Serif:400,400italic,700,700italic%7CDroid+Sans+Mono:400"; +article,aside,details,figcaption,figure,footer,header,hgroup,main,nav,section,summary{display:block} +audio,canvas,video{display:inline-block} +audio:not([controls]){display:none;height:0} +[hidden],template{display:none} +script{display:none!important} +html{font-family:sans-serif;-ms-text-size-adjust:100%;-webkit-text-size-adjust:100%} +body{margin:0} +a{background:transparent} +a:focus{outline:thin dotted} +a:active,a:hover{outline:0} +h1{font-size:2em;margin:.67em 0} +abbr[title]{border-bottom:1px dotted} +b,strong{font-weight:bold} +dfn{font-style:italic} +hr{-moz-box-sizing:content-box;box-sizing:content-box;height:0} +mark{background:#ff0;color:#000} +code,kbd,pre,samp{font-family:monospace;font-size:1em} +pre{white-space:pre-wrap} +q{quotes:"\201C" "\201D" "\2018" "\2019"} +small{font-size:80%} +sub,sup{font-size:75%;line-height:0;position:relative;vertical-align:baseline} +sup{top:-.5em} +sub{bottom:-.25em} +img{border:0} +svg:not(:root){overflow:hidden} +figure{margin:0} +fieldset{border:1px solid silver;margin:0 2px;padding:.35em .625em .75em} +legend{border:0;padding:0} +button,input,select,textarea{font-family:inherit;font-size:100%;margin:0} +button,input{line-height:normal} +button,select{text-transform:none} +button,html input[type="button"],input[type="reset"],input[type="submit"]{-webkit-appearance:button;cursor:pointer} +button[disabled],html input[disabled]{cursor:default} +input[type="checkbox"],input[type="radio"]{box-sizing:border-box;padding:0} +input[type="search"]{-webkit-appearance:textfield;-moz-box-sizing:content-box;-webkit-box-sizing:content-box;box-sizing:content-box} +input[type="search"]::-webkit-search-cancel-button,input[type="search"]::-webkit-search-decoration{-webkit-appearance:none} +button::-moz-focus-inner,input::-moz-focus-inner{border:0;padding:0} +textarea{overflow:auto;vertical-align:top} +table{border-collapse:collapse;border-spacing:0} +*,*:before,*:after{-moz-box-sizing:border-box;-webkit-box-sizing:border-box;box-sizing:border-box} +html,body{font-size:100%} +body{background:#fff;color:rgba(0,0,0,.8);padding:0;margin:0;font-family:"Noto Serif","DejaVu Serif",serif;font-weight:400;font-style:normal;line-height:1;position:relative;cursor:auto} +a:hover{cursor:pointer} +img,object,embed{max-width:100%;height:auto} +object,embed{height:100%} +img{-ms-interpolation-mode:bicubic} +#map_canvas img,#map_canvas embed,#map_canvas object,.map_canvas img,.map_canvas embed,.map_canvas object{max-width:none!important} +.left{float:left!important} +.right{float:right!important} +.text-left{text-align:left!important} +.text-right{text-align:right!important} +.text-center{text-align:center!important} +.text-justify{text-align:justify!important} +.hide{display:none}
svn commit: r1811008 [9/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compon
Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-hadoop-nar/1.4.0/org.apache.nifi.processors.hadoop.inotify.GetHDFSEvents/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-hadoop-nar/1.4.0/org.apache.nifi.processors.hadoop.inotify.GetHDFSEvents/index.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-hadoop-nar/1.4.0/org.apache.nifi.processors.hadoop.inotify.GetHDFSEvents/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-hadoop-nar/1.4.0/org.apache.nifi.processors.hadoop.inotify.GetHDFSEvents/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1 @@ +GetHDFSEventswindow.onload = function(){if(self==top) { document.getElementById('nameHeader').style.display = "inherit"; } }GetHDFSEventsDescription: This processor polls the notification events provided by the HdfsAdmin API. Since this uses the HdfsAdmin APIs it is required to run as an HDFS super user. Currently there are six types of events (append, close, create, metadata, rename, and unlink). Please see org.apache.hadoop.hdfs.inotify.Event documentation for full explanations of each event. This processor will poll for new events based on a defined duration. For each event received a new flow file will be created with the expected attributes and the event itself serialized to JSON and written to th e flow file's content. For example, if event.type is APPEND then the content of the flow file will contain a JSON file containing the information about the append event. If successful the flow files are sent to the 'success' relationship. Be careful of where the generated flow files are stored. If the flow files are stored in one of processor's watch directories there will be a never ending flow of events. It is also important to be aware that this processor must consume all events. The filtering must happen within the processor. This is because the HDFS admin's event notifications API does not have filtering.Tags: hadoop, events, inotify, notifications, filesystemProperties: In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.NameDefault ValueAllowable ValuesDescriptionHadoop Configuration ResourcesA file or comma separated list of files which contains the Hadoop file system configuration. Without this, Hadoop will search the classpath for a 'core-site.xml' and 'hdfs-site.xml' file or will revert to a default configuration.Supports Expression Language: trueKerberos PrincipalKerberos principal to authenticate as. Requires nifi.kerberos.krb5.file to be set in your nifi.propertiesSupports Expression Language: trueKerberos KeytabKerbero s keytab associated with the principal. Requires nifi.kerberos.krb5.file to be set in your nifi.propertiesSupports Expression Language: trueKerberos Relogin Period4 hoursPeriod of time which should pass before attempting a kerberos reloginSupports Expression Language: trueAdditional Classpath ResourcesA comma-separated list of paths to files and/or directories that will be added to the classpath. When specifying a directory, all files with in the directory will be added to the classpath, but further sub-directories will not be included.Poll Duration1 secondThe time before the polling method returns with the next batch of events if they exist. It may exceed this amount of time by up to the time required for an RPC to the NameNode.HDFS Path to WatchThe HDFS path to get event notifications for. This property accepts both expression language and regular expressions. This will be evaluated during the OnScheduled phase.Supports Expression Language: trueIgnore Hidden FilesfalsetruefalseIf true and the final component of the path associated with a given event starts with a '.' then that event will not be processed.Event Types to Filter Onappend, close, create, metadata, rename, unlinkA comma-separated list of event types to process. Valid event types are: append, close, create, metadata, rename, and unlink. Case does not matter.IOException Retries During Event Polling3According to the HDFS admin API for event polling it is good to retry at least a few times. This number defines how many times the poll will be retried if it throws an IOException.Relationships: NameDescriptionsuccessA flow file with updated information about a specific event will be sent to this relationship.Reads Attributes: None specified.Writes Attributes: NameDescriptionmime.typeThis is always application/json.hdfs.inotify.event.typeThis will specify the specific HDFS >notification event type. Currently there are six types of events (append, >close, create, metadata, rename, and
svn commit: r1811008 [5/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compon
Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-ccda-nar/1.4.0/org.apache.nifi.processors.ccda.ExtractCCDAAttributes/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-ccda-nar/1.4.0/org.apache.nifi.processors.ccda.ExtractCCDAAttributes/index.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-ccda-nar/1.4.0/org.apache.nifi.processors.ccda.ExtractCCDAAttributes/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-ccda-nar/1.4.0/org.apache.nifi.processors.ccda.ExtractCCDAAttributes/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1 @@ +ExtractCCDAAttributeswindow.onload = function(){if(self==top) { document.getElementById('nameHeader').style.display = "inherit"; } }ExtractCCDAAttributesDescription: Extracts information from an Consolidated CDA formatted FlowFile and provides individual attributes as FlowFile attributes. The attributes are named as Parent dot Key. If the Parent is repeating, the naming will be Parent underscore Parent Index dot Key. For example, section.act_07.observation.name=Essential hypertensionAdditional Details...Tags: CCDA, healthcare, extract, attributesProperties: In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values.NameDefault ValueAllowable ValuesDescriptionSkip ValidationtruetruefalseWhether or not to validate CDA message valuesRelationships: NameDescriptionsuccessA FlowFile is routed to this relationship if it is properly parsed as CDA and its contents extracted as attributes.failureA FlowFile is routed to this relationship if it cannot be parsed as CDA or its contents extracted as attributes.Reads Attributes: None specified.Writes Attributes: < /h3>None specified.State management: This component does not store state.Restricted: This component is not restricted.Input requirement: This component requires an incoming relationship. \ No newline at end of file Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-cdc-mysql-nar/1.4.0/org.apache.nifi.cdc.mysql.processors.CaptureChangeMySQL/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-cdc-mysql-nar/1.4.0/org.apache.nifi.cdc.mysql.processors.CaptureChangeMySQL/index.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-cdc-mysql-nar/1.4.0/org.apache.nifi.cdc.mysql.processors.CaptureChangeMySQL/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-cdc-mysql-nar/1.4.0/org.apache.nifi.cdc.mysql.processors.CaptureChangeMySQL/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1 @@ +CaptureChangeMySQLwindow.onload = function(){if(self==top) { document.getElementById('nameHeader').style.display = "inherit"; } }CaptureChangeMySQLDescription: Retrieves Change Data Capture (CDC) events from a MySQL database. CDC Events include INSERT, UPDATE, DELETE operations. Events are output as individual flow files ordered by the time at which the operation occurred.Tags: sql, jdbc, cdc, mysqlProperties: In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values, whether a property supports the NiFi Expression Language, and whether a property is considered "sensitive", meaning that its value will be encrypted. Before entering a value in a sensitive property, ensure that the nifi.properties file has an entry for the property nifi.sensitive.props.key.NameDefault ValueAllowable ValuesDescriptionMySQL HostsA list of hostname/port entries corresponding to nodes in a MySQL cluster. The entries should be comma separated using a colon such as host1:port,host2:port, For example mysql.myhost.com:3306. This processor will attempt to connect to the hosts in the list in order. If one node goes down and failover is enabled for the cluster, then the processor will connect to the active node (assuming its host entry is specified in this pro perty. The default port for MySQL connections is 3306.Supports Expression Language: trueMySQL Driver Class Namecom.mysql.jdbc.DriverThe class name of the MySQL database driver classSupports Expression Language: trueMySQL Driver Location(s)Comma-separated list of files/folders and/or URLs containing the MySQL driver JAR and its dependencies (if any). For example '/var/tmp/mysql-connector-java-5.1.38-bin.jar'Supports Expression Language: trueUsernameUsername to access the MySQL clusterSupports Expression Language: truePa sswordPassword to access the MySQL clusterSensitive Property: trueSupports
svn commit: r1811008 [34/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compo
Added: nifi/site/trunk/docs/nifi-docs/html/images/CopyOnWrite.png URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/html/images/CopyOnWrite.png?rev=1811008=auto == Binary file - no diff available. Propchange: nifi/site/trunk/docs/nifi-docs/html/images/CopyOnWrite.png -- svn:mime-type = application/octet-stream Added: nifi/site/trunk/docs/nifi-docs/html/images/DataIngress.png URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/html/images/DataIngress.png?rev=1811008=auto == Binary file - no diff available. Propchange: nifi/site/trunk/docs/nifi-docs/html/images/DataIngress.png -- svn:mime-type = application/octet-stream Added: nifi/site/trunk/docs/nifi-docs/html/images/Funnels.png URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/html/images/Funnels.png?rev=1811008=auto == Binary file - no diff available. Propchange: nifi/site/trunk/docs/nifi-docs/html/images/Funnels.png -- svn:mime-type = application/octet-stream Added: nifi/site/trunk/docs/nifi-docs/html/images/PassByReference.png URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/html/images/PassByReference.png?rev=1811008=auto == Binary file - no diff available. Propchange: nifi/site/trunk/docs/nifi-docs/html/images/PassByReference.png -- svn:mime-type = application/octet-stream Added: nifi/site/trunk/docs/nifi-docs/html/images/UpdatingAttributes.png URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/html/images/UpdatingAttributes.png?rev=1811008=auto == Binary file - no diff available. Propchange: nifi/site/trunk/docs/nifi-docs/html/images/UpdatingAttributes.png -- svn:mime-type = application/octet-stream Added: nifi/site/trunk/docs/nifi-docs/html/images/WebCrawler.png URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/html/images/WebCrawler.png?rev=1811008=auto == Binary file - no diff available. Propchange: nifi/site/trunk/docs/nifi-docs/html/images/WebCrawler.png -- svn:mime-type = application/octet-stream Added: nifi/site/trunk/docs/nifi-docs/html/images/access-policy-config-start.png URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/html/images/access-policy-config-start.png?rev=1811008=auto == Binary file - no diff available. Propchange: nifi/site/trunk/docs/nifi-docs/html/images/access-policy-config-start.png -- svn:mime-type = application/octet-stream Added: nifi/site/trunk/docs/nifi-docs/html/images/add-controller-service-window.png URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/html/images/add-controller-service-window.png?rev=1811008=auto == Binary file - no diff available. Propchange: nifi/site/trunk/docs/nifi-docs/html/images/add-controller-service-window.png -- svn:mime-type = application/octet-stream Added: nifi/site/trunk/docs/nifi-docs/html/images/add-processor-version-example.png URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/html/images/add-processor-version-example.png?rev=1811008=auto == Binary file - no diff available. Propchange: nifi/site/trunk/docs/nifi-docs/html/images/add-processor-version-example.png -- svn:mime-type = application/octet-stream Added: nifi/site/trunk/docs/nifi-docs/html/images/add-processor-version-sort-filter.png URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/html/images/add-processor-version-sort-filter.png?rev=1811008=auto == Binary file - no diff available. Propchange: nifi/site/trunk/docs/nifi-docs/html/images/add-processor-version-sort-filter.png
svn commit: r1811008 [4/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compon
Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.4.0/org.apache.nifi.processors.aws.sns.PutSNS/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.4.0/org.apache.nifi.processors.aws.sns.PutSNS/index.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.4.0/org.apache.nifi.processors.aws.sns.PutSNS/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.4.0/org.apache.nifi.processors.aws.sns.PutSNS/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1 @@ +PutSNSwindow.onload = function(){if(self==top) { document.getElementById('nameHeader').style.display = "inherit"; } }PutSNSDescription: Sends the content of a FlowFile as a notification to the Amazon Simple Notification ServiceTags: amazon, aws, sns, topic, put, publish, pubsubProperties: In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values, whether a property supports the NiFi Expression Language, and whether a property is considered "sensitive", meaning that its value wil l be encrypted. Before entering a value in a sensitive property, ensure that the nifi.properties file has an entry for the property nifi.sensitive.props.key.NameDefault ValueAllowable ValuesDescriptionAmazon Resource Name (ARN)The name of the resource to which notifications should be publishedSupports Expression Language: trueARN TypeTopic ARNTopic ARN Target ARN The type of Amazon Resource Name that is being used.E-mail SubjectThe optional subject to use for any subscribers that are subscribed via E-mailSupports Expression Language: trueRegionus-west-2us-gov-west-1 us-east-1 us-east-2 us-west-1 us-west-2 eu-west-1 eu-west-2 eu-central-1 ap-south-1 ap-southeast-1 ap-southeast-2 ap-northeast-1 ap-northeast-2 sa-east-1 cn-north-1 ca-central-1 No Description Provided.Access KeyNo Description Provided.Sensitive Property: trueSupports Expression Language: trueSecret KeyNo Description Provided.Sensitive Property: trueSupports Expression Language: true< /tr>Credentials FilePath to a file containing AWS access key and secret key in properties file format.AWS Credentials Provider serviceController Service API: AWSCredentialsProviderServiceImplementation: AWSCredentialsProviderControllerServiceThe Controller Service that is used to obtain aws credentials providerCommunications Timeout30 secsNo Description Provided.Use JSON StructurefalsetruefalseIf true, the contents of the FlowFile must be JSON with a top-level element named 'default'. Additional elements can be used to send different messages to different protocols. See the Amazon SNS Documentation for more information.Character SetUTF-8The character set in which the FlowFile's content is encodedSupports Expression Language: trueProxy HostProxy host name or IPSupports Expression Language: trueProxy Host PortProxy host portSupports Expression Language: trueRelatio nships: NameDescriptionsuccessFlowFiles are routed to success relationshipfailureFlowFiles are routed to failure relationshipReads Attributes: None specified.Writes Attributes: None specified.State management: This component does not store state.Restricted: This component is not restricted.Input requirement: This component requires an incoming relationship.See Also:GetSQS, PutSQS \ No newline at end of file Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.4.0/org.apache.nifi.processors.aws.sqs.DeleteSQS/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.4.0/org.apache.nifi.processors.aws.sqs.DeleteSQS/index.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.4.0/org.apache.nifi.processors.aws.sqs.DeleteSQS/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-aws-nar/1.4.0/org.apache.nifi.processors.aws.sqs.DeleteSQS/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1 @@ +DeleteSQSwindow.onload = function(){if(self==top) { document.getElementById('nameHeader').style.display = "inherit"; } }DeleteSQSDescription: Deletes a message from an Amazon Simple Queuing Service QueueTags: Amazon, AWS, SQS, Queue, DeleteProperties: In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values, whether a property supports the NiFi Expression Language, and whether a property is considered "sensitive", meaning that its value will be encrypted. Before entering a valu e in a sensitive property, ensure that the
svn commit: r1811008 [25/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compo
Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.PutDatabaseRecord/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.PutDatabaseRecord/index.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.PutDatabaseRecord/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.PutDatabaseRecord/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1 @@ +PutDatabaseRecordwindow.onload = function(){if(self==top) { document.getElementById('nameHeader').style.display = "inherit"; } }PutDatabaseRecordDescription: The PutDatabaseRecord processor uses a specified RecordReader to input (possibly multiple) records from an incoming flow file. These records are translated to SQL statements and executed as a single batch. If any errors occur, the flow file is routed to failure or retry, and if the records are transmitted successfully, the incoming flow file is routed to success. The type of statement executed by the processor is specified via the Statement Type property, which accepts some hard-coded values such as INSERT, UPDATE, and DELETE, as well as 'Use sta tement.type Attribute', which causes the processor to get the statement type from a flow file attribute. IMPORTANT: If the Statement Type is UPDATE, then the incoming records must not alter the value(s) of the primary keys (or user-specified Update Keys). If such records are encountered, the UPDATE statement issued to the database may do nothing (if no existing records with the new primary key values are found), or could inadvertently corrupt the existing data (by changing records for which the new values of the primary keys exist).Tags: sql, record, jdbc, put, database, update, insert, deleteProperties: In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.N ameDefault ValueAllowable ValuesDescriptionRecord ReaderController Service API: RecordReaderFactoryImplementations: CSVReaderGrokReaderAvroReaderJsonTreeReaderJsonPathReaderScriptedReaderSpecifies the Controller Service to use for parsing incoming data and determining the data's schema.Statement TypeUPDATEINSERTDELETEUse statement.type AttributeSpecifies the type of SQL Statement to generate. If 'Use statement.type Attribute' is chosen, then the value is taken from the statement.type attribute in the FlowFile. The 'Use statement.type Attribute' option is the only one that allows the 'SQL' statement type. If 'SQL' is specified, the value of the field specified by the 'Field Containing SQL' property is expected to be a valid SQL statement on the target database, and will be executed as-is.Database Connection Pooling ServiceController Service API: DBCPServiceImplementations: DBCPConnectionPoolHiveConnectionPoolThe Controller Service that is used to obtain a connection to the database for sending records.Catalog NameThe name of the catalog that the statement should update. This may not apply for the database that you are updating. In this case, leave the field emptySupports Expression Language: trueSchema NameThe name of the schema that the table belongs to. This may not apply for the database that you are updating. In this case, leave the field emptySupports Expression Language: trueTable NameThe name of the table that the statement should affect.Supports Expression Language: trueTranslate Field NamestruetruefalseIf true, the Processor will attempt to translate field names into the appropriate column names for the table specified. If false, the field names must match the column names exactly, or the column will not be updatedUnmatched Field BehaviorIgnore Unmatched FieldsIgnore Unmatched Fields Fail on Unmatched Fields If an incoming record has a field that does not map to any of the database table's columns, this property specifies how to handle the situationUnmatched Column BehaviorFail on Unmatched ColumnsIgnore Unmatched Columns Warn on Unmatched Columns Fail on Unmatched Columns If an incoming record does not have a field mapping for all of the database table's columns, this property specifies how to handle the situationUpdate KeysA comma-separated list of column names that uniquely identifies a row in the database for UPDATE statements. If the Statement Type is UPDATE and this property is not set, the table's Primary Keys are used. In this case, if no Primary Key exists, the conversion to SQL will fail if Unmatched Column Behaviour is set to
svn commit: r1811008 [37/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compo
Added: nifi/site/trunk/docs/nifi-docs/html/record-path-guide.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/html/record-path-guide.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/html/record-path-guide.html (added) +++ nifi/site/trunk/docs/nifi-docs/html/record-path-guide.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1,1468 @@ + + + + + + + + + +Apache NiFi RecordPath Guide + +/* Asciidoctor default stylesheet | MIT License | http://asciidoctor.org */ +/* Copyright (C) 2012-2015 Dan Allen, Ryan Waldron and the Asciidoctor Project + +Permission is hereby granted, free of charge, to any person obtaining a copy +of this software and associated documentation files (the "Software"), to deal +in the Software without restriction, including without limitation the rights +to use, copy, modify, merge, publish, distribute, sublicense, and/or sell +copies of the Software, and to permit persons to whom the Software is +furnished to do so, subject to the following conditions: + +The above copyright notice and this permission notice shall be included in +all copies or substantial portions of the Software. + +THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR +IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, +FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE +AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER +LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, +OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN +THE SOFTWARE. */ +/* Remove the comments around the @import statement below when using this as a custom stylesheet */ +@import "https://fonts.googleapis.com/css?family=Open+Sans:300,300italic,400,400italic,600,600italic%7CNoto+Serif:400,400italic,700,700italic%7CDroid+Sans+Mono:400"; +article,aside,details,figcaption,figure,footer,header,hgroup,main,nav,section,summary{display:block} +audio,canvas,video{display:inline-block} +audio:not([controls]){display:none;height:0} +[hidden],template{display:none} +script{display:none!important} +html{font-family:sans-serif;-ms-text-size-adjust:100%;-webkit-text-size-adjust:100%} +body{margin:0} +a{background:transparent} +a:focus{outline:thin dotted} +a:active,a:hover{outline:0} +h1{font-size:2em;margin:.67em 0} +abbr[title]{border-bottom:1px dotted} +b,strong{font-weight:bold} +dfn{font-style:italic} +hr{-moz-box-sizing:content-box;box-sizing:content-box;height:0} +mark{background:#ff0;color:#000} +code,kbd,pre,samp{font-family:monospace;font-size:1em} +pre{white-space:pre-wrap} +q{quotes:"\201C" "\201D" "\2018" "\2019"} +small{font-size:80%} +sub,sup{font-size:75%;line-height:0;position:relative;vertical-align:baseline} +sup{top:-.5em} +sub{bottom:-.25em} +img{border:0} +svg:not(:root){overflow:hidden} +figure{margin:0} +fieldset{border:1px solid silver;margin:0 2px;padding:.35em .625em .75em} +legend{border:0;padding:0} +button,input,select,textarea{font-family:inherit;font-size:100%;margin:0} +button,input{line-height:normal} +button,select{text-transform:none} +button,html input[type="button"],input[type="reset"],input[type="submit"]{-webkit-appearance:button;cursor:pointer} +button[disabled],html input[disabled]{cursor:default} +input[type="checkbox"],input[type="radio"]{box-sizing:border-box;padding:0} +input[type="search"]{-webkit-appearance:textfield;-moz-box-sizing:content-box;-webkit-box-sizing:content-box;box-sizing:content-box} +input[type="search"]::-webkit-search-cancel-button,input[type="search"]::-webkit-search-decoration{-webkit-appearance:none} +button::-moz-focus-inner,input::-moz-focus-inner{border:0;padding:0} +textarea{overflow:auto;vertical-align:top} +table{border-collapse:collapse;border-spacing:0} +*,*:before,*:after{-moz-box-sizing:border-box;-webkit-box-sizing:border-box;box-sizing:border-box} +html,body{font-size:100%} +body{background:#fff;color:rgba(0,0,0,.8);padding:0;margin:0;font-family:"Noto Serif","DejaVu Serif",serif;font-weight:400;font-style:normal;line-height:1;position:relative;cursor:auto} +a:hover{cursor:pointer} +img,object,embed{max-width:100%;height:auto} +object,embed{height:100%} +img{-ms-interpolation-mode:bicubic} +#map_canvas img,#map_canvas embed,#map_canvas object,.map_canvas img,.map_canvas embed,.map_canvas object{max-width:none!important} +.left{float:left!important} +.right{float:right!important} +.text-left{text-align:left!important} +.text-right{text-align:right!important} +.text-center{text-align:center!important} +.text-justify{text-align:justify!important} +.hide{display:none}
svn commit: r1811008 [16/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compo
Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-record-serialization-services-nar/1.4.0/org.apache.nifi.json.JsonPathReader/additionalDetails.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-record-serialization-services-nar/1.4.0/org.apache.nifi.json.JsonPathReader/additionalDetails.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-record-serialization-services-nar/1.4.0/org.apache.nifi.json.JsonPathReader/additionalDetails.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-record-serialization-services-nar/1.4.0/org.apache.nifi.json.JsonPathReader/additionalDetails.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1,246 @@ + + + + + +JsonPathReader + + + + + + The JsonPathReader Controller Service, parses FlowFiles that are in the JSON format. User-defined properties + specify how to extract all relevant fields from the JSON in order to create a Record. The Controller + Service will not be valid unless at least one JSON Path is provided. Unlike the + JsonTreeReader Controller Service, this + service will return a record that contains only those fields that have been configured via JSON Path. + + + + If the root of the FlowFile's JSON is a JSON Array, each JSON Object found in that array will be treated as a separate + Record, not as a single record made up of an array. If the root of the FlowFile's JSON is a JSON Object, it will be + evaluated as a single Record. + + + + Supplying a JSON Path is accomplished by adding a user-defined property where the name of the property becomes the name + of the field in the Record that is returned. The value of the property must be a valid JSON Path expression. This JSON Path + will be evaluated against each top-level JSON Object in the FlowFile, and the result will be the value of the field whose + name is specified by the property name. If any JSON Path is given but no field is present in the Schema with the proper name, + then the field will be skipped. + + + + This Controller Service must be configured with a schema. Each JSON Path that is evaluated and is found in the "root level" + of the schema will produce a Field in the Record. I.e., the schema should match the Record that is created by evaluating all + of the JSON Paths. It should not match the "incoming JSON" that is read from the FlowFile. + + + + Schemas and Type Coercion + + + When a record is parsed from incoming data, it is separated into fields. Each of these fields is then looked up against the + configured schema (by field name) in order to determine what the type of the data should be. If the field is not present in + the schema, that field is omitted from the Record. If the field is found in the schema, the data type of the received data + is compared against the data type specified in the schema. If the types match, the value of that field is used as-is. If the + schema indicates that the field should be of a different type, then the Controller Service will attempt to coerce the data + into the type specified by the schema. If the field cannot be coerced into the specified type, an Exception will be thrown. + + + + The following rules apply when attempting to coerce a field value from one data type to another: + + + + Any data type can be coerced into a String type. + Any numeric data type (Byte, Short, Int, Long, Float, Double) can be coerced into any other numeric data type. + Any numeric value can be coerced into a Date, Time, or Timestamp type, by assuming that the Long value is the number of + milliseconds since epoch (Midnight GMT, January 1, 1970). + A String value can be coerced into a Date, Time, or Timestamp type, if its format matches the configured "Date Format," "Time Format," + or "Timestamp Format." + A String value can be coerced into a numeric value if the value is of the appropriate type. For example, the String value + 8 can be coerced into any numeric type. However, the
svn commit: r1811008 [10/43] - in /nifi/site/trunk/docs: ./ nifi-docs/ nifi-docs/components/ nifi-docs/components/org.apache.nifi/ nifi-docs/components/org.apache.nifi/nifi-ambari-nar/ nifi-docs/compo
Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-hl7-nar/1.4.0/org.apache.nifi.processors.hl7.RouteHL7/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-hl7-nar/1.4.0/org.apache.nifi.processors.hl7.RouteHL7/index.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-hl7-nar/1.4.0/org.apache.nifi.processors.hl7.RouteHL7/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-hl7-nar/1.4.0/org.apache.nifi.processors.hl7.RouteHL7/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1 @@ +RouteHL7window.onload = function(){if(self==top) { document.getElementById('nameHeader').style.display = "inherit"; } }RouteHL7Description: Routes incoming HL7 data according to user-defined queries. To add a query, add a new property to the processor. The name of the property will become a new relationship for the processor, and the value is an HL7 Query Language query. If a FlowFile matches the query, a copy of the FlowFile will be routed to the associated relationship.Tags: HL7, healthcare, route, Health Level 7Properties: In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. Th e table also indicates any default values, and whether a property supports the NiFi Expression Language.NameDefault ValueAllowable ValuesDescriptionCharacter EncodingUTF-8The Character Encoding that is used to encode the HL7 dataSupports Expression Language: trueDynamic Properties: Dynamic Properties allow the user to specify both the name and value of a property.NameValueDescriptionName of a RelationshipAn HL7 Query Language queryIf a FlowFile matches the query, it will be routed to a relationship with the name of the propertyRelationships: NameDescriptionfailureAny FlowFile that cannot be parsed as HL7 will be routed to this relationshiporiginalThe original FlowFile that comes into this processor will be routed to this relationship, unless it is routed to 'failure'Reads Attributes: None specified.Writes Attributes: NameDescriptionRouteHL7.RouteThe name of the relationship to which the FlowFile was routedState management: This component does not store state.Restricted: This component is not restricted.Input requirement: This component requires an incoming relationship. \ No newline at end of file Added: nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-html-nar/1.4.0/org.apache.nifi.GetHTMLElement/index.html URL: http://svn.apache.org/viewvc/nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-html-nar/1.4.0/org.apache.nifi.GetHTMLElement/index.html?rev=1811008=auto == --- nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-html-nar/1.4.0/org.apache.nifi.GetHTMLElement/index.html (added) +++ nifi/site/trunk/docs/nifi-docs/components/org.apache.nifi/nifi-html-nar/1.4.0/org.apache.nifi.GetHTMLElement/index.html Tue Oct 3 13:30:16 2017 @@ -0,0 +1 @@ +GetHTMLElementwindow.onload = function(){if(self==top) { document.getElementById('nameHeader').style.display = "inherit"; } }GetHTMLElementDescription: Extracts HTML element values from the incoming flowfile's content using a CSS selector. The incoming HTML is first converted into a HTML Document Object Model so that HTML elements may be selected in the similar manner that CSS selectors are used to apply styles to HTML. The resulting HTML DOM is then "queried" using the user defined CSS selector string. The result of "querying" the HTML DOM may produce 0-N results. If no results are found the flowfile will be transferred to the "element not found" relationship to indicate so to the end user. If N resul ts are found a new flowfile will be created and emitted for each result. The query result will either be placed in the content of the new flowfile or as an attribute of the new flowfile. By default the result is written to an attribute. This can be controlled by the "Destination" property. Resulting query values may also have data prepended or appended to them by setting the value of property "Prepend Element Value" or "Append Element Value". Prepended and appended values are treated as string values and concatenated to the result retrieved from the HTML DOM query operation. A more thorough reference for the CSS selector syntax can be found at "http://jsoup.org/apidocs/org/jsoup/select/Selector.html;Tags: get, html, dom, css, elementProperties: In the list below, the names of required properties appear in bold. Any other properties (not in bold) are considered optional. The table also indicates any default values, and whether a proper ty supports the NiFi Expression Language.NameDefault ValueAllowable ValuesDescriptionURLBase URL for the HTML
svn commit: r1811006 - in /nifi/site/trunk/docs: nifi-docs/ nifi/ robots.txt
Author: jstorck Date: Tue Oct 3 13:26:17 2017 New Revision: 1811006 URL: http://svn.apache.org/viewvc?rev=1811006=rev Log: NIFI-4412 removing 1.3.0 docs in preparation for adding 1.4.0 docs Removed: nifi/site/trunk/docs/nifi/ nifi/site/trunk/docs/nifi-docs/ nifi/site/trunk/docs/robots.txt