http://git-wip-us.apache.org/repos/asf/falcon/blob/8e49379d/docs/src/site/twiki/restapi/InstanceList.twiki ---------------------------------------------------------------------- diff --git a/docs/src/site/twiki/restapi/InstanceList.twiki b/docs/src/site/twiki/restapi/InstanceList.twiki deleted file mode 100644 index 214c22f..0000000 --- a/docs/src/site/twiki/restapi/InstanceList.twiki +++ /dev/null @@ -1,151 +0,0 @@ ----++ GET /api/instance/list/:entity-type/:entity-name - * <a href="#Description">Description</a> - * <a href="#Parameters">Parameters</a> - * <a href="#Results">Results</a> - * <a href="#Examples">Examples</a> - ----++ Description -Get list of all instances of a given entity. - ----++ Parameters - * :entity-type Valid options are cluster, feed or process. - * :entity-name Name of the entity. - * start <optional param> Show instances from this date. Date format is yyyy-MM-dd'T'HH:mm'Z'. - * By default, it is set to (end - (10 * entityFrequency)). - * end <optional param> Show instances up to this date. Date format is yyyy-MM-dd'T'HH:mm'Z'. - * Default is set to now. - * colo <optional param> Colo on which the query should be run. - * lifecycle <optional param> Valid lifecycles for feed are Eviction/Replication(default) and for process is Execution(default). - * filterBy <optional param> Filter results by list of field:value pairs. Example: filterBy=STATUS:RUNNING,CLUSTER:primary-cluster - * Supported filter fields are STATUS, CLUSTER, SOURCECLUSTER, STARTEDAFTER. - * Query will do an AND among filterBy fields. - * orderBy <optional param> Field by which results should be ordered. - * Supports ordering by "status","startTime","endTime","cluster". - * sortOrder <optional param> Valid options are "asc" and "desc" - * offset <optional param> Show results from the offset, used for pagination. Defaults to 0. - * numResults <optional param> Number of results to show per request, used for pagination. Only integers > 0 are valid, Default is 10. - * doAs <optional query param> allows the current user to impersonate the user passed in doAs when interacting with the Falcon system. - * allAttempts <optional query param> To get all the attempts for corresponding instances. - ----++ Results -List of instances of given entity. - -The possible instance status returned and its meaning are as follows: - * WAITING - The instance is waiting for the corresponding data(feed) instances to become available. - * READY - The instance is ready to be scheduled. But, is waiting for scheduling conditions to be met. For example, limitation on number of instances that can be run in parallel. - * RUNNING - The instance is running on the workflow engine. - * FAILED - The instance has failed during execution. - * KILLED - The instance has been killed either manually or by the system. - * SUCCEEDED - The instance has executed successfully. - * SKIPPED - This instance was not executed, but was skipped. For example, when the execution order is LAST_ONLY, the older instances are skipped. - * ERROR - There was error while executing this instance on the workflow engine. - * UNDEFINED - The status of the instance could not be determined. ----++ Examples ----+++ Rest Call -<verbatim> -GET http://localhost:15000/api/instance/list/process/SampleProcess?colo=*&start=2012-04-03T07:00Z -</verbatim> ----+++ Result -<verbatim> -{ - "instances": [ - { - "details": "", - "endTime": "2013-10-21T14:40:26-07:00", - "startTime": "2013-10-21T14:39:56-07:00", - "cluster": "primary-cluster", - "logFile": "http:\/\/localhost:11000\/oozie?job=0000070-131021115933395-oozie-rgau-W", - "status": "SUCCEEDED", - "instance": "2012-04-03T07:00Z" - } - ], - "requestId": "default\/e15bb378-d09f-4911-9df2-5334a45153d2\n", - "message": "default\/STATUS\n", - "status": "SUCCEEDED" -} -</verbatim> - - ----+++ Rest Call -<verbatim> -GET http://localhost:15000/api/instance/list/process/SampleProcess?colo=*&start=2012-04-03T07:00Z&filterBy=STATUS:SUCCEEDED,CLUSTER:primary-cluster&orderBy=startTime&offset=2&numResults=2&doAs=joe -</verbatim> ----+++ Result -<verbatim> -{ - "instances": [ - { - "details": "", - "endTime": "2013-10-21T14:40:26-07:00", - "startTime": "2013-10-21T14:39:56-07:00", - "cluster": "primary-cluster", - "logFile": "http:\/\/localhost:11000\/oozie?job=0000070-131021115933395-oozie-rgau-W", - "status": "SUCCEEDED", - "instance": "2012-04-03T07:00Z" - }, - { - "details": "", - "endTime": "2013-10-21T14:42:26-07:00", - "startTime": "2013-10-21T14:41:56-07:00", - "cluster": "primary-cluster", - "logFile": "http:\/\/localhost:11000\/oozie?job=0000070-131021115933397-oozie-rgau-W", - "status": "SUCCEEDED", - "instance": "2012-04-03T08:00Z" - }, - ], - - "requestId": "default\/e15bb378-d09f-4911-9df2-5334a45153d2\n", - "message": "default\/STATUS\n", - "status": "SUCCEEDED" -} -</verbatim> - - ----+++ Rest Call -<verbatim> -GET https://localhost:15443/api/instance/status/process/oozie-mr-process?user.name=narayan&start=2013-11-15T00:05Z&end=2013-11-15T01:00Z&colo=*&offset=0&allAttempts=true -</verbatim> ----+++ Result -<verbatim> -{ - "status":"SUCCEEDED", - "message":"default/STATUS\n", - "requestId":"default/942519651@qtp-1386909980-16 - 5b11a8ba-402b-4cc7-969c-256e0ed18ae2\n", - "instances":[ - { - "instance":"2013-11-15T00:05Z", - "status":"SUCCEEDED", - "logFile":"http://IM1948-X0:11000/oozie?job=0000010-160106121750678-oozie-oozi-W";, - "cluster":"local", - "startTime":"2016-01-06T12:39:22+05:30", - "endTime":"2016-01-06T12:40:05+05:30", - "runId":0, - "details":"", - "actions":[ - { - "action":"mr-node", - "status":"SUCCEEDED", - "logFile":"http://localhost:8088/proxy/application_1452062826344_0010/"; - } - ] - }, - { - "instance":"2013-11-15T00:05Z", - "status":"SUCCEEDED", - "logFile":"http://IM1948-X0:11000/oozie?job=0000011-160106121750678-oozie-oozi-W";, - "cluster":"local", - "startTime":"2016-01-06T12:40:27+05:30", - "endTime":"2016-01-06T12:41:05+05:30", - "runId":0, - "details":"", - "actions":[ - { - "action":"mr-node", - "status":"SUCCEEDED", - "logFile":"http://localhost:8088/proxy/application_1452062826344_0012/"; - } - ] - } - ] -} -</verbatim>
http://git-wip-us.apache.org/repos/asf/falcon/blob/8e49379d/docs/src/site/twiki/restapi/InstanceLogs.twiki ---------------------------------------------------------------------- diff --git a/docs/src/site/twiki/restapi/InstanceLogs.twiki b/docs/src/site/twiki/restapi/InstanceLogs.twiki deleted file mode 100644 index 1e1c98d..0000000 --- a/docs/src/site/twiki/restapi/InstanceLogs.twiki +++ /dev/null @@ -1,113 +0,0 @@ ----++ GET /api/instance/logs/:entity-type/:entity-name - * <a href="#Description">Description</a> - * <a href="#Parameters">Parameters</a> - * <a href="#Results">Results</a> - * <a href="#Examples">Examples</a> - ----++ Description -Get log of a specific instance of an entity. - ----++ Parameters - * :entity-type Valid options are cluster, feed or process. - * :entity-name Name of the entity. - * start <optional param> Show instances from this date. Date format is yyyy-MM-dd'T'HH:mm'Z'. - * By default, it is set to (end - (10 * entityFrequency)). - * end <optional param> Show instances up to this date. Date format is yyyy-MM-dd'T'HH:mm'Z'. - * Default is set to now. - * colo <optional param> Colo on which the query should be run. - * runId <optional param> Run Id. - * lifecycle <optional param> Valid lifecycles for feed are Eviction/Replication(default) and for process is Execution(default). - * filterBy <optional param> Filter results by list of field:value pairs. Example: filterBy=STATUS:RUNNING,CLUSTER:primary-cluster - * Supported filter fields are STATUS, CLUSTER, SOURCECLUSTER, STARTEDAFTER. - * Query will do an AND among filterBy fields. - * orderBy <optional param> Field by which results should be ordered. - * Supports ordering by "status","startTime","endTime","cluster". - * sortOrder <optional param> Valid options are "asc" and "desc" - * offset <optional param> Show results from the offset, used for pagination. Defaults to 0. - * numResults <optional param> Number of results to show per request, used for pagination. Only integers > 0 are valid, Default is 10. - * doAs <optional query param> allows the current user to impersonate the user passed in doAs when interacting with the Falcon system. - ----++ Results -Log of specified instance. - ----++ Examples ----+++ Rest Call -<verbatim> -GET http://localhost:15000/api/instance/logs/process/SampleProcess?colo=*&start=2012-04-03T07:00Z -</verbatim> ----+++ Result -<verbatim> -{ - "instances": [ - { - "actions": [ - { - "logFile": "http:\/\/localhost:50070\/data\/apps\/falcon\/staging\/falcon\/workflows\/process\/SampleProcess\/logs\/job-2012-04-03-07-00\/000\/pig_SUCCEEDED.log", - "status": "SUCCEEDED", - "action": "pig" - } - ], - "details": "", - "endTime": "2013-10-21T14:40:26-07:00", - "startTime": "2013-10-21T14:39:56-07:00", - "cluster": "primary-cluster", - "logFile": "http:\/\/localhost:50070\/data\/apps\/falcon\/staging\/falcon\/workflows\/process\/SampleProcess\/logs\/job-2012-04-03-07-00\/000\/oozie.log", - "status": "SUCCEEDED", - "instance": "2012-04-03T07:00Z" - } - ], - "requestId": "default\/3527038e-8334-4e50-8173-76c4fa430d0b\n", - "message": "default\/STATUS\n", - "status": "SUCCEEDED" -} -</verbatim> - ----+++ Rest Call -<verbatim> -GET http://localhost:15000/api/instance/logs/process/SampleProcess?colo=*&start=2012-04-03T07:00Z&filterBy=STATUS:SUCCEEDED,CLUSTER:primary-cluster&orderBy=startTime&offset=2&numResults=2&doAs=joe -</verbatim> ----+++ Result -<verbatim> -{ - "instances": [ - { - "actions": [ - { - "logFile": "http:\/\/localhost:50070\/data\/apps\/falcon\/staging\/falcon\/workflows\/process\/SampleProcess\/logs\/job-2012-04-03-07-00\/000\/pig_SUCCEEDED.log", - "status": "SUCCEEDED", - "action": "pig" - } - ], - "details": "", - "endTime": "2013-10-21T14:40:26-07:00", - "startTime": "2013-10-21T14:39:56-07:00", - "cluster": "primary-cluster", - "logFile": "http:\/\/localhost:50070\/data\/apps\/falcon\/staging\/falcon\/workflows\/process\/SampleProcess\/logs\/job-2012-04-03-07-00\/000\/oozie.log", - "status": "SUCCEEDED", - "instance": "2012-04-03T07:00Z" - }, - { - "actions": [ - { - "logFile": "http:\/\/localhost:50070\/data\/apps\/falcon\/staging\/falcon\/workflows\/process\/SampleProcess\/logs\/job-2012-04-03-07-00\/001\/pig_SUCCEEDED.log", - "status": "SUCCEEDED", - "action": "pig" - } - ], - "details": "", - "endTime": "2013-10-21T14:42:27-07:00", - "startTime": "2013-10-21T14:41:57-07:00", - "cluster": "primary-cluster", - "logFile": "http:\/\/localhost:50070\/data\/apps\/falcon\/staging\/falcon\/workflows\/process\/SampleProcess\/logs\/job-2012-04-03-07-00\/001\/oozie.log", - "status": "SUCCEEDED", - "instance": "2012-04-03T08:00Z" - } - ], - "requestId": "default\/3527038e-8334-4e50-8173-76c4fa430d0b\n", - "message": "default\/STATUS\n", - "status": "SUCCEEDED" -} -</verbatim> - - - http://git-wip-us.apache.org/repos/asf/falcon/blob/8e49379d/docs/src/site/twiki/restapi/InstanceParams.twiki ---------------------------------------------------------------------- diff --git a/docs/src/site/twiki/restapi/InstanceParams.twiki b/docs/src/site/twiki/restapi/InstanceParams.twiki deleted file mode 100644 index 7a340a5..0000000 --- a/docs/src/site/twiki/restapi/InstanceParams.twiki +++ /dev/null @@ -1,83 +0,0 @@ ----++ GET /api/instance/params/:entity-type/:entity-name - * <a href="#Description">Description</a> - * <a href="#Parameters">Parameters</a> - * <a href="#Results">Results</a> - * <a href="#Examples">Examples</a> - ----++ Description -Get the params passed to the workflow for an instance of feed/process. - ----++ Parameters - * :entity-type Valid options are cluster, feed or process. - * :entity-name Name of the entity. - * start should be the nominal time of the instance for which you want the params to be returned - * colo <optional param> Colo on which the query should be run. - * lifecycle <optional param> Valid lifecycles for feed are Eviction/Replication(default) and for process is Execution(default). - * doAs <optional query param> allows the current user to impersonate the user passed in doAs when interacting with the Falcon system. - - ----++ Results -List of instances currently running. - ----++ Examples ----+++ Rest Call -<verbatim> -http://userqa.user.com:16000/api/instance/params/process/Sample-Process?start=2014-10-01T11:00Z&colo=*&doAs=joe -</verbatim> ----+++ Result -{ - "status": "SUCCEEDED", - "message": "ua1/PARAMS\n", - "requestId": "ua1/807e9fe6-ba60-490e-b720-f8dc8b92063e\n", - "instances": [ - { - "instance": "2014-10-01T11:00Z", - "status": "RUNNING", - "logFile": "http://spyke.user.com:11000/oozie?job=0000211-141117203201940-oozie-oozi-W";, - "cluster": "sample-cluster", - "startTime": "2014-11-19T19:46:29+08:00", - "details": "", - "actions": [ - { - "action": "succeeded-post-processing", - "status": "RUNNING", - "logFile": "http://spyke.user.com:50030/jobdetails.jsp?jobid=job_201411071450_1052"; - } - ], - "params": { - "entry": {"key": "jobTracker", "value": "10.16.114.113:8021"}, - "entry":{"key":"falconInputNames","value":"IGNORE"}, - "entry":{"key":"shouldRecord","value":"false"}, - "entry":{"key":"timeStamp","value":"2014-11-19-11-46"}, - "entry":{"key":"falconInPaths","value":"IGNORE"}, - "entry":{"key":"broker.url","value":"tcp://localhost:61616"}, - "entry":{"key":"feedNames","value":"NONE"}, - "entry":{"key":"falcon.libpath","value":"/path/falcon/sample/lib"}, - "entry":{"key":"ENTITY_PATH","value":"/path/falcon/staging/falcon/workflows/process/Sample-Process/9506be19980e0e6fdb709e1baffff_1416397585511/DEFAULT"}, - "entry":{"key":"entityType","value":"process"}, - "entry":{"key":"nominalTime","value":"2014-10-01-11-00"}, - "entry":{"key":"feedInstancePaths","value":"IGNORE"}, - "entry":{"key":"oozie.bundle.application.path","value":"hdfs://10.16.104.13:8020/path/falcon/staging/falcon/workflows/process/Sample-Process/9506be19980e0e669709e1baffff_1416397585511"}, - "entry":{"key":"logDir","value":"hdfs://10.16.104.13:8020/path/falcon/staging/falcon/workflows/process/Sample-Process/logs"}, - "entry":{"key":"userWorkflowEngine","value":"oozie"}, - "entry":{"key":"broker.ttlInMins","value":"4320"}, - "entry":{"key":"oozie.use.system.libpath","value":"true"}, - "entry":{"key":"queueName","value":"reports"}, - "entry":{"key":"falconDataOperation","value":"GENERATE"}, - "entry":{"key":"oozie.wf.external.id","value":"Sample-Process/DEFAULT/2014-10-01T11:00Z"}, - "entry":{"key":"workflowEngineUrl","value":"http://10.11.100.10:11000/oozie/"}, - "entry":{"key":"userBrokerImplClass","value":"org.apache.activemq.ActiveMQConnectionFactory"}, - "entry":{"key":"ENTITY_NAME","value":"FALCON_PROCESS_DEFAULT_Sample-Process"}, - "entry":{"key":"broker.impl.class","value":"org.apache.activemq.ActiveMQConnectionFactory"}, - "entry":{"key":"userWorkflowName","value":"Sample-workflow"}, - "entry":{"key":"entityName","value":"Sample-Process"}, - "entry":{"key":"srcClusterName","value":"NA"}, - "entry":{"key":"userBrokerUrl","value":"tcp://localhost:61616?daemon=true"}, - "entry":{"key":"falconInputFeeds","value":"NONE"}, - "entry":{"key":"user.name","value":"sampleuser"}, - "entry":{"key":"threedaysback","value":"2014-09-28"}, - "entry":{"key":"userWorkflowVersion","value":"1.0"} - } - } - ] -} http://git-wip-us.apache.org/repos/asf/falcon/blob/8e49379d/docs/src/site/twiki/restapi/InstanceRerun.twiki ---------------------------------------------------------------------- diff --git a/docs/src/site/twiki/restapi/InstanceRerun.twiki b/docs/src/site/twiki/restapi/InstanceRerun.twiki deleted file mode 100644 index eef0e1a..0000000 --- a/docs/src/site/twiki/restapi/InstanceRerun.twiki +++ /dev/null @@ -1,66 +0,0 @@ ----++ POST /api/instance/rerun/:entity-type/:entity-name - * <a href="#Description">Description</a> - * <a href="#Parameters">Parameters</a> - * <a href="#Results">Results</a> - * <a href="#Examples">Examples</a> - ----++ Description -Rerun instances of an entity. On issuing a rerun, by default the execution resumes from the last failed node in the workflow. - ----++ Parameters - * :entity-type can either be a feed or a process. - * :entity-name is name of the entity. - * start is the start time of the instance that you want to refer to - * end is the end time of the instance that you want to refer to - * lifecycle <optional param> can be Eviction/Replication(default) for feed and Execution(default) for process. - * force <optional param> can be used to forcefully rerun the entire instance. - * doAs <optional query param> allows the current user to impersonate the user passed in doAs when interacting with the Falcon system. - ----++ Results -Results of the rerun command. - ----++ Examples ----+++ Rest Call -<verbatim> -POST http://localhost:15000/api/instance/rerun/process/SampleProcess?colo=*&start=2013-04-03T07:00Z&end=2014-04-03T07:00Z -</verbatim> ----+++ Result -<verbatim> -{ - "instances": [ - { - "details": "", - "startTime": "2013-10-21T15:10:47-07:00", - "cluster": "primary-cluster", - "logFile": "http:\/\/localhost:11000\/oozie?job=0000070-131021115933395-oozie-rgau-W", - "status": "RUNNING", - "instance": "2012-04-03T07:00Z" - } - ], - "requestId": "default\/7a3582bd-608c-45a7-9b74-1837b51ba6d5\n", - "message": "default\/RERUN\n", - "status": "SUCCEEDED" -} -</verbatim> - -<verbatim> -POST http://localhost:15000/api/instance/rerun/process/SampleProcess?colo=*&start=2013-04-03T07:00Z&end=2014-04-03T07:00Z&force=true&doAs=joe -</verbatim> ----+++ Result -<verbatim> -{ - "instances": [ - { - "details": "", - "startTime": "2013-10-21T15:10:47-07:00", - "cluster": "primary-cluster", - "logFile": "http:\/\/localhost:11000\/oozie?job=0000070-131021115933395-oozie-rgau-W", - "status": "RUNNING", - "instance": "2012-04-03T07:00Z" - } - ], - "requestId": "default\/7a3582bd-608c-45a7-9b74-1837b51ba6d5\n", - "message": "default\/RERUN\n", - "status": "SUCCEEDED" -} -</verbatim> http://git-wip-us.apache.org/repos/asf/falcon/blob/8e49379d/docs/src/site/twiki/restapi/InstanceResume.twiki ---------------------------------------------------------------------- diff --git a/docs/src/site/twiki/restapi/InstanceResume.twiki b/docs/src/site/twiki/restapi/InstanceResume.twiki deleted file mode 100644 index 1254785..0000000 --- a/docs/src/site/twiki/restapi/InstanceResume.twiki +++ /dev/null @@ -1,43 +0,0 @@ ----++ POST /api/instance/resume/:entity-type/:entity-name - * <a href="#Description">Description</a> - * <a href="#Parameters">Parameters</a> - * <a href="#Results">Results</a> - * <a href="#Examples">Examples</a> - ----++ Description -Resume suspended instances of an entity. - ----++ Parameters - * :entity-type can either be a feed or a process. - * :entity-name is name of the entity. - * start is the start time of the instance(s) that you want to refer to - * end is the end time of the instance(s) that you want to refer to - * lifecycle <optional param> can be Eviction/Replication(default) for feed and Execution(default) for process. - * doAs <optional query param> allows the current user to impersonate the user passed in doAs when interacting with the Falcon system. - ----++ Results -Results of the resume command. - ----++ Examples ----+++ Rest Call - <verbatim> - POST http://localhost:15000/api/instance/resume/process/SampleProcess?colo=*&start=2012-04-03T07:00Z&end=2014-04-03T07:00Z&doAs=joe - </verbatim> - ---+++ Result - <verbatim> - { - "instances": [ - { - "details": "", - "startTime": "2013-10-21T15:19:57-07:00", - "cluster": "primary-cluster", - "logFile": "http:\/\/localhost:11000\/oozie?job=0000070-131021115933395-oozie-rgau-W", - "status": "RUNNING", - "instance": "2012-04-03T07:00Z" - } - ], - "requestId": "default\/e88ff2e0-2af7-4829-a360-f92e95be2981\n", - "message": "default\/RESUME\n", - "status": "SUCCEEDED" - } - </verbatim> http://git-wip-us.apache.org/repos/asf/falcon/blob/8e49379d/docs/src/site/twiki/restapi/InstanceRunning.twiki ---------------------------------------------------------------------- diff --git a/docs/src/site/twiki/restapi/InstanceRunning.twiki b/docs/src/site/twiki/restapi/InstanceRunning.twiki deleted file mode 100644 index 3d1cabc..0000000 --- a/docs/src/site/twiki/restapi/InstanceRunning.twiki +++ /dev/null @@ -1,84 +0,0 @@ ----++ GET /api/instance/running/:entity-type/:entity-name - * <a href="#Description">Description</a> - * <a href="#Parameters">Parameters</a> - * <a href="#Results">Results</a> - * <a href="#Examples">Examples</a> - ----++ Description -Get a list of instances currently running for a given entity. - ----++ Parameters - * :entity-type Valid options are cluster, feed or process. - * :entity-name Name of the entity. - * colo <optional param> Colo on which the query should be run. - * lifecycle <optional param> Valid lifecycles for feed are Eviction/Replication(default) and for process is Execution(default). - * filterBy <optional param> Filter results by list of field:value pairs. Example: filterBy=CLUSTER:primary-cluster - * Supported filter fields are CLUSTER, SOURCECLUSTER, STARTEDAFTER. - * Query will do an AND among filterBy fields. - * orderBy <optional param> Field by which results should be ordered. - * Supports ordering by "status","startTime","endTime","cluster". - * sortOrder <optional param> Valid options are "asc" and "desc" - * offset <optional param> Show results from the offset, used for pagination. Defaults to 0. - * numResults <optional param> Number of results to show per request, used for pagination. Only integers > 0 are valid, Default is 10. - * doAs <optional query param> allows the current user to impersonate the user passed in doAs when interacting with the Falcon system. - ----++ Results -List of instances currently running. - ----++ Examples ----+++ Rest Call -<verbatim> -GET http://localhost:15000/api/instance/running/process/SampleProcess?colo=* -</verbatim> ----+++ Result -<verbatim> -{ - "instances": [ - { - "startTime": "2013-10-21T14:39:28-07:00", - "cluster": "primary-cluster", - "status": "RUNNING", - "instance": "2012-04-03T06:00Z" - } - ], - "requestId": "default\/12e9a7d4-3b4f-4a76-b471-c8f3786a62a0\n", - "message": "default\/Running Instances\n", - "status": "SUCCEEDED" -} -</verbatim> - - ----+++ Rest Call -<verbatim> -GET http://localhost:15000/api/instance/running/process/SampleProcess?colo=*&start=2012-04-03T07:00Z&filterBy=CLUSTER:primary-cluster&orderBy=startTime&offset=2&numResults=2&doAs=joe -</verbatim> ----+++ Result -<verbatim> -{ - "instances": [ - { - "details": "", - "endTime": "2013-10-21T14:40:26-07:00", - "startTime": "2013-10-21T14:39:56-07:00", - "cluster": "primary-cluster", - "logFile": "http:\/\/localhost:11000\/oozie?job=0000070-131021115933395-oozie-rgau-W", - "status": "RUNNING", - "instance": "2012-04-03T07:00Z" - }, - { - "details": "", - "endTime": "2013-10-21T14:42:27-07:00", - "startTime": "2013-10-21T14:41:57-07:00", - "cluster": "primary-cluster", - "logFile": "http:\/\/localhost:11000\/oozie?job=0000070-131021115933397-oozie-rgau-W", - "status": "RUNNING", - "instance": "2012-04-03T08:00Z" - }, - ], - - "requestId": "default\/e15bb378-d09f-4911-9df2-5334a45153d2\n", - "message": "default\/STATUS\n", - "status": "SUCCEEDED" -} -</verbatim> - http://git-wip-us.apache.org/repos/asf/falcon/blob/8e49379d/docs/src/site/twiki/restapi/InstanceStatus.twiki ---------------------------------------------------------------------- diff --git a/docs/src/site/twiki/restapi/InstanceStatus.twiki b/docs/src/site/twiki/restapi/InstanceStatus.twiki deleted file mode 100644 index 2b7b643..0000000 --- a/docs/src/site/twiki/restapi/InstanceStatus.twiki +++ /dev/null @@ -1,98 +0,0 @@ ----++ GET /api/instance/status/:entity-type/:entity-name - * <a href="#Description">Description</a> - * <a href="#Parameters">Parameters</a> - * <a href="#Results">Results</a> - * <a href="#Examples">Examples</a> - ----++ Description -Get status of a specific instance of an entity. - ----++ Parameters - * :entity-type Valid options are cluster, feed or process. - * :entity-name Name of the entity. - * start <optional param> Show instances from this date. Date format is yyyy-MM-dd'T'HH:mm'Z'. - * By default, it is set to (end - (10 * entityFrequency)). - * end <optional param> Show instances up to this date. Date format is yyyy-MM-dd'T'HH:mm'Z'. - * Default is set to now. - * colo <optional param> Colo on which the query should be run. - * lifecycle <optional param> Valid lifecycles for feed are Eviction/Replication(default) and for process is Execution(default). - * filterBy <optional param> Filter results by list of field:value pairs. Example: filterBy=STATUS:RUNNING,CLUSTER:primary-cluster - * Supported filter fields are STATUS, CLUSTER, SOURCECLUSTER, STARTEDAFTER. - * Query will do an AND among filterBy fields. - * orderBy <optional param> Field by which results should be ordered. - * Supports ordering by "status","startTime","endTime","cluster". - * sortOrder <optional param> Valid options are "asc" and "desc" - * offset <optional param> Show results from the offset, used for pagination. Defaults to 0. - * numResults <optional param> Number of results to show per request, used for pagination. Only integers > 0 are valid, Default is 10. - * doAs <optional query param> allows the current user to impersonate the user passed in doAs when interacting with the Falcon system. - * allAttempts <optional query param> To get all the attempts for corresponding instances. - ----++ Results -Status of the specified instance along with job urls for all actions of user workflow and non-succeeded actions of the main-workflow. - ----++ Examples ----+++ Rest Call -<verbatim> -GET https://localhost:15443/api/instance/status/process/WordCount?start=2014-11-04T16:00Z&colo=* -</verbatim> ----+++ Result -<verbatim> -{ - "instances": [ - { - "details": "", - "endTime": "2014-11-05T16:08:10+05:30", - "startTime": "2014-11-05T16:07:29+05:30", - "cluster": "local", - "logFile": "http:\/\/localhost:11000\/oozie?job=0000011-141105155430303-oozie-oozi-W", - "status": "SUCCEEDED", - "instance": "2014-11-04T16:00Z", - "actions": [ - { - "action": "wordcount-mr", - "status": "SUCCEEDED", - "logFile": "http:\/\/localhost:50030\/jobdetails.jsp?jobid=job_201411051553_0005" - } - ] - } - ], - "requestId": "default\/b9fc3cba-1b46-4d1f-8196-52c795ea3580\n", - "message": "default\/STATUS\n", - "status": "SUCCEEDED" -} -</verbatim> - - ----+++ Rest Call -<verbatim> -GET http://localhost:15000/api/instance/status/process/SampleProcess?colo=*&start=2012-04-03T07:00Z&filterBy=STATUS:SUCCEEDED,CLUSTER:primary-cluster&orderBy=startTime&offset=2&numResults=2&doAs=joe -</verbatim> ----+++ Result -<verbatim> -{ - "instances": [ - { - "details": "", - "endTime": "2013-10-21T14:40:26-07:00", - "startTime": "2013-10-21T14:39:56-07:00", - "cluster": "primary-cluster", - "logFile": "http:\/\/localhost:11000\/oozie?job=0000070-131021115933395-oozie-rgau-W", - "status": "SUCCEEDED", - "instance": "2012-04-03T07:00Z" - }, - { - "details": "", - "endTime": "2013-10-21T14:42:26-07:00", - "startTime": "2013-10-21T14:41:56-07:00", - "cluster": "primary-cluster", - "logFile": "http:\/\/localhost:11000\/oozie?job=0000070-131021115933397-oozie-rgau-W", - "status": "SUCCEEDED", - "instance": "2012-04-03T08:00Z" - }, - ], - - "requestId": "default\/e15bb378-d09f-4911-9df2-5334a45153d2\n", - "message": "default\/STATUS\n", - "status": "SUCCEEDED" -} -</verbatim> http://git-wip-us.apache.org/repos/asf/falcon/blob/8e49379d/docs/src/site/twiki/restapi/InstanceSummary.twiki ---------------------------------------------------------------------- diff --git a/docs/src/site/twiki/restapi/InstanceSummary.twiki b/docs/src/site/twiki/restapi/InstanceSummary.twiki deleted file mode 100644 index 0e1ffee..0000000 --- a/docs/src/site/twiki/restapi/InstanceSummary.twiki +++ /dev/null @@ -1,114 +0,0 @@ ----++ GET /api/instance/summary/:entity-type/:entity-name - * <a href="#Description">Description</a> - * <a href="#Parameters">Parameters</a> - * <a href="#Results">Results</a> - * <a href="#Examples">Examples</a> - ----++ Description -Get summary of instance/instances of an entity. - ----++ Parameters - * :entity-type Valid options are feed or process. - * :entity-name Name of the entity. - * start <optional param> Show instances from this date. Date format is yyyy-MM-dd'T'HH:mm'Z'. - * By default, it is set to (end - (10 * entityFrequency)). - * end <optional param> Show instances up to this date. Date format is yyyy-MM-dd'T'HH:mm'Z'. - * Default is set to now. - * colo <optional param> Colo on which the query should be run. - * lifecycle <optional param> Valid lifecycles for feed are Eviction/Replication(default) and for process is Execution(default). - * filterBy <optional param> Filter results by list of field:value pairs. - Example1: filterBy=STATUS:RUNNING,CLUSTER:primary-cluster - Example2: filterBy=Status:RUNNING,Status:KILLED - * Supported filter fields are STATUS, CLUSTER - * Query will do an AND among filterBy fields. - * orderBy <optional param> Field by which results should be ordered. - * Supports ordering by "cluster". - * sortOrder <optional param> Valid options are "asc" and "desc" - Example: orderBy=cluster sortOrder=asc - * doAs <optional query param> allows the current user to impersonate the user passed in doAs when interacting with the Falcon system. - ----++ Results -Summary of the instances over the specified time range - ----++ Examples ----+++ Rest Call -<verbatim> -GET http://localhost:15000/api/instance/summary/process/WordCount?colo=*&start=2014-01-21T13:00Z&end=2014-01-21T16:00Z -</verbatim> ----+++ Result -<verbatim> -{ - "status":"SUCCEEDED", - "message":"default/SUMMARY\n", - "requestId":"default/c344567b-da73-44d5-bcd4-bf456524934c\n", - "instancesSummary": - { - "cluster":"local", - "map": - { - "entry": - { - "key":"SUCCEEDED", - "value":"value" - } - } - } - } -} -</verbatim> - ----+++ Rest Call -<verbatim> -GET https://localhost:16443/api/instance/summary/process/WordCount?filterBy=Status:KILLED,Status:RUNNING&start=2015-06-24T16:00Z&end=2015-06-24T23:00Z&colo=* -</verbatim> ----+++ Result -<verbatim> -{ - "status":"SUCCEEDED", - "message":"local/SUMMARY\n", - "requestId":"local/1246061948@qtp-1059149611-5 - 34d8c3bb-f461-4fd5-87cd-402c9c6b1ed2\n", - "instancesSummary":[ - { - "cluster":"local", - "map":{ - "entry":{ - "key":"RUNNING", - "value":"1" - }, - "entry":{ - "key":"KILLED", - "value":"1" - } - } - } - ] -} -</verbatim> - ----+++ Rest Call -<verbatim> -GET https://localhost:16443/api/instance/summary/process/WordCount?orderBy=cluster&sortOrder=asc&start=2015-06-24T16:00Z&end=2015-06-24T23:00Z&colo=*&doAs=joe -</verbatim> ----+++ Result -<verbatim> -{ - "status":"SUCCEEDED", - "message":"local/SUMMARY\n", - "requestId":"local/1246061948@qtp-1059149611-5 - 42e2040d-6b6e-4bfd-a090-83db5ed1a429\n", - "instancesSummary":[ - { - "cluster":"local", - "map":{ - "entry":{ - "key":"SUCCEEDED", - "value":"6" - }, - "entry":{ - "key":"KILLED", - "value":"1" - } - } - } - ] -} -</verbatim> http://git-wip-us.apache.org/repos/asf/falcon/blob/8e49379d/docs/src/site/twiki/restapi/InstanceSuspend.twiki ---------------------------------------------------------------------- diff --git a/docs/src/site/twiki/restapi/InstanceSuspend.twiki b/docs/src/site/twiki/restapi/InstanceSuspend.twiki deleted file mode 100644 index 2ba8663..0000000 --- a/docs/src/site/twiki/restapi/InstanceSuspend.twiki +++ /dev/null @@ -1,44 +0,0 @@ ----++ POST /api/instance/suspend/:entity-type/:entity-name - * <a href="#Description">Description</a> - * <a href="#Parameters">Parameters</a> - * <a href="#Results">Results</a> - * <a href="#Examples">Examples</a> - ----++ Description -Suspend instances of an entity. - ----++ Parameters - * :entity-type can either be a feed or a process. - * :entity-name is name of the entity. - * start is the start time of the instance(s) that you want to refer to - * end is the end time of the instance(s) that you want to refer to - * lifecycle <optional param> can be Eviction/Replication(default) for feed and Execution(default) for process. - * doAs <optional query param> allows the current user to impersonate the user passed in doAs when interacting with the Falcon system. - ----++ Results -Results of the suspend command. - ----++ Examples ----+++ Rest Call -<verbatim> -POST http://localhost:15000/api/instance/suspend/process/SampleProcess?colo=*&start=2012-04-03T07:00Z&end=2014-04-03T07:00Z&doAs=joe -</verbatim> ----+++ Result -<verbatim> -{ - "instances": [ - { - "details": "", - "endTime": "2013-10-21T15:15:01-07:00", - "startTime": "2013-10-21T15:14:32-07:00", - "cluster": "primary-cluster", - "logFile": "http:\/\/localhost:11000\/oozie?job=0000070-131021115933395-oozie-rgau-W", - "status": "SUCCEEDED", - "instance": "2012-04-03T07:00Z" - } - ], - "requestId": "default\/ff07e45b-b6da-4f47-ae96-9182bd8a7e53\n", - "message": "default\/SUSPEND\n", - "status": "SUCCEEDED" -} -</verbatim> \ No newline at end of file http://git-wip-us.apache.org/repos/asf/falcon/blob/8e49379d/docs/src/site/twiki/restapi/MetadataList.twiki ---------------------------------------------------------------------- diff --git a/docs/src/site/twiki/restapi/MetadataList.twiki b/docs/src/site/twiki/restapi/MetadataList.twiki deleted file mode 100644 index 98abf46..0000000 --- a/docs/src/site/twiki/restapi/MetadataList.twiki +++ /dev/null @@ -1,31 +0,0 @@ ----++ GET api/metadata/discovery/:type/list - * <a href="#Description">Description</a> - * <a href="#Parameters">Parameters</a> - * <a href="#Results">Results</a> - * <a href="#Examples">Examples</a> - ----++ Description -Get all dimensions of specified type. - ----++ Parameters - * :type Valid dimension types are cluster_entity,feed_entity, process_entity, user, colo, tags, groups, pipelines - * cluster <optional query param> Show dimensions related to this cluster. - * doAs <optional query param> allows the current user to impersonate the user passed in doAs when interacting with the Falcon system. - - ----++ Results -List of dimensions that match requested type [and cluster]. - ----++ Examples ----+++ Rest Call -<verbatim> -GET http://localhost:15000/api/metadata/discovery/process_entity/list?cluster=primary-cluster&doAs=joe -</verbatim> ----+++ Result -<verbatim> -{ - "results": ["sampleIngestProcess","testProcess","anotherProcess"], - "totalSize": 3 -} -</verbatim> - http://git-wip-us.apache.org/repos/asf/falcon/blob/8e49379d/docs/src/site/twiki/restapi/MetadataRelations.twiki ---------------------------------------------------------------------- diff --git a/docs/src/site/twiki/restapi/MetadataRelations.twiki b/docs/src/site/twiki/restapi/MetadataRelations.twiki deleted file mode 100644 index b29fd2a..0000000 --- a/docs/src/site/twiki/restapi/MetadataRelations.twiki +++ /dev/null @@ -1,46 +0,0 @@ ----++ GET api/metadata/discovery/:dimension-type/:dimension-name/relations - * <a href="#Description">Description</a> - * <a href="#Parameters">Parameters</a> - * <a href="#Results">Results</a> - * <a href="#Examples">Examples</a> - ----++ Description -Get all relations of a specific dimension. - ----++ Parameters - * :type Valid dimension types are cluster_entity,feed_entity, process_entity, user, colo, tags, groups, pipelines - * :name Name of the dimension. - * doAs <optional query param> allows the current user to impersonate the user passed in doAs when interacting with the Falcon system. - ----++ Results -Get all relations of a specific dimension. - ----++ Examples ----+++ Rest Call -<verbatim> -GET http://localhost:15000/api/metadata/discovery/process_entity/sample-process/relations?doAs=joe -</verbatim> ----+++ Result -<verbatim> -{ - "timestamp":"2014-09-09T01:31Z", - "userWorkflowEngine":"pig", - "name":"sample-process", - "type":"PROCESS_ENTITY", - "userWorkflowName":"imp-click-join-workflow", - "version":"1.0.9", - "inVertices":[ - {"name":"clicks-feed","type":"FEED_ENTITY","label":"input"}, - {"name":"impression-feed","type":"FEED_ENTITY","label":"input"}, - {"name":"sample-process\/2014-01-01T01:00Z","type":"PROCESS_INSTANCE","label":"instance-of"} - ], - "outVertices":[ - {"name":"Critical","type":"TAGS","label":"classified-as"}, - {"name":"testPipeline","type":"PIPELINES","label":"pipeline"}, - {"name":"primary-cluster","type":"CLUSTER_ENTITY","label":"runs-on"}, - {"name":"imp-click-join2","type":"FEED_ENTITY","label":"output"}, - {"name":"imp-click-join1","type":"FEED_ENTITY","label":"output"}, - {"name":"falcon-user","type":"USER","label":"owned-by"} - ] -} -</verbatim> http://git-wip-us.apache.org/repos/asf/falcon/blob/8e49379d/docs/src/site/twiki/restapi/ResourceList.twiki ---------------------------------------------------------------------- diff --git a/docs/src/site/twiki/restapi/ResourceList.twiki b/docs/src/site/twiki/restapi/ResourceList.twiki deleted file mode 100644 index 34c2c6f..0000000 --- a/docs/src/site/twiki/restapi/ResourceList.twiki +++ /dev/null @@ -1,93 +0,0 @@ ----+ RESTful Resources - ----++ Resource List - * <a href="#REST_Call_on_Entity_Resource">REST Call on Entity Resource</a> - * <a href="#REST_Call_on_Feed_and_Process_Instances">REST Call on Feed/Process Instances</a> - * <a href="#REST_Call_on_Admin_Resource">REST Call on Admin Resource</a> - * <a href="#REST_Call_on_Lineage_Graph">REST Call on Lineage Graph Resource</a> - * <a href="#REST_Call_on_Metadata_Resource">REST Call on Metadata Resource</a> - ----++ Authentication - -When security is off (Pseudo/Simple), the authenticated user is the username specified in the user.name query -parameter. If the user.name parameter is not set, the server may either set the authenticated user to a default web -user, if there is any, or return an error response. - -When security is on (kerberos), authentication is performed by Kerberos SPNEGO. - -Below are examples using the curl command tool. - -Authentication when security is off (Pseudo/Simple): -<verbatim> -curl -i "http://<HOST>:<PORT>/<PATH>?[user.name=<USER>&]<PARAM>=..." -</verbatim> - -Authentication using Kerberos SPNEGO when security is on: -<verbatim> -curl -i --negotiate -u : "http://<HOST>:<PORT>/<PATH>?<PARAM>=..." -</verbatim> - -See also: [[../Security.twiki][Security in Falcon]] - -The current version of the rest api's documentation is also hosted on the Falcon server and Prism Server (in distributed mode) at the url http://<HOST>:<PORT>/docs - ----++ REST Call on Admin Resource - -| *Call Type* | *Resource* | *Description* | -| GET | [[AdminStack][api/admin/stack]] | Get stack of the server | -| GET | [[AdminVersion][api/admin/version]] | Get version of the server | -| GET | [[AdminConfig][api/admin/config/:config-type]] | Get configuration information of the server | - ----++ REST Call on Entity Resource - -| *Call Type* | *Resource* | *Description* | -| POST | [[EntityValidate][api/entities/validate/:entity-type]] | Validate the entity | -| POST | [[EntitySubmit][api/entities/submit/:entity-type]] | Submit the entity | -| POST | [[EntityUpdate][api/entities/update/:entity-type/:entity-name]] | Update the entity | -| POST | [[EntitySubmitAndSchedule][api/entities/submitAndSchedule/:entity-type]] | Submit & Schedule the entity | -| POST | [[EntitySchedule][api/entities/schedule/:entity-type/:entity-name]] | Schedule the entity | -| POST | [[EntitySuspend][api/entities/suspend/:entity-type/:entity-name]] | Suspend the entity | -| POST | [[EntityResume][api/entities/resume/:entity-type/:entity-name]] | Resume the entity | -| DELETE | [[EntityDelete][api/entities/delete/:entity-type/:entity-name]] | Delete the entity | -| GET | [[EntityStatus][api/entities/status/:entity-type/:entity-name]] | Get the status of the entity | -| GET | [[EntityDefinition][api/entities/definition/:entity-type/:entity-name]] | Get the definition of the entity | -| GET | [[EntityList][api/entities/list/:entity-type]] | Get the list of entities | -| GET | [[EntitySummary][api/entities/summary/:entity-type/:cluster]] | Get instance summary of all entities | -| GET | [[EntityDependencies][api/entities/dependencies/:entity-type/:entity-name]] | Get the dependencies of the entity | -| GET | [[FeedSLA][api/entities/sla-alert/:entity-type]] | Get pending feed instances which missed sla | -| GET | [[FeedLookup][api/entities/lookup/feed/]] | Get feed for given path | - ----++ REST Call on Feed and Process Instances - -| *Call Type* | *Resource* | *Description* | -| GET | [[InstanceRunning][api/instance/running/:entity-type/:entity-name]] | List of running instances. | -| GET | [[InstanceParams][api/instance/params/:entity-type/:entity-name]] | List of entity instances along with their workflow params. | -| GET | [[InstanceList][api/instance/list/:entity-type/:entity-name]] | List of instances | -| GET | [[InstanceStatus][api/instance/status/:entity-type/:entity-name]] | Status of a given instance | -| POST | [[InstanceKill][api/instance/kill/:entity-type/:entity-name]] | Kill a given instance | -| POST | [[InstanceSuspend][api/instance/suspend/:entity-type/:entity-name]] | Suspend a running instance | -| POST | [[InstanceResume][api/instance/resume/:entity-type/:entity-name]] | Resume a given instance | -| POST | [[InstanceRerun][api/instance/rerun/:entity-type/:entity-name]] | Rerun a given instance | -| GET | [[InstanceLogs][api/instance/logs/:entity-type/:entity-name]] | Get logs of a given instance | -| GET | [[Triage][api/instance/triage/:entity-type/:entity-name]] | Triage an instance to see it's stuck lineage | -| GET | [[InstanceSummary][api/instance/summary/:entity-type/:entity-name]] | Return summary of instances for an entity | -| GET | [[InstanceDependency][api/instance/dependencies/:entity-type/:entity-name]] | Return dependent instances for a given instance | - ----++ REST Call on Metadata Lineage Resource - -| *Call Type* | *Resource* | *Description* | -| GET | [[Graph][api/metadata/lineage/serialize]] | dump the graph | -| GET | [[AllVertices][api/metadata/lineage/vertices/all]] | get all vertices | -| GET | [[Vertices][api/metadata/lineage/vertices?key=:key&value=:value]] | get all vertices for a key index | -| GET | [[Vertex][api/metadata/lineage/vertices/:id]] | get the vertex with the specified id | -| GET | [[VertexProperties][api/metadata/lineage/vertices/properties/:id?relationships=:true]] | get the properties of the vertex with the specified id | -| GET | [[AdjacentVertices][api/metadata/lineage/vertices/:id/:direction]] | get the adjacent vertices or edges of the vertex with the specified direction | -| GET | [[AllEdges][api/metadata/lineage/edges/all]] | get all edges | -| GET | [[Edge][api/metadata/lineage/edges/:id]] | get the edge with the specified id | -| GET | [[EntityLineage][api/metadata/lineage/entities?pipeline=:name]] | Get lineage graph for processes and feeds in the specified pipeline | - ----++ REST Call on Metadata Discovery Resource - -| *Call Type* | *Resource* | *Description* | -| GET | [[MetadataList][api/metadata/discovery/:dimension-type/list]] | list of dimensions | -| GET | [MetadataRelations][api/metadata/discovery/:dimension-type/:dimension-name/relations]] | Return all relations of a dimension | http://git-wip-us.apache.org/repos/asf/falcon/blob/8e49379d/docs/src/site/twiki/restapi/Triage.twiki ---------------------------------------------------------------------- diff --git a/docs/src/site/twiki/restapi/Triage.twiki b/docs/src/site/twiki/restapi/Triage.twiki deleted file mode 100644 index 9ff95c8..0000000 --- a/docs/src/site/twiki/restapi/Triage.twiki +++ /dev/null @@ -1,45 +0,0 @@ ----++ GET api/instance/triage/:entity-type/:entity-name - * <a href="#Description">Description</a> - * <a href="#Parameters">Parameters</a> - * <a href="#Results">Results</a> - * <a href="#Examples">Examples</a> - ----++ Description -Given a feed/process instance this command traces it's ancestors to find what all ancestors have failed. It's useful if -lot of instances are failing in a pipeline as it then finds out the root cause of the pipeline being stuck. - - ----++ Parameters - * :entity-type type of entity(feed/process). - * :entity-name name of the feed/process. - * :start instance time of the entity instance. - * :colo <optional param> name of the colo on which you want to triage - * doAs <optional query param> allows the current user to impersonate the user passed in doAs when interacting with the Falcon system. - ----++ Results -It returns a json graph - ----++ Examples ----+++ Rest Call -<verbatim> -GET http://localhost:15000/api/instance/triage/feed/my-feed?start=2015-03-02T00:00Z&colo=local&doAs=joe -</verbatim> ----+++ Result -<verbatim> -{ - "vertices": ["(FEED) my-feed (2015-03-02T00:00Z) [Unavailable]", "(PROCESS) producer-process (2015-03-01T10:00Z) [TIMEDOUT]", "(FEED) input-feed-for-producer (2015-03-01T00:00Z) [Available]"], - "edges": - [ - { - "from" : "(PROCESS) producer-process (2015-03-01T10:00Z) [TIMEDOUT]", - "to" : "(FEED) my-feed (2015-03-02T00:00Z) [Unavailable]", - "label" : "produces" - }, - { - "from" : "(FEED) input-feed-for-producer (2015-03-01T00:00Z) [Available]", - "to" : "(PROCESS) producer-process (2015-03-01T10:00Z) [TIMEDOUT]", - "label" : "consumed by" - } - ] -} -</verbatim> http://git-wip-us.apache.org/repos/asf/falcon/blob/8e49379d/docs/src/site/twiki/restapi/Vertex.twiki ---------------------------------------------------------------------- diff --git a/docs/src/site/twiki/restapi/Vertex.twiki b/docs/src/site/twiki/restapi/Vertex.twiki deleted file mode 100644 index 82f5bfb..0000000 --- a/docs/src/site/twiki/restapi/Vertex.twiki +++ /dev/null @@ -1,36 +0,0 @@ ----++ GET api/metadata/lineage/vertices/:id - * <a href="#Description">Description</a> - * <a href="#Parameters">Parameters</a> - * <a href="#Results">Results</a> - * <a href="#Examples">Examples</a> - ----++ Description -Gets the vertex with specified id. - ----++ Parameters - * :id is the unique id of the vertex. - * doAs <optional query param> allows the current user to impersonate the user passed in doAs when interacting with the Falcon system. - ----++ Results -Vertex with the specified id. - ----++ Examples ----+++ Rest Call -<verbatim> -GET http://localhost:15000/api/metadata/lineage/vertices/4?doAs=joe -</verbatim> ----+++ Result -<verbatim> -{ - "results": [ - { - "timestamp":"2014-04-21T20:55Z", - "name":"sampleIngestProcess", - "type":"process-instance", - "version":"2.0.0", - "_id":4, - "_type":"vertex" - } - ] -} -</verbatim> http://git-wip-us.apache.org/repos/asf/falcon/blob/8e49379d/docs/src/site/twiki/restapi/VertexProperties.twiki ---------------------------------------------------------------------- diff --git a/docs/src/site/twiki/restapi/VertexProperties.twiki b/docs/src/site/twiki/restapi/VertexProperties.twiki deleted file mode 100644 index 11c64b5..0000000 --- a/docs/src/site/twiki/restapi/VertexProperties.twiki +++ /dev/null @@ -1,34 +0,0 @@ ----++ GET api/metadata/lineage/vertices/properties/:id?relationships=:true - * <a href="#Description">Description</a> - * <a href="#Parameters">Parameters</a> - * <a href="#Results">Results</a> - * <a href="#Examples">Examples</a> - ----++ Description -Gets the properties of the vertex with specified id. - ----++ Parameters - * :id is the unique id of the vertex. - * :relationships has default value of false. Pass true if relationships should be fetched. - * doAs <optional query param> allows the current user to impersonate the user passed in doAs when interacting with the Falcon system. - ----++ Results - Properties associated with the specified vertex. - ----++ Examples ----+++ Rest Call -<verbatim> -GET http://localhost:15000/api/metadata/lineage/vertices/properties/40004?relationships=true&doAs=joe -</verbatim> ----+++ Result -<verbatim> -{ - "results": - { - "timestamp":"2014-04-25T22:20Z", - "name":"local", - "type":"cluster-entity" - }, - "totalSize":3 -} -</verbatim> http://git-wip-us.apache.org/repos/asf/falcon/blob/8e49379d/docs/src/site/twiki/restapi/Vertices.twiki ---------------------------------------------------------------------- diff --git a/docs/src/site/twiki/restapi/Vertices.twiki b/docs/src/site/twiki/restapi/Vertices.twiki deleted file mode 100644 index 643e6e9..0000000 --- a/docs/src/site/twiki/restapi/Vertices.twiki +++ /dev/null @@ -1,38 +0,0 @@ ----++ GET api/metadata/lineage/vertices?key=:key&value=:value - * <a href="#Description">Description</a> - * <a href="#Parameters">Parameters</a> - * <a href="#Results">Results</a> - * <a href="#Examples">Examples</a> - ----++ Description -Get all vertices for a key index given the specified value. - ----++ Parameters - * :key is the key to be matched. - * :value is the associated value of the key. - * doAs <optional query param> allows the current user to impersonate the user passed in doAs when interacting with the Falcon system. - ----++ Results -All vertices matching given property key and a value. - ----++ Examples ----+++ Rest Call -<verbatim> -GET http://localhost:15000/api/metadata/lineage/vertices?key=name&value=sampleIngestProcess&doAs=joe -</verbatim> ----+++ Result -<verbatim> -{ - "results": [ - { - "timestamp":"2014-04-21T20:55Z", - "name":"sampleIngestProcess", - "type":"process-instance", - "version":"2.0.0", - "_id":4, - "_type":"vertex" - } - ], - "totalSize": 1 -} -</verbatim> \ No newline at end of file http://git-wip-us.apache.org/repos/asf/falcon/blob/8e49379d/falcon-regression/.gitignore ---------------------------------------------------------------------- diff --git a/falcon-regression/.gitignore b/falcon-regression/.gitignore deleted file mode 100644 index 0cb27d0..0000000 --- a/falcon-regression/.gitignore +++ /dev/null @@ -1,59 +0,0 @@ -# Licensed to the Apache Software Foundation (ASF) under one -# or more contributor license agreements. See the NOTICE file -# distributed with this work for additional information -# regarding copyright ownership. The ASF licenses this file -# to you under the Apache License, Version 2.0 (the -# "License"); you may not use this file except in compliance -# with the License. You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. - -# Maven -target - -# IntelliJ -*.iml -*.ipr -*.iws -.idea - -# Eclipse -.classpath -.project -.settings -.externalToolBuilders -maven-eclipse.xml - -#ActiveMQ -activemq-data -build - -#log files -logs - -test-output/ -bin/ - -#Mac OS X -.DS_Store -*/DS_Store - -#hadoop-conf -merlin/src/test/resources/hadoop-conf -merlin/src/test/resources/hive-conf -merlin/src/test/resources/falcon-conf - -#prop files -merlin/src/main/resources/Merlin.properties -Merlin.properties - -#emacs -*~ -[#]*[#] -.\#* http://git-wip-us.apache.org/repos/asf/falcon/blob/8e49379d/falcon-regression/CHANGES.txt ---------------------------------------------------------------------- diff --git a/falcon-regression/CHANGES.txt b/falcon-regression/CHANGES.txt deleted file mode 100644 index e3f7264..0000000 --- a/falcon-regression/CHANGES.txt +++ /dev/null @@ -1,598 +0,0 @@ -Apache Falcon Regression Change log - -Trunk (Unreleased) - - INCOMPATIBLE CHANGES - - NEW FEATURES - FALCON-1566 Add test for SLA monitoring API (Pragya Mittal) - - FALCON-1567 Test case for Lifecycle feature (Pragya Mittal) - - FALCON-1784 Add regression test for for FALCON-1647 (Paul Isaychuk) - - FALCON-1829 Add regression for submit and schedule process on native scheduler (time based) (Pragya Mittal) - - FALCON-1766 Add CLI metrics check for HiveDR, HDFS and feed replication (Paul Isaychuk) - - FALCON-1777 Add regression for HDFS replication (recipe) (Paul Isaychuk) - - FALCON-1699 Test fixes for RetentionTest, LineageApiTest, TouchAPIPrismAndServerTest, FeedReplicationTest and few fortifications(Paul Isaychuk via Pragya Mittal) - - FALCON-1698 New tests for ProcessSetupTest, ClusterSetupTest, UI test fixes(Paul Isaychuk via Ajay Yadava) - - FALCON-1700 Add new test cases to HiveDRTest(Paul Isaychuk & Murali Ramasami via Ajay Yadava) - - FALCON-1689 NoOutputProcessTest fails due to scheme missing in workflow.xml(Pragya Mittal) - - FALCON-1377 Add tests in Falcon for the Triage API(Karishma Gulati via Pragya Mittal) - - FALCON-1546 Add ProcessUpdateTest, PipelineInstanceDependencyTest and other tests and test fixes - (Raghav Gautam and Paul Isaychuk via Paul Isaychuk) - - FALCON-1387 Add Instance Dependency API Test(Pragya Mittal via Ajay Yadava) - - FALCON-1382 Add a test for feed retention to make sure that data directory is not deleted (Paul Isaychuk) - - FALCON-1321 Add Entity Lineage Test (Pragya Mittal via Ajay Yadava) - - FALCON-1319 Contribute HiveDr, Mirror tests and some test fixes (Namit Maheshwari, Paul Isaychuk, - Raghav Kumar Gautam & Ruslan Ostafiychuk via Raghav Kumar Gautam) - - FALCON-1254 ClusterSetup UI: edit xml test cases, stabilize 2 tests (Paul Isaychuk via Ruslan Ostafiychuk) - - FALCON-1215 Adding new test cases related to rerun feature (Pragya M via Samarth Gupta) - - FALCON-1249 Tests for process setup wizard (Namit Maheshwari and Paul Isaychuk) - - FALCON-1242 Search UI test for entity upload button (Namit Maheshwari) - - FALCON-1222 Feed Wizard multiple tests (Namit Maheshwari) - - FALCON-1229 Tests for instance page on SearchUI (Ruslan Ostafiychuk) - - FALCON-1216 Cluster setup wizard multiple tests (Paul Isaychuk via Ruslan Ostafiychuk) - - FALCON-1202 Add tests for EntityPage (Raghav Kumar Gautam) - - FALCON-1210 Process Setup tests for testing header and general step default scenario (Raghav Kumar Gautam) - - FALCON-1201 Feed Setup tests for testing header and default scenario (Namit Maheshwari) - - FALCON-1198 Test buttons available on search results page (Ruslan Ostafiychuk) - - FALCON-1187 Test that changes made via API are reflected on UI (Ruslan Ostafiychuk - via Raghav Kumar Gautam) - - FALCON-1173 Tests for entities table of search-ui (Ruslan Ostafiychuk) - - FALCON-1171 Adding search API tests (Paul Isaychuk via Raghav Kumar Gautam) - - FALCON-1167 Homepage & Login test for search-ui (Raghav Kumar Gautam via Ruslan Ostafiychuk) - - FALCON-1067 Add test in falcon-regression for feed instance listing api(Karishma G - via Samarth G) - - FALCON-1066 Add test in falcon to test process SLA feature(Pragya M via Samarth G) - - FALCON-964 add test in falcon regression to test loading of jar present in user lib(Pragya M - via Samarth Gupta) - - FALCON-974 add test in falcon-regression for log mover feature(Pragya via Samarth Gupta) - - FALCON-843 add test to support current & last week el expression(Pragya M via Samarth G) - - FALCON-1035 Add test in falcon regression for validate feature. Validate is exposed - via both server and prism (Karishma G via Samarth Gupta) - - FALCON-1030 Test for Add option to search for Entities(Pragya Mittal Via Samarth Gupta) - - FALCON-1043 Add test in falcon to test touch feature(Pragya Mittal via Samarth Gupta) - - FALCON-1021 Add test in falcon to test feed SLA feature (Pragya Mittal via Raghav Kumar Gautam) - - FALCON-671 Add a test in falcon-regression where one oozie workflow has various actions like - mr, hive, pig (Karishma Gulati via Ruslan Ostafiychuk) - - FALCON-985 Upgrading jsch version in falcon regression pom (Pragya M via Samarth) - - FALCON-884 Add option to dump xmls generated by falcon (Raghav Kumar Gautam via Ruslan - Ostafiychuk) - - FALCON-893 Add tests for replication to wasb filesystem - (Raghav Kumar Gautam and Ruslan Ostafiychuk via Arpit Gupta) - - FALCON-861 Add ACL tests for falcon client and ACL update - (Raghav Kumar Gautam) - - FALCON-844 List instances tests (Paul Isaychuk via Ruslan Ostafiychuk) - - FALCON-841 Test falcon process with different frequencies - (Raghav Kumar Gautam) - - FALCON-814 Tests for entities summary API (Paul Isaychuk via Ruslan Ostafiychuk) - - FALCON-833 FeedReplicationTest.availabilityFlagTest fix (Paul Isaychuk - via Raghav Kumar Gautam) - - FALCON-838 Add support for https in merlin (Raghav Kumar Gautam and - Ruslan Ostafiychuk via Raghav Kumar Gautam) - - FALCON-746 Add ACL validation and enforcement tests (Raghav Kumar Gautam via Ruslan Ostafiychuk) - - FALCON-743 Adding tests for cases related to usage of pipelines tag - (Paul Isaychuk via Raghav Kumar Gautam) - - FALCON-589 Add test cases for various feed operations on Hcat feeds (Karishma G - via Samarth Gupta) - - IMPROVEMENTS - FALCON-1819 Improve test class entity cleanup logic (Paul Isaychuk) - - FALCON-1697 Stabilization of scenarios which are based on instances lifecycle(Paul Isaychuk via Ajay Yadava) - - FALCON-1543 Upgrade Falcon regression to use Active MQ 5.12(Pragya Mittal via Pallavi Rao) - - FALCON-1502 Checkstyle failures in Falcon Regression(Pragya Mittal via Ajay Yadava) - - FALCON-1384 AbstractEntityHelper.java cleanup (Paul Isaychuk) - - FALCON-1306 Custom window dimensions for UI tests (Ruslan Ostafiychuk) - - FALCON-1284 Fix entity cleanup when is_depracate=true (Ruslan Ostafiychuk via Paul Isaychuk) - - FALCON-1283 Save screenshots to log.capture.location (Ruslan Ostafiychuk via Paul Isaychuk) - - FALCON-1259 Fix property picked for DIFFERENT_USER_GROUP (Raghav Kumar Gautam) - - FALCON-1261 ProcessSetupTest, EntitiesPatternSearchTest stabilization (Paul Isaychuk via Raghav Kumar Gautam) - - FALCON-1256 ListProcessInstancesTest needs to be stabilized (Raghav Kumar Gautam) - - FALCON-1227 Add logMover check in FeedReplication test(Pragya M via Samarth G) - - FALCON-1253 Fortify ExternalFSTest (Ruslan Ostafiychuk) - - FALCON-1243 Feed test update as per new UI changes (Namit Maheshwari) - - FALCON-1241 Fix SearchApiTest according to changes in API, tag ClusterSetupTest, - PrismProcessScheduleTest#testScheduleDeletedProcessOnBothColos (Paul Isaychuk) - - FALCON-1226 Stabilize testActionsPauseResume() (Ruslan Ostafiychuk) - - FALCON-1225 remove text line containing "Copyright" from regression - log4j.properties(Samarth Gupta) - - FALCON-1197 Use diamond operator in merlin and merlin-core (Ruslan Ostafiychuk) - - FALCON-1131 Fixing FeedClusterUpdateTest and name confilcts in FALCON-1113(Pragya M - via Samarth Gupta) - - FALCON-1145 Changing entity name if it exceeds defined length(Pragya M via Samarth G) - - FALCON-1151 Migrate oozie related methods from InstanceUtil.java to OozieUtil.java - (Paul Isaychuk via Ruslan Ostafiychuk) - - FALCON-1138: JDK requirement for merlin should be 1.7 (Raghav Kumar Gautam) - - FALCON-1135 Migrate methods related to *Merlin.java classes from InstanceUtil.java and - Bundle.java (Ruslan Ostafiychuk) - - FALCON-1088 Fixing FeedDelayParallelTimeoutTest and renaming it to FeedDelayTest(Pragya M via - Samarth G) - - FALCON-1112 Migrate methods related to *Merlin.java classes from Util.java to their respective - *Merlin.java (Paul Isaychuk via Ruslan Ostafiychuk) - - FALCON-1113 Clean up data files in merlin resource directory. Create better names for them - (Paul Isaychuk via Ruslan Ostafiychuk) - - FALCON-1103 RetentionTest stabilization - remove check of all retention job actions - (Paul Isaychuk via Ruslan Ostafiychuk) - - FALCON-1010 Add documentation in falcon-regression's README.md, making it easy for - contributors to add tests to falcon-regression(Karishma G via Samarth ) - - FALCON-1011 Fix PrismProcessScheduleTest in falcon regression ( Pragya M via - Samarth G) - - FALCON-1075 Fixing ProcessFrequencyTest, EntityDryRunTest, ProcessInstanceRerunTest - which are failing as part of falcon regression (Pragya M via Samarth G) - - FALCON-1094 getAllFilesRecursivelyHDFS without recursive call (Ruslan Ostafiychuk) - - FALCON-1093 Tag all new tests added to falcon-regression (Paul Isaychuk via Ruslan Ostafiychuk) - - FALCON-1089 ProcessInstanceStatusTest improvement (Paul Isaychuk via Ruslan Ostafiychuk) - - FALCON-1058 Test for Feed Replication with Empty Directories(Pragya M via Samarth Gupta) - - FALCON-1046 Add test for process update with user feature(Karishma G via Samarth Gupta) - - FALCON-1017 FeedReplicationTest modified to check for _SUCCESS getting created on - target directory(Pragya M via Samarth G) - - FALCON-1040 Modifying ProcessInstanceStatusTest to expose job id for running jobs in - Falcon. (Pragya M via Samarth G) - - FALCON-1044 Add tests for the change that start and end are compulsory parameters for - all instance POST apis.(Karishma G via Samarth) - - FALCON-1034 Add test for FALCON-677 - wherein feed data and stats paths no longer default - to /tmp/.(Karishma G via Samarth Gupta) - - FALCON-1014 Fix PrismProcessSnSTest in falcon regression . (Contributed by Pragya M via - Samarth G) - - FALCON-1022 Wait for RUNNING status of instances before killing them (Ruslan Ostafiychuk) - - FALCON-968 Remove only entities submitted by same test and baseHDFSDir usage refactored - (Ruslan Ostafiychuk via Raghav Kumar Gautam) - - FALCON-1007 Improve test output and variable names (Paul Isaychuk via Ruslan Ostafiychuk) - - FALCON-1009 InstanceUtil cleanup (Raghav Kumar Gautam) - - FALCON-1006 Add a property for inclusion of test (Raghav Kumar Gautam) - - FALCON-999 Fix PrismProcessResumeTest in falcon regression (Samarth Gupta) - - FALCON-998 Removing 'store' hard coded in regression test (Pragya M via Samarth Gupta) - - FALCON-989 add timeout to EmbeddedPigScriptTest in falcon regression (Samarth Gupta) - - FALCON-978 Refactoring FeedLateRerunTest to be parametrized test (Paul Isaychuk via Ruslan Ostafiychuk) - - FALCON-979 Fix checkstyle issues introduced by falcon-976 (Raghav Kumar Gautam via Ruslan Ostafiychuk) - - FALCON-976 EntityDryRunTest failing in falcon trunk (Pragya M via Samarth Gupta) - - FALCON-942 Cleanup BaseTestClass and setUp/tearDown methods (Ruslan Ostafiychuk) - - FALCON-962 Fortify ListFeedInstancesTest (Paul Isaychuk via Ruslan Ostafiychuk) - - FALCON-963 Add option to exclude tests in falcon-regression (Ruslan Ostafiychuk) - - FALCON-953 Change wasb replication to run with single cluster (Ruslan Ostafiychuk - via Raghav Kumar Gautam) - - FALCON-947 Ignore hadoop configs in merlin/src/test/resources/hadoop-conf (Ruslan Ostafiychuk) - - FALCON-940 Avoid NPE in getAllEntitiesOfOneType() for zero elements - (Ruslan Ostafiychuk via Raghav Kumar Gautam) - - FALCON-908 Remove jars that are not needed (Paul Isaychuk via Raghav Kumar Gautam) - - FALCON-939 Fixing few typos and removing unused stuff (Paul Isaychuk via Ruslan Ostafiychuk) - - FALCON-930 Delete old project name (ivory) from code and xmls (Ruslan Ostafiychuk via Raghav - Kumar Gautam) - - FALCON-927 Refactoring of entity helpers in falcon-regression (Ruslan Ostafiychuk) - - FALCON-928 Use falcon's checkstyle for falcon regression code (Raghav Kumar Gautam) - - FALCON-909 Remove names of the contributors from xmls and code (Ruslan Ostafiychuk) - - FALCON-926 Fix problems found by findbugs in merlin and merlin-core (Ruslan Ostafiychuk and - Raghav Kumar Gautam via Ruslan Ostafiychuk) - - FALCON-698 Fix checkstyle bugs in test files in falcon-regression (Ruslan Ostafiychuk and - Raghav Kumar Gautam via Ruslan Ostafiychuk) - - FALCON-684 Fix problems found by checkstyle in non-test files in falcon-regression (Ruslan - Ostafiychuk) - - FALCON-923 Remove unused xsd's (Paul Isaychuk via Ruslan Ostafiychuk) - - FALCON-699 Use APIResult and other support classes from falcon-client in falcon-regression - (Ruslan Ostafiychuk) - - FALCON-906: Add license header where it is needed, remove deprecated inmobi - references (Paul Isaychuk via Raghav Kumar Gautam) - - FALCON-890 Merlin tests need to be updated in secure cluster to get the - token using the ugi object requests (Arpit Gupta) - - FALCON-863 Fix tests to have start as well as end time for kill, rerun etc - requests (Raghav Kumar Gautam) - - FALCON-856 Handle JsonSyntaxException in hitUrl (Ruslan Ostafiychuk) - - FALCON-847 Issue with login from keytab in merlin (Raghav Kumar Gautam) - - FALCON-835 Tag authorization tests (Raghav Kumar Gautam) - - FALCON-826 unify staging and working dir requirements (Raghav Kumar Gautam via Ruslan - Ostafiychuk) - - FALCON-811 falcon superuser should be used instead of admin (Raghav Kumar Gautam via Ruslan - Ostafiychuk) - - FALCON-812 all the entities must have acl (Raghav Kumar Gautam) - - FALCON-801 Increasing time to wait for instance (Paul Isaychuk) - - FALCON-809 Add message from response if assertSucceeded fails (Ruslan Ostafiychuk) - - FALCON-802 Authorization test disabled (Paul Isaychuk) - - FALCON-706 Parse json with instances to InstancesResult using joda's DateTime (Ruslan - Ostafiychuk) - - FALCON-798 optionalTest_updateProcessMakeOptionalCompulsory fixed (Paul - Isaychuk via Raghav Kumar Gautam) - - FALCON-631 add late data regression test for feed and process(Pragya - via Samarth Gupta) - - FALCON-701 HadoopUtil and Util classes documented (Paul Isaychuk via - Raghav Kumar Gautam) - - FALCON-750 Method name fixed (Paul Isaychuk via Ruslan Ostafiychuk) - - FALCON-645 add test to falcon regression for change made in default behaviour - of instance request ( Karishma Via Samarth Gupta) - - FALCON-745 LogUtil requires fine control over what to dump (Raghav Kumar - Gautam) - - FALCON-739 JmsMessageConsumer should start daemon threads (Raghav Kumar - Gautam) - - FALCON-729 HCatFeedOperationsTest should not initialize hcat client during - var declaration (Raghav Kumar Gautam) - - FALCON-726 Expect less fields in messages in falcon-regression - (Ruslan Ostafiychuk) - - FALCON-720 Fix ProcessInstanceStatusTest as per FALCON-166 - (Raghav Kumar Gautam) - - FALCON-693 Tests with zero inp/outp fixed to use correct workflow, javadocs - added (Paul Isaychuk) - - FALCON-711 Test retagged (Paul Isaychuk) - - FALCON-696 Pull oozie logs at the end of tests (Raghav Kumar Gautam) - - FALCON-675 Request URLS moved from parameters into methods in falcon-regression (Ruslan - Ostafiychuk) - - FALCON-656 add test in falcon regression's Authorization test where non-feed owner updates - a feed with a dependent process(Karishma via Samarth Gupta) - - FALCON-674 General code factored out for ProcessInstance* tests (Paul Isaychuk via Ruslan - Ostafiychuk) - - FALCON-657 String datePattern moved to BaseTestClass (Ruslan Ostafiychuk) - - FALCON-643 Tests with zero-output/input scenario amended to match test case (Paul Isaychuk via - Ruslan Ostafiychuk) - - FALCON-660 7 test classes refactored and few of them documented (Paul Isaychuk via - Ruslan Ostafiychuk) - - FALCON-653 Add falcon regression test for zero input process(Karishma via Samarth Gupta) - FALCON-655 Skip workflow upload if process won't be submitted (Ruslan Ostafiychuk) - - FALCON-587 Don't delete input data in @AfterClass in falcon-regression tests if - clean_test_dir=false (Ruslan Ostafiychuk) - - FALCON-646 Refactoring, documentation stuff (Paul Isaychuk via Ruslan Ostafiychuk) - - FALCON-572 HadoopUtil cleanup in falcon-regression (Ruslan Ostafiychuk via Samarth Gupta) - FALCON-632 Refactoring, documentation stuff (Paul Isaychuk via Samarth Gupta) - - FALCON-609 UpdateAtSpecificTimeTest, InstanceSummaryTest tagged, fixed, refactored - (Paul Isaychuk via Samarth Gupta) - - FALCON-619 ELExp_FutureAndLatestTest stabilization (Paul Isaychuk via Arpit Gupta) - - FALCON-610 Refactoring and documentation updates (Paul Isaychuk via Arpit Gupta) - - FALCON-581 Refactor code for cross product and make it a method - (Raghav Kumar Gautam via Arpit Gupta) - - FALCON-597 String logged at the start and end of the merlin test are slightly - mismatched (Raghav Kumar Gautam via Arpit Gupta) - - OPTIMIZATIONS - FALCON-681 delete duplicate feed retention test from falcon regression (SamarthG) - - BUG FIXES - FALCON-1783 Fix ProcessUpdateTest and SearchApiTest to use prism (Paul Isaychuk) - - FALCON-1816 Fix findbugs-exclude.xml path and hadoop version in falcon-regression pom (Paul Isaychuk via Ajay Yadava) - - FALCON-1701 HiveDr, ClusterSetupTest, MirrorSummaryTest fixes(Murali Ramasami via Ajay Yadava) - - FALCON-1489 Partial status http response code returns 200(Pragya Mittal via Ajay Yadava) - - FALCON-1388 Fix merge conflicts produced by FALCON-1002 (Paul Isaychuk) - - FALCON-1002 Disable UpdateAtSpecific time test from falcon regression(Samarth Gupta via Ajay Yadava) - - FALCON-1376 Fixing FeedDelayTest(Pragya Mittal via Ajay Yadava) - - FALCON-1332 Fortify ClusterSetupTest#testRegistryInterface - if checkbox wasn't clicked repeat an attempt - (Paul Isaychuk via Raghav Kumar Gautam) - - FALCON-1338 Fortify ProcessInstanceRerunTest#testProcessInstanceRerunMultipleSucceeded (Paul Isaychuk) - - FALCON-1318 Method waitForAngularToFinish() should be robust to unresponsive browser (Raghav Kumar Gautam) - - FALCON-1314 Unify handling of local files and directory (Raghav Kumar Gautam) - - FALCON-1278 Submitted entity properties must have unique names (Raghav Kumar Gautam) - - FALCON-1300 Use xml instead of properties for log4j (Raghav Kumar Gautam via Ruslan Ostafiychuk) - - FALCON-1290 Push Enter in start/end filter on entity page, start instance is included (Ruslan Ostafiychuk) - - FALCON-1289 Select instances again after performing action on entity page (Ruslan Ostafiychuk) - - FALCON-1292 Avoid usage of hard coded feed names in Bundle class (Paul Isaychuk) - - FALCON-1281 Fix InstancePageTest#testInstancePageStatusWaitingRunning (Namit Maheshwari via Ruslan Ostafiychuk) - - FALCON-1287 Use listAllEntities() instead of listEntities() (Ruslan Ostafiychuk via Paul Isaychuk) - - FALCON-1288 Fortify expressionLanguageTest (Ruslan Ostafiychuk via Paul Isaychuk) - - FALCON-1285 Don't reduce process name in ProcessSetupTest (Ruslan Ostafiychuk) - - FALCON-1277 Fix SearchApiTest according to api changes (Paul Isaychuk via Ruslan Ostafiychuk) - - FALCON-1275 PrismFeedUpdateTest is using root directory (Raghav Kumar Gautam via Ruslan Ostafiychuk) - - FALCON-1274 PrismProcessScheduleTest is using root directory (Raghav Kumar Gautam via Ruslan Ostafiychuk) - - FALCON-1273 ProcessLateRerunTest still using root directory (Raghav Kumar Gautam via Ruslan Ostafiychuk) - - FALCON-1272 InstanceParamTest still using root directory (Raghav Kumar Gautam via Ruslan Ostafiychuk) - - FALCON-1269 Update InstancePageTest and other after UI changes (Ruslan Ostafiychuk) - - FALCON-1270 SearchUI. Login screen changed to not have password field (Namit Maheshwari via Ruslan Ostafiychuk) - - FALCON-1266 LineageApiTest test fixes (Raghav Kumar Gautam via Ruslan Ostafiychuk) - - FALCON-1265 ListProcessInstancesTest test fixes (Raghav Kumar Gautam via Ruslan Ostafiychuk) - - FALCON-1267 Fix Processsetuptest#testinoutstepdropdownfeeds (Namit Maheshwari via Raghav Kumar Gautam) - - FALCON-1264 Fix validity parsing in ProcessWizardPage (Paul Isaychuk via Ruslan Ostafiychuk) - - FALCON-1263 Fix waitTillInstanceReachState for EntityType.PROCESS (Ruslan Ostafiychuk) - - FALCON-1258 Fix feed validity and fortify ELExpFutureAndLatestTest (Ruslan Ostafiychuk) - - FALCON-1257 Fix feedAclUpdate and processAclUpdate (Ruslan Ostafiychuk) - - FALCON-1255 Fix list of expected statuses in drop down on Entity Page (Ruslan Ostafiychuk) - - FALCON-1246 Remove wrong parameter from update signature, delete related tests (Paul Isaychuk) - - FALCON-1221 RescheduleProcessInFinalStatesTest.checkNotFoundDefinition() needs to be case flexible - (Raghav Kumar Gautam) - - FALCON-1218 Minor fix for testFeedListingAfterFeedDataPathUpdate & testFeedListingAfterFeedAvailabilityFlagUpdate - (Raghav Kumar Gautam) - - FALCON-1183 Fix expected response in testScheduleDeletedFeedOnBothColosUsingColoHelper - (Ruslan Ostafiychuk) - - FALCON-1176 Fixing EntitiesPatternSearchTest failing as a result of FALCON-1158 (Pragya Mittal - via Ruslan Ostafiychuk) - - FALCON-1177 Changing method modifier to make it be not concerned as a test (Paul Isaychuk via - Ruslan Ostafiychuk) - - FALCON-1166 Fixing FeedReplicationTest, TouchAPIPrismAndServerTest, ProcessLibPathLoadTest - (Pragya Mittal via Ruslan Ostafiychuk) - - FALCON-1155 Unwanted character at the end of workflow.xml (Karishma Gulati via Ruslan Ostafiychuk) - - FALCON-1072 Dumping of Oozie info should use os specific newline (Raghav Kumar Gautam) - - FALCON-1018 Enable and fix FalconClientTest#badClusterSubmit (Paul Isaychuk via Ruslan Ostafiychuk) - - FALCON-1005 In ProcessInstanceSuspendTest clean test dir after each method execution - (Paul Isaychuk via Ruslan Ostafiychuk) - - FALCON-990 Fix and enable 3/4 tests of RescheduleProcessInFinalStatesTest (Ruslan Ostafiychuk) - - FALCON-951 Adding wait till instance goes into running for tests in falcon trunk - (Pragya Mittal via Raghav Kumar Gautam) - - FALCON-955 enable and fix feedAclUpdate and processAclUpdate tests (Raghav Kumar Gautam via - Ruslan Ostafiychuk) - - FALCON-948 Enabling late rerun tests (Paul Isaychuk via Ruslan Ostafiychuk) - - FALCON-956 Fix testProcessInstanceStatusTimedOut (Paul Isaychuk via Raghav Kumar Gautam) - - FALCON-937 Fix tests that are still using hdfs root dir in feeds (Raghav Kumar Gautam - via Ruslan Ostafiychuk) - - FALCON-936 Replace deprecated WorkflowJob.getGroup() with getAcl(). - (Ruslan Ostafiychuk via Raghav Kumar Gautam) - - FALCON-895 Fix intermittent failures in ProcessInstanceStatus and KillsTest classes. - (Paul Isaychuk via Raghav Kumar Gautam) - - FALCON-891 Removing some more invalid acl tests (Raghav Kumar Gautam) - - FALCON-888 Disabling test for special chars in pipeline name and - RescheduleProcessInFinalStatesTest (Paul Isaychuk) - - FALCON-886 Disable tests that are failing (Raghav Kumar Gautam) - - FALCON-883 Fixing testFeedCustomFilter() (Paul Isaychuk) - - FALCON-879 Update ACL tests according to info provided in FALCON-864 - (Raghav Kumar Gautam) - - FALCON-876 Reducing fail time for HCatProcessTest and - PrismFeedReplicationUpdateTest (Raghav Kumar Gautam) - - FALCON-873 BeforeClass fails in falcon-regression if "hadoop.rpc.protection" - is not set(Samarth Gupta) - - FALCON-871 Merlin clusters should have hadoop.rpc.protection property - (Raghav Kumar Gautam) - - FALCON-865 Rest end-point entities/summary has changed (Ruslan Ostafiychuk) - - FALCON-867 In process ACL tests process validity needs to be in future - (Raghav Kumar Gautam) - - FALCON-866 Lineage endpoints need to be changed for merlin - (Raghav Kumar Gautam) - - FALCON-855 Fix validation in ProcessInstanceKillsTest#testProcessInstanceKillStartAndEndSame - (Ruslan Ostafiychuk) - - FALCON-860 Add label-types for labels added as part of EntitySummaryTest (Raghav Kumar Gautam - via Ruslan Ostafiychuk) - - FALCON-852 Merlin function testProcessOrderBy() needs to use string ordering instead of enum - ordering (Raghav Kumar Gautam via Ruslan Ostafiychuk) - - FALCON-848 ListEntitiesTest tagged and checkstyle bugs fixed (Ruslan Ostafiychuk) - - FALCON-832 more edge labels and node type for lineage (Raghav Kumar Gautam via Ruslan - Ostafiychuk) - - FALCON-797 ProcessInstanceStatusTest#testProcessInstanceStatusEndOutOfRange fixed (Paul - Isaychuk via Ruslan Ostafiychuk) - - FALCON-779 ProcessInstanceStatusTest#testProcessInstanceStatusReverseDateRange fixed (Paul - Isaychuk via Ruslan Ostafiychuk) - - FALCON-776 Fixing PrismFeedUpdateTest and FeedInstanceStatus test issues (Raghav Kumar Gautam - via Ruslan Ostafiychuk) - - FALCON-747 validateSuccessOnlyStart should use '1' as expected value (Ruslan Ostafiychuk) - - FALCON-737 In NoOutputProcessTest print info before assertion (Raghav Kumar Gautam via Ruslan Ostafiychuk) - - FALCON-736 OneNonCatInputOneHCatOutput test fails because of change in parameter name (Raghav Kumar Gautam - via Ruslan Ostafiychuk) - - FALCON-733 HCatProcess tests fail because _SUCCESS file is non-zero size (Raghav Kumar Gautam - via Ruslan Ostafiychuk) - - FALCON-723 Fix ProcessInstanceResumeTest and ProcessInstanceSuspendTest as per FALCON-166 (Ruslan Ostafiychuk) - - FALCON-715 "end" parameter should be greater than last instances startTime (Ruslan Ostafiychuk) - - FALCON-716 PrismFeedSuspendTest tests retagged as distributed (Ruslan Ostafiychuk) - - FALCON-713 UpdateAtSpecificTimeTest#updateTimeInPast_Feed should submitAndSchedule feed rather - then submit (Paul Isaychuk via Ruslan Ostafiychuk) - - FALCON-707 ProcessInstanceSuspendTest is failing because input path is not set correctly - (Raghav Kumar Gautam via Ruslan Ostafiychuk) -
