http://git-wip-us.apache.org/repos/asf/falcon/blob/8e49379d/CHANGES.txt ---------------------------------------------------------------------- diff --git a/CHANGES.txt b/CHANGES.txt deleted file mode 100755 index 523e1b8..0000000 --- a/CHANGES.txt +++ /dev/null @@ -1,1866 +0,0 @@ -Apache Falcon Change log -Trunk - TASKS: - INCOMPATIBLE CHANGES - NEW FEATURES - FALCON-1627 Provider integration with Azure Data Factory pipelines (Ying Zheng, Venkat Ranganathan, Sowmya Ramesh) - - FALCON-1664 Add Postgres support for native scheduler(Deepak Barr via Pragya Mittal) - - FALCON-1495 In instance status list, show all runs for instances when requested by user(Narayan Periwal via Ajay Yadava) - - FALCON-1230 Data based notification Service to notify execution instances when data becomes available(Pavan Kumar Kolamuri via Ajay Yadava) - - IMPROVEMENTS - FALCON-1584 Falcon allows invalid hadoop queue name for schedulable feed entities (Venkatesan Ramachandran via Balu Vellanki) - - FALCON-1774 Falcon to honour PRISM_URL env var (Praveen Adlakha) - - FALCON-1721 Checkstyle doesn't extend parent. - - FALCON-1818 Minor doc update for tar package locations after FALCON-1751 (Deepak Barr) - - FALCON-1729 Database ingest to support password alias via keystore file (Venkatesan Ramachandran via Balu Vellanki) - - FALCON-1751 Support assembly:single mojo(Ruoyu Wang via Ajay Yadava) - - FALCON-763 Support feed listing for CatalogStorage (Balu Vellanki) - - FALCON-1764 Remove temporary folder "localhost" created during tests(Praveen Adlakha via Ajay Yadava) - - FALCON-1756 Remove PID files on service stop(Deepak Barr via Ajay Yadava) - - FALCON-1771 Tool to merge pull requests (Ajay Yadava) - - FALCON-1770 Update README file (Ajay Yadava) - - BUG FIXES - FALCON-887 Support for multiple lib paths in falcon process (Sowmya Ramesh) - - FALCON-1795 Kill api not killing waiting/ready instances - - FALCON-1804 Non-SLA feed throws NullPointerException. - - FALCON-1806 Update documentation for Import and Export. (Venkatesan Ramachandran via Balu Vellanki) - - FALCON-1787 Ooozie pig-action.xml requires hive sharelib for HCatalog use(Sowmya Ramesh via Ajay Yadava) - - FALCON-1792 Upgrade hadoop.version to 2.6.2 (Venkatesan Ramachandran via Peeyush Bishnoi) - - FALCON-1796 [HOTFIX] Incorrect parent pom in distro module(Ajay Yadava) - - FALCON-1779 Fix rat-check failure in trunk (Ajay Yadava) - - -Proposed Release Version: 0.9 - TASKS: - FALCON-1778 Check licenses and copyright information (Pallavi Rao) - - FALCON-1718 Change versions in pom.xml of master and 0.9 branch(Pallavi Rao via Ajay Yadava) - - FALCON-1594 Update changes.txt to reflect 0.8 as released version(Sowmya Ramesh via Ajay Yadava) - - FALCON-1523 Update CHANGES.txt to change 0.8 branch to release(Sowmya Ramesh) - - FALCON-1453 Upgrade falcon POM for 0.8 release(Sowmya Ramesh) - - INCOMPATIBLE CHANGES - - NEW FEATURES - FALCON-1742 Implement instance summary api for native scheduler (Pallavi Rao) - - FALCON-1677 Support re-tries for timed-out instances (Narayan Periwal via Pallavi Rao) - - FALCON-1643 Add CLI option to display captured replication metrics(Peeyush Bishnoi via Ajay Yadava) - - FALCON-1679 API to get type of scheduler(native/oozie) (Pallavi Rao) - - FALCON-1645 Ability to export to database(Venkat Ramachandran via Balu Vellanki) - - FALCON-1639 Implement update feature for native scheduler (Pallavi Rao) - - FALCON-1636 Add Rerun API In Falcon Native Scheduler(Pavan Kumar Kolamuri via Ajay Yadava) - - FALCON-1652 Documentation for enabling native scheduler in falcon (Pallavi Rao) - - FALCON-1512 Implement touch feature for native scheduler (Pallavi Rao) - - FALCON-1233 Support co-existence of Oozie scheduler (coord) and Falcon native scheduler (Pallavi Rao) - - FALCON-1596 Spring shell based CLI for Falcon - FALCON-1608 Base framework for Spring Shell based shell for Falcon (Rajat Khandelwal via Ajay Yadava) - - FALCON-1234 State Store for instances scheduled by Falcon (Pavan Kolamuri via Pallavi Rao) - - FALCON-1480 Gather data transfer details of Hive DR(Peeyush Bishnoi via Ajay Yadava) - - FALCON-1588 Add ability to provide the path for recipe files in command line(Peeyush Bishnoi via Ajay Yadava) - - FALCON-1573 Supply user-defined properties to Oozie workflows during schedule(Daniel Del Castillo via Ajay Yadava) - - FALCON-1559 Config changes required for native scheduler (Pallavi Rao) - - FALCON-1459 Ability to import from database(Venkat Ramachandran via Sowmya Ramesh) - - FALCON-1213 Base framework of the native scheduler(Pallavi Rao) - - IMPROVEMENTS - FALCON-1707 Code Refactoring for Falcon Client(Ajay Yadava) - - FALCON-1733 Support for building falcon with JDK 1.8 also(Narayan Periwal via Ajay Yadava) - - FALCON-1662 Ensure entity can be scheduled on multiple clusters on same colo (Pallavi Rao) - - FALCON-1545 Add documentation for Hive replication job counters(Peeyush Bishnoi via Ajay Yadava) - - FALCON-1601 Make Falcon StateStore more secure by not disclosing imp params in startup.props(Pavan Kumar Kolamuri via Ajay Yadava) - - FALCON-1705 Standardization of error handling in falcon Server(Praveen Adlakha via Ajay Yadava) - - FALCON-1640 Cascading Delete for instances in Native Scheduler(Pavan Kumar Kolamuri via Ajay Yadava) - - FALCON-1683 Inconsistent behavior when user tries to switch schedulers(Pallavi Rao via Ajay Yadava) - - FALCON-1669 Falcon should show more helpful message when it is unable to initialize Falcon Client object(Baishuo via Ajay Yadava) - - FALCON-1635 Migration of EntityManagerJerseySmokeIT to use falcon unit(Narayan Periwal via Ajay Yadava) - - FALCON-1447 Integration Tests for native scheduler(Pavan Kumar Kolamuri via Ajay Yadava) - - FALCON-1617 Enable SLA monitoring for instances in past(Narayan Periwal via Ajay Yadava) - - FALCON-1577 Migration of EntityManagerJerseyIT to use falcon unit (Narayan Periwal via Pallavi Rao) - - FALCON-1658 MySql Support for Native Scheduler(Pavan Kumar Kolamuri via Ajay Yadava) - - FALCON-1656 Improve FeedHelper:getRetentionFrequency method(Ajay Yadava) - - FALCON-1616 Consume Workflow job end notifications for SLA monitoring(Sandeep Samudrala via Ajay Yadava) - - FALCON-1634 Add .reviewboardrc file so that review requests can be created using just command line(Rajat Khandelwal via Ajay Yadava) - - FALCON-1557 Supporting some Entity Management Api's and admin api in Falcon Unit (Narayan Periwal via Pallavi Rao) - - FALCON-1622 On starting falcon server JPS shows Main and not Falcon(Sandeep Samudrala via Ajay Yadava) - - FALCON-1607 Native Scheduler - Code refactoring: Refactor ID into more specific sub classes(Ajay Yadava) - - FALCON-1587 Divide FalconCLI.twiki into sub sections for different modules on the lines of REST Api(Praveen Adlakha via Ajay Yadava) - - FALCON-1552 Migration of ProcessInstanceManagerIT to use falcon unit (Narayan Periwal via Pallavi Rao) - - FALCON-1486 Add Unit Test cases for HiveDR(Peeyush Bishnoi via Ajay Yadava) - - FALCON-1592 Code Refactoring: Introduce Event type for scheduler events (Ajay Yadava via Pallavi Rao) - - FALCON-1593 Oozie setup failing in setup phase (Praveen Adlakha via Ajay Yadava) - - FALCON-1582 Documentation for globally disabling retries (Pallavi Rao) - - FALCON-1517 Instance Management Api in Falcon Unit (Narayan Periwal via Pallavi Rao) - - FALCON-1520 Delete, update, Validate entity operations support in Falcon Unit (Pavan Kolamuri via Pallavi Rao) - - OPTIMIZATIONS - - BUG FIXES - FALCON-1793 feed element action="archive" is submittable via command line tool falcon (Deepak Barr) - - FALCON-1782 Client returns FalconWebException instead of the expected error message(Praveed Adlakha via Ajay Yadava) - - FALCON-1747 Falcon instance status listing is throwing error message (Peeyush Bishnoi) - - FALCON-1758 APIs fail when oozie workflow entries are deleted (Pavan Kolamuri via Pallavi Rao) - - FALCON-1754 JobCompletionService throws FalconException (Pallavi Rao) - - FALCON-1716 API fails with CommunicationsException when mysql interaction time is longer than 53,434,939 milliseconds (Pavan Kolamuri via Pallavi Rao) - - FALCON-1757 EntityNotRegisteredException when entity is deleted from falcon (Pavan Kolamuri via Pallavi Rao) - - FALCON-1748 Client throws FalconWebException irrespective of type of error(Praveen Adlakha via Ajay Yadava) - - FALCON-1727 Suspend fails with InvalidStateTransitionException if entity has 'KILLED' instances (Pallavi Rao) - - FALCON-1723 Rerun with skip fail actions won't work in few cases (Pavan Kolamuri via Pallavi Rao) - - FALCON-1538 Prism status gives wrong info(Praveen Adlakha via Ajay Yadava) - - FALCON-1715 IllegalStateException in MetadataMappingService when entity is scheduled via native scheduler (Pallavi Rao) - - FALCON-1732 Folders not getting deleted after testing (Praveen Adlakha via Pallavi Rao) - - FALCON-1675 Lifecycle stage is not honoured when only cluster level lifecycle is implemented (Ajay Yadava via Pallavi Rao) - - FALCON-1730 Upgrade enunciate for JDK 8 compatibility(Deepak Barr via Ajay Yadava) - - FALCON-1741 Rerun API behaviour different in case of succeeded instances(Pallavi Rao via Ajay Yadava) - - FALCON-1735 FalconException shouldn't be caught in AbstractRerunHandler in case of obtaining Workflow engine from entity(Pavan Kumar Kolamuri via Ajay Yadava) - - FALCON-1678 SLA Monitoring does not honour entity end date(Ajay Yadava) - - FALCON-1708 params API does not take start as a mandatory option(Praveen Adlakha via Ajay Yadava) - - FALCON-1725 Falcon API shows results in ascending order in native scheduler (Pallavi Rao) - - FALCON-1720 Rerun API does not rerun succeeded instances (Pavan Kolamuri via Pallavi Rao) - - FALCON-1719 Retry does not update the state of the instance in the database (Pavan Kolamuri via Pallavi Rao) - - FALCON-1710 dependency API sets totalResults as 0 by default(Praveen Adlakha via Ajay Yadava) - - FALCON-1714 EntityNotRegisteredException when process with no input/output feed is scheduled(Ajay Yadava) - - FALCON-1674 Fix the mapping of InstanceState status to workflow Status in InstancesResult (Pallavi Rao via Ajay Yadava) - - FALCON-1709 FIFO order is not followed when scheduled using native scheduler (Pallavi Rao) - - FALCON-1711 DependencyInstance twiki does not contain correct documentation (Praveen Adlakha via Pallavi Rao) - - FALCON-1702 Exception thrown by workflow status listeners on success notification(Pallavi Rao via Ajay Yadava) - - FALCON-1703 Falcon docs module not generating html files(Pallavi Rao via Ajay Yadava) - - FALCON-1565 Listing API non-intuitive response if time > endTime (Praveen Adlakha via Ajay Yadava) - - FALCON-1696 Falcon build failing in checkstyle module (Praveen Adlakha via Pallavi Rao) - - FALCON-1694 Status API shows params along with instance status(Pallavi Rao via Ajay Yadava) - - FALCON-1681 Improve logging for idempotent behaviour while scheduling entities(Pallavi Rao via Ajay Yadava) - - FALCON-1680 Error message is not intuitive when entity schedule fails(Pallavi Rao via Ajay Yadava) - - FALCON-1644 Retention : Some feed instances are never deleted by retention jobs(Balu Vellanki via Ajay Yadava) - - FALCON-1641 Triage on an invalid feed instance throws IndexOutOfBoundException(Karishma Gulati via Ajay Yadava) - - FALCON-1572 Only one instance is running in a process when run using Native Scheduler(Pallavi Rao via Ajay Yadava) - - FALCON-1660 Examples directory missing in distributed mode(Praveen Adlakha via Ajay Yadava) - - FALCON-1647 Unable to create feed : FilePermission error under cluster staging directory(Balu Vellanki via Ajay Yadava) - - FALCON-1651 Falcon doesn't start (Ajay Yadava) - - FALCON-1598 Flaky test : EntityManagerJerseyIT.testDuplicateDeleteCommands (Narayan Periwal via Pallavi Rao) - - FALCON-1568 Process Instances are not getting scheduled in Falcon Native Scheduler (Pallavi Rao) - - FALCON-1595 In secure cluster, Falcon server loses ability to communicate with HDFS over time (Balu Vellanki) - - FALCON-1490 Fixing inconsistencies in filterBy behavior (Narayan Periwal via Balu Vellanki) - - FALCON-1604 Status API Not working in case of Falcon Native Scheduler(Pavan Kumar Kolamuri via Ajay Yadava) - - FALCON-1589 Package sample recipe properties file(Peeyush Bishnoi via Ajay Yadava) - - FALCON-1597 Falcon should not retry in case of an instance being manual kill from user (Sandeep Samudrala via Pallavi Rao) - - FALCON-1606 Process schedule fails in some cases in case of NativeScheduler(Pavan Kumar Kolamuri via Ajay Yadava) - - FALCON-1605 Instance API is not working as expected in case of Native Scheduler(Pavan Kumar Kolamuri via Ajay Yadava) - - FALCON-1603 FeedHelperTest::testGetDateFromPath fails in some environments(Balu Vellanki via Ajay Yadava) - - FALCON-1372 Retention does not work in corner cases(Balu Vellanki via Ajay Yadava) - - FALCON-1569 Bug in setting the frequency of Feed retention coordinator(Sowmya Ramesh) - - FALCON-1578 post-processing action fails with javax.servlet.jsp.el.ELException(Venkat Ramachandran via Ajay Yadava) - - FALCON-1579 post-processing action fails with javax.servlet.jsp.el.ELException (Sowmya Ramesh via Pallavi Rao) - - FALCON-1553 Flaky test in SchedulerUtilTest (Balu Vellanki via Pallavi Rao) - - FALCON-1554 Fix Changes.txt after 0.8 branch cut(Sowmya Ramesh) - -Release version: 0.8 - FALCON-1349 Upgrade falcon POM for 0.7 release(Ajay Yadava) - - INCOMPATIBLE CHANGES - FALCON-1401 MetadataMappingService fails to add an edge for a process instance(Pallavi Rao) - - NEW FEATURES - FALCON-570 Falcon needs to publish maven artifacts (Shwethags GS) - - FALCON-1485 Add documentation for data transfer details of filesystem replication(Peeyush Bishnoi via Sowmya Ramesh) - - FALCON-1315 Update falcon ui for HiveDR, secure clusters and bug fixes(Armando Reyna/Venkat Ranganathan via Sowmya Ramesh) - - FALCON-1102 Gather data transfer details of filesystem replication(Peeyush Bishnoi via Sowmya Ramesh) - - FALCON-1316 Add supporting REST API calls for new UI(Balu Vellanki via Sowmya Ramesh) - - FALCON-1473 Feed SLA Miss Alerts through REST API(Ajay Yadava) - - FALCON-965 Open up life cycle stage implementation within Falcon for extension(Ajay Yadava) - - FALCON-1437 Change DR recipes notification with Falcon notification(Peeyush Bishnoi via Sowmya Ramesh) - - FALCON-1027 Falcon proxy user support(Sowmya Ramesh) - - IMPROVEMENTS - FALCON-1585 Documentation for HDFS and Hive DR(Peeyush Bishnoi via Sowmya Ramesh) - - FALCON-1574 Document behavior of lifecycle retention stage frequency behavior(Sowmya Ramesh via Ajay Yadava). - - FALCON-1564 Provide an option for users to disable system post-processing JMS notification (Pallavi Rao) - - FALCON-1519 Suspend And Resume API's in Falcon Unit(Narayan Periwal via Pallavi Rao) - - FALCON-1524 Improve Lifecycle Retention validation checks(Ajay Yadava) - - FALCON-1516 Feed Retention support in Falcon Unit(Pavan Kolamuri via Pallavi Rao) - - FALCON-1527 Release Falcon Unit test jar(Pavan Kumar Kolamuri via Ajay Yadava) - - FALCON-1231 Improve JobCompletionNotification Service(Pallavi Rao) - - FALCON-1157 Build error when using maven 3.3.x(Venkat Ramachandran via Pallavi Rao) - - FALCON-1477 Adding "-debug" option to Falcon CLI for debug statements to stdout(Narayan Periwal via Pallavi Rao) - - FALCON-1476 Maintaining threshold on monitoring entities for SLA service(Ajay Yadava) - - FALCON-592 Refactor FalconCLI to make it more manageable(Balu Vellanki via Ajay Yadava) - - FALCON-1472 Improvements in SLA service(Ajay Yadava) - - FALCON-438 Auto generate documentation for REST API(Narayan Periwal via Ajay Yadava) - - FALCON-1483 Add Utils to common to support native scheduler(Pallavi Rao via Ajay Yadava) - - FALCON-1417 Make validity end date optional for feed / process(Pragya Mittal via Ajay Yadava) - - FALCON-1434 Enhance schedule API to accept key-value properties(Pallavi Rao) - - FALCON-1426 Add documentation for Falcon Email notification (Peeyush Bishnoi via Pallavi Rao) - - FALCON-1425 Provide Email based plugin to send Notification once instance completed(Peeyush Bishnoi via Ajay Yadava) - - FALCON-1205 SLAService to keep track of missing SLAs for feeds(Ajay Yadava) - - FALCON-1449 Move getEntityProperties method to EntityUtil.(Ajay Yadava) - - FALCON-1357 Update CHANGES.txt to change 0.7 branch to release.(Ajay Yadava) - - FALCON-1414 Add all fields in filterBy to the entity list output.(Narayan Periwal via Ajay Yadava) - - FALCON-1430 Exclude designer from source tarball(Ajay Yadava) - - FALCON-348 Add shutdown hook for Falcon (Sandeep Samudrala via Pallavi Rao) - - OPTIMIZATIONS - FALCON-1403 Revisit IT cleanup and teardown(Narayan Periwal via Pallavi Rao) - - BUG FIXES - FALCON-1579 post-processing action fails with javax.servlet.jsp.el.ELException (Sowmya Ramesh via Pallavi Rao) - - FALCON-1563 Old feed instances get deleted from SLA monitoring on feed update (Ajay Yadava). - - FALCON-1560 Lifecycle does not allow feed with frequency greater than days(1) (Ajay Yadava). - - FALCON-1556 Falcon build fails when building with hivedr profile(Sowmya Ramesh) - - FALCON-1558 Sla API shows pending instance although _SUCCESS directory is present(Pragya Mittal via Ajay Yadava). - - FALCON-1555 succeeded-post-processing action fails in Oozie uber mode (Pragya Mittal via Pallavi Rao) - - FALCON-1551 Implement setWorkingDir Method in JailedFileSystem(Pavan Kolamuri via Pallavi Rao) - - FALCON-1541 Bundle deploy.properties while packaging falcon (Pragya Mittal via Pallavi Rao) - - FALCON-1530 SLAMonitoring API is not honouring delete feature(Ajay Yadava). - - FALCON-1532 Incorrect documentation in SLA monitoring(Pragya Mittal via Ajay Yadava) - - FALCON-1466 Flaky unit tests in Proxy user feature(Sowmya Ramesh) - - FALCON-1518 Temporarily comment getTotalEnqueueCount in JMSMessageConsumerTest(Peeyush Bishnoi via Sowmya Ramesh) - - FALCON-1514 Incorrect logging while submitting cluster(Sandeep Samudrala via Pallavi Rao) - - FALCON-1509 Auto generation of REST API does not work in distributed mode(Narayan Periwal via Sowmya Ramesh) - - FALCON-1491 Update ActiveMQ version to 5.12(Peeyush Bishnoi via Sowmya Ramesh) - - FALCON-1487 In secure cluster setup Hcat process/feed scheduling or replication fails(Sowmya Ramesh) - - FALCON-1339 List feed entities shows scheduled Feed entities as submitted(Balu Vellanki via Sowmya Ramesh) - - FALCON-1499 Lifecycle Retention Issues(Ajay Yadava) - - FALCON-1469 Flaky EntityManagerJerseyIT#testDuplicateSubmitCommands(Sandeep Samudrala via Ajay Yadava) - - FALCON-1470 HiveDRStatusStoreTest should fail when using fakeGroup to create StatusStore(Balu Vellanki via Sowmya Ramesh) - - FALCON-1462 Modify use of "testuser" in UTs and ITs(Narayan Periwal via Sowmya Ramesh) - - FALCON-1484 Find Bundles fails in case of hadoop namenode moving to HA(Sandeep Samudrala via Pallavi Rao) - - FALCON-1343 Fix validation of read/write endpoints in ClusterEntityParser(Balu Vellanki via Ajay Yadava) - - FALCON-1373 HiveDR does not work when job is run on destination cluster(Balu Vellanki via Ajay Yadava) - - FALCON-1401 MetadataMappingService fails to add an edge for a process instance(Pallavi Rao) - - FALCON-1465 Cluster submission fails with java.lang.IllegalArgumentException in distributed mode(Ajay Yadava via Sowmya Ramesh) - - FALCON-1331 Update Failed for an entity and further updates are not possible as lock is not released(Pavan Kumar Kolamuri via Ajay Yadava) - - FALCON-1408 Add more logging information for failing ClusterEntityValidationIT(Pavan Kumar Kolamuri via Ajay Yadava) - - FALCON-1442 Contract of WorkflowEngine API broken(Balu Vellanki via Ajay Yadava) - - FALCON-1460 Move getHiveCredentials method to ClusterHelper(Ajay Yadava via Sowmya Ramesh) - - FALCON-1342 Do not allow duplicate properties in entities(Balu Vellanki via Sowmya Ramesh) - - FALCON-1461 NPE in DateValidator validate(Raghav Kumar Gautam via Sowmya Ramesh) - - FALCON-1446 Flaky TaskLogRetrieverYarnTest(Narayan Periwal via Pallavi Rao) - - FALCON-1443 NPE in shutdown hook(Pallavi Rao via Ajay Yadava) - - FALCON-1445 Docfix for api/instance/dependencies endpoint(Raghav Kumar Gautam via Ajay Yadava) - - FALCON-1381 The webservice response of Falcon includes a stack trace in case of errors(Narayan Periwal via Ajay Yadava) - - FALCON-1438 Falcon RestAPI - In case of error falcon responds with FalconWebException::null(Balu Vellanki via Ajay Yadava). - - FALCON-1415 Hive DR process fail if there are no events available from source table(Peeyush Bishnoi via Ajay Yadava) - - FALCON-1371 Status of scheduled Process entity is shown as submitted in corner case(Balu Vellanki via Sowmya Ramesh) - - FALCON-1402 Validate cmd throws NPE when source cluster and any one of target cluster doesn't have overlapping dates(Pavan Kumar Kolamuri via Ajay Yadava) - - FALCON-1365 HCatReplication job fails with AccessControlException(Sowmya Ramesh via Ajay Yadava) - - FALCON-298 Feed update with replication delay creates holes(Sandeep Samudrala via Ajay Yadava) - - FALCON-1410 Entity submit fails when multiple threads try submitting same definition(Sandeep Samudrala via Ajay Yadava) - - FALCON-1429 Fix Falcon monitoring, alert, audit and monitoring plugins by fixing aspectj handling(Venkat Ranganathan via Ajay Yadava) - - FALCON-1416 Add ACL (if missing) during touch(Narayan Periwal via Ajay Yadava) - - FALCON-1413 Filter By throws wrong error in case of wrong argument being passed(Narayan Periwal via Ajay Yadava) - - FALCON-1421 checkColos should be a no-op for embedded mode(Venkat Ranganathan via Ajay Yadava) - - -Release version: 0.7 - FALCON-1424 Update changes.txt for 0.7 branch(Ajay Yadava) - - INCOMPATIBLE CHANGES - - NEW FEATURES - FALCON-1188 Falcon support for Hive Replication(Venkat Ranganathan via Ajay Yadava) - - FALCON-1297 Falcon Unit which supports Submit and Schedule of jobs(Pavan Kumar Kolamuri via Ajay Yadava) - - FALCON-1039 Add instance dependency API in falcon (Ajay Yadava) - - FALCON-796 Enable users to triage data processing issues through falcon (Ajay Yadava) - - IMPROVEMENTS - FALCON-1432 Fix licenses in LICENSES.txt(Ajay Yadava) - - FALCON-1378 Falcon documentation lacks information on how to run Falcon on standalone Oozie/Hadoop setup(Pallavi Rao via Ajay Yadava) - - FALCON-1419 Document ability to disable oozie dryRun during entity schedule actions(Balu Vellanki via Ajay Yadava) - - FALCON-1174 Ability to disable oozie dryrun while scheduling or updating the falcon entity(Balu Vellanki via Ajay Yadava) - - FALCON-1374 Remove the cap on numResults(Pragya Mittal via Ajay Yadava) - - FALCON-1379 Doc describes retention incorrectly(Ajay Yadava) - - FALCON-1359 Improve output format for Feed Instance Listing(Ajay Yadava) - - FALCON-1368 Improve Falcon server restart time(Sandeep Samudrala via Ajay Yadava) - - FALCON-1361 Default end date should be now(Pragya Mittal via Ajay Yadava) - - FALCON-1362 Colo option shouldn't be mandatory(Sandeep Samudrala via Ajay Yadava) - - FALCON-1360 Size of feed should be humanized in feed instance listing(Sndeep Samudrala via Ajay Yadava) - - FALCON-1301 Improve documentation for Installation(Pragya Mittal via Ajay Yadava) - - FALCON-1322 Add prefix in runtime.properties(Sandeep Samudrala via Ajay Yadava) - - FALCON-1317 Inconsistent JSON serialization(Ajay Yadava) - - FALCON-1324 Pagination API breaks backward compatibility(Ajay Yadava). - - FALCON-668 FeedReplicator improvement to include more DistCP options(Sowmya Ramesh via Ajay Yadava) - - FALCON-1320 Adding equals() and hashCode() method in LineageGraphResult.Edge(Pragya Mittal via Ajay Yadava) - - FALCON-1139 Validation issues in Falcon UI(Pallavi Rao via Ajay Yadava) - - FALCON-1204 Expose default configs for feed late data handling in runtime.properties(Balu Vellanki via Ajay Yadava) - - FALCON-1170 Falcon Native Scheduler - Refactor existing workflow/coord/bundle builder(Pallavi Rao via Ajay Yadava) - - FALCON-1031 Make post processing notifications to user topics optional (Pallavi Rao via Ajay Yadava) - - FALCON-1186 Add filtering capability to result of instance summary (Suhas Vasu) - - FALCON-1293 Update CHANGES.txt to change 0.6.1 branch to release (Shaik Idris Ali via Ajay Yadava) - - FALCON-1116 Rule for Oozie 4+ doesn't match 5+ versions (Ruslan Ostafiychuk) - - FALCON-1114 Oozie findBundles lists a directory and tries to match with the bundle's appPath - (Pallavi Rao via Ajay Yadava) - - FALCON-1207 Falcon checkstyle allows wildcard imports(Pallavi Rao via Ajay Yadava) - - FALCON-1147 Allow _ in the names for name value pair(Sowmya Ramesh via Ajay Yadava) - - FALCON-676 Enable metrics for Titan(Ajay Yadava) - - FALCON-1060 Handle transaction failures in Lineage(Pavan Kumar Kolamuri via Ajay Yadava) - - FALCON-1212 Remove dependency on Gremlin (Ajay Yadava via Suhas Vasu) - - FALCON-1211 Source tarball are not generated in mvn assembly when profile is distributed - (Shaik Idris Ali) - - FALCON-1219 Minor doc fix(Raghav Kumar Gautam via Ajay Yadava) - - FALCON-1059 Lineage should support bootstrapping(Ajay Yadava) - - FALCON-75 Falcon CLI for deleting entities should inform user if entity does not exist(Ajay Yadava) - - FALCON-1127 Falcon entity status is submitted when corresponding Bundle - is runningwitherror(Pallavi Rao via Suhas Vasu) - - FALCON-1142 ClusterEntityParserTest.testClusterWithOnlyStaging - fails when run alone(Pallavi Rao via Suhas Vasu) - - FALCON-1152 Names of Xml attributes and Class member variables - are inconsistent(Ajay Yadava) - - OPTIMIZATIONS - FALCON-1228 testSubscriber test of JMSMessageConsumerTest fails at a particular scenario - (Suhas Vasu) - - BUG FIXES - FALCON-1203 2 validateACL UTs broken(Narayan Periwal via Ajay Yadava) - - FALCON-1423 HDFS recipe broken: Unrecognized option: -counterLogDir(Sowmya Ramesh via Ajay Yadava) - - FALCON-1312 Falcon post processing action should use Oozie prepared configuration(Venkat Ranganathan via Ajay Yadava) - - FALCON-1038 Log mover fails for map-reduce action(Peeyush Bishnoi via Ajay Yadava) - - FALCON-1412 Process waits indefinitely and finally timedout even though missing dependencies are met(Pallavi Rao via Ajay Yadava) - - FALCON-1409 Update API throws NullPointerException(Sandeep Samudrala via Ajay Yadava) - - FALCON-1407 Temporarily disable failing tests in ClusterEntityValidationIT(Ajay Yadava) - - FALCON-1392 FalconUnit tests fail(Pavan Kumar Kolamuri via Ajay Yadava) - - FALCON-1344 EntityGraph returns null in list of dependent entities(Ajay Yadava) - - FALCON-1330 When multiple cluster definitions exist for the same colo, triage produces unexpected results(Ajay Yadava) - - FALCON-1399 Property for default number of results is not loaded dynamically(Ajay Yadava) - - FALCON-1398 CrossEntityValidations contains incorrect validations(Pragya Mittal via Ajay Yadava) - - FALCON-1396 Disable the faulty test(Ajay Yadava via Sowmya Ramesh) - - FALCON-1251 FeedEvictor UT fails intermittently(Sandeep Samudrala via Ajay Yadava) - - FALCON-1383 MetadataMappingServiceTest#testLineageForTransactionFailure fails randomly(Sandeep Samudrala via Ajay Yadava) - - FALCON-1380 Triage Result throws incorrect error message on prism for an invalid process instance(Ajay Yadava) - - FALCON-1310 Falcon build fails with Oozie-4.2.0(Peeyush Bishnoi via Sowmya Ramesh) - - FALCON-1369 Trunk build is broken(Ajay Yadava via Sowmya Ramesh) - - FALCON-1363 Fix retry policy example in documentation(Peeyush Bishnoi via Ajay Yadava) - - FALCON-1327 When using triage on a server for a process which does not exist on that server, - a NullPointerException is encountered(Ajay Yadava) - - FALCON-1325 Triage API on prism, for an instance at which a process does not exist sends incorrect message(Ajay Yadava) - - FALCON-1328 Error in Triage documentation(Karishma Gulati via Ajay Yadava) - - FALCON-1323 Reverse lookup of feeds causes NPE(Ajay Yadava) - - FALCON-1329 Falcon's idempotent behaviour breaks in some cases(Ajay Yadava) - - FALCON-1282 Incorrect hdfs servers property for feed replication in secured environment(Venkat Ranganathan via Ajay Yadava) - - FALCON-1311 Instance dependency API produces inconsistent results in some scenarios(Pragya Mittal via Ajay Yadava) - - FALCON-1268 Instance Dependency API failure message is not intuitive in distributed mode (Ajay Yadava) - - FALCON-1260 Instance dependency API produces incorrect results (Ajay Yadava) - - FALCON-99 Adding late data to process doesn't create new coord (Pallavi Rao via Suhas Vasu) - - FALCON-1101 Cluster submission in falcon does not create an owned-by edge(Sowmya Ramesh via Ajay Yadava) - - FALCON-1104 Exception while adding process instance to graphdb when feed has partition expression - (Pavan Kumar Kolamuri via Ajay Yadava) - - FALCON-1252 The parameter "tagkey" should be "tagkeys" in EntityList and FalconCLI twiki - (Ying Zheng via Sowmya Ramesh) - - FALCON-1244 numResults query param in listInstances is ignored when start and end params are not specified - (Balu Vellanki via Sowmya Ramesh) - - FALCON-1121 Backend support for free-text entity search - (Ying Zheng via Sowmya Ramesh) - - FALCON-1051 Lineage apis broken for falcon setup in distributed mode - (Pavan Kumar Kolamuri via Ajay Yadava) - - FALCON-1165 Falcon restart failed, if defined service in cluster entity is unreachable - (Peeyush Bishnoi via Ajay Yadava) - - FALCON-1195 ClusterEntityParserTest fails intermittently - (Balu Vellanki via Sowmya Ramesh) - - FALCON-1162 Cluster submit succeeds when staging HDFS dir does not have - 777 (ALL) permission (Venkat Ramachandran via Sowmya Ramesh) - - FALCON-1153 Instance kill fails intermittently - (Balu Vellanki via Sowmya Ramesh) - - FALCON-954 Secure Kerberos setup : Falcon should periodically revalidate - auth token (Balu Vellanki via Ajay Yadava) - - FALCON-1146 feed retention policy deleted everything all the way up - to the root (Peeyush Bishnoi via Suhas Vasu) - - FALCON-1129 In a secure cluster, feed replication fails because of - Authentication issues (Venkat Ranganathan via Suhas Vasu) - - FALCON-1141 Reverse Lookup for feed in prism fails with BadRequest - (Ajay Yadava via Suhas Vasu) - - FALCON-1143 Correcting order of entities on reload - (Ajay Yadava via Suhas Vasu) - - FALCON-1144 Dynamic partitions not getting registered in Hcat - (Suhas Vasu) - -Release Version: 0.6.1 - INCOMPATIBLE CHANGES - - NEW FEATURES - FALCON-1091 Monitoring plugin that registers catalog partition - code - (Suhas Vasu / PallaviRao / Shwetha GS via Suhas Vasu) - - FALCON-790 Falcon UI to enable entity/process/feed edits and - management. (Armando Reyna/Kenneth Ho via Srikanth Sundarrajan) - - FALCON-949 Force update feature (pavan kumar kolamuri via Suhas Vasu) - - FALCON-822 Add reverse look up API (Ajay Yadava via Suhas Vasu) - - IMPROVEMENTS - FALCON-1280 Update docs/license licenses with right copyright - information (Shaik Idris Ali) - - FALCON-1276 Verify licensing in html5-ui module. - (Shaik Idris Ali) - - FALCON-1245 Verify licensing and update license.txt in falcon-ui module - (Shaik Idris Ali) - - FALCON-1220 Exclude downloaded directories from falcon-ui modules - (Shaik Idris Ali) - - FALCON-1182 Remove reference to com.google.code.findbugs:annotations(Shaik Idris Ali) - - FALCON-1158 Rename the parameter "pattern" in LIST API to "nameseq" - (Ying Zheng via Suhas Vasu) - - FALCON-1142 ClusterEntityParserTest.testClusterWithOnlyStaging - fails when run alone(Pallavi Rao via Suhas Vasu) - - FALCON-1128 Adding getter methods to FeedLookupResult - (Karishma Gulati via Samarth) - - FALCON-1086 Support execution-order of a feed to be overridden - for replication coord (Shaik Idris Ali via Suhas Vasu) - - FALCON-915 Failed to load data. Error: 400 Param user.name - can't be empty - Web UI/0.6 (Balu Vellanki via Suhas Vasu) - - FALCON-933 misleading error msg on cluster submit failure - (Sowmya Ramesh via Suhas Vasu) - - FALCON-910 Better error messages when creating cluster's directories - (karan kumar via Suhas Vasu) - - FALCON-1042 Misleading mesage received while performing touch operation - on scheduled entity (Suhas Vasu) - - FALCON-1074 EntityUtil getInstanceSequence is buggy (Ajay Yadava via Suhas vasu) - - FALCON-1024 Updating tags and pipeline elements of the feed/process definition - resubmits a new Oozie bundle (Pallavi Rao via Suhas Vasu) - - FALCON-555 API response from instance "params" having multiple "entry" key - (Pallavi Rao via Suhas Vasu) - - FALCON-1003 Update checkstyle to remove DoubleCheckedLocking - (Pallavi Rao via Suhas Vasu) - - FALCON-1012 Add support for MapR-FS (Roman Slysh via Suhas Vasu) - - FALCON-774 Discontinue support for JDK 1.6 and move to 1.7. (Peeyush - Bishnoi via Srikanth Sundarrajan) - - FALCON-263 Adding documentation for params api (Ajay Yadav via Srikanth - Sundarrajan) - - FALCON-237 falcon feed replication should honour availability flag (Peeyush - Bishnoi via Srikanth Sundarrajan) - - FALCON-417 Upgrade Hive and HCatalog to latest stable version. (Peeyush Bishnoi - via Srikanth Sundarrajan) - - FALCON-896 Upgrade oozie to 4.1.0 and make it the default for falcon. (Peeyush - Bishnoi via Srikanth Sundarrajan) - - FALCON-749 Improve error printed in falcon CLI. (Suresh Srinivas via Shwetha GS) - - FALCON-977 Drop incubator/incubating from falcon codebase. (Shwetha GS - via Srikanth Sundarrajan) - - FALCON-952 If hadoop home is set, use $HADOOP_HOME to set falcon classpath - (Balu Vellanki via Suhas Vasu) - - FALCON-935 Feed and process late rerun failed in falcon trunk - (Shaik Idris Ali via Suhas Vasu) - - FALCON-914 Add option to search for Entities. (Ajay Yadav via Srikanth - Sundarrajan) - - FALCON-256 Create new API for Process dependency graph DAG which captures - process connected via feeds. (Ajay Yadav via Srikanth Sundarrajan) - - FALCON-823 Add path matching ability to the radix tree (Ajay Yadav - via Srikanth Sundarrajan) - - FALCON-329 Falcon client methods should return objects. (Samar via Shwetha GS) - - FALCON-593 Preserve data type for properties in a vertex. (Ajay - Yadav via Srikanth Sundarrajan) - - FALCON-785 Document upgrade path from 0.5 to 0.6. (Balu Vellanki - via Srikanth Sundarrajan) - - FALCON-877 Pagination API should have a cap on number of results - returned (Ajay Yadav via Srikanth Sundarrajan) - - FALCON-734 Document when to use Distributed Mode vs. Embedded Mode - (Ajay Yadav via Srikanth Sundarrajan) - - FALCON-805 Create store to store feed properties like name against - it's path (Ajay Yadav via Srikanth Sundarrajan) - - FALCON-807 Fix order of actual and expected expression in assert - statements in webapp module (Ajay Yadav via Srikanth Sundarrajan) - - FALCON-784 Update release notes in CHANGES.txt in branch and trunk - (Venkatesh Seetharam) - - FALCON-782 Update trunk version to 0.7-incubating-SNAPSHOT (Venkatesh - Seetharam) - - OPTIMIZATIONS - FALCON-1071 Feed Listing API default behaviour for start and end - not handled properly. (Suhas Vasu) - - FALCON-1063 Falcon CLI list entities operation throws NullPointerException - (Pallavi Rao via Suhas Vasu) - - FALCON-987 params command inconsistent behavior - (pavan kumar kolamuri via Suhas Vasu) - - FALCON-944 Parallel update APIs create 2 coords (Suhas Vasu) - - FALCON-943 process update copying user lib is very slow. (Shwetha G S) - - FALCON-419 Update deprecated HCatalog API to use Hive Metastore API. - (Shwetha GS) - - FALCON-423 Updating falcon server endpoint in distributed setup doesn't - work. (Srikanth Sundarrajan) - - FALCON-913 Change the default values of log clean up services - (Suhas vasu) - - BUG FIXES - FALCON-1238 Add apache license header to .less css in falcon-ui/app - (Shaik Idris Ali) - - FALCON-1224 cannot build falcon - codehaus close service and repo - - fail error 503 (Suhas Vasu) - - FALCON-1161 Test case feedFeedBasePathExists fails intermittently - (Suhas Vasu) - - FALCON-1154 Replication is broken (Sowmya Ramesh via Suhas Vasu) - - FALCON-1159 Falcon build is broken (Suhas Vasu) - - FALCON-1146 feed retention policy deleted everything all the way up - to the root (Peeyush Bishnoi via Suhas Vasu) - - FALCON-1129 In a secure cluster, feed replication fails because of - Authentication issues (Venkat Ranganathan via Suhas Vasu) - - FALCON-1141 Reverse Lookup for feed in prism fails with BadRequest - (Ajay Yadava via Suhas Vasu) - - FALCON-1143 Correcting order of entities on reload - (Ajay Yadava via Suhas Vasu) - - FALCON-1144 Dynamic partitions not getting registered in Hcat - (Suhas Vasu) - - FALCON-1132 Falcon trunk is broken due to failure in IT test - (Ajay Yadava via Suhas Vasu) - - FALCON-1097 UT failure for ExpressionHelperTest - (Ajay Yadava via Shaik Idris) - - FALCON-1125 Feed Lookup API doesnt work via prism - (Ajay Yadava via Suhas Vasu) - - FALCON-1119 Instance logs option is not returning the log location - (Suhas Vasu) - - FALCON-1100 UI : Failed to load data. 404 not found - (Sowmya Ramesh via Suhas Vasu) - - FALCON-1123 Stacktrace printed by Falcon CLI is not useful to user - (Pallavi Rao via Suhas Vasu) - - FALCON-1117 Falcon Client throws NPE on no emtpy result in - reverse lookup (Ajay Yadava via Suhas Vasu) - - FALCON-1099 FeedReplicator: throws NPE (Sowmya Ramesh via Suhas Vasu) - - FALCON-1064 Build hangs at the following test: JMSMessageProducerTest - (Sowmya Ramesh via Suhas Vasu) - - FALCON-1070 numResults and offset doesnot work for instance operations - (Suhas Vasu) - - FALCON-1025 lastWeek and CurrentWeek functions are getting - evaluated incorrect (pavan kumar kolamuri via Suhas Vasu) - - FALCON-1020 validate command produces different results when run - via prism and server (pavan kumar kolamuri via Suhas Vasu) - - FALCON-950 Rerun does not work on succeeded instances (Suhas Vasu) - - FALCON-1048 Incorrect documentation for feed instacnce listing api. (Suhas - Vasu via Srikanth Sundarrajan) - - FALCON-1057 recipes.twiki should be renamed Recipes.twiki for consistency - and to fix a dead link (Aaron Dossett via Srikanth Sundarrajan) - - FALCON-1052 pipeline feature is not able to group by through CLI - (Pallavi Rao via Suhas Vasu) - - FALCON-1047 Feed Instance Listing doesn't return any output or error - (Pallavi Rao via Suhas Vasu) - - FALCON-1050 Falcon rerun is broken for timed out instances - (Suhas Vasu) - - FALCON-1045 Falcon rerun is broken in trunk (Suhas Vasu) - - FALCON-973 Add LogMover Service for yarn - (pavan kumar kolamuri via Suhas Vasu) - - FALCON-993 Falcon Oozie adaptor test case failed with umask issue - (Peeyush Bishnoi via Srikanth Sundarrajan) - - FALCON-1000 ITs fail with NoSuchFieldError: INSTANCE. (Shwetha GS) - - FALCON-109 submission of clusters for non registered colos - (Pallavi Rao via Suhas Vasu) - - FALCON-995 Sharelib directory does not exist in webapp - (Peeyush Bishnoi via Suhas Vasu) - - FALCON-984 Falcon build is broken. (Peeyush Bishnoi via Srikanth - Sundarrajan) - - FALCON-945 Fix broken lineage feature in Web-UI. (Adam Kawa via Srikanth - Sundarrajan) - - FALCON-921 Validate command is exposed only through prism. (Ajay Yadav - via Shwetha GS) - - FALCON-916 Falcon idempotency is being voilated during delete. (Balu - Vellanki via Srikanth Sundarrajan) - - FALCON-917 Fix corner cases while getting job id during instance status - (Suhas Vasu) - - -Release Version: 0.6-incubating - - FALCON-785 Document upgrade path from 0.5 to 0.6 (Venkatesh Seetharam) - - INCOMPATIBLE CHANGES - FALCON-753 Change the ownership for staging dir to user submitting the feed - (Venkatesh Seetharam) - - NEW FEATURES - FALCON-722 Add SLA for processes (Ajay Yadav via Srikanth Sundarrajan) - - FALCON-721 Add SLA for Feeds (Ajay Yadav via Suhas Vasu) - - FALCON-687 Add hooks for extensions in Audit (Venkatesh Seetharam) - - FALCON-636 Add a sample recipe for disaster recovery of hdfs dirs/files - (Sowmya Ramesh via Venkatesh Seetharam) - - FALCON-635 Add recipe option in falcon client (Sowmya Ramesh via - Venkatesh Seetharam) - - FALCON-615 Add pipleline element to lineage graph - (Sowmya Ramesh via Venkatesh Seetharam) - - FALCON-614 Add pipeline element to process entity - (Balu Vellanki via Venkatesh Seetharam) - - FALCON-588 Baselining designer code. (samar via Shwetha GS) - - FALCON-400 Add Authorization for Entities (Venkatesh Seetharam) - FALCON-279 Add ACL for Cluster Entity - FALCON-462 Add ACL for process entity - FALCON-463 Validate Feed ACL only if authorization is enabled - FALCON-464 Enforce Authorization for REST API - FALCON-468 Add User Documentation for authorization feature - FALCON-557 Add super-user who is authorized for all - - FALCON-466 REST APIs must add the entity owner as an implicit filter (Balu Vellanki - via Venkatesh Seetharam) - - FALCON-263 API to get workflow parameters. (pavan kumar kolamuri via Shwetha GS) - - IMPROVEMENTS - FALCON-320 Whitespace has not been taken into consideration in runtime.properties - - FALCON-766 Falcon workflow rerun by default should rerun only Failed nodes - and remove continue option (Shaik Idris Ali via Venkatesh Seetharam) - - FALCON-744 Document existing falcon data archival to cloud store - (Venkatesh Seetharam) - - FALCON-869 Clean up required in the instance API calls. (Suhas Vasu) - - FALCON-878 Move falcon html files to HTML5. (Ajay Yadav via Srikanth Sundarrajan) - - FALCON-145 Feed eviction be implemented in appropriate Storage - implementation. (Ajay Yadav via Srikanth Sundarrajan) - - FALCON-813 Expose job id for running jobs in Falcon (Suhas Vasu) - - FALCON-834 Propagate request id in the response to help trace and debug - failures in merlin (Venkatesh Seetharam) - - FALCON-828 Add hadoop version info as part of falcon admin version API - (Venkatesh Seetharam) - - FALCON-762 Support feed listing for file system storage (Srikanth Sundarrajan) - - FALCON-20 Remove dependency on custom InMobi DistCp (Sowmya Ramesh via - Venkatesh Seetharam) - - FALCON-758 Discontinue support for Oozie-3.x (Peeyush Bishnoi via - Venkatesh Seetharam) - - FALCON-757 Discontinue support for Hadoop-1.x (Sowmya Ramesh via - Venkatesh Seetharam) - - FALCON-748 Falcon throws '413 Full Head' error message when kerberos is - enabled with AD (Balu Vellanki via Venkatesh Seetharam) - - FALCON-767 Upgrade Hadoop from 2.4 to 2.5 (Sowmya Ramesh via Venkatesh Seetharam) - - FALCON-651 Typos in Falcon Documentation (Ajay Yadav via Venkatesh Seetharam) - - FALCON-576 Update Installation notes for Mac OS (Ajay Yadav via - Venkatesh Seetharam) - - FALCON-666 Add Alerts for unrecoverable failures (Venkatesh Seetharam) - - FALCON-665 Handle message consumption failures in JMSMessageConsumer - (Venkatesh Seetharam) - - FALCON-662 Fetch relationships for a given type API (Balu Vellanki via - Venkatesh Seetharam) - - FALCON-661 Add list types to Lineage API (Balu Vellanki via - Venkatesh Seetharam) - - FALCON-654 Exclude junit dependency in pom (Ruslan Ostafiychuk) - - FALCON-640 Add ability to specify sort order for orderBy param in RestAPI - (Balu Vellanki via Venkatesh Seetharam) - - FALCON-594 Process lineage information for Retention policies - (Sowmya Ramesh via Venkatesh Seetharam) - - FALCON-325 Process lineage information for Replication policies - (Sowmya Ramesh via Venkatesh Seetharam) - - FALCON-474 Add Bulk APIs to drive the dashboard needs (Balu Vellanki via - Venkatesh Seetharam) - - FALCON-166 Instance status start and end dates are rigid and inconvenient - (Balu Vellanki via Venkatesh Seetharam) - - FALCON-612 Create CHANGES.txt for falcon-regression(Arpit Gupta via SamarthG) - - FALCON-470 Add support for pagination, filter by, etc. to Entity and - Instance List API (Balu Vellanki via Venkatesh Seetharam) - - FALCON-327 - Simplify message passing framework (Venkatesh Seetharam) - FALCON-484 - Refactor workflow related code into context, listener and Notification - FALCON-485 - Simplify JMS Message Sender/Consumer and use Workflow Context - FALCON-486 - Introduce Workflow Context in Post Processing - FALCON-487 -Introduce Workflow Context in Rerun framework - FALCON-488 - Introduce Workflow Context in Lineage Service - FALCON-492 - Refactor workflow listener implementation init config driven - - FALCON-554 Extend time functions available in Falcon to support current & - last week (Contributed by Srikanth Sundarrajan) - - FALCON-369 Refactor workflow builder. (Shwetha GS) - - FALCON-280 Validate the ACL in Feed entity with the user submitting the entity - (Jean-Baptiste Onofré via Venkatesh Seetharam) - - FALCON-445 Propagate hive credentials defined in cluster entity to - hive-site.xml (Sowmya Ramesh via Venkatesh Seetharam) - - FALCON-133 Upgrade to slf4j 1.7.5 and use SLF4J logger. (Jean-Baptiste Onofré - via Shwetha GS) - - FALCON-353 enable dry run feature of oozie for schedule - and update (Shwetha GS via Suhas Vasu) - - OPTIMIZATIONS - - BUG FIXES - FALCON-829 Better error message for cluster submission failure - (Karan Kumar via Venkatesh Seetharam) - - FALCON-824 Remove usage of Hadoop incompatible API - (Shwetha G S via Venkatesh Seetharam) - - FALCON-894 Cluster submission with hive registry fails in secure setup - (Venkatesh Seetharam) - - FALCON-892 HCatReplication fails in secure setup (Venkatesh Seetharam) - - FALCON-889 Windows azure replication fails with "wasb" as the scheme to an - HDFS file system (Chris Nauroth via Venkatesh Seetharam) - - FALCON-885 RequestID is coming as null for all instance API calls - (Venkatesh Seetharam) - - FALCON-880 Oozie Java actions for hive tables fail in secure mode - (Venkatesh Seetharam) - - FALCON-717 Shutdown not clean for JMSMessageConsumer - (Shaik Idris Ali via Venkatesh Seetharam - - FALCON-875 Enitiy Summary endpoint filterBy does not filter entities - without pipelines (Balu Vellanki via Venkatesh Seetharam) - - FALCON-874 Rest API - Instance and Entity orderBy param values should be - case insensitive (Balu Vellanki via Venkatesh Seetharam) - - FALCON-820 Fix minor nits with HadoopClientFactory - (Sowmya Ramesh via Venkatesh Seetharam) - - FALCON-815 Rename mapBandwidthKB to mapBandwidth in DistCp - (Sowmya Ramesh via Venkatesh Seetharam) - - FALCON-595 Improvements to DefaultAuthorizationProvider code - (Raghav Kumar Gautam via Venkatesh Seetharam) - - FALCON-868 Rerun command incorrect in falcon CLI documentation - (Karishma Gulati via Venkatesh Seetharam) - - FALCON-864 Falcon superuser is unable to delete scheduled feed - (Venkatesh Seetharam) - - FALCON-862 Falcon entity Rest API - filter by tags also returns entities - that do not have tags (Balu Vellanki via Venkatesh Seetharam) - - FALCON-795 Maven Enforcer plugin is throwing error while building Falcon - (Peeyush Bishnoi via Venkatesh Seetharam) - - FALCON-859 EntitySummary RestAPI : Change pathParam "cluster" to queryParam - (Balu Vellanki via Venkatesh Seetharam) - - FALCON-858 entity/instance Rest API - make keys for filterBy param case - insensitive (Balu Vellanki via Venkatesh Seetharam) - - FALCON-857 Authorization failure results in internal server error - (Venkatesh Seetharam) - - FALCON-850 Cluster summary UI page results in 400 Bad Request - (Balu Vellanki via Venkatesh Seetharam) - - FALCON-851 Super user authorization is broken (Venkatesh Seetharam) - - FALCON-840 Possible NPE in filteredInstanceSet method of - AbstractInstanceManager (Balu Vellanki via Venkatesh Seetharam) - - FALCON-839 Authorization succeeds with invalid acl owner based on group - membership (Venkatesh Seetharam) - - FALCON-831 Operation on non existing entity throws internal server error - (Venkatesh Seetharam) - - FALCON-710 start/end is optional for lifecycle operations (Balu Vellanki - via Venkatesh Seetharam) - - FALCON-819 Submission of cluster with registry interface fails on secure - setup (Sowmya Ramesh via Venkatesh Seetharam) - - FALCON-804 Remove Oozie 3.* patch files from Falcon (Peeyush Bishnoi via - Venkatesh Seetharam) - - FALCON-803 Instances displayed on Dashboard entity page should be sorted - by startTime (Balu Vellanki via Venkatesh Seetharam) - - FALCON-799 Falcon Dashboard unusable when server is started with umask 077 - (Balu Vellanki via Venkatesh Seetharam) - - FALCON-678 Falcon's default port has changed to 15443 (Balu Vellanki via - Venkatesh Seetharam) - - FALCON-482 Concurrent requests made using Proxy Oozie client fail - (Sowmya Ramesh via Venkatesh Seetharam) - - FALCON-764 Falcon retry of failed process/feed instances broken during restart - (Shaik Idris via Suhas Vasu) - - FALCON-800 Falcon lineage is not working (Sowmya Ramesh via Venkatesh Seetharam) - - FALCON-792 Integration test EntityManagerPaginationJerseyIT fails - occasionally (Balu Vellanki via Venkatesh Seetharam) - - FALCON-787 FalconCLI - Submit recipe failed (Sowmya Ramesh via - Venkatesh Seetharam) - - FALCON-786 FalconAuditFilter - Arguments in wrong order (Venkatesh Seetharam) - - FALCON-789 Post processing is broken for Feeds (Sowmya Ramesh via - Venkatesh Seetharam) - - FALCON-788 Lineage: Minor bug fixes (Sowmya Ramesh via Venkatesh Seetharam) - - FALCON-777 UT intermittent failures in Messaging tests depending on Thread.sleep - (Sowmya Ramesh via Venkatesh Seetharam) - - FALCON-773 Log clean up handlers only work in distributed mode - (Balu Vellanki via Venkatesh Seetharam) - - FALCON-760 Messaging is broken for FALCON.ENTITY.TOPIC in case of Eviction - (Sowmya Ramesh via Venkatesh Seetharam) - - FALCON-768 Change dashboard USER_ID to falcon-dashboard (Balu Vellanki via - Venkatesh Seetharam) - - FALCON-759 Adding cluster entity fails when Yarn TimelineClient is enabled - (Balu Vellanki via Venkatesh Seetharam) - - FALCON-740 Entity kill job calls OozieClient.kill on bundle coord job ids - before calling kill on bundle job id (Sowmya Ramesh via Venkatesh Seetharam) - - FALCON-732 Lineage capture fails for an instance thats not generated by - falcon (Sowmya Ramesh via Venkatesh Seetharam) - - FALCON-731 Lineage capture for evicted instance is broken - (Sowmya Ramesh via Venkatesh Seetharam) - - FALCON-724 Build fails as Integration test fails (Balu Vellanki via - Venkatesh Seetharam) - - FALCON-728 Unit test failures on jenkins (Sowmya Ramesh via Venkatesh Seetharam) - - FALCON-727 JQuery license is incorrectly mentioned in the header file. (Srikanth Sundarrajan) - - FALCON-702 JailedFileSystem does not work for relative paths - (Sowmya Ramesh via Venkatesh Seetharam) - - FALCON-677 Feed data and stats path defaults to /tmp/. (Suhas Vasu via Shwetha GS) - - FALCON-590 Update to ACLs added to process is not handled - (Venkatesh Seetharam) - - FALCON-694 StringIndexOutOfBoundsException while updating graph DB for - replicated instance (Sowmya Ramesh via Venkatesh Seetharam) - - FALCON-695 Lineage: "stored-in" edge is added between feed entity and - target cluster (Sowmya Ramesh via Venkatesh Seetharam) - - FALCON-669 Missing optional workflow execution listeners configuration - results in NPE (Raghav Kumar Gautam via Venkatesh Seetharam) - - FALCON-644 Falcon message producer masks errors in Post processing - (Venkatesh Seetharam) - - FALCON-338 - late data recording is enabled by default for all feeds - irrespective of late arrival config (Ajay Yadav via Suhas Vasu) - - FALCON-652 EntityUtils tests are failing (Ajay Yadav via Venkatesh Seetharam) - - FALCON-650 Instance list APIs occassionally fail when orderBy set to - starttime or endtime (Balu Vellanki via Venkatesh Seetharam) - - FALCON-649 Remove unnecessary validation for Instance start time in - FalconCLI (Balu Vellanki via Venkatesh Seetharam) - - FALCON-579 Lineage breaks if feed.xml doesn't have the date pattern in - feed path location (Sowmya Ramesh via Venkatesh Seetharam) - - FALCON-642 OozieProcessWorkflowBuilderTest test failures. (Shwetha GS) - - FALCON-630 late data rerun for process broken in trunk. (Shwetha GS) - - FALCON-611 Post process arg status is in 'FAILED' state always - (Shwetha GS via Suhas Vasu) - - FALCON-622 Fix ProcessUpdate and update at specific time test - (Samarthg) - - FALCON-616 cluster submission should fail when shared libs copy fail - (Shwetha GS via Suhas Vasu) - - FALCON-598 ProcessHelper throws NPE if the process has no inputs OR no - outputs defined (Balu Vellanki via Venkatesh Seetharam) - - FALCON-583 Post processing is broken in current trunk - (Venkatesh Seetharam via Suhas Vasu) - - FALCON-582 Latest changes to LICENSE files results in build failure - (Srikanth Sundarrajan via Venkatesh Seetharam) - - FALCON-577 Extend time functions added in Falcon 0.6 to support current & last week - are giving UnsupportedOperationException. (Srikanth Sundarrajan via Shwetha GS) - - FALCON-578 Table import & table export failing during hcat table replication - (Suhas Vasu) - - FALCON-571 user libs not getting loaded during process execution - (Shwetha GS via Suhas Vasu) - - FALCON-514 Falcon CLI giving error when using -file option with -rerun in - instance management. (pavan kumar kolamuri via Shwetha GS) - - FALCON-566 update throwing null job id exception. (Shwetha GS) - - FALCON-561 Falcon jenkins failure in EntityManagerJerseyIT. - (Shwetha GS via Suhas Vasu) - - FALCON-556 Feed Replication _SUCCESS is not getting created on target directory. - (pavan kumar kolamuri via Suhas Vasu) - - FALCON-497 Able to submit feed even though owner of storage specified (location type=data) - is different from the ACL owner. (Shwetha GS) - - FALCON-357 HCatalog Feed replication: Hive export job fails when table partition - contains multiple dated columns. (Satish Mittal via Shwetha GS) - - FALCON-495 multi source single target feed replication failing in regression. - (Satish Mittal via Shwetha GS) - - FALCON-494 update feature broken. (Shwetha GS via Suhas Vasu) - - FALCON-496 Feed Replication with Empty Directories giving error. - (pavan kumar kolamuri via Shwetha GS) - - FALCON-483 Fix the failing test ConfigurationStoreTest.testConcurrentRemoves - on jenkins. (Sowmya Ramesh via Shwetha GS) - - FALCON-430 Process update with user (Shwetha GS via Venkatesh Seetharam) - - FALCON-460 Concurrent deletion of same entity results in NPE (Sowmya Ramesh - via Venkatesh Seetharam) - - FALCON-459 Lineage resource API fails with NPE for bad query params - (Sowmya Ramesh via Venkatesh Seetharam) - - FALCON-456 Custom DistCp conflict with core DistCp in container classpath - fails falcon workflows (Venkatesh Seetharam) - - FALCON-446 Hive Replications fail because of permissions issue - (Venkatesh Seetharam) - - FALCON-444 Logs dir for replication workflow is incorrect and jobs fail - with permission issues (Venkatesh Seetharam) - - FALCON-443 Process with Hive workflow engine and filesystem input feeds, - table output feed fails (Sowmya Ramesh via Venkatesh Seetharam) - - FALCON-382 Error While building Latest trunk code with Hadoop 2.2.0. (Suhas Vasu) - - FALCON-240 Instance status from CLI on a feed doesn't give the retention details. - (pavan kumar kolamuri via Shwetha GS) - - FALCON-441 Lineage capture fails for feeds with multiple instances - (Venkatesh Seetharam) - -Release Version: 0.5-incubating - INCOMPATIBLE CHANGES - FALCON-11 Add support for security in Falcon (Venkatesh Seetharam) - - FALCON-288 Persist lineage information into a persistent store - (Venkatesh Seetharam) - - NEW FEATURES - FALCON-281 Design Action Interface. (Srikanth Sundarrajan) - - FALCON-259 Design Transformation Interface. (Srikanth Sundarrajan) - - FALCON-26 Pipeline Monitor addition. (Suhas Vasu via Shwetha GS) - - FALCON-254 Bootstrap designer module. (Srikanth Sundarrajan via Shwetha GS) - - FALCON-238 Support updates at specific time. (Shwetha GS) - - FALCON-285 Support Lineage information capture (Venkatesh Seetharam) - - FALCON-289 Provide REST APIs for discovering lineage metadata over the store. - (Venkatesh Seetharam) - - FALCON-229 Enable SSL for Falcon REST API (Srikanth Sundarrajan via - Venkatesh Seetharam) - - IMPROVEMENTS - FALCON-453 possible LICENSE/NOTICE issues (Chris Douglas via Venkatesh Seetharam) - - FALCON-450 Add jdk 1.6 requirement in release notes (Venkatesh Seetharam) - - FALCON-449 Twiki documentation files may need ALv2 headers (Venkatesh Seetharam) - - FALCON-448 File names in the release should have apache as the prefix - (Venkatesh Seetharam) - - FALCON-439 Update the copyright in Notice and License files (Venkatesh Seetharam) - - FALCON-324 Document lineage feature (Sowmya Ramesh via Venkatesh Seetharam) - - FALCON-312 Falcon LogCleanupServiceTest seems to clean up root "/" - (Venkatesh Seetharam) - - FALCON-379 Document limitations of Hive support in Falcon (Venkatesh Seetharam) - - FALCON-421 Upgrade Hadoop to 2.4.0 (Sowmya Ramesh via Venkatesh Seetharam) - - FALCON-386 Upgrade to oozie 4.0.1. (Sowmya Ramesh via Venkatesh Seetharam) - - FALCON-392 HCat Example Recipes. (Shwetha GS via Venkatesh Seetharam) - - FALCON-391 Add ability to set mapBandwidth. (Michael Miklavcic via Shwetha GS) - - FALCON-380 The dependency option doesn't mention input or output for a feed. - (Suhas Vasu via Shwetha GS) - - FALCON-365 Remove the checked in oozie xsds. (Shwetha GS) - - FALCON-356 Merge OozieProcessMapper and OozieProcessWorkflowBuilder. (Shwetha GS) - - FALCON-355 Remove SLAMonitoringService. (Shwetha GS) - - FALCON-333 jsp-api dependency is defined twice. (Jean-Baptiste - Onofrévia Shaik Idris) - - FALCON-311 Several dead links in Falcon documentation. - (Suresh Srinivas via Venkatesh Seetharam) - - FALCON-304 Simplify assembly for script in standalone and distributed - mode. (Suresh Srinivas via Venkatesh Seetharam) - - FALCON-264 Update with effectiveTime in CLI. (Shwetha GS via Srikanth - Sundarrajan) - - FALCON-60 Feed retention doesn't delete empty parent dirs. (Shaik Idris) - - FALCON-247 Add scripts to check the status of falcon and prism. (Jean-Baptiste - Onofré via Shwetha GS) - - FALCON-245 POM should use Apache POM as parent. (Jean-Baptiste Onofré via - Shwetha GS) - - FALCON-252 Upgrade to json-simple 1.1.1. (Jean-Baptiste Onofré via - Shwetha GS) - - FALCON-233 Update hadoop 2 version to 2.2.0. (Venkatesh Seetharam - via Shwetha GS) - - FALCON-64 Add example entity xmls in falcon package. (Shwetha GS) - - FALCON-66 Make oozie version change configurable. (Shwetha GS - via Srikanth Sundarrajan) - - FALCON-38 Falcon's parent workflow actions (pre-processing & prost-processing) - should have multiple retries. (Shaik Idris) - - FALCON-242 Post processing is not called in Retention workflows (Shaik Idris) - - FALCON-286 Capture information in process entity about the user workflow - (Venkatesh Seetharam) - - FALCON-287 Record lineage information in post processing (Venkatesh Seetharam) - - FALCON-257 File system storage wont work with relative paths - (Venkatesh Seetharam) - - FALCON-334 Add indexing to the graph property keys. (Venkatesh Seetharam) - - FALCON-342 Add ability to set maxMaps on replication (Michael Miklavcic - via Venkatesh Seetharam) - - FALCON-366 Add a REST API to get properties for a given vertex (Venkatesh Seetharam) - - FALCON-370 Remove Graph dump option in CLI (Venkatesh Seetharam) - - FALCON-367 Bump dagre and jquery version for the web UI (Haohui Mai - via Venkatesh Seetharam) - - FALCON-290 Visualize lineage information on the dashboard (Haohui Mai - via Venkatesh Seetharam) - - FALCON-371 Show vertex information in the web UI (Haohui Mai via Venkatesh Seetharam) - - FALCON-373 Display lineage link only for jobs that are succeeded in the web UI - (Haohui Mai via Venkatesh Seetharam) - - FALCON-393 Display error messages when the web UI fails to get the data from the server - (Haohui Mai via Venkatesh Seetharam) - - FALCON-395 Falcon service does not start when _HOST is used in the spnego principal - (Venkatesh Seetharam) - - FALCON-397 DistCp uses JobSubmissionFiles API which is incompatible between hadoop versions - (Venkatesh Seetharam) - - OPTIMIZATIONS - FALCON-123 Improve build speeds in falcon. (Srikanth Sundarrajan via Shwetha GS) - - BUG FIXES - FALCON-447 Remove the jar file form the source distribution (Venkatesh Seetharam) - - FALCON-440 Exclude IDEA IntelliJ and other unnecessary files from source - distribution (Venkatesh Seetharam) - - FALCON-437 Feed Replication workflows are failing (Venkatesh Seetharam) - - FALCON-429 Falcon CLI entity list command throws NPE stack trace in case - of no entities (Satish Mittal via Venkatesh Seetharam) - - FALCON-427 Update default falcon endpoint URL in runtime.properties for - prism setup to work out of box (Satish Mittal via Venkatesh Seetharam) - - FALCON-425 src/bin/package.sh is broken for hadoop 2.* versions - (Sowmya Ramesh via Venkatesh Seetharam) - - FALCON-426 Prism unable to connect to falcon server if falcon endpoint URL ends with - '/' character. (Satish Mittal via Shwetha GS) - - FALCON-401 replicate hcat table to two targets can fail with export dir - exists on source (Sowmya Ramesh via Venkatesh Seetharam) - - FALCON-364 Process specification contains a mistake in the parallel section - (Jean-Baptiste Onofré via Venkatesh Seetharam) - - FALCON-398 Null pointer Exception on submitting HCat Feed (Sowmya Ramesh - via Venkatesh Seetharam) - - FALCON-390 falcon HCatProcess tests are failing in secure clusters - (Venkatesh Seetharam) - - FALCON-284 Hcatalog based feed retention doesn't work when partition filter spans across - multiple partition keys. (Satish Mittal via Shwetha GS) - - FALCON-409 Not able to create a package. (Raju Bairishetti via Shwetha GS) - - FALCON-396 minor logging typo in FalconTopicSubscriber. (Raghav Kumar Gautam via Shwetha GS) - - FALCON-352 old properties not removed on refresh of runtime properties. (Shaik Idris) - - FALCON-332 Oozie execution order is wrongly mapped in Falcon for LAST_ONLY. - (Shaik Idris) - - FALCON-374 Update with effective time in CLI. (Shwetha GS) - - FALCON-98 starting embedded hadoop fails sometimes. (Shwetha GS) - - FALCON-28 unable to submit/delete feed or process which had been attempted submit - with wrong cluster. (Shwetha GS) - - FALCON-269 Mistake in the embedded ActiveMQ port property. (Jean-Baptiste Onofré - via Shwetha GS) - - FALCON-344 FeedEvictorTest. (Shaik Idris Ali via Shwetha GS) - - FALCON-302 Issues with distributed package properties. (Shwetha GS) - - FALCON-331 Summary API returning NPE if only start is passed. (Shwetha GS) - - FALCON-323 Summary API deserialization fails if array has only one element. - (Shwetha GS via Shaik Idris) - - FALCON-319 Summary instance API returning wrong exception. (Shwetha GS via - Shaik Idris) - - FALCON-321 Feed evictor deleting more stuff than it should. (Shaik Idris) - - FALCON-330 Build fails for the module 'Apache Falcon CLI client ' on ubuntu. - (Deepak Marathe via Shwetha GS) - - FALCON-297 Validations on update with effective time. (Shwetha GS) - - FALCON-278 Changes in feed availability info doesn't update process. (Shwetha GS) - - FALCON-239 Build failed on build-tools due to a missing SNAPSHOT. (Srikanth - Sundarrajan) - - FALCON-221 Logmover is not copying all action level logs. (Srikanth Sundarrajan) - - FALCON-270 Checkstyle can not be run on a module. (Jean-Baptiste Onofré via - Shwetha GS) - - FALCON-260 When a process is scheduled, the user workflow is failing with - OozieClientException. (Shwetha GS) - - FALCON-268 Checkstyle/Findbugs issues on FalconCLI. (Jean-Baptiste Onofré via - Shwetha GS) - - FALCON-258 Falcon status throws an error when external jobids are missing - (Suhas Vasu via Shaik Idris) - - FALCON-262 Example files should use aligned dependency versions. (Jean-Baptiste Onofré - via Shwetha GS) - - FALCON-249 Fix mistakes in docs/InstallationSteps.html. (Jean-Baptiste Onofré - via Shwetha GS) - - FALCON-241 The job logs are not copied during Post-Processing step in Replication workflows. - (Suhas Vasu via Shwetha GS) - - FALCON-106 Falcon compilation fails for hadoop-2 profile. (Shwetha GS - via Srikanth Sundarrajan) - - FALCON-206 Process update for wf changes. (Shwetha GS) - - FALCON-236 Falcon process output events which is optional should have at least one event - if defined. (Shaik Idris Ali via Shwetha GS) - - FALCON-228 Build failed on build-tools module. (Jean-Baptiste Onofré - via Shwetha GS) - - FALCON-232 mvn clean verify fails with oozie war not found. (Shwetha GS) - - FALCON-124 unable to schedule deleted feed. (Shwetha GS via Shaik Idris) - - FALCON-226 Tests for subscribing/listening to multiple active-mq topics. (Shaik Idris - via Shwetha GS) - - FALCON-336 Fix check style error - builds fail (Venkatesh Seetharam) - - FALCON-354 Bug when MetadataMappingService is not configured as one of the - application services. (Venkatesh Seetharam) - - FALCON-360 Lineage recording fails with NPE for processes with >1 inputs. - (Venkatesh Seetharam) - - FALCON-378 Feed status fails with NPE post update when the new coordinator - is in PREP state (Venkatesh Seetharam) - - FALCON-377 Unit test fails consistently - EntityManagerJerseyIT.testProcessInputUpdate. - (Shwetha GS via Venkatesh Seetharam) - - FALCON-418 FALCON-395 introduces a regression with hadoop-1 - (Jean-Baptiste Onofré via Venkatesh Seetharam) - -Release Version: 0.4-incubating - - NEW FEATURES - - FALCON-54: Falcon support for hadoop 2.0 - - FALCON-85: Hive (HCatalog) integration - - FALCON-164: Provide Falcon Prism Web UI - - FALCON-107: Adding extensions - - IMPROVEMENTS - - FALCON-73: Remove JUnit dependency as its used only for asserts while TestNG for tests - - FALCON-80: Option in falcon-start to not start embedded activemq - - FALCON-83: Option to build distributed packages - - FALCON-131: Remove set -e from falcon scripts - - FALCON-151: Document the REST APIs for Falcon - - FALCON-165: simplify packaging to create one package instead of client, falcon and prism packages - - FALCON-192: Release falcon 0.4 umbrella - - FALCON-62: Falcon compilation with hadoop 2.0 libs - - FALCON-63: Ability to ingest hadoop libs to falcon release package - - FALCON-67: Remove ant dependency in oozie workflows - - FALCON-76: Use cluster readonly endpoint for replication source - - FALCON-78: Falcon error when prism on one hadoop version and server on another - - FALCON-86: Hive table integration with cluster entity - - FALCON-87: Hive table integration with feed entity - - FALCON-88: Add embedded hive and webhcat for integration tests - - FALCON-90: Propagate hive table through Process mapper - - FALCON-91: Handle feed updates in purview of tables - - FALCON-93: Replication to handle hive table replication - - FALCON-94: Retention to handle hive table eviction - - FALCON-95: Enable embedding hive scripts directly in a process - - FALCON-96: Hive client to talk to the metastore - - FALCON-102: Add integration tests for feed entity parser with table defined - - FALCON-103: Upgrade oozie to 4.0.x - - FALCON-104: FALCON-86 introduces a backward incompatible change - - FALCON-113: Update documentation for Hive integration - - FALCON-129: Disable Late data handling for hive tables - - FALCON-143: Enable Late data handling for hive tables - - FALCON-146: Javadoc generation should respect skipCheck property - - FALCON-153: Feed Storage type isn't passed in replication for successful post processing - - FALCON-154: Remove webhcat startup in HadoopStartupListener as its not used - - FALCON-161: Feed evictor evicts instances not eligible when pattern has dash - - FALCON-163: Merge FALCON-85 branch into main line - - FALCON-171: Provide status in /api/entities/list - - FALCON-175: Visualize dependency information - - FALCON-178: Implement client-side pagination - - FALCON-190: /api/entities/list should allow the client to query different fields - - FALCON-193: Update the documentation to reflect the current work of dashboard - - FALCON-43: Add Falcon to Sonar for Analysis - - FALCON-134: Remove jsch dependency - - FALCON-135: Remove jzlib dependency - - FALCON-136: Upgrade to commons-codec 1.8 - - FALCON-137: Remove commons-logging dependency - - FALCON-138: Remove perf4j dependency - - FALCON-198 Update LICENSE.txt to contain license information for all third-party libraries - - FALCON-363 Jetty is started with war when the war is already expanded - (Venkatesh Seetharam) - - FALCON-358 REST API does not conform to Rexster (Venkatesh Seetharam) - - FALCON-359 Instance id's captured are of different formats in process and feed - (Venkatesh Seetharam) - - BUG FIXES - - FALCON-223: hive-exec bundles protobuf-2.4.1 which is incompatible with hadoop-2 requiring protobuf-2.5 - - FALCON-213: Validating Storage Exists (table) should be called only from the server (not from prism) - - FALCON-24: Allow re-run of timedout instances - - FALCON-42: Simplify Build and Installation Guide - - FALCON-50: Falcon replication having issue to s3 - - FALCON-61: The identifier regex for oozie bundle,coordinator, workflow pattern is incorrect. - - FALCON-69: exception from ConfigurationChangeListener should fail the API - - FALCON-71: mvn jetty:run doesn't work - - FALCON-72: Feeds with invalid oozie URI in cluster cannot be deleted - - FALCON-74: Falcon CLI needs to be more robust in handling trailing spaces - - FALCON-79: Fix typos in Falcon architecture document - - FALCON-100: Build error with mvn 3.0.4 - - FALCON-101: mvn release:prepare fails because of build order - - FALCON-127: Fix test issues after FALCON-107 - - FALCON-128: Feed replication post processing log mover error - - FALCON-130: Use Geronimo Specs JMS instead of javax.jms - - FALCON-132: assembly plugin for embedded does not generate client artifacts - - FALCON-142: Cleanup testng dependency - - FALCON-152: REST API for entity & Admin resources only returns XML - - FALCON-159: Version API endpoint does not emit valid JSON - - FALCON-162: Update falcon scripts to let the user set the log and pid locations. - - FALCON-168: Different validity of clusters in feed not handled - - FALCON-169: multiple "/" in target for replication for multi target feed - - FALCON-174: bind activemq to all interfaces rather than just localhost - - FALCON-179: Table replication must drop partition before import as late reruns fails - - FALCON-180: Disable table replication for multiple sources - - FALCON-182: Disable specifying partitions in inputs with table storage for process - - FALCON-185: Timestamp handled as int - - FALCON-186: Enable scheduler support for embedded activemq - - FALCON-187: Update Falcon start script to also redirect stdout to the log file - - FALCON-188: hadoop-2 profile is not carried through to oozie package - - FALCON-194 Import external libraries into the repository - - FALCON-204 Process mapper generates params assuming table input and output - as names literally (Venkatesh Seetharam) - - FALCON-201 Package oozie-el-extensions jar files as part of tarball - (Ashish Singh via Venkatesh Seetharam) - - FALCON-203 Do not generate transitive closure for the dependency graph - (Haohui Mai via Venkatesh Seetharam) - - FALCON-212 OozieClient does not propagate user in request to - Oozie server (Venkatesh Seetharam) - - FALCON-208 Improve the icons for instance lists. (Haohui Mai) - - FALCON-158 Fix failing jenkins nightly build. (Venkatesh Seetharam) - - FALCON-215 Falcon-start fails. (Arpit Gupta via Venkatesh Seetharam) - - - -Release Version: 0.3-incubating - - FALCON-70 Confirm if v0.3 branch is ready for release as per guideline. - (Venkatesh Seetharam via Srikanth Sundarrajan) - - FALCON-65 Avoid bundling compilation path dependent configs in artifact - and allow for config scan to seamlessly fallback to classpath if not found - in default conf location. (Srikanth Sundarrajan via Venkatesh Seetharam) - - FALCON-58 Gaps in release source / binary tarball. (Srikanth Sundarrajan) - - FALCON-57 Build fails if the source is not in scm. (Srikanth Sundarrajan) - - FALCON-53 Add -incubating to the version. (Jarek Jarcec Cecho via Srikanth - Sundarrajan) - - FALCON-56 Update Falcon packing to include all source files. (Srikanth - Sundarrajan) - - FALCON-55 Update suspends old oozie coords. (Shwetha GS via Srikanth - Sundarrajan) - - FALCON-52 Main module configured used with jetty:run has issues with app - start. (Srikanth Sundarrajan) - - FALCON-30 Enable embedding pig scripts directly in a process. (Venkatesh - Seetharam via Srikanth Sundarrajan) - - FALCON-47 Falcon Replication should support configurable delays in feed, - parallel, timeout and bulk transfer with variable frequency (Shaik Idris - Ali via Srikanth Sundarrajan) - - FALCON-49 Dependency on oozie-client pulls in hadoop-auth-0.23.1 which - is not necessary (Venkatesh Seetharam via Srikanth Sundarrajan) - - FALCON-32 Store test output in file rather then printing all the output - into the console (Srikanth Sundarrajan via Venkatesh Seetharam) - - FALCON-1 Create packaging and scripts to install and try Apache Falcon - (Srikanth Sundarrajan via Venkatesh Seetharam) - - FALCON-29 Add ability to tag/classify data sets and processes to enable - discovery (Venkatesh Seetharam via Srikanth Sundarrajan) - - FALCON-31 File Installation-steps.txt contains old path to repository (Jarek - Jarcec Cecho via Srikanth Sundarrajan) - - FALCON-33 Add patch files to RAT ignore list (Jarek Jarcec Cecho via Srikanth - Sundarrajan) - - FALCON-22 Rename ivory to falcon in project (Venkatesh Seetharam via Srikanth - Sundarrajan) - - FALCON-19 Bump up the release version to 0.3-SNAPSHOT (Srikanth Sundarrajan - via Venkatesh Seetharam) - - FALCON-13 super pom must reflect license, project website, ML and SCM changes - post incubation (Venkatesh Seetharam via Srikanth Sundarrajan) - - FALCON-10 Add findbugs plugin and fix findbugs warnings for project (Venkatesh - Seetharam via Srikanth Sundarrajan) - -
http://git-wip-us.apache.org/repos/asf/falcon/blob/8e49379d/acquisition/pom.xml ---------------------------------------------------------------------- diff --git a/acquisition/pom.xml b/acquisition/pom.xml deleted file mode 100644 index 38ea259..0000000 --- a/acquisition/pom.xml +++ /dev/null @@ -1,41 +0,0 @@ -<?xml version="1.0" encoding="UTF-8"?> - -<!-- - Licensed to the Apache Software Foundation (ASF) under one or more - contributor license agreements. See the NOTICE file distributed with - this work for additional information regarding copyright ownership. - The ASF licenses this file to You under the Apache License, Version 2.0 - (the "License"); you may not use this file except in compliance with - the License. You may obtain a copy of the License at - - http://www.apache.org/licenses/LICENSE-2.0 - - Unless required by applicable law or agreed to in writing, software - distributed under the License is distributed on an "AS IS" BASIS, - WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. - See the License for the specific language governing permissions and - limitations under the License. - --> - -<project xmlns="http://maven.apache.org/POM/4.0.0"; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; - xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/maven-v4_0_0.xsd";> - - <modelVersion>4.0.0</modelVersion> - <parent> - <groupId>org.apache.falcon</groupId> - <artifactId>falcon-main</artifactId> - <version>0.10-SNAPSHOT</version> - </parent> - <artifactId>falcon-acquisition</artifactId> - <description>Apache Falcon Acquisition Module</description> - <name>Apache Falcon Acquisition</name> - <packaging>jar</packaging> - - <dependencies> - <dependency> - <groupId>org.testng</groupId> - <artifactId>testng</artifactId> - <scope>test</scope> - </dependency> - </dependencies> -</project> http://git-wip-us.apache.org/repos/asf/falcon/blob/8e49379d/archival/pom.xml ---------------------------------------------------------------------- diff --git a/archival/pom.xml b/archival/pom.xml deleted file mode 100644 index b117d9d..0000000 --- a/archival/pom.xml +++ /dev/null @@ -1,41 +0,0 @@ -<?xml version="1.0" encoding="UTF-8"?> - -<!-- - Licensed to the Apache Software Foundation (ASF) under one or more - contributor license agreements. See the NOTICE file distributed with - this work for additional information regarding copyright ownership. - The ASF licenses this file to You under the Apache License, Version 2.0 - (the "License"); you may not use this file except in compliance with - the License. You may obtain a copy of the License at - - http://www.apache.org/licenses/LICENSE-2.0 - - Unless required by applicable law or agreed to in writing, software - distributed under the License is distributed on an "AS IS" BASIS, - WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. - See the License for the specific language governing permissions and - limitations under the License. - --> - -<project xmlns="http://maven.apache.org/POM/4.0.0"; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; - xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/maven-v4_0_0.xsd";> - - <modelVersion>4.0.0</modelVersion> - <parent> - <groupId>org.apache.falcon</groupId> - <artifactId>falcon-main</artifactId> - <version>0.10-SNAPSHOT</version> - </parent> - <artifactId>falcon-archival</artifactId> - <description>Apache Falcon Archival Module</description> - <name>Apache Falcon Archival</name> - <packaging>jar</packaging> - - <dependencies> - <dependency> - <groupId>org.testng</groupId> - <artifactId>testng</artifactId> - <scope>test</scope> - </dependency> - </dependencies> -</project> http://git-wip-us.apache.org/repos/asf/falcon/blob/8e49379d/build-tools/pom.xml ---------------------------------------------------------------------- diff --git a/build-tools/pom.xml b/build-tools/pom.xml deleted file mode 100644 index 6c8801e..0000000 --- a/build-tools/pom.xml +++ /dev/null @@ -1,67 +0,0 @@ -<?xml version="1.0" encoding="UTF-8"?> -<!-- - Licensed to the Apache Software Foundation (ASF) under one - or more contributor license agreements. See the NOTICE file - distributed with this work for additional information - regarding copyright ownership. The ASF licenses this file - to you under the Apache License, Version 2.0 (the - "License"); you may not use this file except in compliance - with the License. You may obtain a copy of the License at - - http://www.apache.org/licenses/LICENSE-2.0 - - Unless required by applicable law or agreed to in writing, software - distributed under the License is distributed on an "AS IS" BASIS, - WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. - See the License for the specific language governing permissions and - limitations under the License. - --> - -<project xmlns="http://maven.apache.org/POM/4.0.0"; - xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; - xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd";> - <modelVersion>4.0.0</modelVersion> - <parent> - <groupId>org.apache.falcon</groupId> - <artifactId>falcon-main</artifactId> - <version>0.10-SNAPSHOT</version> - </parent> - <groupId>org.apache.falcon</groupId> - <artifactId>build-tools</artifactId> - <name>Build Tools</name> - - <dependencies> - <dependency> - <groupId>org.testng</groupId> - <artifactId>testng</artifactId> - <scope>test</scope> - </dependency> - </dependencies> - - <build> - <plugins> - <plugin> - <groupId>org.codehaus.mojo</groupId> - <artifactId>exec-maven-plugin</artifactId> - <version>1.2.1</version> - <executions> - <execution> - <id>BUILD-OOZIE</id> - <phase>validate</phase> - <goals> - <goal>exec</goal> - </goals> - </execution> - </executions> - <configuration> - <executable>src/bin/build-oozie.sh</executable> - <arguments> - <argument>${oozie.version}</argument> - <argument>${oozie.buildversion}</argument> - <argument>${oozie.forcebuild}</argument> - </arguments> - </configuration> - </plugin> - </plugins> - </build> -</project> http://git-wip-us.apache.org/repos/asf/falcon/blob/8e49379d/build-tools/src/bin/build-oozie.sh ---------------------------------------------------------------------- diff --git a/build-tools/src/bin/build-oozie.sh b/build-tools/src/bin/build-oozie.sh deleted file mode 100755 index 889d749..0000000 --- a/build-tools/src/bin/build-oozie.sh +++ /dev/null @@ -1,74 +0,0 @@ -#!/bin/bash - -# Licensed to the Apache Software Foundation (ASF) under one -# or more contributor license agreements. See the NOTICE file -# distributed with this work for additional information -# regarding copyright ownership. The ASF licenses this file -# to you under the Apache License, Version 2.0 (the -# "License"); you may not use this file except in compliance -# with the License. You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. - -set -e -set -x - -VERSION=$1 -BUILD_VERSION=$2 -FORCE_BUILD=$3 - -echo "oozie version $OOZIE_VERSION" - -if [ -z "${MAVEN_HOME}" ] -then - export MVN_CMD=`which mvn`; - if [ -z "${MVN_CMD}" ] - then - echo "Maven is not installed.Please install and set MAVEN_HOME" - exit 1; - fi -else - export MVN_CMD=${MAVEN_HOME}/bin/mvn; -fi -echo "Using maven from " $MVN_CMD - -if [[ ($FORCE_BUILD == 'false') && ( -f `$MVN_CMD help:effective-settings | grep localRepository | cut -d\> -f2 | cut -d\< -f1`/org/apache/oozie/oozie-webapp/$BUILD_VERSION/oozie-webapp-$BUILD_VERSION.war) ]] -then - echo "Oozie already setup. skipping"; - exit 0; -fi - -PKG_URL="http://archive.apache.org/dist/oozie/$VERSION/oozie-$VERSION.tar.gz"; -PKG=oozie-$VERSION - -mkdir -p ../target -pushd ../target -rm -rf oozie-* - -curl -v $PKG_URL -o oozie-$VERSION.tgz -tar -xzvf oozie-$VERSION.tgz -rm oozie-$VERSION.tgz -cd $PKG - -sed -i.bak s/$VERSION\<\\/version\>/$BUILD_VERSION\<\\/version\>/g pom.xml */pom.xml */*/pom.xml -patch -p0 < ../../build-tools/src/patches/oozie-site.patch - -case $VERSION in -4.1.0 ) - ;; -4.2.0 ) - patch -p1 < ../../build-tools/src/patches/oozie-hadoop2-profile.patch - ;; -esac - -rm `find . -name 'pom.xml.bak'` - -$MVN_CMD clean source:jar install -DjavaVersion=1.7 -DtargetJavaVersion=1.6 -DskipTests -Phadoop-2 - -popd
