[ https://issues.apache.org/jira/browse/SPARK-4911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hyukjin Kwon updated SPARK-4911: -------------------------------- Labels: bulk-closed (was: ) > Report the inputs and outputs of Spark jobs so that external systems can > track data lineage > -------------------------------------------------------------------------------------------- > > Key: SPARK-4911 > URL: https://issues.apache.org/jira/browse/SPARK-4911 > Project: Spark > Issue Type: New Feature > Components: Spark Core > Affects Versions: 1.2.0 > Reporter: Sandy Ryza > Priority: Major > Labels: bulk-closed > > When Spark runs a job, it would be useful to log its filesystem inputs and > outputs somewhere. This allows external tools to track which persisted > datasets are derived from other persisted datasets. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org