[jira] [Commented] (ATLAS-2906) Import Process: Transforms: Handling Custom Attributes Does Not Update
[
https://issues.apache.org/jira/browse/ATLAS-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16637786#comment-16637786
]
ASF subversion and git services commented on ATLAS-2906:
Commit a0986f302e9e89454fb51e684bac1455618cf556 in atlas's branch
refs/heads/branch-0.8 from [~ashutoshm]
[ https://git-wip-us.apache.org/repos/asf?p=atlas.git;h=a0986f3 ]
ATLAS-2906: Allow transforms to be applied when entity-level transforms are
present.
> Import Process: Transforms: Handling Custom Attributes Does Not Update
> --
>
> Key: ATLAS-2906
> URL: https://issues.apache.org/jira/browse/ATLAS-2906
> Project: Atlas
> Issue Type: Bug
>Reporter: Ashutosh Mestry
>Assignee: Ashutosh Mestry
>Priority: Major
> Attachments:
> ATLAS-2906-Allow-transforms-to-be-applied-when-entit.patch
>
>
> *Background*
> The new transform framework looks at the entity holistically and computes
> attributes as it sees fit.
> Updating the _hive_storagedesc.location_ if entity-level transform is
> present, does not apply the transform.
> *Steps* *to Duplicate*
> * Attempt to import a zip file with the following transform.
> {code:java}
> { "options": { "transformers": "[{\"conditions\":{\"__entity\":\"topLevel:
> \"},\"action\":{\"__entity\":\"ADD_CLASSIFICATION:
> mycluster0_replicated\"}},{\"action\":{\"__entity.replicatedTo\":\"CLEAR:\",\"__entity.replicatedFrom\":\"CLEAR:\"}},{\"conditions\":{\"hive_db.clusterName\":\"EQUALS:
> mycluster0\"},\"action\":{\"hive_db.clusterName\":\"SET:
> mycluster1\"}},{\"conditions\":{\"hive_storagedesc.location\":\"STARTS_WITH_IGNORE_CASE:
>
> hdfs://localhost.localdomain\"},\"action\":{\"hive_storagedesc.location\":\"REPLACE_PREFIX:
> = :hdfs://localhost.localdomain=hdfs://mycluster1\"}}]", "replicatedFrom":
> "SFO$clx" } }
> {code}
> Locate any entity of type _hive_storagedesc_ and note the _location._ It does
> not apply the updated location.
> *Root Cause*
> * The new transform framework re-computes the location based on cached data.
> * Solution: Prevent caching of this attribute so that it honors the
> externally set transformation.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ATLAS-2897) Import Process: Handle Import of Empty Zip Elegantly
[ https://issues.apache.org/jira/browse/ATLAS-2897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16637785#comment-16637785 ] ASF subversion and git services commented on ATLAS-2897: Commit a490fcdf6fe7b2d4524d33088957bfa3b45426ba in atlas's branch refs/heads/branch-0.8 from [~ashutoshm] [ https://git-wip-us.apache.org/repos/asf?p=atlas.git;h=a490fcd ] ATLAS-2897: Elegant handling of empty zip files. Part 2. > Import Process: Handle Import of Empty Zip Elegantly > > > Key: ATLAS-2897 > URL: https://issues.apache.org/jira/browse/ATLAS-2897 > Project: Atlas > Issue Type: Improvement >Reporter: Ashutosh Mestry >Assignee: Ashutosh Mestry >Priority: Major > Attachments: ATLAS-2897-Elegant-handling-of-empty-zip-files.patch > > > *Background* > Existing implementation of _ZipSource_ always assumes that the zip that is > being passed has valid data. It starts serializing the data and that is where > it encounters serialization error. This case can be handled in a more elegant > way. > *Approach Guidance* > * In _ZipSource_ ctor, detect case for empty file, throw error message > accordingly. > * Handle the case where requested _ZipEntry_ is not found. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (ATLAS-2906) Import Process: Transforms: Handling Custom Attributes Does Not Update
[
https://issues.apache.org/jira/browse/ATLAS-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16637770#comment-16637770
]
Sarath Subramanian commented on ATLAS-2906:
---
+1
> Import Process: Transforms: Handling Custom Attributes Does Not Update
> --
>
> Key: ATLAS-2906
> URL: https://issues.apache.org/jira/browse/ATLAS-2906
> Project: Atlas
> Issue Type: Bug
>Reporter: Ashutosh Mestry
>Assignee: Ashutosh Mestry
>Priority: Major
> Attachments:
> ATLAS-2906-Allow-transforms-to-be-applied-when-entit.patch
>
>
> *Background*
> The new transform framework looks at the entity holistically and computes
> attributes as it sees fit.
> Updating the _hive_storagedesc.location_ if entity-level transform is
> present, does not apply the transform.
> *Steps* *to Duplicate*
> * Attempt to import a zip file with the following transform.
> {code:java}
> { "options": { "transformers": "[{\"conditions\":{\"__entity\":\"topLevel:
> \"},\"action\":{\"__entity\":\"ADD_CLASSIFICATION:
> mycluster0_replicated\"}},{\"action\":{\"__entity.replicatedTo\":\"CLEAR:\",\"__entity.replicatedFrom\":\"CLEAR:\"}},{\"conditions\":{\"hive_db.clusterName\":\"EQUALS:
> mycluster0\"},\"action\":{\"hive_db.clusterName\":\"SET:
> mycluster1\"}},{\"conditions\":{\"hive_storagedesc.location\":\"STARTS_WITH_IGNORE_CASE:
>
> hdfs://localhost.localdomain\"},\"action\":{\"hive_storagedesc.location\":\"REPLACE_PREFIX:
> = :hdfs://localhost.localdomain=hdfs://mycluster1\"}}]", "replicatedFrom":
> "SFO$clx" } }
> {code}
> Locate any entity of type _hive_storagedesc_ and note the _location._ It does
> not apply the updated location.
> *Root Cause*
> * The new transform framework re-computes the location based on cached data.
> * Solution: Prevent caching of this attribute so that it honors the
> externally set transformation.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ATLAS-2906) Import Process: Transforms: Handling Custom Attributes Does Not Update
[
https://issues.apache.org/jira/browse/ATLAS-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16637738#comment-16637738
]
Madhan Neethiraj commented on ATLAS-2906:
-
+1 for the patch.
> Import Process: Transforms: Handling Custom Attributes Does Not Update
> --
>
> Key: ATLAS-2906
> URL: https://issues.apache.org/jira/browse/ATLAS-2906
> Project: Atlas
> Issue Type: Bug
>Reporter: Ashutosh Mestry
>Assignee: Ashutosh Mestry
>Priority: Major
> Attachments:
> ATLAS-2906-Allow-transforms-to-be-applied-when-entit.patch
>
>
> *Background*
> The new transform framework looks at the entity holistically and computes
> attributes as it sees fit.
> Updating the _hive_storagedesc.location_ if entity-level transform is
> present, does not apply the transform.
> *Steps* *to Duplicate*
> * Attempt to import a zip file with the following transform.
> {code:java}
> { "options": { "transformers": "[{\"conditions\":{\"__entity\":\"topLevel:
> \"},\"action\":{\"__entity\":\"ADD_CLASSIFICATION:
> mycluster0_replicated\"}},{\"action\":{\"__entity.replicatedTo\":\"CLEAR:\",\"__entity.replicatedFrom\":\"CLEAR:\"}},{\"conditions\":{\"hive_db.clusterName\":\"EQUALS:
> mycluster0\"},\"action\":{\"hive_db.clusterName\":\"SET:
> mycluster1\"}},{\"conditions\":{\"hive_storagedesc.location\":\"STARTS_WITH_IGNORE_CASE:
>
> hdfs://localhost.localdomain\"},\"action\":{\"hive_storagedesc.location\":\"REPLACE_PREFIX:
> = :hdfs://localhost.localdomain=hdfs://mycluster1\"}}]", "replicatedFrom":
> "SFO$clx" } }
> {code}
> Locate any entity of type _hive_storagedesc_ and note the _location._ It does
> not apply the updated location.
> *Root Cause*
> * The new transform framework re-computes the location based on cached data.
> * Solution: Prevent caching of this attribute so that it honors the
> externally set transformation.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (ATLAS-2906) Import Process: Transforms: Handling Custom Attributes Does Not Update
[
https://issues.apache.org/jira/browse/ATLAS-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ashutosh Mestry updated ATLAS-2906:
---
Attachment: ATLAS-2906-Allow-transforms-to-be-applied-when-entit.patch
> Import Process: Transforms: Handling Custom Attributes Does Not Update
> --
>
> Key: ATLAS-2906
> URL: https://issues.apache.org/jira/browse/ATLAS-2906
> Project: Atlas
> Issue Type: Bug
>Reporter: Ashutosh Mestry
>Assignee: Ashutosh Mestry
>Priority: Major
> Attachments:
> ATLAS-2906-Allow-transforms-to-be-applied-when-entit.patch
>
>
> *Background*
> The new transform framework looks at the entity holistically and computes
> attributes as it sees fit.
> Updating the _hive_storagedesc.location_ if entity-level transform is
> present, does not apply the transform.
> *Steps* *to Duplicate*
> * Attempt to import a zip file with the following transform.
> {code:java}
> { "options": { "transformers": "[{\"conditions\":{\"__entity\":\"topLevel:
> \"},\"action\":{\"__entity\":\"ADD_CLASSIFICATION:
> mycluster0_replicated\"}},{\"action\":{\"__entity.replicatedTo\":\"CLEAR:\",\"__entity.replicatedFrom\":\"CLEAR:\"}},{\"conditions\":{\"hive_db.clusterName\":\"EQUALS:
> mycluster0\"},\"action\":{\"hive_db.clusterName\":\"SET:
> mycluster1\"}},{\"conditions\":{\"hive_storagedesc.location\":\"STARTS_WITH_IGNORE_CASE:
>
> hdfs://localhost.localdomain\"},\"action\":{\"hive_storagedesc.location\":\"REPLACE_PREFIX:
> = :hdfs://localhost.localdomain=hdfs://mycluster1\"}}]", "replicatedFrom":
> "SFO$clx" } }
> {code}
> Locate any entity of type _hive_storagedesc_ and note the _location._ It does
> not apply the updated location.
> *Root Cause*
> * The new transform framework re-computes the location based on cached data.
> * Solution: Prevent caching of this attribute so that it honors the
> externally set transformation.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (ATLAS-2906) Import Process: Transforms: Handling Custom Attributes Does Not Update
Ashutosh Mestry created ATLAS-2906:
--
Summary: Import Process: Transforms: Handling Custom Attributes
Does Not Update
Key: ATLAS-2906
URL: https://issues.apache.org/jira/browse/ATLAS-2906
Project: Atlas
Issue Type: Bug
Reporter: Ashutosh Mestry
Assignee: Ashutosh Mestry
*Background*
The new transform framework looks at the entity holistically and computes
attributes as it sees fit.
Updating the _hive_storagedesc.location_ if entity-level transform is present,
does not apply the transform.
*Steps* *to Duplicate*
* Attempt to import a zip file with the following transform.
{code:java}
{ "options": { "transformers": "[{\"conditions\":{\"__entity\":\"topLevel:
\"},\"action\":{\"__entity\":\"ADD_CLASSIFICATION:
mycluster0_replicated\"}},{\"action\":{\"__entity.replicatedTo\":\"CLEAR:\",\"__entity.replicatedFrom\":\"CLEAR:\"}},{\"conditions\":{\"hive_db.clusterName\":\"EQUALS:
mycluster0\"},\"action\":{\"hive_db.clusterName\":\"SET:
mycluster1\"}},{\"conditions\":{\"hive_storagedesc.location\":\"STARTS_WITH_IGNORE_CASE:
hdfs://localhost.localdomain\"},\"action\":{\"hive_storagedesc.location\":\"REPLACE_PREFIX:
= :hdfs://localhost.localdomain=hdfs://mycluster1\"}}]", "replicatedFrom":
"SFO$clx" } }
{code}
Locate any entity of type _hive_storagedesc_ and note the _location._ It does
not apply the updated location.
*Root Cause*
* The new transform framework re-computes the location based on cached data.
* Solution: Prevent caching of this attribute so that it honors the externally
set transformation.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (ATLAS-2904) Update jetty version to 9.3.24.v20180605 or later
[ https://issues.apache.org/jira/browse/ATLAS-2904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Dénes Terjéki updated ATLAS-2904: Description: Please update the jetty versions to 9.3.24.v20180605 or later/9.4.11.v20180605 or later. (was: To address CVE-2018-12536, Please update the jetty versions to 9.3.24.v20180605 or later/9.4.11.v20180605 or later. Versions affected: No EOL releases - 9.2.x and older (all configurations) 9.3.x (all configurations) 9.4.x (all configurations) Resolved: 9.3.24.v20180605 9.4.11.v20180605) > Update jetty version to 9.3.24.v20180605 or later > - > > Key: ATLAS-2904 > URL: https://issues.apache.org/jira/browse/ATLAS-2904 > Project: Atlas > Issue Type: Bug > Components: atlas-webui >Affects Versions: 1.0.0 >Reporter: László Dénes Terjéki >Priority: Major > Fix For: 1.0.0 > > Attachments: ATLAS-2904.001.patch > > > Please update the jetty versions to 9.3.24.v20180605 or > later/9.4.11.v20180605 or later. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Resolved] (ATLAS-1323) apache knox
[ https://issues.apache.org/jira/browse/ATLAS-1323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nixon Rodrigues resolved ATLAS-1323. Resolution: Invalid > apache knox > --- > > Key: ATLAS-1323 > URL: https://issues.apache.org/jira/browse/ATLAS-1323 > Project: Atlas > Issue Type: Bug >Reporter: Satish Nambiar >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (ATLAS-2905) Generate lineage information for process entities
[ https://issues.apache.org/jira/browse/ATLAS-2905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sarath Subramanian updated ATLAS-2905: -- Attachment: 0001-ATLAS-2905-Generate-lineage-information-for-process.1.patch 0001-ATLAS-2905-Generate-lineage-information-for-process.1-branch-0.8.patch > Generate lineage information for process entities > - > > Key: ATLAS-2905 > URL: https://issues.apache.org/jira/browse/ATLAS-2905 > Project: Atlas > Issue Type: Task > Components: atlas-core >Affects Versions: 0.8.2, 1.0.0 >Reporter: Sarath Subramanian >Assignee: Sarath Subramanian >Priority: Major > Fix For: 0.8.3, 1.1.0 > > Attachments: > 0001-ATLAS-2905-Generate-lineage-information-for-process.1-branch-0.8.patch, > 0001-ATLAS-2905-Generate-lineage-information-for-process.1.patch > > > Currently lineage information is generated only for DataSet entities and its > derivatives. Lineage information should also be generated for Process > entities and in UI lineage tab should be enabled for any process entities and > lineage rendered. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (ATLAS-2905) Generate lineage information for process entities
[ https://issues.apache.org/jira/browse/ATLAS-2905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16636500#comment-16636500 ] ASF subversion and git services commented on ATLAS-2905: Commit d6bd9906546ca5adf069ae33f39b8b4afd8ddc84 in atlas's branch refs/heads/branch-0.8 from [~sarath.ku...@gmail.com] [ https://git-wip-us.apache.org/repos/asf?p=atlas.git;h=d6bd990 ] ATLAS-2905: Generate lineage information for process entities > Generate lineage information for process entities > - > > Key: ATLAS-2905 > URL: https://issues.apache.org/jira/browse/ATLAS-2905 > Project: Atlas > Issue Type: Task > Components: atlas-core >Affects Versions: 0.8.2, 1.0.0 >Reporter: Sarath Subramanian >Assignee: Sarath Subramanian >Priority: Major > Fix For: 0.8.3, 1.1.0 > > > Currently lineage information is generated only for DataSet entities and its > derivatives. Lineage information should also be generated for Process > entities and in UI lineage tab should be enabled for any process entities and > lineage rendered. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
