[jira] [Commented] (ATLAS-2708) AWS S3 data lake typedefs for Atlas

2018-09-24 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626588#comment-16626588 ] t oo commented on ATLAS-2708: - tracking further work in ATLAS-2889 > AWS S3 data lake typedefs for Atlas >

[jira] [Commented] (ATLAS-2708) AWS S3 data lake typedefs for Atlas

2018-09-20 Thread Barbara Eckman (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622266#comment-16622266 ] Barbara Eckman commented on ATLAS-2708: --- [~ayushmnnit] Agreed. > AWS S3 data lake typedefs for

[jira] [Commented] (ATLAS-2708) AWS S3 data lake typedefs for Atlas

2018-09-19 Thread Ayush Nigam (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621527#comment-16621527 ] Ayush Nigam commented on ATLAS-2708: [~toopt4] You have to create your own Lambda code that creates

[jira] [Commented] (ATLAS-2708) AWS S3 data lake typedefs for Atlas

2018-09-19 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621191#comment-16621191 ] t oo commented on ATLAS-2708: - [~barbara] what config/steps should I run to enable this? or are you saying

[jira] [Commented] (ATLAS-2708) AWS S3 data lake typedefs for Atlas

2018-09-19 Thread Barbara Eckman (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621077#comment-16621077 ] Barbara Eckman commented on ATLAS-2708: --- It doesn't do it automatically through a listener like the

[jira] [Commented] (ATLAS-2708) AWS S3 data lake typedefs for Atlas

2018-09-19 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620568#comment-16620568 ] t oo commented on ATLAS-2708: - Can atlas import 's3 object tags' from all s3 objects under a given s3 bucket?

[jira] [Commented] (ATLAS-2708) AWS S3 data lake typedefs for Atlas

2018-06-19 Thread Eckman, Barbara (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16517207#comment-16517207 ] Eckman, Barbara commented on ATLAS-2708: Awesome! Thanks for your suggestions, too! On

[jira] [Commented] (ATLAS-2708) AWS S3 data lake typedefs for Atlas

2018-06-19 Thread Don Bosco Durai (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16516825#comment-16516825 ] Don Bosco Durai commented on ATLAS-2708: {quote}[~bosco] [~madhan.neethiraj] Of course you can

[jira] [Commented] (ATLAS-2708) AWS S3 data lake typedefs for Atlas

2018-06-17 Thread Madhan Neethiraj (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16515156#comment-16515156 ] Madhan Neethiraj commented on ATLAS-2708: - [~barbara] - thanks for the updated model files. The

[jira] [Commented] (ATLAS-2708) AWS S3 data lake typedefs for Atlas

2018-06-15 Thread Barbara Eckman (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16514229#comment-16514229 ] Barbara Eckman commented on ATLAS-2708: --- [~bosco]   bq. You have S3AccessPolicy in AWSS3Bucket as

[jira] [Commented] (ATLAS-2708) AWS S3 data lake typedefs for Atlas

2018-06-15 Thread Barbara Eckman (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16514222#comment-16514222 ] Barbara Eckman commented on ATLAS-2708: --- [~madhan.neethiraj] I agree with all your changes except

[jira] [Commented] (ATLAS-2708) AWS S3 data lake typedefs for Atlas

2018-06-15 Thread Barbara Eckman (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16514168#comment-16514168 ] Barbara Eckman commented on ATLAS-2708: --- [~bosco] [~madhan.neethiraj] Of course you can use my JSON

[jira] [Commented] (ATLAS-2708) AWS S3 data lake typedefs for Atlas

2018-06-15 Thread Don Bosco Durai (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16513593#comment-16513593 ] Don Bosco Durai commented on ATLAS-2708: {quote}I updated the model files for above comments,

[jira] [Commented] (ATLAS-2708) AWS S3 data lake typedefs for Atlas

2018-06-15 Thread Don Bosco Durai (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16513580#comment-16513580 ] Don Bosco Durai commented on ATLAS-2708: [~barbara] looks good. Having a common JSON for AWS

[jira] [Commented] (ATLAS-2708) AWS S3 data lake typedefs for Atlas

2018-06-15 Thread Madhan Neethiraj (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16513574#comment-16513574 ] Madhan Neethiraj commented on ATLAS-2708: - [~barbara] - thanks for AWS/S3 model types. Here are

[jira] [Commented] (ATLAS-2708) AWS S3 data lake typedefs for Atlas

2018-06-14 Thread Barbara Eckman (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512944#comment-16512944 ] Barbara Eckman commented on ATLAS-2708: --- [~bosco]  good point, I should have a backpointer from

[jira] [Commented] (ATLAS-2708) AWS S3 data lake typedefs for Atlas

2018-06-14 Thread Don Bosco Durai (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512845#comment-16512845 ] Don Bosco Durai commented on ATLAS-2708: [~barbara], my comments are inline {quote}bq. 1.  We

[jira] [Commented] (ATLAS-2708) AWS S3 data lake typedefs for Atlas

2018-06-13 Thread Barbara Eckman (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511218#comment-16511218 ] Barbara Eckman commented on ATLAS-2708: --- OK... can you point me to documentation or examples of

[jira] [Commented] (ATLAS-2708) AWS S3 data lake typedefs for Atlas

2018-06-13 Thread Barbara Eckman (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511216#comment-16511216 ] Barbara Eckman commented on ATLAS-2708: --- [~bosco], Great, I'm glad they will be useful.   1.  We

[jira] [Commented] (ATLAS-2708) AWS S3 data lake typedefs for Atlas

2018-06-12 Thread Don Bosco Durai (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16510324#comment-16510324 ] Don Bosco Durai commented on ATLAS-2708: [~barbara] Thanks for coming up with S3 typedef. I am

[jira] [Commented] (ATLAS-2708) AWS S3 data lake typedefs for Atlas

2018-06-11 Thread David Radley (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16507807#comment-16507807 ] David Radley commented on ATLAS-2708: - [~barbara] I have had a quick look at the json file, it looks

[jira] [Commented] (ATLAS-2708) AWS S3 data lake typedefs for Atlas

2018-06-10 Thread Barbara Eckman (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16507532#comment-16507532 ] Barbara Eckman commented on ATLAS-2708: --- I'm sorry, that was stupid.  I'm attaching a file that

[jira] [Commented] (ATLAS-2708) AWS S3 data lake typedefs for Atlas

2018-06-10 Thread Madhan Neethiraj (JIRA)
[ https://issues.apache.org/jira/browse/ATLAS-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16507520#comment-16507520 ] Madhan Neethiraj commented on ATLAS-2708: - [~barbara] - thanks for adding models for S3 types.