Re: [jira] [Created] (AMATERASU-52) Implement AmaContext.datastores

2019-01-29 Thread Arun Manivannan
Makes sense, Nadav. I have been toying with the idea of having the structure like this. I am trying to make it work on konf (argggh!!) though. Do you think this sounds reasonable? datasets: hive: transactions: uri: /user/somepath format: parquet database:

Re: [jira] [Created] (AMATERASU-52) Implement AmaContext.datastores

2019-01-28 Thread Nadav Har Tzvi
Hey Arun, I kinda feel like the datastores yaml is somewhat obscure. I propose the following structure. Instead of datasets: hive: - key: transactions uri: /user/somepath format: parquet database: transations_daily table: transx - key: second_transactions

Re: [jira] [Created] (AMATERASU-52) Implement AmaContext.datastores

2019-01-13 Thread Arun Manivannan
Hi Guy, Yaniv and Nadiv, This PR just captures part of the issue - the datasets.yaml, ConfigManager and the testcases. The Integration with the AmaContext is yet to be done but I would like to get your thoughts on the implementation. Guy -

[jira] [Created] (AMATERASU-52) Implement AmaContext.datastores

2018-10-12 Thread Yaniv Rodenski (JIRA)
Yaniv Rodenski created AMATERASU-52: --- Summary: Implement AmaContext.datastores Key: AMATERASU-52 URL: https://issues.apache.org/jira/browse/AMATERASU-52 Project: AMATERASU Issue Type: Task