This is an automated email from the ASF dual-hosted git repository.
yaniv pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-amaterasu.git.
from 8b07446 Merge pull request #3 from
eyalbenivri/feature/yarn-support-pyfix
add 9b48e0e 1.SparkSql runner can read a dataframe from previous action
through AmaContext; 2.SparkSql runner can parse amacontext in user supplied
query; 3.SparkSql can read/write data directly from a sql,json,parquet, orm and
text file. JDBC support will be available in future releases
add 0acf1ee If no dataframe read format is specified by user, parquet is
used as default file format to load data from previous actions
add c8e8cd0 Updated parser to parse advanced queries
add 3d316d7 Merge branch 'master' into AMATERASU-13
add 8a94f89 Merge branch 'master' into AMATERASU-13
new 0f0b0ae Merge pull request #2 from kirupagaran/AMATERASU-13
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../runners/spark/SparkSql/SparkSqlRunner.scala | 121 ++++++++++++++++-----
.../resources/SparkSql/csv/SparkSqlTestCsv.csv | 4 +
.../resources/SparkSql/json/SparkSqlTestData.json | 6 +-
.../amaterasu/spark/SparkSqlRunnerTests.scala | 100 +++++++++++++++--
4 files changed, 191 insertions(+), 40 deletions(-)
create mode 100644 executor/src/test/resources/SparkSql/csv/SparkSqlTestCsv.csv
--
To stop receiving notification emails like this one, please contact
['"[email protected]" <[email protected]>'].
