com>
To: user@hive.apache.org
Sent: Wednesday, April 4, 2018 6:58:58 AM
Subject: Re: Building Datwarehouse Application in Spark
Hi Mahender,
Did you look at this? https://www.snappydata.io/blog/the-spark-database
But I believe that most people handle this use case by either using:
- Their
Hi Mahender,
Did you look at this? https://www.snappydata.io/blog/the-spark-database
But I believe that most people handle this use case by either using:
- Their favorite regular RDBMS (mySQL, postgres, Oracle, SQL-Server, ...)
if the data is not too big
- Their favorite New-SQL storage
Hi,
Does anyone has good architecture document/design principle for building
warehouse application using Spark.
Is it better way of having Hive Context created with HQL and perform
transformation or Directly loading files in dataframe and perform data
transformation.
We need to implement SCD
