Re: Using CsvBulkInsert With compressed Hive data

2016-09-29 Thread Gabriel Reid
Hi Zack, Am I correct in understanding the the files are under a structure like x/.deflate/csv_file.csv ? In that case, I believe everything under the .deflate directory will simply be ignored, as directories whose name start with a period are considered "hidden" files. However, assuming the dat

Using CsvBulkInsert With compressed Hive data

2016-09-29 Thread Riesland, Zack
For a very long time, we've had a workflow that looks like this: Export data from a compressed, orc hive table to another hive table that is "external stored as text file". No compression specified. Then, we point to the folder "x" behind that new table and use CsvBulkInsert to get data to Hbas