Re: UDF get_splits()

2020-04-05 Thread Sungwoo Park
Hello Eric, Now I understand why get_splits() returns LlapInputSplit[]. It seems that get_splits() is not part of public API as there is no documentation about it (and the user cannot do anything useful using the result of get_splits() anyway). Thank you very much for your email and saving me a

Re: UDF get_splits()

2020-04-05 Thread Eric Wohlstadter
Hi Sungoo, get_splits() is used by the HiveWarehouseConnector, you can see an example here: https://github.com/hortonworks/hive-warehouse-connector/blob/HDP-3.1.5.20-4-tag/src/main/java/com/hortonworks/spark/sql/hive/llap/HiveWarehouseDataSourceReader.java That being said, I'm not sure if this

UDF get_splits()

2020-04-05 Thread Sungwoo Park
Hello, I would like to learn the use of UDF get_splits(). I tried such queries as: select get_splits("select * from web_returns", 1) ; select get_splits("select count(*) from web_returns", 1); These queries just return InputSplit objects, and I would like to see an example that uses the result