pan3793 commented on PR #41856: URL: https://github.com/apache/spark/pull/41856#issuecomment-1645013166
@surnaik Apache Kyuubi has a [Spark TPC-H Connector](https://github.com/apache/kyuubi/tree/master/extensions/spark/kyuubi-spark-connector-tpch/src/main/scala/org/apache/kyuubi/spark/connector/tpch) based on DataSource V2 API, which is inspired by [TPCH connector](https://trino.io/docs/current/connector/tpch.html#connector-tpch--page-root) ``` spark-sql \ --packages org.apache.kyuubi:kyuubi-spark-connector-tpch_2.12:1.7.1 \ --conf spark.sql.catalog.tpch=org.apache.kyuubi.spark.connector.tpch.TPCHCatalog ``` ``` spark-sql> show tables in tpch.sf1; customer orders lineitem part partsupp supplier nation region Time taken: 0.1 seconds, Fetched 8 row(s) spark-sql> select * from tpch.sf1.orders limit 10; 1 36901 O 173665.47 1996-01-02 5-LOW Clerk#000000951 0 nstructions sleep furiously among 2 78002 O 46929.18 1996-12-01 1-URGENT Clerk#000000880 0 foxes. pending accounts at the pending, silent asymptot 3 123314 F 193846.25 1993-10-14 5-LOW Clerk#000000955 0 sly final accounts boost. carefully regular ideas cajole carefully. depos 4 136777 O 32151.78 1995-10-11 5-LOW Clerk#000000124 0 sits. slyly regular warthogs cajole. regular, regular theodolites acro 5 44485 F 144659.2 1994-07-30 5-LOW Clerk#000000925 0 quickly. bold deposits sleep slyly. packages use slyly 6 55624 F 58749.59 1992-02-21 4-NOT SPECIFIED Clerk#000000058 0 ggle. special, final requests are against the furiously specia 7 39136 O 252004.18 1996-01-10 2-HIGH Clerk#000000470 0 ly special requests 32 130057 O 208660.75 1995-07-16 2-HIGH Clerk#000000616 0 ise blithely bold, regular requests. quickly unusual dep 33 66958 F 163243.98 1993-10-27 3-MEDIUM Clerk#000000409 0 uriously. furiously final request 34 61001 O 58949.67 1998-07-21 3-MEDIUM Clerk#000000223 0 ly final packages. fluffily final deposits wake blithely ideas. spe Time taken: 2.608 seconds, Fetched 10 row(s) ``` It could also be used to generate the data by using CTAS. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
