Thanks Kyle! From: Kyle Weaver <[email protected]> Date: Thursday, May 6, 2021 at 12:19 PM To: Tao Li <[email protected]> Cc: "[email protected]" <[email protected]>, Anuj Gandhi <[email protected]> Subject: Re: Does SnowflakeIO support spark runner
Yeah, I'm pretty sure that documentation is just misleading. All of the options from --runner onward are runner-specific and don't have anything to do with Snowflake, so they should probably be removed from the doc. On Thu, May 6, 2021 at 12:06 PM Tao Li <[email protected]<mailto:[email protected]>> wrote: Hi @Kyle Weaver<mailto:[email protected]> According to this doc<https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fbeam.apache.org%2Fdocumentation%2Fio%2Fbuilt-in%2Fsnowflake%2F&data=04%7C01%7Ctaol%40zillow.com%7C7be88d03486d4f64c1db08d910c3e67a%7C033464830d1840e7a5883784ac50e16f%7C0%7C0%7C637559255833746635%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=gnk80TpLC%2BMlclZ%2F5PKFTFc5H2GoQtL2GUOYZvzRj1g%3D&reserved=0>: --runner=<DirectRunner/DataflowRunner> From: Kyle Weaver <[email protected]<mailto:[email protected]>> Reply-To: "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>> Date: Thursday, May 6, 2021 at 12:01 PM To: "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>> Cc: Anuj Gandhi <[email protected]<mailto:[email protected]>> Subject: Re: Does SnowflakeIO support spark runner As far as I know, it should be supported (Beam's abstract model means IOs usually "just work" on all runners). What makes you think it isn't supported? On Thu, May 6, 2021 at 11:52 AM Tao Li <[email protected]<mailto:[email protected]>> wrote: Hi Beam community, Does SnowflakeIO support spark runner? Seems like only direct runner and dataflow runner are supported.. Thanks!
