Re: Drill on Windows
There is a 'run' option provided with the script to achieve this, ignore my previous mail. # Use this when launching Drill from your own script that manages the # process, such as (roll-your-own) YARN, Mesos, supervisord, etc. - Rahul On Sun, May 13, 2018 at 10:53 PM, Rahul Raj <rahul@option3consulting.com > wrote: > Is it possible to run drill in foreground? > With "drillbit.sh start" command, the exec command sends drill process to > background. It requires some modification to the start scripts to get drill > running in foreground. Will it not be a good idea to add a 'foreground' > option to the start scripts to make containerizing drill easy? > > I am not sure how to handle a graceful shutdown within a container > possible in such a scenario. Let me know your thoughts on this. > > Regards, > Rahul > > On Fri, Apr 20, 2018 at 10:09 PM, Timothy Farkas <tfar...@mapr.com> wrote: > >> Thanks everyone, >> >> I made a ticket here https://issues.apache.org/jira/browse/DRILL-6346 . >> Please follow it to get the latest info. >> >> Tim >> >> >> >> >> From: Chris Cunningham <cunningham...@gmail.com> >> Sent: Friday, April 20, 2018 7:41:48 AM >> To: user@drill.apache.org >> Subject: Re: Drill on Windows >> >> Hi Tim, >> I would appreciate this as well. Thank you for offering. >> -Chris >> >> On Fri, Apr 20, 2018 at 4:54 AM, Rahul Raj <rahul.raj@option3consulting.c >> om> >> wrote: >> >> > Thanks for the inputs. >> > >> > Tim, would really appreciate if you could get the docker image done. >> > >> > Regards, >> > Rahul >> > >> > On Fri, Apr 20, 2018 at 9:43 AM, scott <tcots8...@gmail.com> wrote: >> > >> > > Tim, >> > > >> > > As it turns out, I was just out there looking for an official docker >> > image >> > > today, and was a little disappointed there wasn't one. It's not that >> hard >> > > to make my own, but always preferable to me to use an official image >> > where >> > > I can just control it using parameters. >> > > >> > > Would be much appreciated if you built one. >> > > >> > > >> > > Scott >> > > >> > > >> > > >> > > On 04/19/2018 11:21 AM, Timothy Farkas wrote: >> > > >> > >> Rahul / Chris, >> > >> >> > >> The easiest way to do this would be to create a docker container for >> > >> Drill. Also it looks like Docker leverage's Windows 10's linux >> > subsystem so >> > >> docker images don't run in a VM https://urldefense.proofpoint. >> com/v2/url?u=https-3A__www.hanselman.com_blog=DwIBaQ=csk >> dkSMqhcnjZxdQVpwTXg=4eQVr8zB8ZBff-yxTimdOQ=DIQzoSbv5xeat >> vKHpNj9ly2AxFYhVDfJTqqfPZksg6w=3egN79Un6ZdskTbq_OKxqdFG9Gc >> XJNpspPLGbtV0pj8= >> > >> /DockerAndLinuxContainersOnWindowsWithOrWithoutHyperVVirtualM >> > achines.aspx. >> > >> So you get support for running on Windows 10 for free with no >> > performance >> > >> penalty. Plus everyone expects software to be package in docker >> images >> > >> these days anyway. >> > >> >> > >> Currently, there is no official drill docker image. If you're >> > interested, >> > >> let me know, and I can create a Jira and make one. I'm pretty bored >> > right >> > >> now and need something to do anyway :). >> > >> >> > >> Thanks, >> > >> Tim >> > >> >> > >> ___ >> > >> >> > > -- _*** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom it is addressed. If you are not the named addressee then you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately and delete this e-mail from your system.***_
Re: Drill on Windows
Is it possible to run drill in foreground? With "drillbit.sh start" command, the exec command sends drill process to background. It requires some modification to the start scripts to get drill running in foreground. Will it not be a good idea to add a 'foreground' option to the start scripts to make containerizing drill easy? I am not sure how to handle a graceful shutdown within a container possible in such a scenario. Let me know your thoughts on this. Regards, Rahul On Fri, Apr 20, 2018 at 10:09 PM, Timothy Farkas <tfar...@mapr.com> wrote: > Thanks everyone, > > I made a ticket here https://issues.apache.org/jira/browse/DRILL-6346 . > Please follow it to get the latest info. > > Tim > > > > > From: Chris Cunningham <cunningham...@gmail.com> > Sent: Friday, April 20, 2018 7:41:48 AM > To: user@drill.apache.org > Subject: Re: Drill on Windows > > Hi Tim, > I would appreciate this as well. Thank you for offering. > -Chris > > On Fri, Apr 20, 2018 at 4:54 AM, Rahul Raj <rahul.raj@option3consulting. > com> > wrote: > > > Thanks for the inputs. > > > > Tim, would really appreciate if you could get the docker image done. > > > > Regards, > > Rahul > > > > On Fri, Apr 20, 2018 at 9:43 AM, scott <tcots8...@gmail.com> wrote: > > > > > Tim, > > > > > > As it turns out, I was just out there looking for an official docker > > image > > > today, and was a little disappointed there wasn't one. It's not that > hard > > > to make my own, but always preferable to me to use an official image > > where > > > I can just control it using parameters. > > > > > > Would be much appreciated if you built one. > > > > > > > > > Scott > > > > > > > > > > > > On 04/19/2018 11:21 AM, Timothy Farkas wrote: > > > > > >> Rahul / Chris, > > >> > > >> The easiest way to do this would be to create a docker container for > > >> Drill. Also it looks like Docker leverage's Windows 10's linux > > subsystem so > > >> docker images don't run in a VM https://urldefense.proofpoint. > com/v2/url?u=https-3A__www.hanselman.com_blog=DwIBaQ= > cskdkSMqhcnjZxdQVpwTXg=4eQVr8zB8ZBff-yxTimdOQ= > DIQzoSbv5xeatvKHpNj9ly2AxFYhVDfJTqqfPZksg6w=3egN79Un6ZdskTbq_ > OKxqdFG9GcXJNpspPLGbtV0pj8= > > >> /DockerAndLinuxContainersOnWindowsWithOrWithoutHyperVVirtualM > > achines.aspx. > > >> So you get support for running on Windows 10 for free with no > > performance > > >> penalty. Plus everyone expects software to be package in docker images > > >> these days anyway. > > >> > > >> Currently, there is no official drill docker image. If you're > > interested, > > >> let me know, and I can create a Jira and make one. I'm pretty bored > > right > > >> now and need something to do anyway :). > > >> > > >> Thanks, > > >> Tim > > >> > > >> ___ > > > > -- _*** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom it is addressed. If you are not the named addressee then you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately and delete this e-mail from your system.***_
Re: Drill on Windows
Thanks everyone, I made a ticket here https://issues.apache.org/jira/browse/DRILL-6346 . Please follow it to get the latest info. Tim From: Chris Cunningham <cunningham...@gmail.com> Sent: Friday, April 20, 2018 7:41:48 AM To: user@drill.apache.org Subject: Re: Drill on Windows Hi Tim, I would appreciate this as well. Thank you for offering. -Chris On Fri, Apr 20, 2018 at 4:54 AM, Rahul Raj <rahul@option3consulting.com> wrote: > Thanks for the inputs. > > Tim, would really appreciate if you could get the docker image done. > > Regards, > Rahul > > On Fri, Apr 20, 2018 at 9:43 AM, scott <tcots8...@gmail.com> wrote: > > > Tim, > > > > As it turns out, I was just out there looking for an official docker > image > > today, and was a little disappointed there wasn't one. It's not that hard > > to make my own, but always preferable to me to use an official image > where > > I can just control it using parameters. > > > > Would be much appreciated if you built one. > > > > > > Scott > > > > > > > > On 04/19/2018 11:21 AM, Timothy Farkas wrote: > > > >> Rahul / Chris, > >> > >> The easiest way to do this would be to create a docker container for > >> Drill. Also it looks like Docker leverage's Windows 10's linux > subsystem so > >> docker images don't run in a VM > >> https://urldefense.proofpoint.com/v2/url?u=https-3A__www.hanselman.com_blog=DwIBaQ=cskdkSMqhcnjZxdQVpwTXg=4eQVr8zB8ZBff-yxTimdOQ=DIQzoSbv5xeatvKHpNj9ly2AxFYhVDfJTqqfPZksg6w=3egN79Un6ZdskTbq_OKxqdFG9GcXJNpspPLGbtV0pj8= > >> /DockerAndLinuxContainersOnWindowsWithOrWithoutHyperVVirtualM > achines.aspx. > >> So you get support for running on Windows 10 for free with no > performance > >> penalty. Plus everyone expects software to be package in docker images > >> these days anyway. > >> > >> Currently, there is no official drill docker image. If you're > interested, > >> let me know, and I can create a Jira and make one. I'm pretty bored > right > >> now and need something to do anyway :). > >> > >> Thanks, > >> Tim > >> > >> ___ >
Re: Drill on Windows
Hi Tim, I would appreciate this as well. Thank you for offering. -Chris On Fri, Apr 20, 2018 at 4:54 AM, Rahul Rajwrote: > Thanks for the inputs. > > Tim, would really appreciate if you could get the docker image done. > > Regards, > Rahul > > On Fri, Apr 20, 2018 at 9:43 AM, scott wrote: > > > Tim, > > > > As it turns out, I was just out there looking for an official docker > image > > today, and was a little disappointed there wasn't one. It's not that hard > > to make my own, but always preferable to me to use an official image > where > > I can just control it using parameters. > > > > Would be much appreciated if you built one. > > > > > > Scott > > > > > > > > On 04/19/2018 11:21 AM, Timothy Farkas wrote: > > > >> Rahul / Chris, > >> > >> The easiest way to do this would be to create a docker container for > >> Drill. Also it looks like Docker leverage's Windows 10's linux > subsystem so > >> docker images don't run in a VM https://www.hanselman.com/blog > >> /DockerAndLinuxContainersOnWindowsWithOrWithoutHyperVVirtualM > achines.aspx. > >> So you get support for running on Windows 10 for free with no > performance > >> penalty. Plus everyone expects software to be package in docker images > >> these days anyway. > >> > >> Currently, there is no official drill docker image. If you're > interested, > >> let me know, and I can create a Jira and make one. I'm pretty bored > right > >> now and need something to do anyway :). > >> > >> Thanks, > >> Tim > >> > >> ___ >
Re: Drill on Windows
Thanks for the inputs. Tim, would really appreciate if you could get the docker image done. Regards, Rahul On Fri, Apr 20, 2018 at 9:43 AM, scott <tcots8...@gmail.com> wrote: > Tim, > > As it turns out, I was just out there looking for an official docker image > today, and was a little disappointed there wasn't one. It's not that hard > to make my own, but always preferable to me to use an official image where > I can just control it using parameters. > > Would be much appreciated if you built one. > > > Scott > > > > On 04/19/2018 11:21 AM, Timothy Farkas wrote: > >> Rahul / Chris, >> >> The easiest way to do this would be to create a docker container for >> Drill. Also it looks like Docker leverage's Windows 10's linux subsystem so >> docker images don't run in a VM https://www.hanselman.com/blog >> /DockerAndLinuxContainersOnWindowsWithOrWithoutHyperVVirtualMachines.aspx. >> So you get support for running on Windows 10 for free with no performance >> penalty. Plus everyone expects software to be package in docker images >> these days anyway. >> >> Currently, there is no official drill docker image. If you're interested, >> let me know, and I can create a Jira and make one. I'm pretty bored right >> now and need something to do anyway :). >> >> Thanks, >> Tim >> >> ____________ >> From: Chris Cunningham <cunningham...@gmail.com> >> Sent: Wednesday, April 18, 2018 4:41:13 PM >> To: user@drill.apache.org >> Subject: Re: Drill on Windows >> >> Supposedly with Windows 10, there is a full Linux subsystem that you can >> use. Note: I haven't done this myself, so I'm not sure what would be >> needed (or exactly how it would work). But it looks like a reasonable >> option to pursue. >> >> https://urldefense.proofpoint.com/v2/url?u=https-3A__www.how >> togeek.com_249966_how-2Dto-2Dinstall-2Dand-2Duse-2Dthe-2Dlin >> ux-2Dbash-2Dshell-2Don-2Dwindows-2D10_=DwIBaQ=cskdkSMqhc >> njZxdQVpwTXg=4eQVr8zB8ZBff-yxTimdOQ=WogK4xioUxlrOsNBOGo >> B6W15z3N-mtPAV2Wh10p4gDU=JuU7VctfFIZOo70T7ofeMNbHrZ1U-l3FMAFevLD_DpE= >> >> This link says background processes aren't possible (which would make this >> pointless for drill, right?), but it seems that has been fixed. >> >> On Wed, Apr 18, 2018 at 10:45 AM, Kunal Khatua <ku...@apache.org> wrote: >> >> I might be wrong, but I think it's partly because of the need for >>> Zookeeper on Windows, which is not commonly done. >>> >>> Other more obvious factors, IMO, are the overhead in creating and >>> maintaining *nix shell scripts in Batch files. Linux (Bash) scripts are >>> much more powerful with a lot of capabilities to make use of a rich >>> variety >>> of utilities that the Linux OS offers. I've worked with Windows batch >>> files >>> nearly a decade ago and found it handicapping. Running in Cygwin is one >>> low-risk workaround, but no one seems to have done (or shared the >>> process). >>> >>> >>> On 4/18/2018 4:41:11 AM, Rahul Raj <rahul@option3consulting.com> >>> wrote: >>> Is there any reason why Drill does not run on Windows as standalone? I >>> can >>> only see a windows batch file for sqlline. >>> >>> Will it not work if we get the shell scripts translated to windows as >>> cmd/batch files? >>> >>> Regards, >>> Rahul >>> >>> -- >>> _*** This email and any files transmitted with it are confidential and >>> intended solely for the use of the individual or entity to whom it is >>> addressed. If you are not the named addressee then you should not >>> disseminate, distribute or copy this e-mail. Please notify the sender >>> immediately and delete this e-mail from your system.***_ >>> >>> > -- _*** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom it is addressed. If you are not the named addressee then you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately and delete this e-mail from your system.***_
Re: Drill on Windows
Tim, As it turns out, I was just out there looking for an official docker image today, and was a little disappointed there wasn't one. It's not that hard to make my own, but always preferable to me to use an official image where I can just control it using parameters. Would be much appreciated if you built one. Scott On 04/19/2018 11:21 AM, Timothy Farkas wrote: Rahul / Chris, The easiest way to do this would be to create a docker container for Drill. Also it looks like Docker leverage's Windows 10's linux subsystem so docker images don't run in a VM https://www.hanselman.com/blog/DockerAndLinuxContainersOnWindowsWithOrWithoutHyperVVirtualMachines.aspx. So you get support for running on Windows 10 for free with no performance penalty. Plus everyone expects software to be package in docker images these days anyway. Currently, there is no official drill docker image. If you're interested, let me know, and I can create a Jira and make one. I'm pretty bored right now and need something to do anyway :). Thanks, Tim From: Chris Cunningham <cunningham...@gmail.com> Sent: Wednesday, April 18, 2018 4:41:13 PM To: user@drill.apache.org Subject: Re: Drill on Windows Supposedly with Windows 10, there is a full Linux subsystem that you can use. Note: I haven't done this myself, so I'm not sure what would be needed (or exactly how it would work). But it looks like a reasonable option to pursue. https://urldefense.proofpoint.com/v2/url?u=https-3A__www.howtogeek.com_249966_how-2Dto-2Dinstall-2Dand-2Duse-2Dthe-2Dlinux-2Dbash-2Dshell-2Don-2Dwindows-2D10_=DwIBaQ=cskdkSMqhcnjZxdQVpwTXg=4eQVr8zB8ZBff-yxTimdOQ=WogK4xioUxlrOsNBOGoB6W15z3N-mtPAV2Wh10p4gDU=JuU7VctfFIZOo70T7ofeMNbHrZ1U-l3FMAFevLD_DpE= This link says background processes aren't possible (which would make this pointless for drill, right?), but it seems that has been fixed. On Wed, Apr 18, 2018 at 10:45 AM, Kunal Khatua <ku...@apache.org> wrote: I might be wrong, but I think it's partly because of the need for Zookeeper on Windows, which is not commonly done. Other more obvious factors, IMO, are the overhead in creating and maintaining *nix shell scripts in Batch files. Linux (Bash) scripts are much more powerful with a lot of capabilities to make use of a rich variety of utilities that the Linux OS offers. I've worked with Windows batch files nearly a decade ago and found it handicapping. Running in Cygwin is one low-risk workaround, but no one seems to have done (or shared the process). On 4/18/2018 4:41:11 AM, Rahul Raj <rahul@option3consulting.com> wrote: Is there any reason why Drill does not run on Windows as standalone? I can only see a windows batch file for sqlline. Will it not work if we get the shell scripts translated to windows as cmd/batch files? Regards, Rahul -- _*** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom it is addressed. If you are not the named addressee then you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately and delete this e-mail from your system.***_
Re: Drill on Windows
Rahul / Chris, The easiest way to do this would be to create a docker container for Drill. Also it looks like Docker leverage's Windows 10's linux subsystem so docker images don't run in a VM https://www.hanselman.com/blog/DockerAndLinuxContainersOnWindowsWithOrWithoutHyperVVirtualMachines.aspx. So you get support for running on Windows 10 for free with no performance penalty. Plus everyone expects software to be package in docker images these days anyway. Currently, there is no official drill docker image. If you're interested, let me know, and I can create a Jira and make one. I'm pretty bored right now and need something to do anyway :). Thanks, Tim From: Chris Cunningham <cunningham...@gmail.com> Sent: Wednesday, April 18, 2018 4:41:13 PM To: user@drill.apache.org Subject: Re: Drill on Windows Supposedly with Windows 10, there is a full Linux subsystem that you can use. Note: I haven't done this myself, so I'm not sure what would be needed (or exactly how it would work). But it looks like a reasonable option to pursue. https://urldefense.proofpoint.com/v2/url?u=https-3A__www.howtogeek.com_249966_how-2Dto-2Dinstall-2Dand-2Duse-2Dthe-2Dlinux-2Dbash-2Dshell-2Don-2Dwindows-2D10_=DwIBaQ=cskdkSMqhcnjZxdQVpwTXg=4eQVr8zB8ZBff-yxTimdOQ=WogK4xioUxlrOsNBOGoB6W15z3N-mtPAV2Wh10p4gDU=JuU7VctfFIZOo70T7ofeMNbHrZ1U-l3FMAFevLD_DpE= This link says background processes aren't possible (which would make this pointless for drill, right?), but it seems that has been fixed. On Wed, Apr 18, 2018 at 10:45 AM, Kunal Khatua <ku...@apache.org> wrote: > I might be wrong, but I think it's partly because of the need for > Zookeeper on Windows, which is not commonly done. > > Other more obvious factors, IMO, are the overhead in creating and > maintaining *nix shell scripts in Batch files. Linux (Bash) scripts are > much more powerful with a lot of capabilities to make use of a rich variety > of utilities that the Linux OS offers. I've worked with Windows batch files > nearly a decade ago and found it handicapping. Running in Cygwin is one > low-risk workaround, but no one seems to have done (or shared the process). > > > On 4/18/2018 4:41:11 AM, Rahul Raj <rahul@option3consulting.com> > wrote: > Is there any reason why Drill does not run on Windows as standalone? I can > only see a windows batch file for sqlline. > > Will it not work if we get the shell scripts translated to windows as > cmd/batch files? > > Regards, > Rahul > > -- > _*** This email and any files transmitted with it are confidential and > intended solely for the use of the individual or entity to whom it is > addressed. If you are not the named addressee then you should not > disseminate, distribute or copy this e-mail. Please notify the sender > immediately and delete this e-mail from your system.***_ >
Re: Drill on Windows
Supposedly with Windows 10, there is a full Linux subsystem that you can use. Note: I haven't done this myself, so I'm not sure what would be needed (or exactly how it would work). But it looks like a reasonable option to pursue. https://www.howtogeek.com/249966/how-to-install-and-use-the-linux-bash-shell-on-windows-10/ This link says background processes aren't possible (which would make this pointless for drill, right?), but it seems that has been fixed. On Wed, Apr 18, 2018 at 10:45 AM, Kunal Khatuawrote: > I might be wrong, but I think it's partly because of the need for > Zookeeper on Windows, which is not commonly done. > > Other more obvious factors, IMO, are the overhead in creating and > maintaining *nix shell scripts in Batch files. Linux (Bash) scripts are > much more powerful with a lot of capabilities to make use of a rich variety > of utilities that the Linux OS offers. I've worked with Windows batch files > nearly a decade ago and found it handicapping. Running in Cygwin is one > low-risk workaround, but no one seems to have done (or shared the process). > > > On 4/18/2018 4:41:11 AM, Rahul Raj > wrote: > Is there any reason why Drill does not run on Windows as standalone? I can > only see a windows batch file for sqlline. > > Will it not work if we get the shell scripts translated to windows as > cmd/batch files? > > Regards, > Rahul > > -- > _*** This email and any files transmitted with it are confidential and > intended solely for the use of the individual or entity to whom it is > addressed. If you are not the named addressee then you should not > disseminate, distribute or copy this e-mail. Please notify the sender > immediately and delete this e-mail from your system.***_ >
Re: Drill on Windows
I might be wrong, but I think it's partly because of the need for Zookeeper on Windows, which is not commonly done. Other more obvious factors, IMO, are the overhead in creating and maintaining *nix shell scripts in Batch files. Linux (Bash) scripts are much more powerful with a lot of capabilities to make use of a rich variety of utilities that the Linux OS offers. I've worked with Windows batch files nearly a decade ago and found it handicapping. Running in Cygwin is one low-risk workaround, but no one seems to have done (or shared the process). On 4/18/2018 4:41:11 AM, Rahul Rajwrote: Is there any reason why Drill does not run on Windows as standalone? I can only see a windows batch file for sqlline. Will it not work if we get the shell scripts translated to windows as cmd/batch files? Regards, Rahul -- _*** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom it is addressed. If you are not the named addressee then you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately and delete this e-mail from your system.***_