AW: What are all the empty "ext" directories for?

2023-07-14 Thread Christofer Dutz
Ok … so having had a look, it seems as if this happens in the 
UDFExecutableManager
Class (And the matching other Manager components. The “SystemFileFactory
.makeDirIfNecessary” are the ones creating them.
Possibly worth investigating if they really need to exist, of if we could 
change the Managers to check if they exist.

Chris


Von: Xiangdong Huang 
Datum: Freitag, 14. Juli 2023 um 09:15
An: dev@iotdb.apache.org 
Betreff: Re: What are all the empty "ext" directories for?
> I can imagine what it’s used for … I was more just asking, why it’s creating 
> these directories locally instead of just looking if they exist. Always feels 
> a bit odd, if loads of empty directories are in my filesystem.

agree with that feeling... this can be indeed an improvement if it
does not bring too much complexity.

Best,
---
Xiangdong Huang

Christofer Dutz  于2023年7月14日周五 14:30写道:
>
> Hi Xiangdong,
>
> I can imagine what it’s used for … I was more just asking, why it’s creating 
> these directories locally instead of just looking if they exist. Always feels 
> a bit odd, if loads of empty directories are in my filesystem.
>
> Chris
>
> Von: Xiangdong Huang 
> Datum: Freitag, 14. Juli 2023 um 07:51
> An: dev@iotdb.apache.org 
> Betreff: Re: What are all the empty "ext" directories for?
> "ext" refers to "extension", and its subfolder:
> - trigger, similar with trigger in RDBMS.
> - udf, user define functions.
> - PIPE, a new function for ETL or data subscription.
>
> All the above need to users claiming their data processing logic using
> jar files.
> So as Trevor said, you can put your jar files there.
>
>
> Best,
> ---
> Xiangdong Huang
>
> 18110526...@163.com <18110526...@163.com> 于2023年7月14日周五 08:55写道:
> >
> > We have written the relevant documentation, you can see 
> > https://apache-iotdb.feishu.cn/docx/SG1DdQklco67oaxSLbYcghWxnkc.
> > > 2023年7月12日 20:45,Christofer Dutz  写道:
> > >
> > > Hi,
> > >
> > > so playing around with IoTDB running in embedded mode, I noticed that it 
> > > creates a directory “data” which totally makes sense to me, as it 
> > > contains all the data.
> > > However it also creates a whole tree under “ext” which just seems to 
> > > contain loads of empty directories.
> > > What’s the purpose of these and could we prevent them from being created, 
> > > if they are not needed?
> > >
> > > ext
> > >   /pipe
> > >  /install
> > >  /tmp
> > >/trigger
> > >  /install
> > >  /tmp
> > >/udf
> > >  /install
> > >  /tmp
> > >
> > >
> > > Chris
> >


Re: What are all the empty "ext" directories for?

2023-07-14 Thread Xiangdong Huang
> I can imagine what it’s used for … I was more just asking, why it’s creating 
> these directories locally instead of just looking if they exist. Always feels 
> a bit odd, if loads of empty directories are in my filesystem.

agree with that feeling... this can be indeed an improvement if it
does not bring too much complexity.

Best,
---
Xiangdong Huang

Christofer Dutz  于2023年7月14日周五 14:30写道:
>
> Hi Xiangdong,
>
> I can imagine what it’s used for … I was more just asking, why it’s creating 
> these directories locally instead of just looking if they exist. Always feels 
> a bit odd, if loads of empty directories are in my filesystem.
>
> Chris
>
> Von: Xiangdong Huang 
> Datum: Freitag, 14. Juli 2023 um 07:51
> An: dev@iotdb.apache.org 
> Betreff: Re: What are all the empty "ext" directories for?
> "ext" refers to "extension", and its subfolder:
> - trigger, similar with trigger in RDBMS.
> - udf, user define functions.
> - PIPE, a new function for ETL or data subscription.
>
> All the above need to users claiming their data processing logic using
> jar files.
> So as Trevor said, you can put your jar files there.
>
>
> Best,
> ---
> Xiangdong Huang
>
> 18110526...@163.com <18110526...@163.com> 于2023年7月14日周五 08:55写道:
> >
> > We have written the relevant documentation, you can see 
> > https://apache-iotdb.feishu.cn/docx/SG1DdQklco67oaxSLbYcghWxnkc.
> > > 2023年7月12日 20:45,Christofer Dutz  写道:
> > >
> > > Hi,
> > >
> > > so playing around with IoTDB running in embedded mode, I noticed that it 
> > > creates a directory “data” which totally makes sense to me, as it 
> > > contains all the data.
> > > However it also creates a whole tree under “ext” which just seems to 
> > > contain loads of empty directories.
> > > What’s the purpose of these and could we prevent them from being created, 
> > > if they are not needed?
> > >
> > > ext
> > >   /pipe
> > >  /install
> > >  /tmp
> > >/trigger
> > >  /install
> > >  /tmp
> > >/udf
> > >  /install
> > >  /tmp
> > >
> > >
> > > Chris
> >


AW: What are all the empty "ext" directories for?

2023-07-13 Thread Christofer Dutz
Hi Xiangdong,

I can imagine what it’s used for … I was more just asking, why it’s creating 
these directories locally instead of just looking if they exist. Always feels a 
bit odd, if loads of empty directories are in my filesystem.

Chris

Von: Xiangdong Huang 
Datum: Freitag, 14. Juli 2023 um 07:51
An: dev@iotdb.apache.org 
Betreff: Re: What are all the empty "ext" directories for?
"ext" refers to "extension", and its subfolder:
- trigger, similar with trigger in RDBMS.
- udf, user define functions.
- PIPE, a new function for ETL or data subscription.

All the above need to users claiming their data processing logic using
jar files.
So as Trevor said, you can put your jar files there.


Best,
---
Xiangdong Huang

18110526...@163.com <18110526...@163.com> 于2023年7月14日周五 08:55写道:
>
> We have written the relevant documentation, you can see 
> https://apache-iotdb.feishu.cn/docx/SG1DdQklco67oaxSLbYcghWxnkc.
> > 2023年7月12日 20:45,Christofer Dutz  写道:
> >
> > Hi,
> >
> > so playing around with IoTDB running in embedded mode, I noticed that it 
> > creates a directory “data” which totally makes sense to me, as it contains 
> > all the data.
> > However it also creates a whole tree under “ext” which just seems to 
> > contain loads of empty directories.
> > What’s the purpose of these and could we prevent them from being created, 
> > if they are not needed?
> >
> > ext
> >   /pipe
> >  /install
> >  /tmp
> >/trigger
> >  /install
> >  /tmp
> >/udf
> >  /install
> >  /tmp
> >
> >
> > Chris
>


AW: What are all the empty "ext" directories for?

2023-07-13 Thread Christofer Dutz
(With my Apache Member Hat on)

This relevant information should also be available to all without needing to 
request access.

Chris

Von: 18110526...@163.com <18110526...@163.com>
Datum: Freitag, 14. Juli 2023 um 02:55
An: dev@iotdb.apache.org 
Betreff: Re: What are all the empty "ext" directories for?
We have written the relevant documentation, you can see 
https://apache-iotdb.feishu.cn/docx/SG1DdQklco67oaxSLbYcghWxnkc.
> 2023年7月12日 20:45,Christofer Dutz  写道:
>
> Hi,
>
> so playing around with IoTDB running in embedded mode, I noticed that it 
> creates a directory “data” which totally makes sense to me, as it contains 
> all the data.
> However it also creates a whole tree under “ext” which just seems to contain 
> loads of empty directories.
> What’s the purpose of these and could we prevent them from being created, if 
> they are not needed?
>
> ext
>   /pipe
>  /install
>  /tmp
>/trigger
>  /install
>  /tmp
>/udf
>  /install
>  /tmp
>
>
> Chris


Re: What are all the empty "ext" directories for?

2023-07-13 Thread Xiangdong Huang
"ext" refers to "extension", and its subfolder:
- trigger, similar with trigger in RDBMS.
- udf, user define functions.
- PIPE, a new function for ETL or data subscription.

All the above need to users claiming their data processing logic using
jar files.
So as Trevor said, you can put your jar files there.


Best,
---
Xiangdong Huang

18110526...@163.com <18110526...@163.com> 于2023年7月14日周五 08:55写道:
>
> We have written the relevant documentation, you can see 
> https://apache-iotdb.feishu.cn/docx/SG1DdQklco67oaxSLbYcghWxnkc.
> > 2023年7月12日 20:45,Christofer Dutz  写道:
> >
> > Hi,
> >
> > so playing around with IoTDB running in embedded mode, I noticed that it 
> > creates a directory “data” which totally makes sense to me, as it contains 
> > all the data.
> > However it also creates a whole tree under “ext” which just seems to 
> > contain loads of empty directories.
> > What’s the purpose of these and could we prevent them from being created, 
> > if they are not needed?
> >
> > ext
> >   /pipe
> >  /install
> >  /tmp
> >/trigger
> >  /install
> >  /tmp
> >/udf
> >  /install
> >  /tmp
> >
> >
> > Chris
>


Re: What are all the empty "ext" directories for?

2023-07-13 Thread 18110526...@163.com
We have written the relevant documentation, you can see 
https://apache-iotdb.feishu.cn/docx/SG1DdQklco67oaxSLbYcghWxnkc.
> 2023年7月12日 20:45,Christofer Dutz  写道:
> 
> Hi,
> 
> so playing around with IoTDB running in embedded mode, I noticed that it 
> creates a directory “data” which totally makes sense to me, as it contains 
> all the data.
> However it also creates a whole tree under “ext” which just seems to contain 
> loads of empty directories.
> What’s the purpose of these and could we prevent them from being created, if 
> they are not needed?
> 
> ext
>   /pipe
>  /install
>  /tmp
>/trigger
>  /install
>  /tmp
>/udf
>  /install
>  /tmp
> 
> 
> Chris



Re: What are all the empty "ext" directories for?

2023-07-12 Thread Trevor Hart
Not sure what all of them are but UDF is where you put custom data functions 
(jar files).



Im guessing the same for triggers?



Thanks 

Trevor Hart

Ope Limited

w: http://www.ope.nz/

m: +64212728039








 On Thu, 13 Jul 2023 00:45:40 +1200 Christofer Dutz 
 wrote ---



Hi, 
 
so playing around with IoTDB running in embedded mode, I noticed that it 
creates a directory “data” which totally makes sense to me, as it contains all 
the data. 
However it also creates a whole tree under “ext” which just seems to contain 
loads of empty directories. 
What’s the purpose of these and could we prevent them from being created, if 
they are not needed? 
 
ext 
 /pipe 
 /install 
 /tmp 
 /trigger 
 /install 
 /tmp 
 /udf 
 /install 
 /tmp 
 
 
Chris

What are all the empty "ext" directories for?

2023-07-12 Thread Christofer Dutz
Hi,

so playing around with IoTDB running in embedded mode, I noticed that it 
creates a directory “data” which totally makes sense to me, as it contains all 
the data.
However it also creates a whole tree under “ext” which just seems to contain 
loads of empty directories.
What’s the purpose of these and could we prevent them from being created, if 
they are not needed?

ext
   /pipe
  /install
  /tmp
/trigger
  /install
  /tmp
/udf
  /install
  /tmp


Chris