Re: [GRASS-dev] [BUG] or at least unclear error message

[Rainer M Krug]

Rainer M Krug  writes:

> Markus Neteler  writes:
>
>> On Mon, Nov 2, 2015 at 11:50 AM, Rainer M Krug  wrote:
>>> Hi
>>>
>>> OS: OS X, El Capitan, grass installed via homebrew.
>>>
>>> I have a mega location with 532 read-only mapsets with each around 2500 
>>> mapsets
>>> (plus PERMANENT and an read-write analysis mapset).
>>>
>>> When using g.list type=rast mapset=* I get the following error: "Unable
>>> to open directory". I guess this is caused by to many open files as I
>>> can execute the command g.list type=rast mapset=... for this mapset
>>> without problems.
>>
>> You likely hit the current setting of open files. See e.g. this page
>> how to set a higher limit:
>>
>> https://grass.osgeo.org/grass70/manuals/r.series.html#management-of-open-file-limits
>

Just to add and possibly to be invcluded in the manual: on OS X the hard
limit is unlimited and the soft limit is 256.

Cheers,

Rainer


> Yes - that solved the issue. But I am wondering, if it really is
> necessary to keep all these files open just to list the maps?
>
> Thanks,
>
> Rainer
>
>
>>
>> Please let us know how it goes.
>>
>> Markus

-- 
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, 
UCT), Dipl. Phys. (Germany)

Centre of Excellence for Invasion Biology
Stellenbosch University
South Africa

Tel :   +33 - (0)9 53 10 27 44
Cell:   +33 - (0)6 85 62 59 98
Fax :   +33 - (0)9 58 10 27 44

Fax (D):+49 - (0)3 21 21 25 22 44

email:  rai...@krugs.de

Skype:  RMkrug

PGP: 0x0F52F982


signature.asc
Description: PGP signature
___
grass-dev mailing list
grass-dev@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/grass-dev

Re: [GRASS-dev] [BUG] or at least unclear error message

[Markus Neteler]

On Thu, Nov 5, 2015 at 9:07 AM, Rainer M Krug  wrote:
> Just to add and possibly to be invcluded in the manual: on OS X the hard
> limit is unlimited and the soft limit is 256.

maybe we should modify that part and refer to an overview page
describing the various operating systems?

Markus
___
grass-dev mailing list
grass-dev@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/grass-dev

Re: [GRASS-dev] [BUG] or at least unclear error message

[Rainer M Krug]

Markus Neteler  writes:

> On Thu, Nov 5, 2015 at 9:07 AM, Rainer M Krug  wrote:
>> Just to add and possibly to be invcluded in the manual: on OS X the hard
>> limit is unlimited and the soft limit is 256.
>
> maybe we should modify that part and refer to an overview page
> describing the various operating systems?

I think that would be a good idea as this likely can affect many scripts
and commands.

Apart from the offline documentation, this might even a candidate for
the wiki.

Rainer

>
> Markus

-- 
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, 
UCT), Dipl. Phys. (Germany)

Centre of Excellence for Invasion Biology
Stellenbosch University
South Africa

Tel :   +33 - (0)9 53 10 27 44
Cell:   +33 - (0)6 85 62 59 98
Fax :   +33 - (0)9 58 10 27 44

Fax (D):+49 - (0)3 21 21 25 22 44

email:  rai...@krugs.de

Skype:  RMkrug

PGP: 0x0F52F982


signature.asc
Description: PGP signature
___
grass-dev mailing list
grass-dev@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/grass-dev

Re: [GRASS-dev] [BUG] or at least unclear error message

[Glynn Clements]

Rainer M Krug wrote:

> I have a mega location with 532 read-only mapsets with each around 2500 
> mapsets
> (plus PERMANENT and an read-write analysis mapset).
> 
> When using g.list type=rast mapset=* I get the following error: "Unable
> to open directory". I guess this is caused by to many open files as I
> can execute the command g.list type=rast mapset=... for this mapset
> without problems.
> 
> (transcript below)
> 
> Is this the case? Could the error message be clarified (I fear not) or a
> different approach be used to list the maps?

G_ls2() doesn't call closedir() when it has finished reading the
directory.

Fixed in trunk with r66719.

-- 
Glynn Clements 
___
grass-dev mailing list
grass-dev@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/grass-dev

Re: [GRASS-dev] [BUG] or at least unclear error message

[Markus Neteler]

On Tue, Nov 3, 2015 at 1:09 PM, Rainer M Krug  wrote:
> Glynn Clements  writes:
>> G_ls2() doesn't call closedir() when it has finished reading the
>> directory.
>>
>> Fixed in trunk with r66719.
>
> Thanks.
>
> I assume this will not be included in 7.0.2?

It will, already backported.
(but it didn't make it by some minutes into RC2).

Markus
___
grass-dev mailing list
grass-dev@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/grass-dev

Re: [GRASS-dev] [BUG] or at least unclear error message

[Rainer M Krug]

Markus Neteler  writes:

> On Tue, Nov 3, 2015 at 1:09 PM, Rainer M Krug  wrote:
>> Glynn Clements  writes:
>>> G_ls2() doesn't call closedir() when it has finished reading the
>>> directory.
>>>
>>> Fixed in trunk with r66719.
>>
>> Thanks.
>>
>> I assume this will not be included in 7.0.2?
>
> It will, already backported.

Great - thanks

Rainer

> (but it didn't make it by some minutes into RC2).
>
> Markus

-- 
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, 
UCT), Dipl. Phys. (Germany)

Centre of Excellence for Invasion Biology
Stellenbosch University
South Africa

Tel :   +33 - (0)9 53 10 27 44
Cell:   +33 - (0)6 85 62 59 98
Fax :   +33 - (0)9 58 10 27 44

Fax (D):+49 - (0)3 21 21 25 22 44

email:  rai...@krugs.de

Skype:  RMkrug

PGP: 0x0F52F982


signature.asc
Description: PGP signature
___
grass-dev mailing list
grass-dev@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/grass-dev

Re: [GRASS-dev] [BUG] or at least unclear error message

[Rainer M Krug]

Markus Neteler  writes:

> On Mon, Nov 2, 2015 at 11:50 AM, Rainer M Krug  wrote:
>> Hi
>>
>> OS: OS X, El Capitan, grass installed via homebrew.
>>
>> I have a mega location with 532 read-only mapsets with each around 2500 
>> mapsets
>> (plus PERMANENT and an read-write analysis mapset).
>>
>> When using g.list type=rast mapset=* I get the following error: "Unable
>> to open directory". I guess this is caused by to many open files as I
>> can execute the command g.list type=rast mapset=... for this mapset
>> without problems.
>
> You likely hit the current setting of open files. See e.g. this page
> how to set a higher limit:
>
> https://grass.osgeo.org/grass70/manuals/r.series.html#management-of-open-file-limits

Yes - that solved the issue. But I am wondering, if it really is
necessary to keep all these files open just to list the maps?

Thanks,

Rainer


>
> Please let us know how it goes.
>
> Markus

-- 
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, 
UCT), Dipl. Phys. (Germany)

Centre of Excellence for Invasion Biology
Stellenbosch University
South Africa

Tel :   +33 - (0)9 53 10 27 44
Cell:   +33 - (0)6 85 62 59 98
Fax :   +33 - (0)9 58 10 27 44

Fax (D):+49 - (0)3 21 21 25 22 44

email:  rai...@krugs.de

Skype:  RMkrug

PGP: 0x0F52F982


signature.asc
Description: PGP signature
___
grass-dev mailing list
grass-dev@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/grass-dev

[GRASS-dev] [BUG] or at least unclear error message

[Rainer M Krug]

Hi

OS: OS X, El Capitan, grass installed via homebrew.

I have a mega location with 532 read-only mapsets with each around 2500 mapsets
(plus PERMANENT and an read-write analysis mapset).

When using g.list type=rast mapset=* I get the following error: "Unable
to open directory". I guess this is caused by to many open files as I
can execute the command g.list type=rast mapset=... for this mapset
without problems.

(transcript below)

Is this the case? Could the error message be clarified (I fear not) or a
different approach be used to list the maps?

Thanks,

Rainer
,
| simASM:grassAnalysis> g.list type=rast mapset=*
| ERROR: Unable to open directory
|
/Users/rainerkrug/grassdata/simASM/simASM.CapePeninsula.Past.CapePeninsula_0_1.CapePeninsula.47712.2/cell
| simASM:grassAnalysis> g.list type=rast 
mapset=simASM.CapePeninsula.Past.CapePeninsula_0_1.CapePeninsula.47712.2 | wc -l
| 2615
| simASM:grassAnalysis> g.version -b -r -e --v
| GRASS 7.0.1 (2015)
| 
|  ./configure  --prefix=/usr/local/Cellar/grass-70/7.0.1 --disable-debug 
--disable-dependency-tracking --enable-shared --with-cxx --with-python 
--with-blas --with-lapack --with-sqlite --with-odbc 
--with-geos=/usr/local/opt/geos/bin/geos-config 
--with-proj-share=/usr/local/opt/proj/share/proj --with-png 
--with-readline-includes=/usr/local/opt/readline/include 
--with-readline-libs=/usr/local/opt/readline/lib --with-readline 
--with-nls-includes=/usr/local/opt/gettext/include 
--with-nls-libs=/usr/local/opt/gettext/lib --with-nls --with-freetype 
--without-tcltk --with-includes=/usr/local/opt/gettext/include 
--with-wxwidgets=/usr/local/opt/wxmac/bin/wx-config --enable-64bit 
--with-macos-archs=x86_64 
--with-cairo-includes=/usr/local/opt/cairo/include/cairo 
--with-cairo-libs=/usr/local/opt/cairo/lib --with-cairo --with-postgres 
--with-mysql-includes=/usr/local/opt/mysql/include/mysql 
--with-mysql-libs=/usr/local/opt/mysql/lib --with-mysql 
--with-liblas=/usr/local/opt/liblas/bin/liblas-config
| libgis Revision: 64733 
| libgis Date: 2015-02-25 01:56:29 +0100 (Wed, 25 Feb 2015) 
| PROJ.4: 4.9.1
| GDAL/OGR: 1.11.2
| GEOS: 3.4.2
| SQLite: 3.8.11.1
`

-- 
Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, 
UCT), Dipl. Phys. (Germany)

Centre of Excellence for Invasion Biology
Stellenbosch University
South Africa

Tel :   +33 - (0)9 53 10 27 44
Cell:   +33 - (0)6 85 62 59 98
Fax :   +33 - (0)9 58 10 27 44

Fax (D):+49 - (0)3 21 21 25 22 44

email:  rai...@krugs.de

Skype:  RMkrug

PGP: 0x0F52F982


signature.asc
Description: PGP signature
___
grass-dev mailing list
grass-dev@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/grass-dev

Re: [GRASS-dev] [BUG] or at least unclear error message

[Markus Neteler]

On Mon, Nov 2, 2015 at 11:50 AM, Rainer M Krug  wrote:
> Hi
>
> OS: OS X, El Capitan, grass installed via homebrew.
>
> I have a mega location with 532 read-only mapsets with each around 2500 
> mapsets
> (plus PERMANENT and an read-write analysis mapset).
>
> When using g.list type=rast mapset=* I get the following error: "Unable
> to open directory". I guess this is caused by to many open files as I
> can execute the command g.list type=rast mapset=... for this mapset
> without problems.

You likely hit the current setting of open files. See e.g. this page
how to set a higher limit:

https://grass.osgeo.org/grass70/manuals/r.series.html#management-of-open-file-limits

Please let us know how it goes.

Markus
___
grass-dev mailing list
grass-dev@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/grass-dev