Re: [OSM-dev] osm2pgsql - COPY_END SSL error?

2012-05-29 Thread Sven Geggus
Ákos Maróy a...@maroy.hu wrote:

 the command I used for the import was:
 
 /usr/local/bin/osm2pgsql -d osm -U osm -W -H localhost -S
 /usr/local/share/osm2pgsql/default.style -G -v -m -s -k -K -C 2048
 europe-120525.osm.bz2

On Unix -H localhost does not make sence as does SSL because local access
using unix domain sockets should be much faster and encryption is not needed
on localhost.

Try again with a small OSM file (e.g. downloaded via API) and
without the -H localhost option.

Sven

-- 
Der wichtigste Aspekt, den Sie vor der Entscheidung für ein Open
Source-Betriebssystem bedenken sollten, ist, dass Sie kein
Windows-Betriebssystem erhalten. (von http://www.dell.de/ubuntu)
/me is giggls@ircnet, http://sven.gegg.us/ on the Web

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] osm2pgsql - COPY_END SSL error?

2012-05-29 Thread Ákos Maróy
On 29/05/12 15:06, Sven Geggus wrote:
 On Unix -H localhost does not make sence as does SSL because local access
 using unix domain sockets should be much faster and encryption is not needed
 on localhost.

well, still it does, as access via a network socket is different than
direct local access, at least from an authentication perspective.

but still, it's contradictory that initial access works fine, and then
there is an SSL error at the end?

 Try again with a small OSM file (e.g. downloaded via API) and
 without the -H localhost option.

interestingly, another small file went through fine using the very same
options.

since then I'm importing the same Europe file, but with a defined
bounding box (-b option). now this seems to have went through, but it's
spending over 10 hours now after this step, doing high I/O by posgres:


All indexes on  planet_osm_polygon created  in 577s
Completed planet_osm_polygon
Stopped table: planet_osm_rels in 819s


I wonder what it is doing all this time..


Akos

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] osm2pgsql - COPY_END SSL error?

2012-05-29 Thread Ákos Maróy
On 29/05/12 16:18, sly (sylvain letuffe) wrote:
 I wonder what it is doing all this time..
 
 building indexes mostly

interesting

I chose a bounding box that is only slightly larger than Hungary  - so
that the content doesn't stop at the national border. while importing
hungary.osm.bz2 is very fast (less then an hour), importing this
bounding box via europe.osm.bz2 takes very very long - just this index
building has been going on for over 10 hours now

well, just sharing experiences.


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] osm2pgsql - COPY_END SSL error?

2012-05-29 Thread sly (sylvain letuffe)
 I chose a bounding box that is only slightly larger than Hungary  - so
 that the content doesn't stop at the national border. while importing
 hungary.osm.bz2 is very fast (less then an hour), importing this
 bounding box via europe.osm.bz2 takes very very long

Weird, do you mean your import allready ran for ~30 hours or so ?

My guess would be that your bbox setting wasn't applied at all and what is 
happenning is that you are importing the whole europe.

-- 
sly
qui suis-je : http://sly.letuffe.org
email perso : sylvain chez letuffe un point org

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] osm2pgsql - COPY_END SSL error?

2012-05-29 Thread Ákos Maróy
On 29/05/12 16:36, sly (sylvain letuffe) wrote:
 I chose a bounding box that is only slightly larger than Hungary  - so
 that the content doesn't stop at the national border. while importing
 hungary.osm.bz2 is very fast (less then an hour), importing this
 bounding box via europe.osm.bz2 takes very very long
 
 Weird, do you mean your import allready ran for ~30 hours or so ?
 
 My guess would be that your bbox setting wasn't applied at all and what is 
 happenning is that you are importing the whole europe.

oh, that sounds nice...

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[OSM-dev] osm2pgsql - COPY_END SSL error?

2012-05-27 Thread Ákos Maróy
Hi,

I was about to import the European part of the OSM planet file into a
PostGIS database, and after about 3 days of processing I ended up with
the following error:

COPY_END for planet_osm_point failed: SSL error: sslv3 alert unexpected
message

Error occurred, cleaning up


and an empty database :(

what could have I done wrong?


I'm using a osm2pgsql compiled from the current subversion source, svn
revision 28407:

$ osm2pgsql --version
osm2pgsql SVN version 0.80.0 (32bit id space)


I started to import the europe.osm.bz2 file I just downloaded into an
empty PostGIS 1.5 (PostgreSQL 9.1) database on Ubuntu 12.04 64 bit. the
command I used for the import was:

/usr/local/bin/osm2pgsql -d osm -U osm -W -H localhost -S
/usr/local/share/osm2pgsql/default.style -G -v -m -s -k -K -C 2048
europe-120525.osm.bz2

please fine the complete console log at the end of this e-mail.

I wonder what should be done for the import to complete successfully.


Akos

PS: the complete console log:

$ /usr/local/bin/osm2pgsql -d osm -U osm -W -H localhost -S
/usr/local/share/osm2pgsql/default.style -G -v -m -s -k -K -C 2048
europe-120525.osm.bz2
osm2pgsql SVN version 0.80.0 (32bit id space)

Password:
Using projection SRS 900913 (Spherical Mercator)
Setting up table: planet_osm_point
NOTICE:  table planet_osm_point does not exist, skipping
NOTICE:  table planet_osm_point_tmp does not exist, skipping
Setting up table: planet_osm_line
NOTICE:  table planet_osm_line does not exist, skipping
NOTICE:  table planet_osm_line_tmp does not exist, skipping
Setting up table: planet_osm_polygon
NOTICE:  table planet_osm_polygon does not exist, skipping
NOTICE:  table planet_osm_polygon_tmp does not exist, skipping
Setting up table: planet_osm_roads
NOTICE:  table planet_osm_roads does not exist, skipping
NOTICE:  table planet_osm_roads_tmp does not exist, skipping
Allocating memory for dense node cache
Allocating dense node cache in one big chunk
Allocating memory for sparse node cache
Sharing dense sparse
Node-cache: cache=2048MB, maxblocks=262145*8192, allocation method=11
Mid: pgsql, scale=100 cache=2048
Setting up table: planet_osm_nodes
NOTICE:  table planet_osm_nodes does not exist, skipping
NOTICE:  CREATE TABLE / PRIMARY KEY will create implicit index
planet_osm_nodes_pkey for table planet_osm_nodes
Setting up table: planet_osm_ways
NOTICE:  table planet_osm_ways does not exist, skipping
NOTICE:  CREATE TABLE / PRIMARY KEY will create implicit index
planet_osm_ways_pkey for table planet_osm_ways
Setting up table: planet_osm_rels
NOTICE:  table planet_osm_rels does not exist, skipping
NOTICE:  CREATE TABLE / PRIMARY KEY will create implicit index
planet_osm_rels_pkey for table planet_osm_rels

Reading in file: europe-120525.osm.bz2
Processing: Node(683806k 116.6k/s) Way(19035k 0.34k/s) Relation(0 0.00/s)


Processing: Node(683806k 116.6k/s) Way(82544k 0.71k/s) Relation(434180
10.00/s)
Standard exception processing way_id 1082366: TopologyException: side
location conflict at 822832 8.30585e+06
Processing: Node(683806k 116.6k/s) Way(82544k 0.71k/s) Relation(812580
10.64/s)
Standard exception processing way_id 1792031: TopologyException: side
location conflict at -734926 5.24355e+06
Processing: Node(683806k 116.6k/s) Way(82544k 0.71k/s) Relation(851720
10.70/s)
Standard exception processing way_id 1868906: TopologyException: side
location conflict at 1.22428e+06 5.69149e+06
Processing: Node(683806k 116.6k/s) Way(82544k 0.71k/s) Relation(977178
10.83/s)  parse time: 212482s

Node stats: total(683806262), max(174322) in 5864s
Way stats: total(82544343), max(157747584) in 116394s
Relation stats: total(977178), max(2109249) in 90224s
COPY_END for planet_osm_point failed: SSL error: sslv3 alert unexpected
message

Error occurred, cleaning up

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev