Hello,
while trying to integrate various processing steps into a rather complex
pipeline I have run into troubles. Each step alone seems to work, even
more complex arrangements, but not all of them. (Go to bottom of message
(3) to see an working example with multiple invocations of osmosis.)
The osmosis commands below (1) stop at "FINE: Waiting for task
1-read-xml to complete.", probably forever. CPU utilization goes up
first and then slowly down to zero, fstat does not show any read
activity on the input file (anymore).
I have tried to pin down at what point the processing hangs; everything
before "--derive-change" works, tested with "--write-null[-change]".
The questions are:
1) Am I getting something fundamentally wrong about the way osmosis
pipes work?
2) Is there any obvious mistake in my parameters?
3) Have I hit a bug?
(BTW, basicly I am after simplifying ways; but --simplify-ways leaves
(now) unused nodes behind; getting rid of them by means of --used-node
removes poi-type nodes as well (not used in ways and relations).
Therefore I have to go the long way of diffing before- and after
--used-node, parse that for "used" (i.e., poi-type) nodes and merge.)
Thanks in advance for any pointers!
Marcus
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
(1) the command:
osmosis \
-verbose 5 \
--read-xml file="${_src}" outPipe.0=source \
--sort inPipe.0=source outPipe.0=sourcesort \
--simplify-ways epsilonMeters="${_err}" inPipe.0=sourcesort outPipe.0=norm \
--sort inPipe.0=norm outPipe.0=normsort \
--tee inPipe.0=normsort outPipe.0=fullnorm outPipe.1=tousedonly \
--used-node inPipe.0=tousedonly outPipe.0=usedonly \
--sort inPipe.0=usedonly outPipe.0=usedonlysort \
--tee inPipe.0=usedonlysort outPipe.0=usedonlymerge outPipe.1=usedonlydiff \
--derive-change inPipe.0=fullnorm inPipe.1=usedonlydiff outPipe.0=diff \
--sort-change inPipe.0=diff outPipe.0=diffsort \
--read-empty outPipe.0=empty \
--apply-change inPipe.0=empty inPipe.1=diffsort outPipe.0=diffosm \
--tag-transform file="${HOME}/.nonemptynodes.xml" inPipe.0=diffosm
outPipe.0=tt \
--node-key keyList="is_poi" inPipe.0=tt outPipe.0=pois \
--merge inPipe.0=usedonlymerge inPipe.1=pois outPipe.0=merged \
--write-xml inPipe.0=merged file="${_tgt}"
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
(2) the output
Dez 06, 2011 2:48:46 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Osmosis Version 0.40
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar
loadBuiltInPlugins
FINER: Loading plugin configuration file from url
jar:file:/home/asfer/bin/osmosis-0.40/lib/default/osmosis-apidb-0.40.jar!/osmosis-plugins.conf.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar
loadBuiltInPlugins
FINER: Loading plugin via loader
org.openstreetmap.osmosis.apidb.ApidbPluginLoader.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar
loadBuiltInPlugins
FINER: Loading plugin configuration file from url
jar:file:/home/asfer/bin/osmosis-0.40/lib/default/osmosis-areafilter-0.40.jar!/osmosis-plugins.conf.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar
loadBuiltInPlugins
FINER: Loading plugin via loader
org.openstreetmap.osmosis.areafilter.AreaFilterPluginLoader.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar
loadBuiltInPlugins
FINER: Loading plugin configuration file from url
jar:file:/home/asfer/bin/osmosis-0.40/lib/default/osmosis-core-0.40.jar!/osmosis-plugins.conf.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar
loadBuiltInPlugins
FINER: Loading plugin via loader
org.openstreetmap.osmosis.core.CorePluginLoader.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar
loadBuiltInPlugins
FINER: Loading plugin configuration file from url
jar:file:/home/asfer/bin/osmosis-0.40/lib/default/osmosis-dataset-0.40.jar!/osmosis-plugins.conf.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar
loadBuiltInPlugins
FINER: Loading plugin via loader
org.openstreetmap.osmosis.dataset.DatasetPluginLoader.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar
loadBuiltInPlugins
FINER: Loading plugin configuration file from url
jar:file:/home/asfer/bin/osmosis-0.40/lib/default/osmosis-pbf-0.40.jar!/osmosis-plugins.conf.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar
loadBuiltInPlugins
FINER: Loading plugin via loader crosby.binary.osmosis.BinaryPluginLoader.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar
loadBuiltInPlugins
FINER: Loading plugin configuration file from url
jar:file:/home/asfer/bin/osmosis-0.40/lib/default/osmosis-pgsimple-0.40.jar!/osmosis-plugins.conf.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar
loadBuiltInPlugins
FINER: Loading plugin via loader
org.openstreetmap.osmosis.pgsimple.PgSimplePluginLoader.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar
loadBuiltInPlugins
FINER: Loading plugin configuration file from url
jar:file:/home/asfer/bin/osmosis-0.40/lib/default/osmosis-pgsnapshot-0.40.jar!/osmosis-plugins.conf.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar
loadBuiltInPlugins
FINER: Loading plugin via loader
org.openstreetmap.osmosis.pgsnapshot.PgSnapshotPluginLoader.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar
loadBuiltInPlugins
FINER: Loading plugin configuration file from url
jar:file:/home/asfer/bin/osmosis-0.40/lib/default/osmosis-replication-0.40.jar!/osmosis-plugins.conf.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar
loadBuiltInPlugins
FINER: Loading plugin via loader
org.openstreetmap.osmosis.replication.ReplicationPluginLoader.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar
loadBuiltInPlugins
FINER: Loading plugin configuration file from url
jar:file:/home/asfer/bin/osmosis-0.40/lib/default/osmosis-set-0.40.jar!/osmosis-plugins.conf.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar
loadBuiltInPlugins
FINER: Loading plugin via loader org.openstreetmap.osmosis.set.SetPluginLoader.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar
loadBuiltInPlugins
FINER: Loading plugin configuration file from url
jar:file:/home/asfer/bin/osmosis-0.40/lib/default/osmosis-tagfilter-0.40.jar!/osmosis-plugins.conf.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar
loadBuiltInPlugins
FINER: Loading plugin via loader
org.openstreetmap.osmosis.tagfilter.TagFilterPluginLoader.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar
loadBuiltInPlugins
FINER: Loading plugin configuration file from url
jar:file:/home/asfer/bin/osmosis-0.40/lib/default/osmosis-xml-0.40.jar!/osmosis-plugins.conf.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar
loadBuiltInPlugins
FINER: Loading plugin via loader org.openstreetmap.osmosis.xml.XmlPluginLoader.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar
loadBuiltInPlugins
FINER: Loading plugin configuration file from url
jar:file:/home/asfer/bin/osmosis-0.40/lib/default/osmosis-simplifyways-v0.39.1.jar!/osmosis-plugins.conf.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar
loadBuiltInPlugins
FINER: Loading plugin via loader
de.vwistuttgart.openstreetmap.osmosis.simplifyways.SimplifyWaysPluginLoader.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar
loadBuiltInPlugins
FINER: Loading plugin configuration file from url
jar:file:/home/asfer/bin/osmosis-0.40/lib/default/tagtransform.jar!/osmosis-plugins.conf.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar
loadBuiltInPlugins
FINER: Loading plugin via loader
uk.co.randomjunk.osmosis.transform.TransformPlugin.
Dez 06, 2011 2:48:47 PM org.java.plugin.ObjectFactory loadProperties
FINE: no jpf.properties file found in ${java.home}/lib
(/usr/local/jdk-1.7.0/jre/lib/jpf.properties) nor in CLASSPATH, using standard
properties
Dez 06, 2011 2:48:47 PM org.java.plugin.ObjectFactory loadProperties
FINE: loaded jpf.properties from
jar:file:/home/asfer/bin/osmosis-0.40/lib/default/jpf-1.5.jar!/org/java/plugin/standard/jpf.properties
Dez 06, 2011 2:48:47 PM org.java.plugin.ObjectFactory findProperty
FINE: property org.java.plugin.ObjectFactory found in properties file
Dez 06, 2011 2:48:47 PM org.java.plugin.ObjectFactory newInstance
FINE: object factory instance created -
org.java.plugin.standard.StandardObjectFactory@1a1ed04
Dez 06, 2011 2:48:47 PM org.java.plugin.standard.StandardObjectFactory
getImplClassName
FINE: implementation class for org.java.plugin.registry.PluginRegistry is
org.java.plugin.registry.xml.PluginRegistryImpl
Dez 06, 2011 2:48:47 PM org.java.plugin.registry.xml.ManifestParser <init>
INFO: got SAX parser factory -
org.apache.xerces.jaxp.SAXParserFactoryImpl@177ee02
Dez 06, 2011 2:48:47 PM org.java.plugin.registry.xml.PluginRegistryImpl
configure
INFO: configured, stopOnError=false, isValidating=true
Dez 06, 2011 2:48:47 PM org.java.plugin.standard.StandardObjectFactory
createRegistry
FINE: registry instance created -
org.java.plugin.registry.xml.PluginRegistryImpl@aaf438
Dez 06, 2011 2:48:47 PM org.java.plugin.standard.StandardObjectFactory
getImplClassName
FINE: implementation class for org.java.plugin.PathResolver is
org.java.plugin.standard.StandardPathResolver
Dez 06, 2011 2:48:47 PM org.java.plugin.standard.StandardObjectFactory
createPathResolver
FINE: path resolver instance created -
org.java.plugin.standard.StandardPathResolver@203a16
Dez 06, 2011 2:48:47 PM org.java.plugin.standard.StandardObjectFactory
getImplClassName
FINE: implementation class for org.java.plugin.standard.PluginLifecycleHandler
is org.java.plugin.standard.StandardPluginLifecycleHandler
Dez 06, 2011 2:48:47 PM org.java.plugin.standard.StandardPluginLifecycleHandler
configure
FINE: probeParentLoaderLast parameter value is false
Dez 06, 2011 2:48:47 PM org.java.plugin.standard.StandardObjectFactory
createLifecycleHandler
FINE: life cycle handler instance created -
org.java.plugin.standard.StandardPluginLifecycleHandler@1b47cc2
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar
loadJPFPlugins
FINE: Searching for JPF plugins.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar
gatherJpfPlugins
FINER: Loading plugins in /home/asfer/Daten/GIS/test/plugins
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar
gatherJpfPlugins
FINER: Loading plugins in /home/asfer/.openstreetmap/osmosis/plugins
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar
gatherJpfPlugins
FINER: Loading plugins in
/home/asfer/Daten/GIS/test/null/openstreetmap/osmosis/plugins
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar
loadJPFPlugins
FINE: Registering the core plugin.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar
registerCorePlugin
FINEST: Plugin URL:
jar:file:/home/asfer/bin/osmosis-0.40/lib/default/osmosis-core-0.40.jar!/org/openstreetmap/osmosis/core/plugin/plugin.xml
Dez 06, 2011 2:48:48 PM org.java.plugin.registry.xml.ManifestParser$1
resolveEntity
FINE: entity resolved to plug-in manifest DTD, publicId=-//JPF//Java Plug-in
Manifest 1.0, systemId=http://jpf.sourceforge.net/plugin_1_0.dtd
Dez 06, 2011 2:48:48 PM org.java.plugin.registry.xml.ManifestHandler
startElement
FINE: startElement - []/[]/[plugin]
Dez 06, 2011 2:48:48 PM org.java.plugin.registry.xml.ManifestHandler
startElement
FINE: startElement - []/[]/[extension-point]
Dez 06, 2011 2:48:48 PM org.java.plugin.registry.xml.ManifestHandler
startElement
FINE: startElement - []/[]/[parameter-def]
Dez 06, 2011 2:48:48 PM org.java.plugin.registry.xml.ManifestHandler endElement
FINE: endElement - []/[]/[parameter-def]
Dez 06, 2011 2:48:48 PM org.java.plugin.registry.xml.ManifestHandler
startElement
FINE: startElement - []/[]/[parameter-def]
Dez 06, 2011 2:48:48 PM org.java.plugin.registry.xml.ManifestHandler endElement
FINE: endElement - []/[]/[parameter-def]
Dez 06, 2011 2:48:48 PM org.java.plugin.registry.xml.ManifestHandler endElement
FINE: endElement - []/[]/[extension-point]
Dez 06, 2011 2:48:48 PM org.java.plugin.registry.xml.ManifestHandler endElement
FINE: endElement - []/[]/[plugin]
Dez 06, 2011 2:48:48 PM org.java.plugin.registry.xml.PluginRegistryImpl register
FINE: manifest files parsed, plugins.size=1, fragments.size=0
Dez 06, 2011 2:48:48 PM org.java.plugin.registry.xml.PluginRegistryImpl register
FINE: plug-ins versions checked, plugins.size=1
Dez 06, 2011 2:48:48 PM org.java.plugin.registry.xml.PluginRegistryImpl register
FINE: plug-in fragments versions checked, fragments.size=0
Dez 06, 2011 2:48:48 PM org.java.plugin.registry.xml.PluginRegistryImpl
registerPlugin
FINE: registering plug-in, URL -
jar:file:/home/asfer/bin/osmosis-0.40/lib/default/osmosis-core-0.40.jar!/org/openstreetmap/osmosis/core/plugin/plugin.xml
Dez 06, 2011 2:48:48 PM
org.java.plugin.registry.xml.ExtensionPointImpl$ParameterDefinitionImpl <init>
FINE: object instantiated: {PluginExtensionPoint.ParameterDefinition:
extPointUid=org.openstreetmap.osmosis.core.plugin.Core@Task; id=class}
Dez 06, 2011 2:48:49 PM
org.java.plugin.registry.xml.ExtensionPointImpl$ParameterDefinitionImpl <init>
FINE: object instantiated: {PluginExtensionPoint.ParameterDefinition:
extPointUid=org.openstreetmap.osmosis.core.plugin.Core@Task; id=name}
Dez 06, 2011 2:48:49 PM org.java.plugin.registry.xml.ExtensionPointImpl <init>
FINE: object instantiated: {ExtensionPoint:
uid=org.openstreetmap.osmosis.core.plugin.Core@Task}
Dez 06, 2011 2:48:49 PM org.java.plugin.registry.xml.PluginDescriptorImpl <init>
FINE: object instantiated: {PluginDescriptor:
[email protected]}
Dez 06, 2011 2:48:49 PM org.java.plugin.registry.xml.PluginRegistryImpl register
INFO: plug-in and fragment descriptors registered - 1
Dez 06, 2011 2:48:49 PM org.java.plugin.registry.xml.PluginRegistryImpl dump
FINE: PLUG-IN REGISTRY DUMP:
-------------- DUMP BEGIN -----------------
Plug-ins: 1
{PluginDescriptor:
[email protected]}
Fragments: 0
Memory TOTAL/FREE/MAX: 16252928/12468600/259522560
-------------- DUMP END -----------------
Dez 06, 2011 2:48:49 PM
org.java.plugin.registry.xml.PluginRegistryImpl$RegistryChangeDataImpl dump
FINE: PLUG-IN REGISTRY CHANGES DUMP:
-------------- DUMP BEGIN -----------------
Added plug-ins: 1
org.openstreetmap.osmosis.core.plugin.Core
Removed plug-ins: 0
Modified plug-ins: 0
Added extensions: 0
Removed extensions: 0
Modified extensions: 0
Memory TOTAL/FREE/MAX: 16252928/12468600/259522560
-------------- DUMP END -----------------
Dez 06, 2011 2:48:49 PM org.java.plugin.registry.xml.PluginRegistryImpl
fireEvent
FINE: propagating registry change event
Dez 06, 2011 2:48:49 PM org.java.plugin.registry.xml.PluginRegistryImpl
fireEvent
FINE: registry change event propagated
Dez 06, 2011 2:48:49 PM org.java.plugin.standard.StandardPluginClassLoader
getUrls
FINE: Code URL's populated for plug-in {PluginDescriptor:
[email protected]}:
Dez 06, 2011 2:48:49 PM
org.java.plugin.standard.StandardPluginClassLoader$PluginResourceLoader get
FINEST: Resource URL's populated for plug-in {PluginDescriptor:
[email protected]}:
Dez 06, 2011 2:48:49 PM org.java.plugin.standard.StandardPluginManager
activatePlugin
INFO: plug-in started - [email protected]
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.TaskRegistrar
loadJPFPlugins
FINE: Registering the extension plugins.
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Preparing pipeline.
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline
prepare
FINE: Building tasks.
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline
buildTasks
FINE: Created task "1-read-xml"
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline
buildTasks
FINE: Created task "2-sort"
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline
buildTasks
FINE: Created task "3-simplify-ways"
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline
buildTasks
FINE: Created task "4-sort"
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline
buildTasks
FINE: Created task "5-tee"
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline
buildTasks
FINE: Created task "6-used-node"
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline
buildTasks
FINE: Created task "7-sort"
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline
buildTasks
FINE: Created task "8-tee"
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline
buildTasks
FINE: Created task "9-derive-change"
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline
buildTasks
FINE: Created task "10-sort-change"
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline
buildTasks
FINE: Created task "11-read-empty"
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline
buildTasks
FINE: Created task "12-apply-change"
Dez 06, 2011 2:48:49 PM uk.co.randomjunk.osmosis.transform.impl.TransformHelper
<init>
FINE: Transform configured with /home/asfer/.nonemptynodes.xml and null
Dez 06, 2011 2:48:49 PM uk.co.randomjunk.osmosis.transform.impl.TransformLoader
parseTranslation
INFO: New translation: remove empty nodes
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline
buildTasks
FINE: Created task "13-tag-transform"
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline
buildTasks
FINE: Created task "14-node-key"
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline
buildTasks
FINE: Created task "15-merge"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline
buildTasks
FINE: Created task "16-write-xml"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline
prepare
FINE: Connecting tasks.
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "1-read-xml" produced pipe "source"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline
connectTasks
FINE: Connected task "1-read-xml"
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "2-sort" consumed pipe "source"
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "2-sort" produced pipe "sourcesort"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline
connectTasks
FINE: Connected task "2-sort"
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "3-simplify-ways" consumed pipe "sourcesort"
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "3-simplify-ways" produced pipe "norm"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline
connectTasks
FINE: Connected task "3-simplify-ways"
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "4-sort" consumed pipe "norm"
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "4-sort" produced pipe "normsort"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline
connectTasks
FINE: Connected task "4-sort"
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "5-tee" consumed pipe "normsort"
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "5-tee" produced pipe "fullnorm"
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "5-tee" produced pipe "tousedonly"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline
connectTasks
FINE: Connected task "5-tee"
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "6-used-node" consumed pipe "tousedonly"
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "6-used-node" produced pipe "usedonly"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline
connectTasks
FINE: Connected task "6-used-node"
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "7-sort" consumed pipe "usedonly"
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "7-sort" produced pipe "usedonlysort"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline
connectTasks
FINE: Connected task "7-sort"
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "8-tee" consumed pipe "usedonlysort"
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "8-tee" produced pipe "usedonlymerge"
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "8-tee" produced pipe "usedonlydiff"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline
connectTasks
FINE: Connected task "8-tee"
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "9-derive-change" consumed pipe "fullnorm"
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "9-derive-change" consumed pipe "usedonlydiff"
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "9-derive-change" produced pipe "diff"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline
connectTasks
FINE: Connected task "9-derive-change"
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "10-sort-change" consumed pipe "diff"
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "10-sort-change" produced pipe "diffsort"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline
connectTasks
FINE: Connected task "10-sort-change"
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "11-read-empty" produced pipe "empty"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline
connectTasks
FINE: Connected task "11-read-empty"
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "12-apply-change" consumed pipe "empty"
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "12-apply-change" consumed pipe "diffsort"
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "12-apply-change" produced pipe "diffosm"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline
connectTasks
FINE: Connected task "12-apply-change"
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "13-tag-transform" consumed pipe "diffosm"
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "13-tag-transform" produced pipe "tt"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline
connectTasks
FINE: Connected task "13-tag-transform"
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "14-node-key" consumed pipe "tt"
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "14-node-key" produced pipe "pois"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline
connectTasks
FINE: Connected task "14-node-key"
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "15-merge" consumed pipe "usedonlymerge"
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "15-merge" consumed pipe "pois"
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "15-merge" produced pipe "merged"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline
connectTasks
FINE: Connected task "15-merge"
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "16-write-xml" consumed pipe "merged"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline
connectTasks
FINE: Connected task "16-write-xml"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Launching pipeline execution.
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager execute
FINE: Launching task 1-read-xml in a new thread.
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PassiveTaskManager execute
FINE: Task 2-sort is passive, no execution required.
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PassiveTaskManager execute
FINE: Task 3-simplify-ways is passive, no execution required.
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PassiveTaskManager execute
FINE: Task 4-sort is passive, no execution required.
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PassiveTaskManager execute
FINE: Task 5-tee is passive, no execution required.
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PassiveTaskManager execute
FINE: Task 6-used-node is passive, no execution required.
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PassiveTaskManager execute
FINE: Task 7-sort is passive, no execution required.
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PassiveTaskManager execute
FINE: Task 8-tee is passive, no execution required.
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager execute
FINE: Launching task 9-derive-change in a new thread.
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PassiveTaskManager execute
FINE: Task 10-sort-change is passive, no execution required.
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager execute
FINE: Launching task 11-read-empty in a new thread.
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager execute
FINE: Launching task 12-apply-change in a new thread.
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PassiveTaskManager execute
FINE: Task 13-tag-transform is passive, no execution required.
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PassiveTaskManager execute
FINE: Task 14-node-key is passive, no execution required.
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager execute
FINE: Launching task 15-merge in a new thread.
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.PassiveTaskManager execute
FINE: Task 16-write-xml is passive, no execution required.
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Pipeline executing, waiting for completion.
Dez 06, 2011 2:48:50 PM
org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager
waitForCompletion
FINE: Waiting for task 1-read-xml to complete.
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
(3) a working example
_td=$(mktemp -t -d osmnorm-XXXXXX)
_fnnorm="${_td}/norm.osm"
_fnused="${_td}/used.osm"
_fnpois="${_td}/pois.osm"
_fndiff="${_td}/diff.osm"
print simplify-ways
osmosis \
-verbose 0 \
--read-xml file="${_src}" outPipe.0=source \
--sort inPipe.0=source outPipe.0=sourcesort \
--simplify-ways epsilonMeters="${_err}" inPipe.0=sourcesort outPipe.0=norm \
--sort inPipe.0=norm outPipe.0=normsort \
--write-xml inPipe.0=normsort file="${_fnnorm}"
print used-node
osmosis \
-verbose 0 \
--read-xml file="${_fnnorm}" outPipe.0=norm \
--used-node inPipe.0=norm outPipe.0=usedonly \
--sort inPipe.0=usedonly outPipe.0=usedonlysort \
--write-xml inPipe.0=usedonlysort file="${_fnused}"
print derive-change
osmosis \
-verbose 0 \
--read-xml file="${_fnnorm}" outPipe.0=norm \
--read-xml file="${_fnused}" outPipe.0=used \
--derive-change inPipe.0=used inPipe.1=norm outPipe.0=diff \
--sort-change inPipe.0=diff outPipe.0=diffsort \
--read-empty outPipe.0=empty \
--apply-change inPipe.0=empty inPipe.1=diffsort outPipe.0=diffosm \
--write-xml inPipe.0=diffosm file="${_fndiff}"
print tag-transform, node-key
osmosis \
-verbose 0 \
--read-xml file="${_fndiff}" outPipe.0=diffosm \
--tag-transform file="${HOME}/.nonemptynodes.xml" inPipe.0=diffosm
outPipe.0=tt \
--node-key keyList="is_poi" inPipe.0=tt outPipe.0=pois \
--write-xml inPipe.0=pois file="${_fnpois}"
print merge
osmosis \
-verbose 0 \
--read-xml file="${_fnused}" outPipe.0=used \
--read-xml file="${_fnpois}" outPipe.0=pois \
--merge inPipe.0=used inPipe.1=pois outPipe.0=merged \
--write-xml inPipe.0=merged file="${_tgt}"
rm -rf "${_td}"
_______________________________________________
osmosis-dev mailing list
[email protected]
http://lists.openstreetmap.org/listinfo/osmosis-dev
