[
https://issues.apache.org/jira/browse/IGNITE-13344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexey Zinoviev updated IGNITE-13344:
-------------------------------------
Fix Version/s: 2.10
> [ML] DummyVectorizer fails to extract label for coordinate with value "0.0"
> when backed by sparse vector
> --------------------------------------------------------------------------------------------------------
>
> Key: IGNITE-13344
> URL: https://issues.apache.org/jira/browse/IGNITE-13344
> Project: Ignite
> Issue Type: Bug
> Components: ml
> Affects Versions: 2.8.1
> Reporter: Thilo-Alexander Ginkel
> Assignee: Alexey Zinoviev
> Priority: Minor
> Fix For: 2.10
>
>
> Given: A labeled DummyVectorizer:
>
> {code:java}
> new DummyVectorizer<String>()
> .exclude(excludeCoordinates.stream().map(coord -> vectorLength +
> coord).toArray(Integer[]::new))
> .labeled(labelCoord);
> {code}
> {{When extracting the label, the call hierarchy eventually ends up at
> org.apache.ignite.ml.dataset.feature.extractor.impl.DummyVectorizer#feature,
> which returns null for val.getRaw when val is a sparse vector with the
> element at the requested label coordinate being 0.0. This causes the training
> job to fail (which expects a non-null label):}}
> {code:java}
> org.apache.ignite.IgniteException: Remote job threw user exception (override
> or implement ComputeTask.result(..) method if you would like to have
> automatic failover for this exception):
> nullorg.apache.ignite.IgniteException: Remote job threw user exception
> (override or implement ComputeTask.result(..) method if you would like to
> have automatic failover for this exception): null at
> org.apache.ignite.compute.ComputeTaskAdapter.result(ComputeTaskAdapter.java:102)
> ~[ignite-core-2.8.1.jar:2.8.1] at
> org.apache.ignite.internal.processors.task.GridTaskWorker$5.apply(GridTaskWorker.java:1062)
> ~[ignite-core-2.8.1.jar:2.8.1] at
> org.apache.ignite.internal.processors.task.GridTaskWorker$5.apply(GridTaskWorker.java:1055)
> ~[ignite-core-2.8.1.jar:2.8.1] at
> org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:7037)
> ~[ignite-core-2.8.1.jar:2.8.1] at
> org.apache.ignite.internal.processors.task.GridTaskWorker.result(GridTaskWorker.java:1055)
> ~[ignite-core-2.8.1.jar:2.8.1] at
> org.apache.ignite.internal.processors.task.GridTaskWorker.onResponse(GridTaskWorker.java:862)
> ~[ignite-core-2.8.1.jar:2.8.1] at
> org.apache.ignite.internal.processors.task.GridTaskProcessor.processJobExecuteResponse(GridTaskProcessor.java:1146)
> ~[ignite-core-2.8.1.jar:2.8.1] at
> org.apache.ignite.internal.processors.job.GridJobWorker.finishJob(GridJobWorker.java:961)
> ~[ignite-core-2.8.1.jar:2.8.1] at
> org.apache.ignite.internal.processors.job.GridJobWorker.finishJob(GridJobWorker.java:809)
> ~[ignite-core-2.8.1.jar:2.8.1] at
> org.apache.ignite.internal.processors.job.GridJobWorker.execute0(GridJobWorker.java:659)
> ~[ignite-core-2.8.1.jar:2.8.1] at
> org.apache.ignite.internal.processors.job.GridJobWorker.body(GridJobWorker.java:519)
> ~[ignite-core-2.8.1.jar:2.8.1] at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120)
> ~[ignite-core-2.8.1.jar:2.8.1] at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
> ~[na:na] at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
> ~[na:na] at java.base/java.lang.Thread.run(Thread.java:832) ~[na:na]Caused
> by: org.apache.ignite.IgniteException: null at
> org.apache.ignite.internal.processors.closure.GridClosureProcessor$C2.execute(GridClosureProcessor.java:1858)
> ~[ignite-core-2.8.1.jar:2.8.1] at
> org.apache.ignite.internal.processors.job.GridJobWorker$2.call(GridJobWorker.java:596)
> ~[ignite-core-2.8.1.jar:2.8.1] at
> org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:7005)
> ~[ignite-core-2.8.1.jar:2.8.1] at
> org.apache.ignite.internal.processors.job.GridJobWorker.execute0(GridJobWorker.java:590)
> ~[ignite-core-2.8.1.jar:2.8.1] ... 5 common frames omittedCaused by:
> java.lang.NullPointerException: null at
> org.apache.ignite.ml.dataset.impl.bootstrapping.BootstrappedDatasetBuilder.build(BootstrappedDatasetBuilder.java:91)
> ~[ignite-ml-2.8.1.jar:2.8.1] at
> org.apache.ignite.ml.dataset.impl.bootstrapping.BootstrappedDatasetBuilder.build(BootstrappedDatasetBuilder.java:41)
> ~[ignite-ml-2.8.1.jar:2.8.1] at
> org.apache.ignite.ml.dataset.impl.cache.util.ComputeUtils.lambda$getData$4(ComputeUtils.java:239)
> ~[ignite-ml-2.8.1.jar:2.8.1] at
> org.apache.ignite.ml.dataset.impl.cache.util.PartitionDataStorage.lambda$computeDataIfAbsent$1(PartitionDataStorage.java:56)
> ~[ignite-ml-2.8.1.jar:2.8.1] at
> java.base/java.util.concurrent.ConcurrentHashMap.computeIfAbsent(ConcurrentHashMap.java:1708)
> ~[na:na] at
> org.apache.ignite.ml.dataset.impl.cache.util.PartitionDataStorage.computeDataIfAbsent(PartitionDataStorage.java:56)
> ~[ignite-ml-2.8.1.jar:2.8.1] at
> org.apache.ignite.ml.dataset.impl.cache.util.ComputeUtils.getData(ComputeUtils.java:209)
> ~[ignite-ml-2.8.1.jar:2.8.1] at
> org.apache.ignite.ml.dataset.impl.cache.CacheBasedDataset.lambda$compute$c7cefc59$1(CacheBasedDataset.java:172)
> ~[ignite-ml-2.8.1.jar:2.8.1] at
> org.apache.ignite.ml.dataset.impl.cache.util.ComputeUtils$DeployableCallable.call(ComputeUtils.java:432)
> ~[ignite-ml-2.8.1.jar:2.8.1] at
> org.apache.ignite.internal.processors.closure.GridClosureProcessor$C2.execute(GridClosureProcessor.java:1855)
> ~[ignite-core-2.8.1.jar:2.8.1] ... 8 common frames omitted{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
