Hi Nicolas,
I did the fllowing tests so far:
1) Dataset with 1309000 instances, 30 attributes and
"classifiers.ensemble.Bagging -s 2"
command:
bin/samoa storm target/SAMOA-Storm-0.4.0-incubating-SNAPSHOT.jar
"PrequentialEvaluation -i -1 -f 1000 -d /tmp/cenario10-2classes-
ordenado-trat_entdv-sem-label-puro.csv -l (classifiers.ensemble.Bagging -s
2) -s (org.apache.samoa.streams.ArffFileStream -s HDFSFileStreamSource -f
/cenario10-2classes-ordenado-trat_entdv-sem-label-puro.csv.arff)"
status before classification:
Tasks: 139 total, 1 running, 138 sleeping, 0 stopped, 0 zombie
%Cpu(s): 0.5 us, 0.1 sy, 0.0 ni, 99.4 id, 0.0 wa, 0.0 hi, 0.0 si,
0.0 st
KiB Mem: 30951404 total, 2327304 used, 28624100 free, 90060 buffers
KiB Swap: 901116 total, 0 used, 901116 free, 1211872 cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
3947 root 20 0 2770m 236m 18m S 1.0 0.8 0:16.06 java
2852 root 20 0 199m 41m 6848 S 0.3 0.1 0:05.99 Xorg
3792 root 20 0 2569m 202m 18m S 0.3 0.7 0:04.81 java
1 root 20 0 10648 824 688 S 0.0 0.0 0:00.72 init
status during classification (success):
Tasks: 142 total, 1 running, 141 sleeping, 0 stopped, 0 zombie
%Cpu(s): 75.1 us, 23.4 sy, 0.0 ni, 1.3 id, 0.0 wa, 0.0 hi, 0.3 si,
0.0 st
KiB Mem: 30951404 total, 10100004 used, 20851400 free, 90768 buffers
KiB Swap: 901116 total, 0 used, 901116 free, 1873500 cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
4713 root 20 0 9467m 6.7g 15m S 391.1 22.8 4:14.95 java
3462 root 20 0 305m 18m 11m S 1.3 0.1 0:04.70
gnome-terminal
3947 root 20 0 2770m 236m 18m S 1.3 0.8 0:18.42 java
19 root 20 0 0 0 0 S 0.3 0.0 0:00.11 ksoftirqd/3
output:
1309000.0,1309000.0,93.50015278838808,0.0,-249.044141778799
196069 [Thread-12-org.apache.samoa.evaluation.EvaluatorProcessor_1] INFO
org.apache.samoa.evaluation.EvaluatorProcessor - total evaluation time:
145 seconds for 1309791 instances
230680 [main] INFO backtype.storm.daemon.nimbus - Delaying event :remove
for 30 secs for Prequential_20160913213245-1-1473813184
2) Dataset with 107000 instances, 30 attributes and
"classifiers.ensemble.AdaptiveBagging
-s 1"
command:
bin/samoa storm target/SAMOA-Storm-0.4.0-incubating-SNAPSHOT.jar
"PrequentialEvaluation -i -1 -f 1000 -d /tmp/cenao11-2classes-
ordenado-trat_entdv-sem-label-puro.csv -l (classifiers.ensemble.AdaptiveBagging
-s 1) -s (org.apache.samoa.streams.ArffFileStream -s HDFSFileStreamSource
-f /cenario11-2classes-ordenado-trat_entdv-sem-label-puro.csv.arff)"
status before classification:
Tasks: 140 total, 1 running, 139 sleeping, 0 stopped, 0 zombie
%Cpu(s): 0.4 us, 0.1 sy, 0.0 ni, 99.5 id, 0.0 wa, 0.0 hi, 0.0 si,
0.0 st
KiB Mem: 30951404 total, 3150588 used, 27800816 free, 92904 buffers
KiB Swap: 901116 total, 0 used, 901116 free, 1981304 cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
3947 root 20 0 2770m 248m 18m S 2.3 0.8 0:26.20 java
3630 root 20 0 2616m 265m 18m S 0.3 0.9 0:11.40 java
1 root 20 0 10648 824 688 S 0.0 0.0 0:00.73 init
2 root 20 0 0 0 0 S 0.0 0.0 0:00.00 kthreadd
status during classification (fail):
Tasks: 145 total, 1 running, 144 sleeping, 0 stopped, 0 zombie
%Cpu(s): 74.1 us, 24.2 sy, 0.0 ni, 1.1 id, 0.0 wa, 0.0 hi, 0.7 si,
0.0 st
KiB Mem: 30951404 total, 5737076 used, 25214328 free, 103376 buffers
KiB Swap: 901116 total, 0 used, 901116 free, 3154772 cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
6601 root 20 0 9473m 1.2g 15m S 385.9 4.1 0:37.38 java
2852 root 20 0 200m 41m 6892 S 3.7 0.1 0:26.38 Xorg
3462 root 20 0 306m 18m 11m S 3.0 0.1 0:15.39
gnome-terminal
3947 root 20 0 2775m 254m 18m S 1.0 0.8 0:53.04 java
19 root 20 0 0 0 0 S 0.3 0.0 0:00.72 ksoftirqd/3
output:
15421 [Thread-12-org.apache.samoa.evaluation.EvaluatorProcessor_1] INFO
org.apache.samoa.evaluation.EvaluatorProcessor - 0 seconds for 1000
instances
15422
[Thread-22-org.apache.samoa.learners.classifiers.trees.ModelAggregatorProcessor_1]
INFO org.apache.samoa.learners.classifiers.trees.ModelAggregatorProcessor
- Change detected, resetting the classifier
15422 [Thread-12-org.apache.samoa.evaluation.EvaluatorProcessor_1] INFO
org.apache.samoa.evaluation.EvaluatorProcessor - evaluation instances =
92,000
classified instances = 92,000
classifications correct (percent) = 98.609
Kappa Statistic (percent) = 16.772
Kappa Temporal Statistic (percent) = 22.892
15422
[Thread-22-org.apache.samoa.learners.classifiers.trees.ModelAggregatorProcessor_1]
INFO org.apache.samoa.learners.classifiers.trees.ModelAggregatorProcessor
- Change detected, resetting the classifier
15426
[Thread-22-org.apache.samoa.learners.classifiers.trees.ModelAggregatorProcessor_1]
INFO org.apache.samoa.learners.classifiers.trees.ModelAggregatorProcessor
- Change detected, resetting the classifier
3) Dataset with 107000 instances, 30 attributes and
"classifiers.ensemble.AdaptiveBagging
-s 2"
command:
bin/samoa storm target/SAMOA-Storm-0.4.0-incubating-SNAPSHOT.jar
"PrequentialEvaluation -i -1 -f 1000 -d /tmp/cenao11-2classes-
ordenado-trat_entdv-sem-label-puro.csv -l (classifiers.ensemble.AdaptiveBagging
-s 2) -s (org.apache.samoa.streams.ArffFileStream -s HDFSFileStreamSource
-f /cenario11-2classes-ordenado-trat_entdv-sem-label-puro.csv.arff)"
status before classification:
Tasks: 140 total, 1 running, 139 sleeping, 0 stopped, 0 zombie
%Cpu(s): 0.4 us, 0.1 sy, 0.0 ni, 99.5 id, 0.0 wa, 0.0 hi, 0.0 si,
0.0 st
KiB Mem: 30951404 total, 3150588 used, 27800816 free, 92904 buffers
KiB Swap: 901116 total, 0 used, 901116 free, 1981304 cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
3947 root 20 0 2770m 248m 18m S 2.3 0.8 0:26.20 java
3630 root 20 0 2616m 265m 18m S 0.3 0.9 0:11.40 java
1 root 20 0 10648 824 688 S 0.0 0.0 0:00.73 init
2 root 20 0 0 0 0 S 0.0 0.0 0:00.00 kthreadd
status during classification (fail):
Tasks: 142 total, 1 running, 141 sleeping, 0 stopped, 0 zombie
%Cpu(s): 78.1 us, 20.4 sy, 0.0 ni, 1.2 id, 0.0 wa, 0.0 hi, 0.3 si,
0.0 st
KiB Mem: 30951404 total, 5056400 used, 25895004 free, 94752 buffers
KiB Swap: 901116 total, 0 used, 901116 free, 2189600 cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
5641 root 20 0 9494m 1.6g 15m S 391.3 5.5 0:41.70 java
3462 root 20 0 305m 18m 11m S 2.0 0.1 0:09.75
gnome-terminal
3947 root 20 0 2770m 248m 18m S 1.0 0.8 0:30.81 java
11 root 20 0 0 0 0 S 0.3 0.0 0:00.40 kworker/0:1
output:
18985 [Thread-12-org.apache.samoa.evaluation.EvaluatorProcessor_1] INFO
org.apache.samoa.evaluation.EvaluatorProcessor - 0 seconds for 1000
instances
18985
[Thread-28-org.apache.samoa.learners.classifiers.trees.ModelAggregatorProcessor_2]
INFO org.apache.samoa.learners.classifiers.trees.ModelAggregatorProcessor
- Change detected, resetting the classifier
18985 [Thread-12-org.apache.samoa.evaluation.EvaluatorProcessor_1] INFO
org.apache.samoa.evaluation.EvaluatorProcessor - evaluation instances =
85,000
classified instances = 85,000
classifications correct (percent) = 99.531
Kappa Statistic (percent) = 8.933
Kappa Temporal Statistic (percent) = 21.457
18987
[Thread-28-org.apache.samoa.learners.classifiers.trees.ModelAggregatorProcessor_2]
INFO org.apache.samoa.learners.classifiers.trees.ModelAggregatorProcessor
- Change detected, resetting the classifier
18987
[Thread-28-org.apache.samoa.learners.classifiers.trees.ModelAggregatorProcessor_2]
INFO org.apache.samoa.learners.classifiers.trees.ModelAggregatorProcessor
- Change detected, resetting the classifier
18988
[Thread-28-org.apache.samoa.learners.classifiers.trees.ModelAggregatorProcessor_2]
INFO org.apache.samoa.learners.classifiers.trees.ModelAggregatorProcessor
- Change detected, resetting the classifier
18989
[Thread-28-org.apache.samoa.learners.classifiers.trees.ModelAggregatorProcessor_2]
INFO org.apache.samoa.learners.classifiers.trees.ModelAggregatorProcessor
- Change detected, resetting the classifier
Note: I used the same number of attributes to facilitate the comparison.
System configuration:
Debian 7 (virtual machine)
30 GB RAM
4 processors
Thanks,
Eduardo.
2016-09-12 4:51 GMT-03:00 Nicolas Kourtellis <[email protected]>:
> Hi Eduardo,
>
> Thanks for the tests and questions,
>
> I can't tell if this is a problem of Storm / Nimbus or Samoa.
> Have you tried a smaller stream, i.e., with a smaller number of events, or
> smaller number of attributes?
>
> Perhaps the DSPE is shutting down due to memory error or other resource
> issue?
>
> Try with different sizes and let us know the status of the machine before
> it fails.
>
> Thanks,
>
> Nicolas
>
>
>
>
> On Mon, Sep 12, 2016 at 4:25 AM, Eduardo Costa <[email protected]>
> wrote:
>
> > Dear,
> > I'm executanto the Samoa with the storm in local mode (command line:
> > bin/samoa storm target/SAMOA-Storm-0.4.0-incubating-SNAPSHOT.jar
> > "PrequentialEvaluation -i -1 -f 1000 -d /tmp/cenario10-2classes-
> > ordenado-trat_entdv-sem-label-puro.csv -l (classifiers.ensemble.
> > AdaptiveBagging
> > -s 1) -s (org.apache.samoa.streams.ArffFileStream -s
> HDFSFileStreamSource
> > -f /cenario10-2classes-ordenado-trat_entdv-sem-label-puro.csv.arff)").
> >
> > I am using a dataset of 1,300.00 instances, but this samoa stopping at
> > 480,000 when I use Adaptive Bagging. After a while the following message
> > appears:
> >
> > ------------------------------------------------------------
> > ---------------------------------------------------
> >
> > org.apache.samoa.learners.classifiers.trees.ModelAggregatorProcessor -
> > Change detected, resetting the classifier
> > 66025 [Thread-22-org.apache.samoa.learners.classifiers.trees.
> > ModelAggregatorProcessor_1]
> > INFO org.apache.samoa.learners.classifiers.trees.
> ModelAggregatorProcessor
> > - Change detected, resetting the classifier
> > 66025 [Thread-22-org.apache.samoa.learners.classifiers.trees.
> > ModelAggregatorProcessor_1]
> > INFO org.apache.samoa.learners.classifiers.trees.
> ModelAggregatorProcessor
> > - Change detected, resetting the classifier
> > 66026 [Thread-22-org.apache.samoa.learners.classifiers.trees.
> > ModelAggregatorProcessor_1]
> > INFO org.apache.samoa.learners.classifiers.trees.
> ModelAggregatorProcessor
> > - Change detected, resetting the classifier
> > 66027 [Thread-22-org.apache.samoa.learners.classifiers.trees.
> > ModelAggregatorProcessor_1]
> > INFO org.apache.samoa.learners.classifiers.trees.
> ModelAggregatorProcessor
> > - Change detected, resetting the classifier
> > 66027 [Thread-22-org.apache.samoa.learners.classifiers.trees.
> > ModelAggregatorProcessor_1]
> > INFO org.apache.samoa.learners.classifiers.trees.
> ModelAggregatorProcessor
> > - Change detected, resetting the classifier
> > 224126 [main] INFO backtype.storm.daemon.nimbus - Delaying event :remove
> > for 30 secs for Prequential_20160911213510-1-1473640527
> > 224132 [main] INFO backtype.storm.daemon.nimbus - Updated
> > Prequential_20160911213510-1-1473640527 with status {:type :killed,
> > :kill-time-secs 30}
> > 224132 [main] INFO backtype.storm.daemon.nimbus - Shutting down master
> > 224136 [ProcessThread(sid:0 cport:-1):] INFO
> > org.apache.storm.zookeeper.server.PrepRequestProcessor
> > - Processed session termination for sessionid: 0x1571bd1c9c50001
> > 224137 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO
> > org.apache.storm.zookeeper.server.NIOServerCnxn - Closed socket
> > connection
> > for client /0:0:0:0:0:0:0:1:50353 which had sessionid 0x1571bd1c9c50001
> > 224137 [main] INFO org.apache.storm.zookeeper.ZooKeeper - Session:
> > 0x1571bd1c9c50001 closed
> > 224137 [main-EventThread] INFO org.apache.storm.zookeeper.ClientCnxn -
> > EventThread shut down
> > 224142 [main] INFO backtype.storm.daemon.nimbus - Shut down master
> > 224155 [ProcessThread(sid:0 cport:-1):] INFO
> > org.apache.storm.zookeeper.server.PrepRequestProcessor
> > - Processed session termination for sessionid: 0x1571bd1c9c50003
> > 224159 [main] INFO org.apache.storm.zookeeper.ZooKeeper - Session:
> > 0x1571bd1c9c50003 closed
> > 224159 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO
> > org.apache.storm.zookeeper.server.NIOServerCnxn - Closed socket
> > connection
> > for client /0:0:0:0:0:0:0:1:50355 which had sessionid 0x1571bd1c9c50003
> > 224159 [main-EventThread] INFO org.apache.storm.zookeeper.ClientCnxn -
> > EventThread shut down
> > 224163 [ProcessThread(sid:0 cport:-1):] INFO
> > org.apache.storm.zookeeper.server.PrepRequestProcessor
> > - Processed session termination for sessionid: 0x1571bd1c9c50005
> > 224164 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO
> > org.apache.storm.zookeeper.server.NIOServerCnxn - Closed socket
> > connection
> > for client /127.0.0.1:49569 which had sessionid 0x1571bd1c9c50005
> > 224165 [main-EventThread] INFO org.apache.storm.zookeeper.ClientCnxn -
> > EventThread shut down
> > 224165 [main] INFO org.apache.storm.zookeeper.ZooKeeper - Session:
> > 0x1571bd1c9c50005 closed
> > 224166 [main] INFO backtype.storm.daemon.supervisor - Shutting down
> > 9957d6b3-05c3-46d4-bb6f-c37751a40026:37ed88ae-36f0-
> 4b87-b128-cd16c1fa21f7
> > 224166 [main] INFO backtype.storm.process-simulator - Killing process
> > 3a39d80e-10b5-4db7-823d-a48ca5d85109
> > 224166 [main] INFO backtype.storm.daemon.worker - Shutting down worker
> > Prequential_20160911213510-1-1473640527 9957d6b3-05c3-46d4-bb6f-
> > c37751a40026
> > 1024
> > 224167 [main] INFO backtype.storm.daemon.worker - Shutting down receive
> > thread
> > 224167 [main] INFO backtype.storm.messaging.loader - Shutting down
> > receiving-thread: [Prequential_20160911213510-1-1473640527, 1024]
> > 224167 [main] INFO backtype.storm.messaging.loader - Waiting for
> > receiving-thread:[Prequential_20160911213510-1-1473640527, 1024] to die
> > 224167 [Thread-10-worker-receiver-thread-0] INFO
> > backtype.storm.messaging.loader
> > - Receiving-thread:[Prequential_20160911213510-1-1473640527, 1024]
> > received
> > shutdown notice
> > 224168 [main] INFO backtype.storm.messaging.loader - Shutdown
> > receiving-thread: [Prequential_20160911213510-1-1473640527, 1024]
> > 224168 [main] INFO backtype.storm.daemon.worker - Shut down receive
> thread
> > 224169 [main] INFO backtype.storm.daemon.worker - Terminating messaging
> > context
> > 224169 [main] INFO backtype.storm.daemon.worker - Shutting down
> executors
> > 224169 [main] INFO backtype.storm.daemon.executor - Shutting down
> executor
> > org.apache.samoa.evaluation.EvaluatorProcessor_1:[2 2]
> > 224169 [Thread-12-org.apache.samoa.evaluation.EvaluatorProcessor_1] INFO
> > backtype.storm.util - Async loop interrupted!
> > 224170 [Thread-11-disruptor-executor[2 2]-send-queue] INFO
> > backtype.storm.util - Async loop interrupted!
> > 224170 [main] INFO backtype.storm.daemon.executor - Shut down executor
> > org.apache.samoa.evaluation.EvaluatorProcessor_1:[2 2]
> > 224170 [main] INFO backtype.storm.daemon.executor - Shutting down
> executor
> > org.apache.samoa.learners.classifiers.ensemble.
> > BaggingDistributorProcessor_1:[3 3]
> > ------------------------------------------------------------
> > --------------------------------------------------------
> > What can it be?
> >
> > Regards,
> > Eduardo Costa.
> >
>
>
>
> --
> Nicolas Kourtellis
>
