Re: [maemo-users] metalayer-crawler

2007-02-01 Thread Eero Tamminen

Hi,

ext Eero Tamminen wrote:

If you reboot, can you get it again to consume that much CPU
i.e. is the problem (easily) re-producable?


It starts consuming CPU as soon as it starts, and keeps going.


But only if your MMC is in when you reboot?
Does dmesg tell anything?

What happens if you remove MMC?
Does the device complain that your MMC is in use?

If it does, what is the output of following:
  for pid in $(pidof metalayer-crawler); do ls -l /proc/$pid/fd; done
(Does it list any files from the MMC?)


I've now received an MMC which triggers this bug. The FAT file system on 
this MMC is corrupted.  I.e. you would see in dmesg messages about FAT

errors and the crawler has some files open which names are complete
(200 bytes long) garbage.  Most of the MMC contents seemed OK though
and I think that's why it was mounted.

Please check whether all the file names on your MMC look alright and
fsck it.   If this doesn't cure the problem, more information about
the problem is needed.


- Eero
___
maemo-users mailing list
maemo-users@maemo.org
https://maemo.org/mailman/listinfo/maemo-users


Re: [maemo-users] metalayer-crawler

2007-01-30 Thread Eero Tamminen

Hi,

ext william maddler wrote:

first of all I have to say that I am *very* impressed by the N800, great
 device!

By the way, I just found metalayer-crawler0 is eating up a lot of CPU, I
have 4 processes, and at least one is eating at least 50% of my CPU, all
the time.

How did you trigger that (what did you do before that)?


The only thing I can think of, is placing a 1GB MMC in external slot.


Did it eventually stop using the CPU (without rebooting)
i.e. is this a temporary problem?


No, I waited about an hour, and the process was still there.


Ok, then it's definitely a bug, not just a performance issue.



If you reboot, can you get it again to consume that much CPU
i.e. is the problem (easily) re-producable?


It starts consuming CPU as soon as it starts, and keeps going.


But only if your MMC is in when you reboot?
Does dmesg tell anything?

What happens if you remove MMC?
Does the device complain that your MMC is in use?

If it does, what is the output of following:
  for pid in $(pidof metalayer-crawler); do ls -l /proc/$pid/fd; done
(Does it list any files from the MMC?)



Could you file a bug to Maemo bugzilla about this (with the above info)
and send link to the bug here?


Sure, I was only trying if that was my fault or a real bug.


Please attach also result of this (contents of MMC triggering
the bug):
ls -lR /media/mmc1/
to the bug report.

AFAIK the crawler digs out extra information from some file types and it
might be some specific file that is triggering the problem (e.g. because
the file is broken in some specific way which triggers a bug in
crawler), or the amount of files (e.g. of certain types).



[...]
1) Has anyone else experienced same problem.
2) Could the absence of the daemon, be a problem for other applications
(i.e. Media Player)?

Not sure, but I think Mediaplayer gets the files in its library
from the crawler database.


I'll try then


Thanks!

- Eero

PS. I tried triggering the bug by creating some partial mp3 files:
cd /home/user/MyDocs/.sounds/;
for i in $(seq 20); do
out=/media/mmc1/test-$(($i+10)).mp3;
dd bs=102400 count=$i if=Road_To_Ruin.mp3 of=$out;
done;
sync

And re-inserting the MMC, but at least that didn't trigger the bug.
___
maemo-users mailing list
maemo-users@maemo.org
https://maemo.org/mailman/listinfo/maemo-users


[maemo-users] metalayer-crawler

2007-01-26 Thread william maddler
Hi all,
first of all I have to say that I am *very* impressed by the N800, great
 device!

By the way, I just found metalayer-crawler0 is eating up a lot of CPU, I
have 4 processes, and at least one is eating at least 50% of my CPU, all
the time.

As far as I discovered, metalayer-crawler is in charge of collecting
information about the comings and goings of media files in the system.
The metadata of media files is automatically extracted using
Libmetalayer for other applications to use.

I ended up to completely disable the daemon.

My questions:

1) Has anyone else experienced same problem.
2) Could the absence of the daemon, be a problem for other applications
(i.e. Media Player)?

Thx
William Maddler

___
maemo-users mailing list
maemo-users@maemo.org
https://maemo.org/mailman/listinfo/maemo-users


Re: [maemo-users] metalayer-crawler

2007-01-26 Thread Eero Tamminen

Hi,

ext william maddler wrote:

first of all I have to say that I am *very* impressed by the N800, great
 device!

By the way, I just found metalayer-crawler0 is eating up a lot of CPU, I
have 4 processes, and at least one is eating at least 50% of my CPU, all
the time.


How did you trigger that (what did you do before that)?

Did it eventually stop using the CPU (without rebooting)
i.e. is this a temporary problem?

If you reboot, can you get it again to consume that much CPU
i.e. is the problem (easily) re-producable?

Could you file a bug to Maemo bugzilla about this (with the above info)
and send link to the bug here?



As far as I discovered, metalayer-crawler is in charge of collecting
information about the comings and goings of media files in the system.
The metadata of media files is automatically extracted using
Libmetalayer for other applications to use.

I ended up to completely disable the daemon.

My questions:

1) Has anyone else experienced same problem.
2) Could the absence of the daemon, be a problem for other applications
(i.e. Media Player)?


Not sure, but I think Mediaplayer gets the files in its library
from the crawler database.


- Eero
___
maemo-users mailing list
maemo-users@maemo.org
https://maemo.org/mailman/listinfo/maemo-users


Re: [maemo-users] metalayer-crawler

2007-01-26 Thread Andrew Flegg

On 1/26/07, william maddler [EMAIL PROTECTED] wrote:


first of all I have to say that I am *very* impressed by the N800, great
 device!


Ditto.


By the way, I just found metalayer-crawler0 is eating up a lot of CPU, I
have 4 processes, and at least one is eating at least 50% of my CPU, all
the time.


Other people have reported the same issue on the
internettablettalk.com forums, but I've not noticed the issue myself,
yet.

Cheers,

Andrew

--
Andrew Flegg -- mailto:[EMAIL PROTECTED]  |  http://www.bleb.org/
___
maemo-users mailing list
maemo-users@maemo.org
https://maemo.org/mailman/listinfo/maemo-users


Re: [maemo-users] metalayer-crawler

2007-01-26 Thread william maddler
Quick upgrade.
If I'm not wrong, the crawler explore the *whole* filesystem, and thus
eating so much CPU (and resources). A quick work around could be to
watch only thos directoryes which are likely to contains media files:

/home/user/MyDocs/.video
/home/user/MyDocs/.sounds
/home/user/MyDocs/.images

invoking with: media-crawler -F -c
/home/user/MyDocs/.video,/home/user/MyDocs/.sounds,/home/user/MyDocs/.images

I added a MEDIAPATH variable to /etc/init.d/metalayer-crawler0 script
and added it to metalayer-crawler invocations in the same script. CPU
consumption is now ok.

I'm going to open a bug this evening from home.

Bye

william maddler wrote:
 Hi all,
 first of all I have to say that I am *very* impressed by the N800, great
  device!
 
 By the way, I just found metalayer-crawler0 is eating up a lot of CPU, I
 have 4 processes, and at least one is eating at least 50% of my CPU, all
 the time.
 
 As far as I discovered, metalayer-crawler is in charge of collecting
 information about the comings and goings of media files in the system.
 The metadata of media files is automatically extracted using
 Libmetalayer for other applications to use.
 
 I ended up to completely disable the daemon.
 
 My questions:
 
 1) Has anyone else experienced same problem.
 2) Could the absence of the daemon, be a problem for other applications
 (i.e. Media Player)?
 
 Thx
 William Maddler
 
 ___
 maemo-users mailing list
 maemo-users@maemo.org
 https://maemo.org/mailman/listinfo/maemo-users
 


___
maemo-users mailing list
maemo-users@maemo.org
https://maemo.org/mailman/listinfo/maemo-users