Anyone? :-)
-------- Original-Nachricht --------
Betreff: Meta Tags
Datum: Mon, 19 Dec 2011 15:30:12 +0100
Von: Marek Bachmann<[email protected]>
Antwort an: [email protected]
An: [email protected]
Hello again,
I want to extract specific meta tag from HTML pages, like:
<meta name="uniks-fb" value="fb16" />
But it seems that they aren't extracted by the parser. I dumped the
segment of a page (Since the readseg doesn't work for me :-/ ) and
inspected the values for this example page:
http://cms.uni-kassel.de/unicms/index.php?id=29216&L=0
This page contains these metatags:
<meta name="uniks-fb" content="default" />
<meta name="keywords"
content="Universitt,Kassel,Forschung,Lehre,Wissenschaft" />
<meta name="robots" content="index" />
<meta name="DC.Description" content="Der Internetauftritt der
Universität Kassel" />
<meta name="DC.Subject"
content="Universitt,Kassel,Forschung,Lehre,Wissenschaft" />
<meta name="generator" content="TYPO3 4.2 CMS" />
But these tags don't appear in the segment as shown above. I thought
I'll find them in "Parse Metadata" but there are only this two values:
"CharEncodingForConversion=utf-8" "OriginalCharEncoding=utf-8"
I use the value parse-(html|tika) in my plugin.includes as well as urlmeta.
Any suggestions what I am doing wrong?
THANK YOU!
Snippet from segment dump:
Recno:: 97
URL:: http://cms.uni-kassel.de/unicms/index.php?id=29216&L=0
CrawlDatum::
Version: 7
Status: 67 (linked)
Fetch time: Mon Dec 19 12:44:49 CET 2011
Modified time: Thu Jan 01 01:00:00 CET 1970
Retries since fetch: 0
Retry interval: 603450 seconds (6 days)
Score: 0.0
Signature: null
Metadata:
CrawlDatum::
Version: 7
Status: 67 (linked)
Fetch time: Mon Dec 19 12:42:04 CET 2011
Modified time: Thu Jan 01 01:00:00 CET 1970
Retries since fetch: 0
Retry interval: 603450 seconds (6 days)
Score: 0.0
Signature: null
Metadata:
CrawlDatum::
Version: 7
Status: 67 (linked)
Fetch time: Mon Dec 19 12:42:04 CET 2011
Modified time: Thu Jan 01 01:00:00 CET 1970
Retries since fetch: 0
Retry interval: 603450 seconds (6 days)
Score: 0.0
Signature: null
Metadata:
CrawlDatum::
Version: 7
Status: 67 (linked)
Fetch time: Mon Dec 19 12:42:04 CET 2011
Modified time: Thu Jan 01 01:00:00 CET 1970
Retries since fetch: 0
Retry interval: 603450 seconds (6 days)
Score: 0.0
Signature: null
Metadata:
CrawlDatum::
Version: 7
Status: 65 (signature)
Fetch time: Mon Dec 19 12:42:04 CET 2011
Modified time: Thu Jan 01 01:00:00 CET 1970
Retries since fetch: 0
Retry interval: 0 seconds (0 days)
Score: 0.0
Signature: 7260839eaf4927f64b03dd86dcd0918a
Metadata:
CrawlDatum::
Version: 7
Status: 67 (linked)
Fetch time: Mon Dec 19 12:42:04 CET 2011
Modified time: Thu Jan 01 01:00:00 CET 1970
Retries since fetch: 0
Retry interval: 603450 seconds (6 days)
Score: 0.0
Signature: null
Metadata:
CrawlDatum::
Version: 7
Status: 67 (linked)
Fetch time: Mon Dec 19 12:42:51 CET 2011
Modified time: Thu Jan 01 01:00:00 CET 1970
Retries since fetch: 0
Retry interval: 603450 seconds (6 days)
Score: 0.0
Signature: null
Metadata:
CrawlDatum::
Version: 7
Status: 1 (db_unfetched)
Fetch time: Sat Dec 17 14:45:49 CET 2011
Modified time: Thu Jan 01 01:00:00 CET 1970
Retries since fetch: 1
Retry interval: 603450 seconds (6 days)
Score: 0.0
Signature: null
Metadata: _ngt_: 1324289811219_pst_: exception(16), lastModified=0:
java.net.SocketTimeoutException: Read timed out
CrawlDatum::
Version: 7
Status: 33 (fetch_success)
Fetch time: Mon Dec 19 12:25:59 CET 2011
Modified time: Thu Jan 01 01:00:00 CET 1970
Retries since fetch: 1
Retry interval: 603450 seconds (6 days)
Score: 0.0
Signature: null
Metadata: _ngt_: 1324289811219_pst_: success(1), lastModified=0
Content::
Version: -1
url: http://cms.uni-kassel.de/unicms/index.php?id=29216&L=0
base: http://cms.uni-kassel.de/unicms/index.php?id=29216&L=0
contentType: application/xhtml+xml
metadata: Date=Mon, 19 Dec 2011 10:24:09 GMT Vary=Accept-Encoding
Content-Length=3886 Content-Encoding=gzip Via=1.0 cms.uni-kassel.de
_fst_=33 Set-Cookie=fe_typo_user=cb42ebddb40df7e8a04b0183f79c41cb;
path=/unicms/ nutch.segment.name=20111219111925
Content-Type=text/html;charset=utf-8 Connection=close
Server=Apache/2.2.3 (Debian) mod_ssl/2.2.3 OpenSSL/0.9.8c
X-Powered-By=PHP/5.2.0-8+etch16
Content:
<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE html
PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd";>
<html xmlns="http://www.w3.org/1999/xhtml"; xml:lang="en" lang="de">
(...)
</html>
ParseData::
Version: 5
Status: success(1,0)
Title: 2004 - Universität Kassel
Outlinks: 35
outlink: toUrl:
http://cms.uni-kassel.de/unicms/index.php?id=29216&L=0#navigation
anchor: Zur Hauptnavigation (Nutzergruppen-Navigation)
(...)
Content Metadata: Content-Length=3886 _fst_=33
Set-Cookie=fe_typo_user=cb42ebddb40df7e8a04b0183f79c41cb; path=/unicms/
nutch.segment.name=20111219111925 Connection=close Server=Apache/2.2.3
(Debian) mod_ssl/2.2.3 OpenSSL/0.9.8c X-Powered-By=PHP/5.2.0-8+etch16
nutch.content.digest=7260839eaf4927f64b03dd86dcd0918a Date=Mon, 19 Dec
2011 10:24:09 GMT Vary=Accept-Encoding Content-Encoding=gzip Via=1.0
cms.uni-kassel.de Content-Type=text/html;charset=utf-8
Parse Metadata: CharEncodingForConversion=utf-8 OriginalCharEncoding=utf-8
ParseText::
2004 - Universität Kassel Zur Hauptnavigation (Nutzergruppen-Navigation)
. Zur Unternavigation . Zum Inhalt . Zu verwandten Links und
Informationen . Infos für: Universität Studium Forschung Fachbereiche
Einrichtungen International students and scholars Sie befinden sich
hier: HFK> Ehemalige Mitarbeiter> Früchting> Liste der
Veröffentlichungen> 2004 Veröffentlichungen im Fachgebiet
Hochfrequenztechnik/Kommunikationssysteme 2004: [113] Semmelrodt, S.;
Kattenbach, R.; Früchting, H.: Toolbox for Spectral Analysis and Linear
Prediction of Stationary and Non-Stationary Signals, COST 273 TD(04)019,
Athen, Greece, January 26-28, 2004 [114] Semmelrodt, S.: Maximum
Likelihood Based Parameter Estimation of Stationary and Non-Stationary
Multi-Component Signals, FREQUENZ 58 (2004) 1-2, S. 20-24. [115]
Semmelrodt, S.: Methoden zur prädiktiven Kanalschätzung für adaptive
Übertragungstechniken im Mobilfunk, Dissertation Universität Kassel,
Kassel: Kassel University Press 2004, ISBN 3-89958-041-9. [116] Henze,
N.: Efficiency Measurement of Planar Solar Cell Antennas using the
Wheeler Cap Method, 8th International Student Conference on Electrical
Engineering, Technical University Prague, Czech, May 20, 2004. [117]
Weitz, M.: A Planar Solar Cell Antenna for Vehicular Mobile
Communication Systems, 8th International Student Conference on
Electrical Engineering, Technical University Prague, Czech, May 20,
2004. [118] Schäfer, A.: Construction of a 200 MHz and 400 MHz
Clock-Oszillator for an Indoor Channel Sounder, 8th International
Student Conference on Electrical Engineering, Technical University
Prague, Czech, May 20, 2004. [119] Semmelrodt, S.: Spectral Analysis and
Linear Prediction Toolbox for Stationary and Non-Stationary Signals,
FREQUENZ 58 (2004) 7-8, S. 185-187. [120] Henze, N.; Weitz, M.; Hofmann,
P.; Bendel, C.; Kirchhof, J.; Früchting, H..: Investigation of Planar
Antennas with Photovoltaic Solar Cells for Mobile Communications, in
Proceedings of the 15th IEEE International Symposium on Personal, Indoor
and Mobile Radio Communications (PIMRC 2004), Barcelona, Spain,
September 5-8, 2004. Liste der Veröffentlichungen 2005 2004 2003 2002
2001 2000 1999 1998 1997 1996 1995 1994 1993 1992 1991 bis1990 Impressum
Google-Suche über Uni-Seiten Softlink Letzte Änderung: 29.12.2009 ComLab
