Diederik has submitted this change and it was merged. Change subject: Add test data for unit-tests ......................................................................
Add test data for unit-tests Change-Id: I0038c1c5ea7ad08fecf33710ba12791fac67f4e0 --- M .gitignore A kraken-pig/src/test/resources/testdata_desktop.csv A kraken-pig/src/test/resources/testdata_mobile.csv A kraken-pig/src/test/resources/testdata_session.csv 4 files changed, 53 insertions(+), 1 deletion(-) Approvals: Diederik: Verified; Looks good to me, approved diff --git a/.gitignore b/.gitignore index 123ae76..c5ebe20 100644 --- a/.gitignore +++ b/.gitignore @@ -17,7 +17,7 @@ doc/ deploy.sh -testdata* +testdata.csv kraken-dclass/src/main/java/org/openddr/ *.gz tmp/ diff --git a/kraken-pig/src/test/resources/testdata_desktop.csv b/kraken-pig/src/test/resources/testdata_desktop.csv new file mode 100644 index 0000000..bc96671 --- /dev/null +++ b/kraken-pig/src/test/resources/testdata_desktop.csv @@ -0,0 +1,25 @@ +knsq24.knams.wikimedia.org 560388694 2013-02-13T07:05:54.593 0 10.180.33.0 TCP_MEM_HIT/200 5041 GET http://commons.wikimedia.org/w/index.php?title=MediaWiki:TextCleaner.js&action=raw&ctype=text/javascript NONE/- text/javascript http://commons.wikimedia.org/wiki/File:Victoria_(Seychelles).jpg?uselang=ru - Mozilla/5.0%20(Windows%20NT%206.1;%20WOW64)%20AppleWebKit/537.17%20(KHTML,%20like%20Gecko)%20Chrome/24.0.1312.57%20Safari/537.17 ru-RU,ru;q=0.8,en-US;q=0.6,en;q=0.4 - +cp1036.eqiad.wmnet 1987998022 2013-02-13T07:05:54 0.001018524 10.167.250.0 miss/304 0 GET http://upload.wikimedia.org/wikipedia/commons/thumb/2/2c/PPD-34_and_PPD-34_38.JPG/200px-PPD-34_and_PPD-34_38.JPG - image/jpeg http://en.wikipedia.org/wiki/List_of_Russian_weaponry - Mozilla/4.0%20(compatible;%20MSIE%208.0;%20Windows%20NT%206.1;%20Trident/4.0;%20%20SLCC2;%20.NET%20CLR%202.0.50727;%20.NET%20CLR%203.5.30729;%20.NET%20CLR%203.0.30729;%20Media%20Center%20PC%206.0;%20.NET4.0C;%20.NET4.0E;%20) en-US - +cp1012.eqiad.wmnet 839078746 2013-02-13T07:05:54.672 0 10.185.212.0 TCP_MEM_HIT/200 489 GET http://meta.wikimedia.org/wiki/Special:RecordImpression?banner=B13_BlankA_FR&campaign=C13_wpnd_mlWW_FR&result=show&country=AR&userlang=es&project=wikipedia&db=eswiki&sitename=Wikipedia&bucket=0 NONE/- image/png http://es.wikipedia.org/wiki/D%C3%ADa_de_San_Valent%C3%ADn - Mozilla/5.0%20(Windows%20NT%205.1)%20AppleWebKit/537.17%20(KHTML,%20like%20Gecko)%20Chrome/24.0.1312.57%20Safari/537.17 es-ES,es;q=0.8 - +cp1021.eqiad.wmnet 1978892196 2013-02-13T07:05:54 0.000040531 10.49.217.0 hit/200 5738 GET http://upload.wikimedia.org/wikipedia/commons/thumb/3/3d/Mediawiki-logo.png/35px-Mediawiki-logo.png - image/png http://en.wikipedia.org/wiki/Main_Page - Mozilla/5.0%20(Windows%20NT%205.1)%20AppleWebKit/537.17%20(KHTML,%20like%20Gecko)%20Chrome/24.0.1312.57%20Safari/537.17 en-US,en;q=0.8 - +amssq57.esams.wikimedia.org 825729523 2013-02-13T07:05:54.661 15 10.138.51.0 TCP_MISS/200 47879 GET http://upload.wikimedia.org/wikipedia/commons/thumb/6/60/Wiki-mam-intcs.png/220px-Wiki-mam-intcs.png CARP/91.198.174.57 image/png http://de.wikipedia.org/wiki/Cumshot - Mozilla/4.0%20(compatible;%20MSIE%208.0;%20Windows%20NT%205.2;%20Trident/4.0;%20.NET%20CLR%201.1.4322;%20.NET%20CLR%202.0.50727;%20.NET%20CLR%203.0.4506.2152;%20.NET%20CLR%203.5.30729;%20.NET4.0C;%20.NET4.0E;%20OfficeLiveConnector.1.5;%20OfficeLivePatch.1.3) de - +cp3010.esams.wikimedia.org 3167536827 2013-02-13T07:05:54 0.000055790 10.123.230.0 hit/200 508 GET http://upload.wikimedia.org/wikipedia/commons/thumb/3/3e/Flag_of_New_Zealand.svg/22px-Flag_of_New_Zealand.svg.png - image/png http://ru.wikipedia.org/wiki/Bell_UH-1_Iroquois - Opera/9.80%20(Windows%20NT%206.1;%20WOW64;%20U;%20ru)%20Presto/2.10.289%20Version/12.00 ru-RU,ru;q=0.9,en;q=0.8 - +cp1013.eqiad.wmnet 841173907 2013-02-13T07:05:54.739 1 10.43.19.0 TCP_MISS/200 14279 GET http://ja.wikipedia.org/wiki/%E3%83%AD%E3%82%B7%E3%82%A2%E8%AA%9E%E4%BC%9A%E8%A9%B1 CARP/10.64.0.133 text/html http://www.google.co.jp/url?sa=t&rct=j&q=%E3%83%AD%E3%82%B7%E3%82%A2%E8%AA%9E%E3%80%80%E8%AC%9B%E5%BA%A7%E3%80%80%E3%82%BF%E3%83%AC%E3%83%B3%E3%83%88&source=web&cd=1&ved=0CDAQFjAA&url=http%3A%2F%2Fja.wikipedia.org%2Fwiki%2F%25E3%2583%25AD%25E3%2582%25B7%25E3%2582%25A2%25E8%25AA%259E%25E4%25BC%259A%25E8%25A9%25B1&ei=JjsbUfjkKeTAmQWNj4CoBA&usg=AFQjCNHIxiPlFmQzx2Rr1-tCquUoSRfY1w&bvm=bv.42261806,d.dGY - Mozilla/5.0%20(compatible;%20MSIE%209.0;%20Windows%20NT%206.1;%20Trident/5.0) ja-JP - +amssq36.esams.wikimedia.org 558274766 2013-02-13T07:05:54.709 0 10.183.118.0 TCP_MEM_HIT/200 777 GET http://de.wikipedia.org/favicon.ico NONE/- image/x-icon - - Mozilla/5.0%20(Windows%20NT%206.1;%20WOW64;%20rv:18.0)%20Gecko/20100101%20Firefox/18.0 de-de,de;q=0.8,en-us;q=0.5,en;q=0.3 - +cp1016.eqiad.wmnet 841001129 2013-02-13T07:05:54.794 0 10.138.100.0 TCP_MISS/200 446 GET http://meta.wikimedia.org/wiki/Special:RecordImpression?result=hide&reason=empty&country=JP&userlang=ja&project=wikibooks&db=jawikibooks&sitename=Wikibooks&bucket=1 CARP/10.64.0.140 image/png http://ja.wikibooks.org/wiki/%E5%BB%BA%E7%AF%89%E5%9F%BA%E6%BA%96%E6%B3%95%E7%AC%AC22%E6%9D%A1 - Mozilla/4.0%20(compatible;%20MSIE%208.0;%20Windows%20NT%205.1;%20Trident/4.0;%20GTB7.0;%20.NET%20CLR%201.1.4322;%20.NET%20CLR%202.0.50727) ja - +cp1035.eqiad.wmnet 1985205536 2013-02-13T07:05:54 0.000524282 10.157.20.0 miss/200 1868 GET http://upload.wikimedia.org/wikipedia/commons/thumb/6/61/RoseVents.svg/25px-RoseVents.svg.png - image/png http://ru.wikipedia.org/wiki/%D0%92%D0%BE%D0%BB%D0%B3%D0%BE%D0%B4%D0%BE%D0%BD%D1%81%D0%BA - Mozilla/5.0%20(Windows%20NT%205.1)%20AppleWebKit/535.11%20(KHTML,%20like%20Gecko)%20Chrome/17.0.963.46%20Safari/535.11%20MRCHROME ru-RU,ru;q=0.8,en-US;q=0.6,en;q=0.4 - +cp1009.eqiad.wmnet 840705027 2013-02-13T07:05:54.829 0 10.111.83.0 TCP_MEM_HIT/200 637 GET http://meta.wikimedia.org/wiki/Special:BannerRandom?userlang=ja&sitename=Wikipedia&project=wikipedia&anonymous=true&bucket=0&country=JP&slot=12 NONE/- text/javascript http://ja.wikipedia.org/wiki/%E9%9B%AA - Mozilla/5.0%20(compatible;%20MSIE%209.0;%20Windows%20NT%206.0;%20Trident/5.0) ja - +cp1011.eqiad.wmnet 842187309 2013-02-13T07:05:54.849 76 10.80.154.0 TCP_MISS/200 3214 GET http://commons.wikimedia.org/w/index.php?title=Image:Fr%C3%A9jus-Plage1.jpg&action=render&uselang=sr CARP/10.64.0.139 text/html http://sr.wikipedia.org/wiki/%D0%94%D0%B0%D1%82%D0%BE%D1%82%D0%B5%D0%BA%D0%B0:Fr%C3%A9jus-Plage1.jpg 2620:0:861:101:7a2b:cbff:fe08:791e MediaWiki/1.21wmf8 - - +cp1022.eqiad.wmnet 1987324886 2013-02-13T07:05:54 0.000627995 10.94.20.0 miss/200 11927 GET http://upload.wikimedia.org/wikipedia/commons/thumb/7/7b/Tamina.superflysplash.jpg/250px-Tamina.superflysplash.jpg - image/jpeg http://en.wikipedia.org/wiki/Sarona_Reiher - Mozilla/5.0%20(Macintosh;%20Intel%20Mac%20OS%20X%2010_6_8)%20AppleWebKit/537.17%20(KHTML,%20like%20Gecko)%20Chrome/24.0.1312.57%20Safari/537.17 en-US,en;q=0.8 - +cp3009.esams.wikimedia.org 3170981880 2013-02-13T07:05:54 0.000061989 10.191.186.0 hit/304 0 GET http://upload.wikimedia.org/wikipedia/commons/thumb/d/d9/Flag_of_Norway.svg/20px-Flag_of_Norway.svg.png - image/png http://de.wikipedia.org/wiki/F-35 - Mozilla/5.0%20(Windows%20NT%205.1;%20rv:16.0)%20Gecko/20100101%20Firefox/16.0 de-de,de;q=0.8,en-us;q=0.5,en;q=0.3 - +amssq50.esams.wikimedia.org 825779908 2013-02-13T07:05:54.849 991 10.164.249.0 TCP_MISS/200 953276 GET http://upload.wikimedia.org/wikipedia/commons/thumb/5/56/Solar_eclipse_animate_%282005-Apr-08%29.gif/200px-Solar_eclipse_animate_%282005-Apr-08%29.gif CARP/91.198.174.61 image/gif http://ru.wikipedia.org/wiki/%D0%A1%D0%BE%D0%BB%D0%BD%D0%B5%D1%87%D0%BD%D0%BE%D0%B5_%D0%B7%D0%B0%D1%82%D0%BC%D0%B5%D0%BD%D0%B8%D0%B5_8_%D0%B0%D0%BF%D1%80%D0%B5%D0%BB%D1%8F_2005_%D0%B3%D0%BE%D0%B4%D0%B0 - Mozilla/5.0%20(Windows%20NT%205.1)%20AppleWebKit/537.17%20(KHTML,%20like%20Gecko)%20Chrome/24.0.1312.57%20Safari/537.17 ru-RU,ru;q=0.8,en-US;q=0.6,en;q=0.4 - +knsq16.knams.wikimedia.org 807707118 2013-02-13T07:05:54.864 0 10.44.46.0 TCP_REFRESH_HIT/200 1088 GET http://upload.wikimedia.org/wikipedia/commons/thumb/b/b4/Gtk-dialog-info.svg/12px-Gtk-dialog-info.svg.png CARP/91.198.174.30 image/png http://fr.wikipedia.org/wiki/Nigel_Farage - Mozilla/5.0%20(iPad;%20CPU%20OS%206_1%20like%20Mac%20OS%20X)%20AppleWebKit/536.26%20(KHTML,%20like%20Gecko)%20Version/6.0%20Mobile/10B141%20Safari/8536.25 fr-fr - +cp1006.eqiad.wmnet 840817540 2013-02-13T07:05:54.930 0 10.149.130.0 TCP_MEM_HIT/200 532 GET http://meta.wikimedia.org/wiki/Special:BannerRandom?userlang=en&sitename=Wikipedia&project=wikipedia&anonymous=true&bucket=0&country=CA&slot=22 NONE/- text/javascript http://en.wikipedia.org/wiki/The_Happening_(2008_film) - Mozilla/5.0%20(Windows%20NT%206.1;%20WOW64;%20rv:18.0)%20Gecko/20100101%20Firefox/18.0 en-US,en;q=0.5 - +cp1006.eqiad.wmnet 840817554 2013-02-13T07:05:54.948 0 10.166.162.0 TCP_MEM_HIT/200 2661 GET http://es.wikipedia.org/w/index.php?title=MediaWiki:RefToolbarMessages-es.js&action=raw&ctype=text/javascript NONE/- text/javascript http://es.wikipedia.org/w/index.php?title=Pedro_II_de_Pennsylvania,_Chester_Olszewski_(antipapa)&action=edit&redlink=1 - Mozilla/5.0%20(Macintosh;%20Intel%20Mac%20OS%20X%2010_5_8)%20AppleWebKit/537.1%20(KHTML,%20like%20Gecko)%20Chrome/21.0.1180.90%20Safari/537.1 es-ES,es;q=0.8 - +cp1026.eqiad.wmnet 1502335964 2013-02-13T07:05:54 0.001554489 10.231.223.0 miss/200 646 GET http://upload.wikimedia.org/math/9/9/6/9960263b8ac93898b143d11ae62b8476.png - image/png http://en.wikipedia.org/wiki/Cohomology - Mozilla/5.0%20(Windows%20NT%206.1;%20WOW64)%20AppleWebKit/537.17%20(KHTML,%20like%20Gecko)%20Chrome/24.0.1312.57%20Safari/537.17 en-US,en;q=0.8 - +cp1003.eqiad.wmnet 841104887 2013-02-13T07:05:54.977 0 10.116.251.0 TCP_MEM_HIT/200 732 GET http://en.wikipedia.org/favicon.ico NONE/- image/x-icon http://www.wikipedia.org/ - Mozilla/5.0%20(Linux;%20U;%20Android%202.3.6;%20en-gb;%20GT-I9100%20Build/GINGERBREAD)%20AppleWebKit/533.1%20(KHTML,%20like%20Gecko)%20Version/4.0%20Mobile%20Safari/533.1 en-GB,%20en-US - +cp3010.esams.wikimedia.org 3167537299 2013-02-13T07:05:54 0.000071526 10.207.84.0 hit/200 551 GET http://upload.wikimedia.org/wikipedia/commons/thumb/4/48/Flag_of_Moscow_oblast.svg/50px-Flag_of_Moscow_oblast.svg.png - image/png http://ru.wikipedia.org/wiki/%C8%E2%E0%ED%F2%E5%E5%E2%EA%E0 - Mozilla/4.0%20(compatible;%20MSIE%207.0;%20Windows%20NT%205.1;%20.NET%20CLR%202.0.50727;%20.NET%20CLR%203.0.04506.30;%20.NET%20CLR%201.1.4322;%20InfoPath.1) ru - +cp1021.eqiad.wmnet 1978892632 2013-02-13T07:05:54 0.004127026 10.211.231.0 miss/200 17652 GET http://upload.wikimedia.org/wikipedia/commons/thumb/9/9d/SHU-1.jpg/220px-SHU-1.jpg - image/jpeg http://en.wikipedia.org/wiki/Shanghai_University - Mozilla/5.0%20(Windows%20NT%206.1;%20WOW64)%20AppleWebKit/537.17%20(KHTML,%20like%20Gecko)%20Chrome/24.0.1312.57%20Safari/537.17 en-US,en;q=0.8 - +cp1029.eqiad.wmnet 1995769810 2013-02-13T07:05:55 0.000043154 10.155.172.0 hit/200 650 GET http://upload.wikimedia.org/wikipedia/commons/thumb/3/35/Flag_of_the_Cook_Islands.svg/22px-Flag_of_the_Cook_Islands.svg.png - image/png http://en.wikipedia.org/wiki/List_of_countries_by_GDP_(nominal) - Mozilla/5.0%20(Windows%20NT%206.1;%20WOW64)%20AppleWebKit/537.17%20(KHTML,%20like%20Gecko)%20Chrome/24.0.1312.57%20Safari/537.17 en-GB,en-US;q=0.8,en;q=0.6 - +cp1023.eqiad.wmnet 1924659665 2013-02-13T07:05:55 0.000632286 10.172.3.0 miss/200 20451 GET http://upload.wikimedia.org/wikipedia/en/thumb/1/15/Kprojectpromoimage.jpg/230px-Kprojectpromoimage.jpg - image/jpeg http://en.wikipedia.org/wiki/K_(anime) - Mozilla/5.0%20(compatible;%20MSIE%209.0;%20Windows%20NT%206.1;%20Win64;%20x64;%20Trident/5.0) en-US - + diff --git a/kraken-pig/src/test/resources/testdata_mobile.csv b/kraken-pig/src/test/resources/testdata_mobile.csv new file mode 100644 index 0000000..fb58700 --- /dev/null +++ b/kraken-pig/src/test/resources/testdata_mobile.csv @@ -0,0 +1,25 @@ +cp1041.eqiad.wmnet 2667705525 2013-03-27T06:28:12 0.001685619 10.234.170.0 miss/200 4116 GET http://sv.m.wikipedia.org/wiki/High_%27N%27_Dry - text/html; charset=UTF-8 http://sv.m.wikipedia.org/wiki/Def_Leppard - Mozilla/5.0%20(iPhone;%20CPU%20iPhone%20OS%206_0%20like%20Mac%20OS%20X)%20AppleWebKit/536.26%20(KHTML,%20like%20Gecko)%20Version/6.0%20Mobile/10A403%20Safari/8536.25 sv-se - +cp1042.eqiad.wmnet 2667900965 2013-03-27T06:28:12 0.177723646 10.80.154.0 miss/200 4149 GET http://ko.m.wikipedia.org/wiki/%EA%B3%A0%EC%82%B0%EB%B3%91 - text/html; charset=UTF-8 - 61.247.204.35 Yeti/1.0%20(NHN%20Corp.;%20http://help.naver.com/robots/) ko,en;q=0.5 - +cp1042.eqiad.wmnet 2667900993 2013-03-27T06:28:12 0.000099421 10.255.1.0 hit/200 318 GET http://en.m.wikipedia.org/favicon.ico - image/x-icon http://en.m.wikipedia.org/wiki/Ab_Tumhare_Hawale_Watan_Saathiyo 119.234.0.1 Mozilla/5.0%20(Linux;%20U;%20Android%202.3.3;%20en-gb;%20GT-I9100%20Build/GINGERBREAD)%20AppleWebKit/533.1%20(KHTML,%20like%20Gecko)%20Version/4.0%20Mobile%20Safari/533.1 en-GB,%20en-US - +cp1041.eqiad.wmnet 2667705614 2013-03-27T06:28:12 0.337810755 10.249.76.0 miss/200 6827 GET http://en.m.wikipedia.org/wiki/2011_UEFS_Futsal_Women's_Championship - text/html; charset=UTF-8 - - Mozilla/5.0%20(iPhone;%20U;%20CPU%20iPhone%20OS%204_1%20like%20Mac%20OS%20X;%20en-us)%20AppleWebKit/532.9%20(KHTML,%20like%20Gecko)%20Version/4.0.5%20Mobile/8B117%20Safari/6531.22.7%20(compatible;%20Googlebot-Mobile/2.1;%20+http://www.google.com/bot.html) - - +cp1043.wikimedia.org 2137202426 2013-03-27T06:28:12 0.000138998 10.39.77.0 hit/304 0 GET http://en.m.wikipedia.org/wiki/Self-induced_abortion - text/html; charset=UTF-8 http://www.google.com/search?q=self+induced+miscarriage&aq=f&sourceid=chrome-mobile&ie=UTF-8 - Mozilla/5.0%20(iPod;%20CPU%20iPhone%20OS%205_1%20like%20Mac%20OS%20X;%20en-us)%20AppleWebKit/534.46.0%20(KHTML,%20like%20Gecko)%20CriOS/21.0.1180.82%20Mobile/9B176%20Safari/7534.48.3 en-US,en;q=0.8 - +cp1041.eqiad.wmnet 2667705665 2013-03-27T06:28:13 0.000076532 10.197.233.0 hit/404 5159 GET http://de.m.wikipedia.org/apple-touch-icon-precomposed.png - text/html; charset=utf-8 - - Mozilla/5.0%20(iPhone;%20CPU%20iPhone%20OS%206_1_3%20like%20Mac%20OS%20X)%20AppleWebKit/536.26%20(KHTML,%20like%20Gecko)%20CriOS/25.0.1364.124%20Mobile/10B329%20Safari/8536.25 it-IT,it;q=0.8,en-US;q=0.6,en;q=0.4 - +cp1043.wikimedia.org 2137202514 2013-03-27T06:28:13 0.000114441 10.50.158.0 hit/304 0 GET http://en.m.wikipedia.org/w/index.php?title=MediaWiki:Gadget-ReferenceTooltips.js&action=raw&ctype=text/javascript&508635914 - text/javascript; charset=UTF-8 http://en.m.wikipedia.org/wiki/David_and_Jonathan - Mozilla/5.0%20(Linux;%20U;%20Android%202.3.6;%20en-us;%20SPH-D700%20Build/GINGERBREAD)%20AppleWebKit/533.1%20(KHTML,%20like%20Gecko)%20Version/4.0%20Mobile%20Safari/533.1 en-US - +cp1041.eqiad.wmnet 2667705736 2013-03-27T06:28:13 0.050471783 10.4.201.0 miss/301 20 GET http://en.m.wikipedia.org/wiki/fluctuate - text/html; charset=utf-8 - - Mozilla/5.0%20(Linux;%20U;%20Android%204.1.1;%20zh-tw;%20PadFone%202%20Build/JRO03L)%20AppleWebKit/534.30%20(KHTML,%20like%20Gecko)%20Version/4.0%20Mobile%20Safari/534.30 zh-TW,%20en-US - +cp1043.wikimedia.org 2137202531 2013-03-27T06:28:13 0.000077724 10.25.186.0 hit/200 2393 GET http://en.m.wikipedia.org/w/index.php?title=MediaWiki:Gadget-ReferenceTooltips.js&action=raw&ctype=text/javascript&508635914 - text/javascript; charset=UTF-8 http://en.m.wikipedia.org/wiki/Xbox - Mozilla/5.0%20(Linux;%20U;%20Android%204.2.2;%20en-us;%20SGH-T959%20Build/JDQ39;%20CyanogenMod-10.1)%20AppleWebKit/534.30%20(KHTML,%20like%20Gecko)%20Version/4.0%20Mobile%20Safari/534.30 en-US - +cp1043.wikimedia.org 2137202557 2013-03-27T06:28:13 0.000075579 10.21.64.0 hit/200 24658 GET http://en.m.wikipedia.org/wiki/%2B_(album) - text/html; charset=UTF-8 http://en.m.wikipedia.org/wiki?search=+%20(Ed%20Sheeran%20album) - Mozilla/5.0%20(iPod;%20CPU%20iPhone%20OS%206_1_2%20like%20Mac%20OS%20X)%20AppleWebKit/536.26%20(KHTML,%20like%20Gecko)%20Mobile/10B146 en-us - +cp1041.eqiad.wmnet 2667705793 2013-03-27T06:28:13 0.004090309 10.228.106.0 miss/200 60609 GET http://en.m.wikipedia.org/wiki/List_of_unusual_deaths - text/html; charset=UTF-8 - 41.220.68.33 Opera/9.80%20(J2ME/MIDP;%20Opera%20Mini/4.2/29.3075;%20U;%20en)%20Presto/2.8.119%20Version/11.10 en - +cp1044.wikimedia.org 2133042769 2013-03-27T06:28:13 0.000080824 10.207.69.0 hit/200 13565 GET http://en.m.wikipedia.org/wiki/Georgia_Guidestones - text/html; charset=UTF-8 - - Mozilla/5.0%20(iPhone;%20CPU%20iPhone%20OS%206_1_3%20like%20Mac%20OS%20X)%20AppleWebKit/536.26%20(KHTML,%20like%20Gecko)%20Version/6.0%20Mobile/10B329%20Safari/8536.25 en-us - +cp1042.eqiad.wmnet 2667901256 2013-03-27T06:28:13 0.000089884 10.133.49.0 hit/200 314 GET http://ru.m.wikipedia.org/w/api.php?action=opensearch&limit=15&namespace=0&format=json&search=%D0%93%D0%90%D0%A0&format=json - application/json; charset=utf-8 http://ru.m.wikipedia.org/wiki/%D0%A5%D0%BB%D0%B0%D0%BC%D0%B8%D0%B4%D0%B8%D0%BE%D0%B7 - Mozilla/5.0%20(Macintosh;%20U;%20Intel%20Mac%20OS%20X%2010_6_3;%20HTC_SensationXL_Beats_X315e;%20ru-ua)%20AppleWebKit/533.16%20(KHTML,%20like%20Gecko)%20Version/5.0%20Safari/533.16 ru-UA,%20en-US - +cp1044.wikimedia.org 2133042812 2013-03-27T06:28:13 0.000101805 10.88.122.0 hit/200 1739 GET http://zh.m.wikipedia.org/wiki/%E6%BD%98%E4%BD%99%E5%9D%87 - text/vnd.wap.wml http://m.baidu.com/ssid=0/from=2001a/bd_page_type=1/uid=B038ADB32B73C11317694BB830466A3A/s?word=%e6%bd%98%e4%bd%99%e5%9d%87&uc_param_str=upssntdnvelami&st_1=111041&st_2=102041&pu=sz%401321_1003&idx=30000&tn_1=webmain&tn_2=fwapadv&ct_1=%e7%99%be%e5%ba%a6%e4%b8%80%e4%b8%8b 10.36.202.44 JUC(Linux;U;2.3.3;Zh_cn;C8650;320*480;) en,%20zh-cn - +cp1041.eqiad.wmnet 2667705919 2013-03-27T06:28:13 0.482581615 10.167.158.0 miss/200 57287 GET http://es.m.wikipedia.org/wiki/Salvador_Dal%C3%AD - text/html; charset=UTF-8 - - Mozilla/5.0%20(iPhone;%20CPU%20iPhone%20OS%206_1_3%20like%20Mac%20OS%20X)%20AppleWebKit/536.26%20(KHTML,%20like%20Gecko)%20Version/6.0%20Mobile/10B329%20Safari/8536.25 es-es - +cp1042.eqiad.wmnet 2667901351 2013-03-27T06:28:13 0.001424789 10.145.210.0 miss/200 17432 GET http://en.m.wikipedia.org/wiki/Nephrotic_syndrome - text/html; charset=UTF-8 http://www.google.com/search?client=ms-opera-mini&channel=new&hl=en&ie=UTF-8&q=nephrotic+syndrome 213.55.73.35 Opera/9.80%20(J2ME/MIDP;%20Opera%20Mini/7.0.31606/29.3075;%20U;%20en)%20Presto/2.8.119%20Version/11.10 en - +cp1044.wikimedia.org 2133042922 2013-03-27T06:28:13 0.000078201 10.165.5.0 hit/304 0 GET http://ja.m.wikipedia.org/wiki/%E7%9C%9F%E9%81%B8%E7%B5%84 - text/html; charset=UTF-8 http://ja.m.wikipedia.org/wiki/%E9%8A%80%E9%AD%82%E3%81%AE%E7%99%BB%E5%A0%B4%E4%BA%BA%E7%89%A9%E4%B8%80%E8%A6%A7#section_2 - Mozilla/5.0%20(Linux;%20U;%20Android%204.0.4;%20ja-jp;%20SBM200SH%20Build/S0016)%20AppleWebKit/534.30%20(KHTML,%20like%20Gecko)%20Version/4.0%20Mobile%20Safari/534.30 ja-JP,%20en-US - +cp1041.eqiad.wmnet 2667706009 2013-03-27T06:28:13 0.342918634 10.176.5.0 miss/200 5744 GET http://en.m.wikipedia.org/wiki/Scott_Raab - text/html; charset=UTF-8 http://www.google.com.au/search?q=scott+raab&hl=en&oq=scott+raab&gs_l=mobile-heirloom-serp.3...0.0.1.43.0.0.0.0.0.0.0.0..0.0.les%3B..0.0...1c.fTWeQpdIg4o - Mozilla/5.0%20(compatible;%20MSIE%209.0;%20Windows%20Phone%20OS%207.5;%20Trident/5.0;%20IEMobile/9.0;%20NOKIA;%20Lumia%20800) en-AU - +cp1043.wikimedia.org 2137202778 2013-03-27T06:28:13 0.000077248 10.142.48.0 hit/200 2393 GET http://en.m.wikipedia.org/w/index.php?title=MediaWiki:Gadget-ReferenceTooltips.js&action=raw&ctype=text/javascript&508635914 - text/javascript; charset=UTF-8 http://en.m.wikipedia.org/wiki/Walking_Dead - Mozilla/5.0%20(Linux;%20U;%20Android%204.1.2;%20en-us;%20Nexus%20S%20Build/JZO54K)%20AppleWebKit/534.30%20(KHTML,%20like%20Gecko)%20Version/4.0%20Mobile%20Safari/534.30 en-US - +cp1042.eqiad.wmnet 2667901503 2013-03-27T06:28:14 0.304436445 10.87.241.0 miss/200 3719 GET http://ru.m.wikipedia.org/w/index.php?title=Special%3ASearch&search=%D0%BF%D0%B5%D0%BB%D0%BE%D0%BF%D0%BE%D0%BD%D0%B5%D1%81 - text/html; charset=UTF-8 http://ru.m.wikipedia.org/wiki/%D0%9A%D1%80%D0%B8%D1%82 - Mozilla/5.0%20(Linux;%20U;%20Android%202.3.5;%20ru-ru;%20HTC_WildfireS_A510e%20Build/GRJ90)%20AppleWebKit/533.1%20(KHTML,%20like%20Gecko)%20Version/4.0%20Mobile%20Safari/533.1 ru-RU,%20en-US - +cp1043.wikimedia.org 2137202865 2013-03-27T06:28:14 0.000072718 10.228.39.0 hit/200 318 GET http://en.m.wikipedia.org/favicon.ico - image/x-icon http://en.m.wikipedia.org/wiki/Compulsory_Rotatory_Residential_Internship - Mozilla/5.0%20(Linux;%20U;%20Android%202.2.2;%20en-us;%20LG-P970%20Build/FRG83G)%20AppleWebKit/533.1%20(KHTML,%20like%20Gecko)%20Version/4.0%20Mobile%20Safari/533.1%20MMS/LG-Android-MMS-V1.0/1.2 en-US - +cp1041.eqiad.wmnet 2667706152 2013-03-27T06:28:14 0.001775980 10.14.86.0 miss/200 26405 GET http://en.m.wikipedia.org/wiki/Robber_baron_(industrialist) - text/html; charset=UTF-8 - - Mozilla/4.0%20(PSP%20(PlayStation%20Portable);%202.00) en - +cp1042.eqiad.wmnet 2667901563 2013-03-27T06:28:14 0.292754173 2600:::::fd1a::103 pass/200 7418 GET http://en.m.wikipedia.org/wiki/Rock_Steady_(The_Whispers_song) - text/html; charset=UTF-8 http://www.google.com/search?hl=en&redir_esc=&client=ms-android-verizon&source=android-launcher-search&v=141338691&qsubts=1364365695916&q=whispers+rock+steady+album - Mozilla/5.0%20(Linux;%20U;%20Android%204.0.4;%20en-us;%20DROID%20RAZR%204G%20Build/6.7.2-180_DHD-16_M4-31)%20AppleWebKit/534.30%20(KHTML,%20like%20Gecko)%20Version/4.0%20Mobile%20Safari/534.30 en-US - +cp1041.eqiad.wmnet 2667706193 2013-03-27T06:28:14 0.411927462 10.17.95.0 miss/200 13840 GET http://ru.m.wikipedia.org/wiki/%D0%A1%D0%BC%D0%B0%D0%B9%D0%BB%D0%B8%D0%BA - text/html; charset=UTF-8 http://www.google.by/search?hl=ru&redir_esc=&client=ms-android-sonyericsson&source=android-launcher-widget&v=141400000&qsubts=1364365648825&q=%D1%80%D0%B5%D0%BA%D0%BB%D0%B0%D0%BC%D0%B0+15+%D0%BB%D0%B5%D1%82+%D1%81%D0%BC%D0%B0%D0%B9%D0%BB%D0%B8%D0%BA+%D0%B8%D1%81%D0%BF%D0%BE%D0%BB%D1%8C%D0%B7%D1%83%D0%B5%D1%82%D1%81%D1%8F - Mozilla/5.0%20(Linux;%20U;%20Android%204.0.4;%20ru-ru;%20SonyEricssonST27i%20Build/6.1.1.B.1.10)%20AppleWebKit/534.30%20(KHTML,%20like%20Gecko)%20Version/4.0%20Mobile%20Safari/534.30 ru-RU,%20en-US - +cp1042.eqiad.wmnet 2667901597 2013-03-27T06:28:14 0.001672983 10.145.208.0 miss/200 21165 GET http://ru.m.wikipedia.org/wiki/%D0%9C%D0%B5%D1%82%D0%B0%D0%BC%D0%BE%D1%80%D1%84%D0%B8%D1%87%D0%B5%D1%81%D0%BA%D0%B8%D0%B5_%D0%B3%D0%BE%D1%80%D0%BD%D1%8B%D0%B5_%D0%BF%D0%BE%D1%80%D0%BE%D0%B4%D1%8B - text/html; charset=UTF-8 - 90.133.72.212 Opera/9.80%20(Android;%20Opera%20Mini/6.5.26571/29.3054;%20U;%20ru)%20Presto/2.8.119%20Version/11.10 ru,en;q=0.9 - diff --git a/kraken-pig/src/test/resources/testdata_session.csv b/kraken-pig/src/test/resources/testdata_session.csv new file mode 100644 index 0000000..84b1bb3 --- /dev/null +++ b/kraken-pig/src/test/resources/testdata_session.csv @@ -0,0 +1,2 @@ +ssl1003 3826230220 2013-06-20T06:58:17.386 0.000 127.0.0.1 -/204 208 GET https://bits.wikimedia.org/event.gif NONE/bits - https://en.wikipedia.org/wiki/Photon - Mozilla/5.0%20(Macintosh;%20Intel%20Mac%20OS%20X%2010_6_8)%20AppleWebKit/537.36%20(KHTML,%20like%20Gecko)%20Chrome/27.0.1453.116%20Safari/537.36 en-US,en;q=0.8 - +ssl3002 3398747920 2013-06-20T06:54:53.298 0.281 127.0.0.1 -/200 10601 GET https://bits.wikimedia.org/sv.wikipedia.org/load.php NONE/bits - https://sv.wikipedia.org/wiki/Dow_Jones_Industrial_Average - Mozilla/5.0%20(Macintosh;%20Intel%20Mac%20OS%20X%2010_6_8)%20AppleWebKit/537.36%20(KHTML,%20like%20Gecko)%20Chrome/27.0.1453.116%20Safari/537.36 sv-SE - -- To view, visit https://gerrit.wikimedia.org/r/83962 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: merged Gerrit-Change-Id: I0038c1c5ea7ad08fecf33710ba12791fac67f4e0 Gerrit-PatchSet: 1 Gerrit-Project: analytics/kraken Gerrit-Branch: master Gerrit-Owner: Diederik <[email protected]> Gerrit-Reviewer: Diederik <[email protected]> _______________________________________________ MediaWiki-commits mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
