De:YaCyPeerProcess

Aus YaCyWiki
Wechseln zu: Navigation, Suche

Abläufe im Peer

Starten=

Icon work.png TODO: Das Log mal in die einzelnen Stages zerlegen und erklären

2009/08/12 09:49:16 STARTUP Java version: 1.6.0_03
S 2009/08/12 09:49:17 STARTUP Operation system: Windows XP
S 2009/08/12 09:49:17 STARTUP Application root-path: C:\Programme\Netz\YaCy
S 2009/08/12 09:49:17 STARTUP Time zone: UTC+0200; UTC+0000 is 1250063356838
S 2009/08/12 09:49:17 STARTUP Maximum file system path length: 255
I 2009/08/12 09:49:17 PLASMA This is the pro-version of YaCy
I 2009/08/12 09:49:19 HeapReader generating index for C:\Programme\Netz\YaCy\DATA\INDEX\freeworld\NETWORK\seed.new.heap, 0 MB. Please wait.
I 2009/08/12 09:49:19 HeapReader finished index generation for C:\Programme\Netz\YaCy\DATA\INDEX\freeworld\NETWORK\seed.new.heap, 53 entries, 20 gaps.
I 2009/08/12 09:49:19 kelondroBLOBHeap BLOB seed.new.heap: merged 0 free records
I 2009/08/12 09:49:19 HeapReader generating index for C:\Programme\Netz\YaCy\DATA\INDEX\freeworld\NETWORK\seed.old.heap, 0 MB. Please wait.
I 2009/08/12 09:49:19 HeapReader finished index generation for C:\Programme\Netz\YaCy\DATA\INDEX\freeworld\NETWORK\seed.old.heap, 48 entries, 23 gaps.
I 2009/08/12 09:49:19 kelondroBLOBHeap BLOB seed.old.heap: merged 0 free records
I 2009/08/12 09:49:20 HeapReader generating index for C:\Programme\Netz\YaCy\DATA\INDEX\freeworld\NETWORK\seed.pot.heap, 0 MB. Please wait.
I 2009/08/12 09:49:20 HeapReader finished index generation for C:\Programme\Netz\YaCy\DATA\INDEX\freeworld\NETWORK\seed.pot.heap, 52 entries, 17 gaps.
I 2009/08/12 09:49:20 kelondroBLOBHeap BLOB seed.pot.heap: merged 0 free records
I 2009/08/12 09:49:20 ECOTABLE initialization of C:\Programme\Netz\YaCy\DATA\INDEX\freeworld\NETWORK\news.db: available RAM: 472MB, allocating space for 2632 entries
I 2009/08/12 09:49:20 ECOTABLE C:\Programme\Netz\YaCy\DATA\INDEX\freeworld\NETWORK\news.db: EcoTable C:\Programme\Netz\YaCy\DATA\INDEX\freeworld\NETWORK\news.db has table copy ENABLED
I 2009/08/12 09:49:20 ECOTABLE initializing RAM index for EcoTable news.db, please wait.
W 2009/08/12 09:49:21 KELONDRO USEDC inconsistency at startup: calculated_used = 18, USEDC = 7, FREEC = 12, recordsize = 48, file = C:\Programme\Netz\YaCy\DATA\INDEX\freeworld\NETWORK\newsOut.stack
W 2009/08/12 09:49:21 KELONDRO USEDC inconsistency at startup: calculated_used = 2799, USEDC = 2640, FREEC = 0, recordsize = 48, file = C:\Programme\Netz\YaCy\DATA\INDEX\freeworld\NETWORK\newsIn.stack
I 2009/08/12 09:49:21 PLASMA Initializing Segment 'C:\Programme\Netz\YaCy\DATA\INDEX\freeworld\TEXT', word hash cache size is 49266.
I 2009/08/12 09:49:21 HeapReader generating index for C:\Programme\Netz\YaCy\DATA\INDEX\freeworld\TEXT\RICELL\index.20090806202419406.blob, 1750 MB. Please wait.
I 2009/08/12 09:50:29 HeapReader finished index generation for C:\Programme\Netz\YaCy\DATA\INDEX\freeworld\TEXT\RICELL\index.20090806202419406.blob, 2419017 entries, 0 gaps.
I 2009/08/12 09:50:29 HeapReader generating index for C:\Programme\Netz\YaCy\DATA\INDEX\freeworld\TEXT\RICELL\index.20090811205633369.blob, 19 MB. Please wait.
I 2009/08/12 09:50:31 HeapReader finished index generation for C:\Programme\Netz\YaCy\DATA\INDEX\freeworld\TEXT\RICELL\index.20090811205633369.blob, 75808 entries, 0 gaps.
I 2009/08/12 09:50:31 HeapReader generating index for C:\Programme\Netz\YaCy\DATA\INDEX\freeworld\TEXT\RICELL\index.20090811105500853.blob, 1342 MB. Please wait.
I 2009/08/12 09:51:24 HeapReader finished index generation for C:\Programme\Netz\YaCy\DATA\INDEX\freeworld\TEXT\RICELL\index.20090811105500853.blob, 2180723 entries, 0 gaps.
I 2009/08/12 09:51:24 HeapReader generating index for C:\Programme\Netz\YaCy\DATA\INDEX\freeworld\TEXT\RICELL\index.20090808093813296.blob, 1852 MB. Please wait.
I 2009/08/12 09:52:33 HeapReader finished index generation for C:\Programme\Netz\YaCy\DATA\INDEX\freeworld\TEXT\RICELL\index.20090808093813296.blob, 2577213 entries, 0 gaps.
I 2009/08/12 09:52:33 HeapReader generating index for C:\Programme\Netz\YaCy\DATA\INDEX\freeworld\TEXT\RICELL\index.20090811205633697.blob, 0 MB. Please wait.
I 2009/08/12 09:52:34 HeapReader finished index generation for C:\Programme\Netz\YaCy\DATA\INDEX\freeworld\TEXT\RICELL\index.20090811205633697.blob, 7979 entries, 0 gaps.
I 2009/08/12 09:52:34 HeapReader generating index for C:\Programme\Netz\YaCy\DATA\INDEX\freeworld\TEXT\RICELL\index.20090809155106150.blob, 1961 MB. Please wait.
I 2009/08/12 09:53:40 HeapReader finished index generation for C:\Programme\Netz\YaCy\DATA\INDEX\freeworld\TEXT\RICELL\index.20090809155106150.blob, 2952040 entries, 0 gaps.
I 2009/08/12 09:53:40 HeapReader generating index for C:\Programme\Netz\YaCy\DATA\INDEX\freeworld\TEXT\RICELL\index.20090810074918385.blob, 201 MB. Please wait.
I 2009/08/12 09:53:48 HeapReader finished index generation for C:\Programme\Netz\YaCy\DATA\INDEX\freeworld\TEXT\RICELL\index.20090810074918385.blob, 466575 entries, 0 gaps.
I 2009/08/12 09:53:49 HeapReader generating index for C:\Programme\Netz\YaCy\DATA\INDEX\freeworld\TEXT\RICELL\index.20090811205638572.blob, 32 MB. Please wait.
I 2009/08/12 09:53:51 HeapReader finished index generation for C:\Programme\Netz\YaCy\DATA\INDEX\freeworld\TEXT\RICELL\index.20090811205638572.blob, 106396 entries, 0 gaps.
I 2009/08/12 09:53:51 HeapReader generating index for C:\Programme\Netz\YaCy\DATA\INDEX\freeworld\TEXT\RICELL\index.20090809153407588.blob, 204 MB. Please wait.
I 2009/08/12 09:54:03 HeapReader finished index generation for C:\Programme\Netz\YaCy\DATA\INDEX\freeworld\TEXT\RICELL\index.20090809153407588.blob, 684710 entries, 0 gaps.
I 2009/08/12 09:54:03 HeapReader generating index for C:\Programme\Netz\YaCy\DATA\INDEX\freeworld\TEXT\RICELL\index.20090808143246296.blob, 200 MB. Please wait.
W 2009/08/12 09:54:15 kelondroBLOBHeap BLOB index.20090808143246296.blob: skiped not wellformed key °d
I 2009/08/12 09:56:07 PLASMA active crawl: uZx_aeN2DlQs - snippetGlobalText
I 2009/08/12 09:56:07 PLASMA active crawl: wNxpBQNmpV3b - /autoReCrawl/weekly/http://www.thezeitgeistmovement.com/
I 2009/08/12 09:56:07 PLASMA active crawl: yQrLTEWfNXKh - /autoReCrawl/daily/https://epetitionen.bundestag.de/
I 2009/08/12 09:56:07 HeapReader generating index for C:\Programme\Netz\YaCy\DATA\INDEX\freeworld\QUEUES\crawlProfilesPassive.heap, 0 MB. Please wait.
I 2009/08/12 09:56:07 HeapReader finished index generation for C:\Programme\Netz\YaCy\DATA\INDEX\freeworld\QUEUES\crawlProfilesPassive.heap, 0 entries, 0 gaps.
I 2009/08/12 09:56:07 PLASMA Loaded passive crawl profiles from file crawlProfilesPassive.heap, 0 entries, 0
W 2009/08/12 09:56:07 KELONDRO USEDC inconsistency at startup: calculated_used = 101, USEDC = 0, FREEC = 0, recordsize = 394, file = C:\Programme\Netz\YaCy\DATA\INDEX\freeworld\QUEUES\urlNoticePreStack
I 2009/08/12 09:56:09 YACY BOOTSTRAP: 53 seeds known from previous run
I 2009/08/12 09:56:14 HeapReader generating index for C:\Programme\Netz\YaCy\DATA\PLASMADB\crawlRobotsTxt.heap, 0 MB. Please wait.
I 2009/08/12 09:56:14 HeapReader finished index generation for C:\Programme\Netz\YaCy\DATA\PLASMADB\crawlRobotsTxt.heap, 0 entries, 0 gaps.
I 2009/08/12 09:56:14 PLASMA HTCACHE Path = C:\Programme\Netz\YaCy\DATA\HTCACHE
I 2009/08/12 09:56:14 HeapReader generating index for C:\Programme\Netz\YaCy\DATA\HTCACHE\responseHeader.heap, 221 MB. Please wait.
...

I 2009/08/12 09:56:34 YACY BOOTSTRAP: 0 seeds from seed-list URL http://www.yacy.net/seed.txt, AGE=7044h
I 2009/08/12 09:56:35 YACY BOOTSTRAP: 55 seeds from seed-list URL http://home.arcor.de/hermens/yacy/seed.txt, AGE=0h
I 2009/08/12 09:57:07 PLASMA surrogates.in Path = C:\Programme\Netz\YaCy\DATA\SURROGATES\in
I 2009/08/12 09:57:07 PLASMA surrogates.out Path = C:\Programme\Netz\YaCy\DATA\SURROGATES\out
I 2009/08/12 09:57:07 PLASMA RELEASE Path = C:\Programme\Netz\YaCy\DATA\RELEASE
I 2009/08/12 09:57:07 PLASMA RELEASE Path = C:\Programme\Netz\YaCy\DATA\RELEASE
I 2009/08/12 09:57:07 HeapReader generating index for C:\Programme\Netz\YaCy\DATA\WORK\message.heap, 0 MB. Please wait.
I 2009/08/12 09:57:07 HeapReader finished index generation for C:\Programme\Netz\YaCy\DATA\WORK\message.heap, 0 entries, 0 gaps.
I 2009/08/12 09:57:07 HeapReader generating index for C:\Programme\Netz\YaCy\DATA\WORK\wiki.heap, 0 MB. Please wait.
I 2009/08/12 09:57:07 HeapReader finished index generation for C:\Programme\Netz\YaCy\DATA\WORK\wiki.heap, 0 entries, 0 gaps.
I 2009/08/12 09:57:07 HeapReader generating index for C:\Programme\Netz\YaCy\DATA\WORK\wiki-bkp.heap, 0 MB. Please wait.
I 2009/08/12 09:57:07 HeapReader finished index generation for C:\Programme\Netz\YaCy\DATA\WORK\wiki-bkp.heap, 0 entries, 0 gaps.
I 2009/08/12 09:57:07 HeapReader generating index for C:\Programme\Netz\YaCy\DATA\WORK\blog.heap, 0 MB. Please wait.
...
I 2009/08/12 09:57:07 BOOKMARKS rebuilding tags.db from bookmarks.db...
I 2009/08/12 09:57:07 BOOKMARKS Rebuilt 5 tags using your 51 bookmarks.
I 2009/08/12 09:57:08 PARSER Searching for additional content parsers in package de.anomic.plasma.parser
I 2009/08/12 09:57:08 PARSER Found functional parser for mimeType 'application/x-zip'.
	Name:    Compressed Archive File Parser
	Version: 0.1
	Class:   de.anomic.plasma.parser.zip.zipParser
I 2009/08/12 09:57:08 PARSER Found functional parser for mimeType 'application/java-archive'.
	Name:    Compressed Archive File Parser
	Version: 0.1
	Class:   de.anomic.plasma.parser.zip.zipParser
I 2009/08/12 09:57:08 PARSER Found functional parser for mimeType 'application/zip'.
	Name:    Compressed Archive File Parser
	Version: 0.1
....
I 2009/08/12 09:57:22 PROXY Proxy access logging configuration done.
S 2009/08/12 09:57:22 HTTPDFiles Loading mime mapping file httpd.mime
I 2009/08/12 09:57:26 YACY yacyClient.publishMySeed thread 'PublishSeed_kellerlanplayerRoot' contacted peer at 188.40.55.86:8080, received 10744 bytes, time = 6062 milliseconds
D 2009/08/12 09:57:26 CRAWLER LOCALCRAWL[5996, 0, 0, 0]: URL=http://demowatch.de/organisations/93-nonazisinbad-gegen-nazis-in-baden-baden-und-umgebung, initiator=2nC5ykaA2T__, crawlOrder=true, depth=2, crawlDepth=3, must-match=.*, must-not-match=, permission=false
I 2009/08/12 09:57:26 YACY yacyClient.publishMySeed thread 'PublishSeed_KIT01-01F-GEOCACHING' contacted peer at 141.52.175.31:8080, received 10909 bytes, time = 6156 milliseconds
D 2009/08/12 09:57:27 ROBOTS Trying to download the robots.txt file from URL 'http://custom.simplemachines.org/robots.txt'.
D 2009/08/12 09:57:27 CRAWLER LOCALCRAWL[5988, 0, 0, 0]: URL=http://www.bund.de/cln_135/sid_F46DEABA5C2B7CBC446FE9F0A4A28555/DE/Immobilien/Functions/Gewerbe/gewerbe_node.html, initiator=2nC5ykaA2T__, crawlOrder=true, depth=2, crawlDepth=3, must-match=.*, must-not-match=, permission=false
D 2009/08/12 09:57:42 CRAWLER LOCALCRAWL[5974, 44, 0, 0]: URL=http://demowatch.de/tag/Baden-W%C3%BCrttemberg, initiator=2nC5ykaA2T__, crawlOrder=true, depth=2, crawlDepth=3, must-match=.*, must-not-match=, permission=true
I 2009/08/12 09:57:43 RICELL-shrink1 unmountBestMatch(2.0, 268435456)
D 2009/08/12 09:57:43 CRAWLER LOCALCRAWL[5973, 45, 0, 0]: URL=http://www.nickles.de/v3/tools/postingsV2.php?id_edit=538565173, initiator=2nC5ykaA2T__, crawlOrder=true, depth=3, crawlDepth=4, must-match=.*nickles.de.*, must-not-match=, permission=true
I 2009/08/12 09:57:43 IODispatcher appended merge job of files index.20090811205633369.blob, index.20090811205638572.blob to index.20090812075743103.blob
D 2009/08/12 09:57:43 CRAWLER Crawling of URL 'http://www.nickles.de/v3/tools/postingsV2.php?id_edit=538565173' disallowed by robots.txt.
I 2009/08/12 09:57:43 RICELL-shrink2 unmountSmallest(268435456)
I 2009/08/12 09:57:43 IODispatcher appended merge job of files index.20090811205633697.blob, index.20090808143246296.blob to index.20090812075743697.blob
I 2009/08/12 09:57:43 BLOBArray merging index.20090811205633369.blob with index.20090811205638572.blob

Crawling

Parsen

Indizieren

RWI

Einordnen

Verteilen

Beispiel Seiten hinzufügen

Beispiel Suche