Eclipse Community Forums
Forum Search:

Search      Help    Register    Login    Home
Home » Eclipse Projects » SeMantic Information Logistics Architecture (SMILA) » What do the DeltaIndexing?
What do the DeltaIndexing? [message #660382] Fri, 18 March 2011 08:49 Go to next message
SMILANewBee is currently offline SMILANewBee
Messages: 42
Registered: August 2010
Member
Hello,

we are looking at the DeltaIndexing and we are not sure about it. What it is doing? Our first assumption was that a crawled page isn't crawled twice if it was not changed on the web. But after considering the source we discover that delta indexing doesn't affect the crawling process but records changes of the records. So the change of a record is traceable over time.
Re: What do the DeltaIndexing? [message #660785 is a reply to message #660382] Mon, 21 March 2011 15:32 Go to previous message
Igor Novakovic is currently offline Igor Novakovic
Messages: 53
Registered: July 2009
Member
Hi,

Under delta indexing we consider a revisiting/reindexing of a dataset.
Thereby we want to reindex/reprocess only data objects which have
changed since the last crawling of the dataset so that we can reflect
those changes in index structures and/or ontologies created during
initial crawling.

A quote from
http://wiki.eclipse.org/SMILA/Documentation/DeltaIndexingMan ager states
exactly what it does:
"The DeltaIndexingManager stores information about the last modification
of each record and can determine if a record has changed since its last
processing..."

Cheers
Igor

Am 18.03.2011 09:49, schrieb SMILANewBee:
> Hello,
>
> we are looking at the DeltaIndexing and we are not sure about it. What
> it is doing? Our first assumption was that a crawled page isn't crawled
> twice if it was not changed on the web. But after considering the source
> we discover that delta indexing doesn't affect the crawling process but
> records changes of the records. So the change of a record is traceable
> over time.
Previous Topic:Nightly builds are now also available for Mac OS X!
Next Topic:New SMILA tryout
Goto Forum:
  


Current Time: Fri Sep 19 00:04:51 GMT 2014

Powered by FUDForum. Page generated in 0.12523 seconds
.:: Contact :: Home ::.

Powered by: FUDforum 3.0.2.
Copyright ©2001-2010 FUDforum Bulletin Board Software