Eclipse Community Forums: SeMantic Information Logistics Architecture (SMILA)

Help

Home

Home » Archived » SeMantic Information Logistics Architecture (SMILA) » What do the DeltaIndexing?

Show: Today's Messages :: Show Polls :: Message Navigator

What do the DeltaIndexing? [message #660382]

Fri, 18 March 2011 08:49

SMILANewBee

Messages: 42
Registered: August 2010

Member

Hello,

we are looking at the DeltaIndexing and we are not sure about it. What it is doing? Our first assumption was that a crawled page isn't crawled twice if it was not changed on the web. But after considering the source we discover that delta indexing doesn't affect the crawling process but records changes of the records. So the change of a record is traceable over time.

Report message to a moderator

Re: What do the DeltaIndexing? [message #660785 is a reply to message #660382]

Mon, 21 March 2011 15:32

Igor Novakovic

Messages: 54
Registered: July 2009

Member

Hi,

Under delta indexing we consider a revisiting/reindexing of a dataset.
Thereby we want to reindex/reprocess only data objects which have
changed since the last crawling of the dataset so that we can reflect
those changes in index structures and/or ontologies created during
initial crawling.

A quote from
http://wiki.eclipse.org/SMILA/Documentation/DeltaIndexingMan ager states
exactly what it does:
"The DeltaIndexingManager stores information about the last modification
of each record and can determine if a record has changed since its last
processing..."

Cheers
Igor

Am 18.03.2011 09:49, schrieb SMILANewBee:
> Hello,
>
> we are looking at the DeltaIndexing and we are not sure about it. What
> it is doing? Our first assumption was that a crawled page isn't crawled
> twice if it was not changed on the web. But after considering the source
> we discover that delta indexing doesn't affect the crawling process but
> records changes of the records. So the change of a record is traceable
> over time.

Report message to a moderator

Previous Topic:	Nightly builds are now also available for Mac OS X!
Next Topic:	New SMILA tryout

Goto Forum:

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

]

Current Time: Thu Apr 25 13:21:15 GMT 2024

.:: Contact :: Home ::.

Breadcrumbs

Sign up to our Newsletter