Skip to main content

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [cross-project-issues-dev] Lucene version problem for DTP

I noticed that with Lucene 2.9, the format of pre-built index has changed.
This means: any documentation plugins that ship with a pre-built index (typically built using the Eclipse 3.6 basebuilder today) but then run against Eclipse 3.7 will need to have their index re-generated on performing a doc search the first time. Rebuilding the doc index can take in the range of 15 minutes on a large installation, and can create files of several MB size in the config area / user's home directory in a shared read-only installation. Which leads to very bad end user experience when performing the first search!
A couple learnings from this:
- For the Indigo Release, we'll want to ensure that Projects use a 3.7 based basebuilder early enough such that their prebuilt index has the new Lucene format.
- When upgrading to Lucene 3.0 is considered (and assuming that 3.0 uses yet another index format than 2.9) it's probably better doing that now than forcing yet another migration step on consumers in the future.
- Consider testing / documenting a scenario where the 2.9 Lucene Index can be added to existing old doc plugins with 1.9 index through fragments (like NL fragments)
- Consider testing / documenting a script that builds the doc index for an entire installation from commandline at end user's site (ie as part of an install program), in order to avoid the 15-minute-delay for the end user when he wants to search docs the first time
Martin Oberhuber, Senior Member of Technical Staff, Wind River
direct +43.662.457915.85  fax +43.662.457915.6

From: cross-project-issues-dev-bounces@xxxxxxxxxxx [mailto:cross-project-issues-dev-bounces@xxxxxxxxxxx] On Behalf Of Chris Goldthorpe
Sent: Donnerstag, 13. Jänner 2011 22:32
To: Cross project issues
Subject: Re: [cross-project-issues-dev] Lucene version problem for DTP

I can give some background is the bug that tracked upgrading to Lucene 2.9
Before the upgrade to 2.9.1  happened there was a lot of discussion about whether the API changes between Lucene 1.x and 2.x would impact clients and we ended up convincing ourselves that clients would be able to adapt to the change with little or no disruption.On a related topic a Bugzilla was just filed - requesting that we move to Lucene 3.x.

One thing I had not anticipated was that splitting the Lucene class files  into three bundles rather than two would cause any issues. Lucene 2.9.1 was already in the Orbit repository before the SDK switched to using it for the help system so I'm not aware of why it went from two bundles to three.

Have you tried creating an optional dependency to  org.apache.lucene.core?


From:        Brian Payton/Santa Teresa/IBM@IBMUS
To:        Cross project issues <cross-project-issues-dev@xxxxxxxxxxx>
Date:        01/13/2011 12:33 PM
Subject:        [cross-project-issues-dev] Lucene version problem for DTP
Sent by:        cross-project-issues-dev-bounces@xxxxxxxxxxx

Greetings Eclipse project leads,

We (the DTP project PMC) would like to call on the collective wisdom of the Eclipse projects.

DTP is having a runtime problem with the versions of Lucene (org.apache.lucene) that are shipped with Eclipse.  Eclipse versions up to 3.6 included Lucene 1.9.1.  In Eclipse 3.7, however, the Lucene plugin versions jumped to version 2.9.1.  As part of the version change, the main Lucene plugin (org.apache.lucene) was restructured so that its content moved into a new plugin named org.apache.lucene.core.

DTP makes use of Lucene services to implement one of its views, the SQL Results view.  When run against Eclipse 3.7, the SQL Results view does not open because the required Lucene classes cannot be found.

We build both of the current versions of  DTP (v1.8.2  for the Helios release train and v1.9 the Indigo release train), against Eclipse 3.6.1.  We prefer building on an earlier, known stable Eclipse release to provide flexibility for our adopters, who sometimes want to get the latest version of our project without upgrading their Eclipse base.  And up to now this hasn't been a problem; we have been able to run our DTP builds on "the next version" of Eclipse, because the binary compatibility has been good.  With Lucene in Eclipse 3.7 however, this appears to be no longer the case.

We would appreciate suggestions on how to address this.  Has any other project had to deal with this issue, or a similar one?  


Brian Payton

Data Tools Development
IBM Silicon Valley Laboratory
cross-project-issues-dev mailing list

Back to the top