Eclipse Community Forums
Forum Search:

Search      Help    Register    Login    Home
Home » Language IDEs » PHP Development Tools (PDT) » DLTK indexing EXTREMLY slow
DLTK indexing EXTREMLY slow [message #1393961] Fri, 04 July 2014 15:00 Go to next message
Tomasz Ch is currently offline Tomasz ChFriend
Messages: 4
Registered: July 2014
Junior Member
Hi guys,

recently I've migrated to eclipse luna/pdt from phpeclipse (i know, it's a dinosaur, actually I've just reminded why I had not done it before). phpeclipse doesn't support syntax standards introduced recently, and this is what pushed me to make a change. it makes working with namespces etc. impossible.
eclipse pdt is not better for me though. It supports fresh syntax, but coding is literally IMPOSSIBLE when working with huge frameworks. I created new fresh workspace (i'm working on network drive), imported projects from repositories, libraries (including ZF1 & ZF2 - mapped this as include paths to link it to other projects supported by these frameworks). Much time put in this operation. After all it came out completely useless! DLTK indexing takes AGES (it takes about 30-40 s for a single ZF source file! it's going to take light ages to index the whole framework!). While eclipse indexes the files, coding is not possible at all. It takes about 4-5 s to type a single character. while waiting for character to appear on the screen, eclipse hangs and stops responding. It's been a couple of days since migrated, tested on 2 different network drives.
As mentioned, I'm working on Eclipse luna/pdt, windows 7, workspace is a network drive (i/o speed is fair - all through lan). I've also uninstalled GIT extension.
I've already gone through "5 ways to improve ..." with no effect. Last, but not least, I'm not planning to turn off building workspace. I find it very useful and that would not solve the problem.
Any clues what could be wrong? Are there fellows developers that use similar parameters and having no problems?

thanks!
Tom
Re: DLTK indexing EXTREMLY slow [message #1394142 is a reply to message #1393961] Fri, 04 July 2014 21:32 Go to previous messageGo to next message
Tomasz Ch is currently offline Tomasz ChFriend
Messages: 4
Registered: July 2014
Junior Member
update - now it's been indexing one single php file for 30 mins already. it is a controller file, 190 lines long, wide max 200 chars. I don't have any problem with accessing this file over samba.
Noticed that while indexing my .metadata\.plugins\org.eclipse.dltk.core.index.sql.h2\model.trace.db was getting bigger and bigger, after printing its content found log that is being repeated

07-04 23:21:06 database: flush
org.h2.message.DbException: Polaczenie nie zostalo zamkniete [Connection has not been closed]
IO Exception: "java.io.IOException: Stream Closed"; "Y:/.metadata/.plugins/org.eclipse.dltk.core.index.sql.h2/model.h2.db" [90031-168]
at org.h2.message.DbException.get(DbException.java:158)
at org.h2.message.DbException.convertIOException(DbException.java:315)
at org.h2.store.FileStore.write(FileStore.java:330)
at org.h2.store.PageStore.writePage(PageStore.java:1327)
at org.h2.store.PageStreamData.write(PageStreamData.java:105)
at org.h2.store.PageOutputStream.storePage(PageOutputStream.java:146)
at org.h2.store.PageOutputStream.flush(PageOutputStream.java:154)
at org.h2.store.PageLog.flushOut(PageLog.java:856)
at org.h2.store.PageLog.flush(PageLog.java:663)
at org.h2.store.PageStore.flushLog(PageStore.java:986)
at org.h2.engine.Database.flush(Database.java:1780)
at org.h2.store.WriterThread.run(WriterThread.java:86)
at java.lang.Thread.run(Unknown Source)
Caused by: org.h2.jdbc.JdbcSQLException: Polaczenie nie zostalo zamkniete
IO Exception: "java.io.IOException: Stream Closed"; "Y:/.metadata/.plugins/org.eclipse.dltk.core.index.sql.h2/model.h2.db" [90031-168]
at org.h2.message.DbException.getJdbcSQLException(DbException.java:329)
... 13 more
Caused by: java.io.IOException: Stream Closed
at java.io.RandomAccessFile.writeBytes0(Native Method)
at java.io.RandomAccessFile.writeBytes(Unknown Source)
at java.io.RandomAccessFile.write(Unknown Source)
at org.h2.store.fs.FileDisk.write(FilePathDisk.java:438)
at org.h2.store.fs.FileUtils.writeFully(FileUtils.java:372)
at org.h2.store.FileStore.write(FileStore.java:327)
... 10 more


this is my org.eclipse.dltk.core.index.sql.h2 directory

-rwxrwxrwx 1 user user 71313408 07-04 23:03 model.h2.db
-rwxrw-rw- 1 user user 104 07-04 22:45 model.lock.db
-rwxrw-rw- 1 user user 4842303 07-04 23:37 model.trace.db


Re: DLTK indexing EXTREMLY slow [message #1394662 is a reply to message #1394142] Sat, 05 July 2014 17:50 Go to previous messageGo to next message
Dawid Pakula is currently offline Dawid PakulaFriend
Messages: 147
Registered: March 2013
Senior Member
PDT (DLTK) indexing everything into h2 database and highly use it on each process (CA, search, semantic highlights, override indicators...).

Unfortunately, this database is not indexed properly.

You should move your workspace into normal drive (even USB). Your projects still can be on network drive.

You can also try DLTK modified by me :
Update site zip: http://cl.ly/0x0Q1y3y3o3W
Source code (branch indexing): http://github.com/zulus/dltk.core/


[Updated on: Sat, 05 July 2014 17:53]

Report message to a moderator

Re: DLTK indexing EXTREMLY slow [message #1395414 is a reply to message #1394662] Sun, 06 July 2014 22:27 Go to previous messageGo to next message
Tomasz Ch is currently offline Tomasz ChFriend
Messages: 4
Registered: July 2014
Junior Member
Thank you for your answer, Dawid. I have already tried your library with no effect.

When I run eclipse on linux, indexing goes smoothly and fast.
Switching from windows to debian fixed the problem for me.
Re: DLTK indexing EXTREMLY slow [message #1395417 is a reply to message #1395414] Sun, 06 July 2014 22:32 Go to previous messageGo to next message
Dawid Pakula is currently offline Dawid PakulaFriend
Messages: 147
Registered: March 2013
Senior Member
Could you tell me how you was connected on windows and how you are connected on window?

Protocol, software ?


Re: DLTK indexing EXTREMLY slow [message #1395762 is a reply to message #1395417] Mon, 07 July 2014 11:10 Go to previous messageGo to next message
Tomasz Ch is currently offline Tomasz ChFriend
Messages: 4
Registered: July 2014
Junior Member
Server (debian) shares the data over samba, and I logged into it through my network on windows, and mapping as a network drive (after connecting to the network - outside the network resources are not available)
Re: DLTK indexing EXTREMLY slow [message #1395778 is a reply to message #1395762] Mon, 07 July 2014 11:41 Go to previous messageGo to next message
Dawid Pakula is currently offline Dawid PakulaFriend
Messages: 147
Registered: March 2013
Senior Member
Thanks again. As I remember, default debian samba configuration, can be painfull if pernament + some concurrent connections are required.

Re: DLTK indexing EXTREMLY slow [message #1552258 is a reply to message #1393961] Thu, 08 January 2015 03:21 Go to previous message
Toby Thain is currently offline Toby ThainFriend
Messages: 6
Registered: July 2009
Junior Member
It's very likely you need to increase Eclipse's maximum heap size.

Find the eclipse.ini and give -Xmx 1536 or 2048MB.

e.g. mine looks like this:

$ cat /Applications/eclipseLuna/Eclipse.app/Contents/MacOS/eclipse.ini 
-startup
../../../plugins/org.eclipse.equinox.launcher_1.3.0.v20140415-2008.jar
--launcher.library
../../../plugins/org.eclipse.equinox.launcher.cocoa.macosx.x86_64_1.1.200.v20140603-1326
-product
org.eclipse.epp.package.php.product
--launcher.defaultAction
openFile
-showsplash
org.eclipse.platform
--launcher.XXMaxPermSize
256m
--launcher.defaultAction
openFile
--launcher.appendVmargs
-vmargs
-Dosgi.requiredJavaVersion=1.7
-XstartOnFirstThread
-Dorg.eclipse.swt.internal.carbon.smallFonts
-XX:MaxPermSize=256m
-Xms64m
-Xmx2048m
-Xdock:icon=../Resources/Eclipse.icns
-XstartOnFirstThread
-Dorg.eclipse.swt.internal.carbon.smallFonts
Previous Topic:How to I add WSDL visual editor to Eclipse IDE Java 4.4.1
Next Topic:Content assist is not working
Goto Forum:
  


Current Time: Fri Sep 04 01:48:34 GMT 2015

Powered by FUDForum. Page generated in 0.04470 seconds
.:: Contact :: Home ::.

Powered by: FUDforum 3.0.2.
Copyright ©2001-2010 FUDforum Bulletin Board Software