Home » Eclipse Projects » Subversive » Subversive History Extremely Slow
| Subversive History Extremely Slow [message #16067] |
Wed, 16 April 2008 04:38  |
 nikolaus heger
Messages: 16
Registered: July 2009 |
Junior Member |
|
|
Hi,
When I do a command line svn log, it takes about 1 second and MenuMeters
shows me that it downloads a few KB before it's done.
When I do the same thing from within Eclipse using subversion, it takes a
very long time, and downloads a very large amount of data. MenuMeters shows
I am maxing out my line with 400KB/second for several minutes. Other
subversive operations are fine, e.g. Update and commit are fast and work
well.
This is on OS X 10.5 svn command line client 1.4.6 and the latest
Eclipse/sunversive client, happens with all settings I have tried, both
SVNKit and JavaHL connectors.
"Show history" shows a progress of 32% when this happens, the SVN command
line nothing until the very end. E.g. I don't think the SVN command is
taking all that time. What could be downloading huge amounts of data every
time, and how can I fix it?
Our repository layout is
/modules
/otherstuff
And my eclipse workspace pointed to
/modules/moduleA/trunk
Any help would be much appreciated...
Nikolaus Heger
|
|
|
| Re: Subversive History Extremely Slow [message #16520 is a reply to message #16067] |
Thu, 17 April 2008 14:46  |
nikolaus heger
Messages: 16
Registered: July 2009 |
Junior Member |
|
|
Guys, does anybody have any ideas on this? I didn't find anything about this
on the web so I guess it's not all that common.
How can I debug this further?
Thanks, N.
On 16.04.2008 11:38, in article C42B95CF.5D7%nheger@gmail.com, "Nik Heger"
<nheger@gmail.com> wrote:
Hi,
When I do a command line svn log, it takes about 1 second and MenuMeters
shows me that it downloads a few KB before it's done.
When I do the same thing from within Eclipse using subversion, it takes a
very long time, and downloads a very large amount of data. MenuMeters shows
I am maxing out my line with 400KB/second for several minutes. Other
subversive operations are fine, e.g. Update and commit are fast and work
well.
This is on OS X 10.5 svn command line client 1.4.6 and the latest
Eclipse/sunversive client, happens with all settings I have tried, both
SVNKit and JavaHL connectors.
"Show history" shows a progress of 32% when this happens, the SVN command
line nothing until the very end. E.g. I don't think the SVN command is
taking all that time. What could be downloading huge amounts of data every
time, and how can I fix it?
Our repository layout is
/modules
/otherstuff
And my eclipse workspace pointed to
/modules/moduleA/trunk
Any help would be much appreciated...
Nikolaus Heger
|
|
|
| Re: Subversive History Extremely Slow [message #16554 is a reply to message #16067] |
Fri, 18 April 2008 01:59 |
nikolaus heger
Messages: 16
Registered: July 2009 |
Junior Member |
|
|
More information: I tested on a svn server hosted by cvsdude, and History
performs as expected.
One difference seems to be that the cvsdude svn server is accessed via https
and ours via the svn:// protocol - ours is on a VPN so we don't really need
https security.
Are there known problems with subversive and the svn:// protocol?
Thanks, N.
On 16.04.2008 11:38, in article C42B95CF.5D7%nheger@gmail.com, "Nik Heger"
<nheger@gmail.com> wrote:
Hi,
When I do a command line svn log, it takes about 1 second and MenuMeters
shows me that it downloads a few KB before it's done.
When I do the same thing from within Eclipse using subversion, it takes a
very long time, and downloads a very large amount of data. MenuMeters shows
I am maxing out my line with 400KB/second for several minutes. Other
subversive operations are fine, e.g. Update and commit are fast and work
well.
This is on OS X 10.5 svn command line client 1.4.6 and the latest
Eclipse/sunversive client, happens with all settings I have tried, both
SVNKit and JavaHL connectors.
"Show history" shows a progress of 32% when this happens, the SVN command
line nothing until the very end. E.g. I don't think the SVN command is
taking all that time. What could be downloading huge amounts of data every
time, and how can I fix it?
Our repository layout is
/modules
/otherstuff
And my eclipse workspace pointed to
/modules/moduleA/trunk
Any help would be much appreciated...
Nikolaus Heger
|
|
|
| Re: Subversive History Extremely Slow [message #16602 is a reply to message #16554] |
Fri, 18 April 2008 06:46 |
nikolaus heger
Messages: 16
Registered: July 2009 |
Junior Member |
|
|
I have filed a bug here:
https://bugs.eclipse.org/bugs/show_bug.cgi?id=227708
I now don't think it's the svn protocol, rather it seems to happen for files
where:
- There are branches / tags
- Not all branches / tags are checked out locally
If I add a new file to trunk - meaning there won't be any branches of it -
history and compare are reasonably fast.
On 18.04.2008 08:59, in article C42E137F.63D%nheger@gmail.com, "Nik Heger"
<nheger@gmail.com> wrote:
More information: I tested on a svn server hosted by cvsdude, and History
performs as expected.
One difference seems to be that the cvsdude svn server is accessed via https
and ours via the svn:// protocol - ours is on a VPN so we don't really need
https security.
Are there known problems with subversive and the svn:// protocol?
Thanks, N.
On 16.04.2008 11:38, in article C42B95CF.5D7%nheger@gmail.com, "Nik Heger"
<nheger@gmail.com> wrote:
Hi,
When I do a command line svn log, it takes about 1 second and MenuMeters
shows me that it downloads a few KB before it's done.
When I do the same thing from within Eclipse using subversion, it takes a
very long time, and downloads a very large amount of data. MenuMeters shows
I am maxing out my line with 400KB/second for several minutes. Other
subversive operations are fine, e.g. Update and commit are fast and work
well.
This is on OS X 10.5 svn command line client 1.4.6 and the latest
Eclipse/sunversive client, happens with all settings I have tried, both
SVNKit and JavaHL connectors.
"Show history" shows a progress of 32% when this happens, the SVN command
line nothing until the very end. E.g. I don't think the SVN command is
taking all that time. What could be downloading huge amounts of data every
time, and how can I fix it?
Our repository layout is
/modules
/otherstuff
And my eclipse workspace pointed to
/modules/moduleA/trunk
Any help would be much appreciated...
Nikolaus Heger
|
|
| |
| Re: Subversive History Extremely Slow [message #16823 is a reply to message #16602] |
Tue, 22 April 2008 06:00 |
nikolaus heger
Messages: 16
Registered: July 2009 |
Junior Member |
|
|
I updated the bug https://bugs.eclipse.org/bugs/show_bug.cgi?id=227708
I have found a potential cause for the slowness.
When I issue a "svn log --verbose (filename)" on one of the slow files, I
get a list of "changed paths" which each revision. That is interesting but
has a fatal problem with the initial revision. The file was there from the
beginning, and our repository was set up from scratch with an existing code
base, so the last rev looks like this:
r9 | rob | 2008-04-06 12:54:48 +0700 (Sun, 06 Apr 2008) | 1 line
Changed paths:
A /modules/moduleA
A /modules/moduleA/branches
A /modules/moduleA/branches/branch1
.....
And it now goes on to list all 55,000 files that were checked in on the
initial checkin, each one on it's own line. That's over 6MB of data, just
for the log on a single file. All operations that use a verbose svn log
would be affected by this.
It compresses fairly well but even compressed a file with the same content
(copied and pasted) is still close to 400KB, more than I want to download to
get the history.
The link I mentioned above mentions that the authors implemented a client
side log caching algorithm. That's very simple to do since the svn log is
always moving forward. Therefore, if you locally cached the log up to rev
X, all you would need to do to get the new log up to revision Y is do a svn
log from rev X to rev Y, then append that partial log to the cached log.
Huge amounts of bandwidth would be saved, and the system would be way
faster.
So this is a feature request. In the meantime, I am going to check into how
we can restructure our repository such that this doesn't happen quite so
badly. HTTP compression would probably help a lot.
Supposedly, TortoiseSVN on Windows does log caching as well.
|
|
|
Goto Forum:
Current Time: Thu Apr 25 13:46:59 GMT 2024
Powered by FUDForum. Page generated in 0.03507 seconds |
] 
Search
Help
Register
Login
Home
