Eclipse Community Forums: EGit / JGit » Automatic maintenance of application server side repository

Home » Eclipse Projects » EGit / JGit » Automatic maintenance of application server side repository(Automatic maintenance of application server side repository)

Show: Today's Messages :: Show Polls :: Message Navigator

Automatic maintenance of application server side repository [message #1240030]

Wed, 05 February 2014 15:14

Laurent Petit

Messages: 21
Registered: December 2010

Junior Member

Hello,

My web application uses a jgit repository to store content.

It can have a very high uptime (not being restarted for weeks or months).

When the client git is used on the command line, there are some "cleanup" operations that are done from time to time.

Out of the top of my head:

- garbage collection
- packing

What would be the best way to trigger these operations when a repository will be managed programatically by a very long running process ?

- I have found a gc() method, what about packing ?
- During the associated maintenance calls, what can be still performed in parallel on the git repository ( it's a web application, concurrent requests can occur ) ? I already serialize access to the "write" operations, should I consider these maintenance operations as "write operations" as well ? Do they generally last long ? Is there a scheduling policy that would minimize the time spent each time ?

Thanks in advance,

--
Laurent Petit

Report message to a moderator

Re: Automatic maintenance of application server side repository [message #1240080 is a reply to message #1240030]

Wed, 05 February 2014 16:55

Matthias Sohn

Messages: 1138
Registered: July 2009

Senior Member

- gc includes repacking and might take a long time and consume considerable resources (heap and CPU)
depending on the size and complexity of the repository
- you shouldn't run multiple gc commands concurrently on the same repository since this would waste a lot of
resources, if you try that anyway some of the concurrent runs may fail if they fail to acquire locks implemented
by LockFile [1] which is using atomic rename of the lock file to implement locking semantics in jgit. Native git
is using the same locking mechanism.
- there are only a few commands which modify existing objects in these cases jgit (and native git) use this
locking mechanism relying on the atomicity of renaming a file, on filesystems not providing atomic rename git's
locking mechanism won't work
- running other modifying operations like push, update ref etc should be safe to run while gc is running
- which kind of write operations is your application using ?
- why are you serializing write operations ? This severely limits scalability for these operations.

[1] https://git.eclipse.org/c/jgit/jgit.git/tree/org.eclipse.jgit/src/org/eclipse/jgit/internal/storage/file/LockFile.java

Report message to a moderator

Previous Topic:	Is there any GIT Console as happens for svn?
Next Topic:	Replace with HEAD Revision does not work

Goto Forum:

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

]

Current Time: Wed May 27 23:07:52 GMT 2020

.:: Contact :: Home ::.

Breadcrumbs

Sign up to our Newsletter