Skip to main content


Eclipse Community Forums
Forum Search:

Search      Help    Register    Login    Home
Home » Eclipse Projects » EGit / JGit » Support for Large File Storage (LFS)
Support for Large File Storage (LFS) [message #1697484] Thu, 04 June 2015 10:12 Go to next message
paolo di tommaso is currently offline paolo di tommasoFriend
Messages: 22
Registered: July 2009
Junior Member
Does JGit support Git Large File Extension (https://git-lfs.github.com) ? or is there any plan to support it ?


Cheers,
Paolo
Re: Support for Large File Storage (LFS) [message #1697968 is a reply to message #1697484] Tue, 09 June 2015 22:34 Go to previous messageGo to next message
Matthias Sohn is currently offline Matthias SohnFriend
Messages: 1097
Registered: July 2009
Senior Member
JGit doesn't support LFS yet. We plan to start working on that.
Re: Support for Large File Storage (LFS) [message #1698018 is a reply to message #1697968] Wed, 10 June 2015 12:27 Go to previous messageGo to next message
paolo di tommaso is currently offline paolo di tommasoFriend
Messages: 22
Registered: July 2009
Junior Member
That's a very good news. In the meanwhile do you think there's any "hack" that would allow the LFS extension to be used with JGit ?
Re: Support for Large File Storage (LFS) [message #1698100 is a reply to message #1698018] Thu, 11 June 2015 08:53 Go to previous messageGo to next message
Christian Halstrick is currently offline Christian HalstrickFriend
Messages: 264
Registered: July 2009
Senior Member
See http://dev.eclipse.org/mhonarc/lists/jgit-dev/msg02908.html. I'll start working on that. I think there is no real hack available beforehand (aside using native git for "add", "checkout", "push"). lfs works with two filters and a hook which jgit doesn't recognize currently. You'll have to wait until JGit learns this and gather experience with native git to see whether LFS is really what you want.

Ciao
Chris
Re: Support for Large File Storage (LFS) [message #1698119 is a reply to message #1698100] Thu, 11 June 2015 12:41 Go to previous messageGo to next message
paolo di tommaso is currently offline paolo di tommasoFriend
Messages: 22
Registered: July 2009
Junior Member
That's great. Let me know if you may need help to test it.

Cheers, p
Re: Support for Large File Storage (LFS) [message #1709167 is a reply to message #1698100] Thu, 24 September 2015 14:59 Go to previous messageGo to next message
paolo di tommaso is currently offline paolo di tommasoFriend
Messages: 22
Registered: July 2009
Junior Member
Hey there,

Is there any update on Git LFS support ?

Cheers,
Paolo
Re: Support for Large File Storage (LFS) [message #1709169 is a reply to message #1709167] Thu, 24 September 2015 15:05 Go to previous messageGo to next message
Matthias Sohn is currently offline Matthias SohnFriend
Messages: 1097
Registered: July 2009
Senior Member
There are a few changes pending in review but our work on LFS stalled since another internal project got a higher priority, we will take this up again soon.
Re: Support for Large File Storage (LFS) [message #1709170 is a reply to message #1709169] Thu, 24 September 2015 15:08 Go to previous messageGo to next message
paolo di tommaso is currently offline paolo di tommasoFriend
Messages: 22
Registered: July 2009
Junior Member
OK. Thanks for the feedback.

Cheers,
Paolo
Re: Support for Large File Storage (LFS) [message #1709171 is a reply to message #1709169] Thu, 24 September 2015 15:09 Go to previous messageGo to next message
Matthias Sohn is currently offline Matthias SohnFriend
Messages: 1097
Registered: July 2009
Senior Member
The changes pending in review are here:
https://git.eclipse.org/r/q/project:jgit/jgit+is:open+message:LFS
https://git.eclipse.org/r/c/50371/
https://git.eclipse.org/r/50372
Re: Support for Large File Storage (LFS) [message #1716470 is a reply to message #1709171] Fri, 04 December 2015 08:45 Go to previous messageGo to next message
paolo di tommaso is currently offline paolo di tommasoFriend
Messages: 22
Registered: July 2009
Junior Member
Hello,

I'm wondering if there's any schedule for releasing the JGit support for the LFS protocol.


Cheers,
Paolo
Re: Support for Large File Storage (LFS) [message #1716475 is a reply to message #1716470] Fri, 04 December 2015 09:27 Go to previous messageGo to next message
Christian Halstrick is currently offline Christian HalstrickFriend
Messages: 264
Registered: July 2009
Senior Member
From Client side current EGit/JGit do support the LFS protocol. You can download the lfs tooling from https://git-lfs.github.com/ and configure your repo to use lfs. This will put some filter definitions in your .gitattributes and .gitconfig files. JGit/EGit has now learned to respect these .gitattribute settings and when adding content to the repo, pushing to the central server and checking out branches calls the right filters. Authentication to the github lfs server can be tricky to configure with egit/jgit (see https://github.com/github/git-lfs/blob/master/docs/api/README.md?utm_source=gitlfs_site&utm_medium=api_spec_link&utm_campaign=gitlfs#authentication) but it works. There is more work to be done (replace filter commands from github by java implementations, configuration in EGit)

Ciao
Chris
Re: Support for Large File Storage (LFS) [message #1716480 is a reply to message #1716475] Fri, 04 December 2015 10:16 Go to previous messageGo to next message
paolo di tommaso is currently offline paolo di tommasoFriend
Messages: 22
Registered: July 2009
Junior Member
That's sound great because I only need the client to pull/update data from a LFS repo.

Ciao,
Paolo
Re: Support for Large File Storage (LFS) [message #1716545 is a reply to message #1697484] Fri, 04 December 2015 16:57 Go to previous messageGo to next message
David North is currently offline David NorthFriend
Messages: 1
Registered: December 2015
Junior Member
I was excited to read that progress is being made on LFS support in EGit, and indeed I've confirmed - using a nightly build - that I can now check out a repository configured for LFS via the Eclipse UI and have it fetch the large files successfully.

However, committing large files and using the staging view on them seems broken, with errors along the lines of:

Caused by: java.io.EOFException: Input did not match supplied length. 22,323 bytes are missing.
	at org.eclipse.jgit.internal.storage.file.ObjectDirectoryInserter.shortInput(ObjectDirectoryInserter.java:248)


Is this a known issue? Is there anything I can do to help fix it?
Re: Support for Large File Storage (LFS) [message #1716646 is a reply to message #1716545] Mon, 07 December 2015 07:45 Go to previous messageGo to next message
Christian Halstrick is currently offline Christian HalstrickFriend
Messages: 264
Registered: July 2009
Senior Member
No, that bug is not known. Of course modifying/staging large files should work. It does work in Unit tests and when I try it out manually. I think you have found a bug which we have not seen yet. Please open a bug in https://bugs.eclipse.org and describe the bug. I really would like to debug this situation.

Ciao
Chris
Re: Support for Large File Storage (LFS) [message #1731475 is a reply to message #1716646] Thu, 05 May 2016 20:48 Go to previous messageGo to next message
Giancarlo Baldan is currently offline Giancarlo BaldanFriend
Messages: 1
Registered: May 2016
Junior Member
Has this bug report being filed? I could not find it in bugzilla.

I ask as I am experiencing the same problem. I am trying to work with an existing repository (created with native git) that supports lfs. While using git everything works smoothly, the staging area in eclipse reports the large files as unstaged when they are not and if I try to stage them (or even other new files that are unstaged for real) I get the same error "Input did not match supplied length". This causes other problems, for example during merging where the files get replaced with just the hooks.

I am using Eclipse Mars (4.5.2) with EGit 4.3 and I can provide screenshots, videos etc. I could even create a fake and small repository where this could be replicated.

Thanks for any suggestion,

Giancarlo.
Re: Support for Large File Storage (LFS) [message #1732148 is a reply to message #1731475] Thu, 12 May 2016 21:58 Go to previous message
Matthias Sohn is currently offline Matthias SohnFriend
Messages: 1097
Registered: July 2009
Senior Member
Try with the nightly build (4.4.0-SNAPSHOT) and report bugs you find in Bugzilla
Previous Topic:Missing extension points schema in EGit releases
Next Topic:Can't Merge into master
Goto Forum:
  


Current Time: Tue Oct 15 14:28:11 GMT 2019

Powered by FUDForum. Page generated in 0.02585 seconds
.:: Contact :: Home ::.

Powered by: FUDforum 3.0.2.
Copyright ©2001-2010 FUDforum Bulletin Board Software

Back to the top