Eclipse Community Forums: EGit / JGit » Support for Large File Storage (LFS)

Help

Home

Home » Eclipse Projects » EGit / JGit » Support for Large File Storage (LFS)

Show: Today's Messages :: Show Polls :: Message Navigator

Support for Large File Storage (LFS) [message #1697484]

Thu, 04 June 2015 10:12

paolo di tommaso

Messages: 22
Registered: July 2009

Junior Member

Does JGit support Git Large File Extension (https://git-lfs.github.com) ? or is there any plan to support it ?

Cheers,
Paolo

Report message to a moderator

Re: Support for Large File Storage (LFS) [message #1697968 is a reply to message #1697484]

Tue, 09 June 2015 22:34

Matthias Sohn

Messages: 1268
Registered: July 2009

Senior Member

JGit doesn't support LFS yet. We plan to start working on that.

Report message to a moderator

Re: Support for Large File Storage (LFS) [message #1698018 is a reply to message #1697968]

Wed, 10 June 2015 12:27

paolo di tommaso

Messages: 22
Registered: July 2009

Junior Member

That's a very good news. In the meanwhile do you think there's any "hack" that would allow the LFS extension to be used with JGit ?

Report message to a moderator

Re: Support for Large File Storage (LFS) [message #1698100 is a reply to message #1698018]

Thu, 11 June 2015 08:53

Christian Halstrick

Messages: 274
Registered: July 2009

Senior Member

See http://dev.eclipse.org/mhonarc/lists/jgit-dev/msg02908.html. I'll start working on that. I think there is no real hack available beforehand (aside using native git for "add", "checkout", "push"). lfs works with two filters and a hook which jgit doesn't recognize currently. You'll have to wait until JGit learns this and gather experience with native git to see whether LFS is really what you want.

Ciao
Chris

Report message to a moderator

Re: Support for Large File Storage (LFS) [message #1698119 is a reply to message #1698100]

Thu, 11 June 2015 12:41

paolo di tommaso

Messages: 22
Registered: July 2009

Junior Member

That's great. Let me know if you may need help to test it.

Cheers, p

Report message to a moderator

Re: Support for Large File Storage (LFS) [message #1709167 is a reply to message #1698100]

Thu, 24 September 2015 14:59

paolo di tommaso

Messages: 22
Registered: July 2009

Junior Member

Hey there,

Is there any update on Git LFS support ?

Cheers,
Paolo

Report message to a moderator

Re: Support for Large File Storage (LFS) [message #1709169 is a reply to message #1709167]

Thu, 24 September 2015 15:05

Matthias Sohn

Messages: 1268
Registered: July 2009

Senior Member

There are a few changes pending in review but our work on LFS stalled since another internal project got a higher priority, we will take this up again soon.

Report message to a moderator

Re: Support for Large File Storage (LFS) [message #1709170 is a reply to message #1709169]

Thu, 24 September 2015 15:08

paolo di tommaso

Messages: 22
Registered: July 2009

Junior Member

OK. Thanks for the feedback.

Cheers,
Paolo

Report message to a moderator

Re: Support for Large File Storage (LFS) [message #1709171 is a reply to message #1709169]

Thu, 24 September 2015 15:09

Matthias Sohn

Messages: 1268
Registered: July 2009

Senior Member

The changes pending in review are here:
https://git.eclipse.org/r/q/project:jgit/jgit+is:open+message:LFS
https://git.eclipse.org/r/c/50371/
https://git.eclipse.org/r/50372

Report message to a moderator

Re: Support for Large File Storage (LFS) [message #1716470 is a reply to message #1709171]

Fri, 04 December 2015 08:45

paolo di tommaso

Messages: 22
Registered: July 2009

Junior Member

Hello,

I'm wondering if there's any schedule for releasing the JGit support for the LFS protocol.

Cheers,
Paolo

Report message to a moderator

Re: Support for Large File Storage (LFS) [message #1716475 is a reply to message #1716470]

Fri, 04 December 2015 09:27

Christian Halstrick

Messages: 274
Registered: July 2009

Senior Member

From Client side current EGit/JGit do support the LFS protocol. You can download the lfs tooling from https://git-lfs.github.com/ and configure your repo to use lfs. This will put some filter definitions in your .gitattributes and .gitconfig files. JGit/EGit has now learned to respect these .gitattribute settings and when adding content to the repo, pushing to the central server and checking out branches calls the right filters. Authentication to the github lfs server can be tricky to configure with egit/jgit (see https://github.com/github/git-lfs/blob/master/docs/api/README.md?utm_source=gitlfs_site&utm_medium=api_spec_link&utm_campaign=gitlfs#authentication) but it works. There is more work to be done (replace filter commands from github by java implementations, configuration in EGit)

Ciao
Chris

Report message to a moderator

Re: Support for Large File Storage (LFS) [message #1716480 is a reply to message #1716475]

Fri, 04 December 2015 10:16

paolo di tommaso

Messages: 22
Registered: July 2009

Junior Member

That's sound great because I only need the client to pull/update data from a LFS repo.

Ciao,
Paolo

Report message to a moderator

Re: Support for Large File Storage (LFS) [message #1716545 is a reply to message #1697484]

Fri, 04 December 2015 16:57

David North

Messages: 1
Registered: December 2015

Junior Member

I was excited to read that progress is being made on LFS support in EGit, and indeed I've confirmed - using a nightly build - that I can now check out a repository configured for LFS via the Eclipse UI and have it fetch the large files successfully.

However, committing large files and using the staging view on them seems broken, with errors along the lines of:

Caused by: java.io.EOFException: Input did not match supplied length. 22,323 bytes are missing.
	at org.eclipse.jgit.internal.storage.file.ObjectDirectoryInserter.shortInput(ObjectDirectoryInserter.java:248)

Is this a known issue? Is there anything I can do to help fix it?

Report message to a moderator

Re: Support for Large File Storage (LFS) [message #1716646 is a reply to message #1716545]

Mon, 07 December 2015 07:45

Christian Halstrick

Messages: 274
Registered: July 2009

Senior Member

No, that bug is not known. Of course modifying/staging large files should work. It does work in Unit tests and when I try it out manually. I think you have found a bug which we have not seen yet. Please open a bug in https://bugs.eclipse.org and describe the bug. I really would like to debug this situation.

Ciao
Chris

Report message to a moderator

Re: Support for Large File Storage (LFS) [message #1731475 is a reply to message #1716646]

Thu, 05 May 2016 20:48

Giancarlo Baldan

Messages: 1
Registered: May 2016

Junior Member

Has this bug report being filed? I could not find it in bugzilla.

I ask as I am experiencing the same problem. I am trying to work with an existing repository (created with native git) that supports lfs. While using git everything works smoothly, the staging area in eclipse reports the large files as unstaged when they are not and if I try to stage them (or even other new files that are unstaged for real) I get the same error "Input did not match supplied length". This causes other problems, for example during merging where the files get replaced with just the hooks.

I am using Eclipse Mars (4.5.2) with EGit 4.3 and I can provide screenshots, videos etc. I could even create a fake and small repository where this could be replicated.

Thanks for any suggestion,

Giancarlo.

Report message to a moderator