Skip to main content

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [jgit-dev] JGit DFS backend - has anyone tried to implement Cassandra?


> On 7 Jan 2016, at 13:56, Luca Milanesio <luca.milanesio@xxxxxxxxx> wrote:
> 
> Hi Alex,
> thank you for your quick reply: as "you know someone" who did a real JGit DFS implementation ... and you believe is possible ... we get more confidence in starting this work.

Cassandra will be Ok for supporting references but I don't believe that it will work for storing the pack files (objects). So the question becomes: where do you store the data. You'd really need to have a plan for that first. Cassandra has limited sizes for individual entries (2G max, in practice orders of magnitude less according to the wiki) which would make it unsuitable for storing pack files in general. 

You might consider storing pack files in S3 and the references in Cassandra for example to provide a scalable solution. But you shouldn't rely on Cassandra for the pack files.

So where did you intend on storing the large data blobs?

Alex

Back to the top