Skip to main content
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [babel-dev] Extracting project source files from Git repositories

Denis,

The extraction process is a PHP script. However, I heard that there is a memory problem with file_get_contents() when reading large files. file_get_contents() reads everything into memory, and the snapshot zips potentially could be big, and may result in "Allowed Memory Size Exhausted" fatal error.

Therefore, I plan to shell out and use the wget command in the PHP script to fetch the snapshot zips, if there is no firewall restrictions from the Babel server.

Thanks,
Kit Lo
Eclipse Babel Project Lead
IBM Eclipse SDK (IES) Globalization Technical Lead
IBM Rational solution for Collaborative Lifecycle Management (CLM) Globalization Technical Lead

Inactive hide details for Denis Roy ---11/14/2012 09:18:58 AM---Hi Kit, IMO, using wget to fetch a snapshot zip is even better Denis Roy ---11/14/2012 09:18:58 AM---Hi Kit, IMO, using wget to fetch a snapshot zip is even better than a Git clone,

From: Denis Roy <denis.roy@xxxxxxxxxxx>
To: babel-dev@xxxxxxxxxxx,
Date: 11/14/2012 09:18 AM
Subject: Re: [babel-dev] Extracting project source files from Git repositories
Sent by: babel-dev-bounces@xxxxxxxxxxx




Hi Kit,

IMO, using wget to fetch a snapshot zip is even better than a Git clone, there you're essentially fetching (and storing) the entire project's history, which is definitely not needed for Babel's purposes.

Either use wget if it's a shell script, or use php's file_get_contents() if it's a PHP script.

Denis



On 11/13/2012 06:06 PM, Kit Lo wrote:

    Denis,

    Now that most Eclipse projects have moved to Git repositories, Babel has to add the supports to extract project source files from Git repositories.

    I found that it's very convenient to download the Git repositories snapshot zips, for example     http://git.eclipse.org/c/platform/eclipse.platform.git/snapshot/R4_2.zip, and then extract all the .properties files from the zips.

    Do you know if it's safe to use "wget" to download the Git repositories snapshot zips? Or, do you have better suggestions on how to download/copy the zips from the Eclipse servers?    _______________________________________________
    babel-dev mailing list
    babel-dev@xxxxxxxxxxx
    https://dev.eclipse.org/mailman/listinfo/babel-dev

GIF image

Back to the top