| Parsing Java files with JDT and it's memory consumption / performance [message #1744271] |
Fri, 23 September 2016 15:10  |
Eclipse User |
|
|
|
Hi to all,
I want to parse java code with jdt from commandline and so I wrote a small tool, which parses the java files in the following kind:
ASTParser parser = ASTParser.newParser(AST.JLS8);
parser.setEnvironment(classpath, srcPaths, encodings, false);
parser.setSource(//String of file read before);
parser.setResolveBindings(true);
parser.setBindingsRecovery(true);
parser.setUnitName(name of File);
parser.setKind(ASTParser.K_COMPILATION_UNIT);
CompilationUnit cu = (CompilationUnit) parser.createAST(null);
With this code I get an OOM with 2GB after reading 1300 java files, but I can resolve e.g. MethodInvocations. If i skip the
parser.setBindinsRecovery(true)
My small and perhaps easy question: How can I implement this with less memory consumption and better performance AND getting all things resolved? I guess jdt implementaion in eclipse itself needs maximum some MBs to read the AST.
Thanks for your help
Markus
|
|
|
|
|
| Re: Parsing Java files with JDT and it's memory consumption / performance [message #1744280 is a reply to message #1744274] |
Fri, 23 September 2016 16:51  |
| Eclipse User |
|
|
|
Hi Stephan,
thanks for you help,
JDT is really cool, if you know how to handle it 
This first implementation (still optimizable....) did it for me:
ASTParser parser = ASTParser.newParser(AST.JLS8);
parser.setEnvironment(classpath, srcPaths.toArray(new String[srcPaths.size()]),
encodings.toArray(new String[encodings.size()]), false);
parser.setResolveBindings(true);
Collection<String> sources = new ArrayList<String>();
Collection<String> sourceEncodings = new ArrayList<String>();
for (File nextFile: allFiles) {
sources.add(nextFile.getAbsolutePath());
encodings.add("ISO-8859-15");
}
final JavaProject thisProject = this;
FileASTRequestor requestor = new FileASTRequestor() {
@Override
public void acceptAST(String sourcefilePath, CompilationUnit ast) {
try {
System.out.println ("Reading " + sourcefilePath);
JavaSource javaSource = new JavaSourceJdt(thisProject, ast);
javaSourceContainer.addItem(javaSource);
javaTypeContainer.addAllItems(javaSource.getTypes());
} catch (Throwable t) {
log.error(t.toString(), t);
throw new RuntimeException(t);
}
}
};
String [] sourcesAsArray = sources.toArray(new String [sources.size()]);
String [] encodingsAsArray = encodings.toArray(new String [sourceEncodings.size()]);
parser.createASTs(sourcesAsArray, encodingsAsArray, new String[0], requestor, null); //new SubProgressMonitor(subMonitor, 1));
Cheers
Markus
|
|
|
|
|
Powered by
FUDForum. Page generated in 0.04165 seconds
Home