Eclipse Community Forums: TMF (Xtext) » Customizing the generated ANTLR Lexer file (Internal*_

Help

Home

Home » Modeling » TMF (Xtext) » Customizing the generated ANTLR Lexer file (Internal*__.g)

Show: Today's Messages :: Show Polls :: Message Navigator

Customizing the generated ANTLR Lexer file (Internal*__.g) [message #654499]

Wed, 16 February 2011 04:10

valtron2000

Messages: 3
Registered: February 2011

Junior Member

Basically, I need to generate my own lexer for my language project because of some things that can't be done otherwise (like heredocs and code interpolation).

Xtext generates a lexer file for ANTLR in parser.antlr.internal.Internal(name)__.g, but I haven't found a place where I can customize its creation.

I've looked at the example for creating an indentation-oriented language, but unfortunately what I'm trying to do can't be done by a simple CharStream transform. Also, the docs don't give details on modifying the ANTLR files. Any help is appreciated.

Thanks.

Report message to a moderator

Re: Customizing the generated ANTLR Lexer file (Internal*__.g) [message #654622 is a reply to message #654499]

Wed, 16 February 2011 13:25

Henrik Lindberg

Messages: 2509
Registered: July 2009

Senior Member

I use an external lexer in the "Geppetto" project - you can take a look
at it on Github - the dsl project is found here:
https://github.com/cloudsmith/geppetto/tree/master/org.cloud smith.geppetto.pp.dsl

Regards
- henrik

On 2/16/11 5:10 AM, valtron2000@gmail.com wrote:
> Basically, I need to generate my own lexer for my language project
> because of some things that can't be done otherwise (like heredocs and
> code interpolation).
>
> Xtext generates a lexer file for ANTLR in
> parser.antlr.internal.Internal(name)__.g, but I haven't found a place
> where I can customize its creation.
>
> I've looked at the example for creating an indentation-oriented
> language, but unfortunately what I'm trying to do can't be done by a
> simple CharStream transform. Also, the docs don't give details on
> modifying the ANTLR files. Any help is appreciated.
> Thanks.

Report message to a moderator