Eclipse Community Forums: TMF (Xtext) » Keyword clashing with terminal rule

Help

Home

Home » Modeling » TMF (Xtext) » Keyword clashing with terminal rule

Show: Today's Messages :: Show Polls :: Message Navigator

Keyword clashing with terminal rule [message #1858872]

Thu, 27 April 2023 12:58

Simon Cockx

Messages: 60
Registered: October 2021

Member

I have a data rule containing the keyword '/':

MultiplicativeOperation returns Expression:
	BinaryOperation ( =>({ArithmeticOperation.left=current} operator=('*'|'/')) right=RosettaCalcBinary)*
;

Now I wanted to add support for JavaScript like regular expressions, e.g., `/[a-b]+/`. I added the following terminal rule for it:

terminal PATTERN returns Pattern:
	'/' ( '\\' . | !('\\'|'/') )* '/'
;

(given `type Pattern wraps Pattern` in Xcore)

However, now the `MultiplicativeOperation` rule doesn't work anymore. Any occurences of a division "a / b" results in a syntax error "mismatched character '<EOF>' expecting '/'".

Is there a way around this?

Report message to a moderator

Re: Keyword clashing with terminal rule [message #1858873 is a reply to message #1858872]

Thu, 27 April 2023 13:02

Christian Dietrich

Messages: 14496
Registered: July 2009

Senior Member

i dont think this is solvable without introducing a stateful lexer (you migh look into jflex)

Need professional support for Xtext, Xpand, EMF?
Go to: https://www.itemis.com/en/it-services/methods-and-tools/xtext
Twitter : @chrdietrich
Blog : https://www.dietrich-it.de

Report message to a moderator

Re: Keyword clashing with terminal rule [message #1858874 is a reply to message #1858873]

Thu, 27 April 2023 13:03

Christian Dietrich

Messages: 14496
Registered: July 2009

Senior Member

or you check if you can reuse https://github.com/eclipse/n4js/blob/master/plugins/org.eclipse.n4js/src/org/eclipse/n4js/parser/RegExLiteralAwareLexer.java

Need professional support for Xtext, Xpand, EMF?
Go to: https://www.itemis.com/en/it-services/methods-and-tools/xtext
Twitter : @chrdietrich
Blog : https://www.dietrich-it.de

Report message to a moderator

Re: Keyword clashing with terminal rule [message #1858875 is a reply to message #1858874]

Thu, 27 April 2023 13:17

Simon Cockx

Messages: 60
Registered: October 2021

Member

I feared this was gonna be hard. Thank you for the quick response and the references.

Report message to a moderator

Re: Keyword clashing with terminal rule [message #1858883 is a reply to message #1858875]

Fri, 28 April 2023 07:37

Ed Willink

Messages: 7595
Registered: July 2009

Senior Member

When grammar tooling starts to fail, it is often a forewarning that there are ambiguous syntaxes that will not always be parsed in accordance with your user's expectations.

It is obviously possible to make a regex look like all sorts of regular grammar.

Better to introduce something distinctive such as a 'regex' keyword prefix or surrounding quotes. Just imagine 'improving' the Java grammar to support call of the regex support without quotes.

Report message to a moderator

Re: Keyword clashing with terminal rule [message #1858948 is a reply to message #1858872]

Tue, 02 May 2023 19:46

Luong Tiet

Messages: 4
Registered: May 2023

Junior Member

This case works for me

grammar org.xtext.example.mydsl.MyDsl hidden(WS)

import "http://www.eclipse.org/emf/2002/Ecore" as ecore

generate myDsl "http://www.xtext.org/example/mydsl/MyDsl"

Model:Test;
Test: value+=(MultiplicativeOperation | Pattern)+;
BinaryOperation: value=INT;
RosettaCalcBinary: value=INT;

MultiplicativeOperation returns Expression: BinaryOperation ( =>({ArithmeticOperation.left=current} operator='*' | '/') right=RosettaCalcBinary)*;

Pattern:	{Pattern} '/' P_BODY '/';

terminal INT returns ecore::EInt: ('0'..'9')+;
terminal P_BODY: ( '\\' | '\\*' | '\\/' | !('\\'|'/'|'*'|' '|'\t'|'\r'|'\n') )+ ;
terminal WS: (' '|'\t'|'\r'|'\n')+;

Report message to a moderator

Re: Keyword clashing with terminal rule [message #1858949 is a reply to message #1858948]

Tue, 02 May 2023 19:56

Luong Tiet

Messages: 4
Registered: May 2023

Junior Member

to modify in previous message:

MultiplicativeOperation returns Expression: BinaryOperation ( =>({ArithmeticOperation.left=current} operator=('*'|'/')) right=RosettaCalcBinary)*

Report message to a moderator

Previous Topic:	Syntactic predicates and proposal provider execution time
Next Topic:	Xtext 2.31.0.M2 is out

Goto Forum:

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

]

Current Time: Sat Jun 03 20:37:02 GMT 2023

.:: Contact :: Home ::.

Breadcrumbs

Sign up to our Newsletter