Tokenizer.g4 (Antlr)

Fichero de Antlr que contiene la especificación léxica de MLang.

specifications/Tokenizer.g4

lexer grammar Tokenizer;

INT_LITERAL: [0-9]+;
FLOAT_LITERAL: [0-9]+ '.' [0-9]+;

IDENT: [a-zA-Z][a-zA-Z0-9_]*;

LINE_COMMENT: '//' .*? ('\n' | EOF) -> skip;
MULTILINE_COMMENT: '/*' .*? '*/' -> skip;

WHITESPACE: [ \t\r\n]+ -> skip;