Tunnel Parsing with the Token’s Lexeme

Autor: Nikolay Handzhiyski, Elena Somova
Rok vydání: 2022
Předmět:
Zdroj: Cybernetics and Information Technologies. 22:125-144
ISSN: 1314-4081
Popis: The article describes a string recognition approach, engraved in the parsers generated by Tunnel Grammar Studio that use the tunnel parsing algorithm, of how a lexer and a parser can operate on the input during its recognition. Proposed is an addition of the augmented Backus-Naur form syntax that enables the formal language to be expressed with a parser grammar and optionally with an additional lexer grammar. The tokens outputted from the lexer are matched to the phrases in the parser grammar by their name and optionally by their lexeme, case sensitively or insensitively.
Databáze: OpenAIRE