tokenize()
tokenize(
source):ILexingResult
Defined in: parser/src/lexer/lexer.ts:19
Tokenize PromptScript source code.
Parameters
source
string
Source code to tokenize
Returns
ILexingResult
Lexing result with tokens and any errors
tokenize(
source):ILexingResult
Defined in: parser/src/lexer/lexer.ts:19
Tokenize PromptScript source code.
string
Source code to tokenize
ILexingResult
Lexing result with tokens and any errors