Function: tokenize()¶
tokenize(
source):ILexingResult
Defined in: parser/src/lexer/lexer.ts:19
Tokenize PromptScript source code.
Parameters¶
source¶
string
Source code to tokenize
Returns¶
ILexingResult
Lexing result with tokens and any errors
tokenize(
source):ILexingResult
Defined in: parser/src/lexer/lexer.ts:19
Tokenize PromptScript source code.
string
Source code to tokenize
ILexingResult
Lexing result with tokens and any errors