# tokenize()

[**PromptScript API**](https://getpromptscript.dev/api-reference/index.md)

***

# Function: tokenize()

> **tokenize**(`source`): `ILexingResult`

Defined in: [parser/src/lexer/lexer.ts:19](https://github.com/mrwogu/promptscript/blob/49aa50f943865b985366c4eda6e95c5a31ef39a6/packages/parser/src/lexer/lexer.ts#L19)

Tokenize PromptScript source code.

## Parameters

### source

`string`

Source code to tokenize

## Returns

`ILexingResult`

Lexing result with tokens and any errors