Saxonberg Server API
    Preparing search index...
    • Tokenize input. Whitespace is consumed but not emitted. The stream is always terminated with an eof token whose start/end point at input.length.

      Throws MqlLexError on unterminated literals, dangling # or $, or any unrecognized character.

      Parameters

      • input: string

      Returns Token[]