The Central Go Modules Repository

To use GoCenter:
export GOPROXY=https://gocenter.io
0
Stars
UNKNOWN
License
1
Downloads
August 16th 2019
Last Modified
Version:
Loading...

toki

Regexp tokenizer/scanner in Go.

The scanner takes in a list of token definitions and string input. it is general and easy to use.

Token definition

A token is a pair of constant and regexp string.

Credits

Originally made by taylorchu (https://github.com/taylorchu/toki).