Test & Maybe Release

feat: export `Tokenizer`, document how it can be used #297

Sign in to view logs

Run time

Learn about OS pricing on GitHub Actions

Job	Run time
test (16.x, macos-latest)	1m 36s
test (16.x, ubuntu-latest)	40s
test (16.x, windows-latest)	1m 36s
test (18.x, macos-latest)	1m 29s
test (18.x, ubuntu-latest)	1m 13s
test (18.x, windows-latest)	1m 47s
test (lts/*, macos-latest)	1m 29s
test (lts/*, ubuntu-latest)	42s
test (lts/*, windows-latest)	1m 42s
test (current, macos-latest)	1m 2s
test (current, ubuntu-latest)	40s
test (current, windows-latest)	1m 6s
Release	0s
	15m 2s