scanner

package

v0.0.0-...-f5d25ad Latest Latest Go to latest Published: Aug 7, 2020 License: MIT Imports: 4 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Package scanner implements a tokenizer that creates tokens of the SQLite grammar.

View Source

const (
	ErrUnexpectedToken   = Error("unexpected token")
	ErrInvalidUTF8String = Error("input is not a valid utf8 encoded string")
)

Constant errors

This section is empty.

This section is empty.

type Error string

Error allows constant errors.

func (s Error) Error() string

type Scanner interface {
	Next() token.Token
	Peek() token.Token
}

Scanner is the interface that describes a scanner.

func NewRuleBased(input string, ruleset ruleset.Ruleset) (Scanner, error)

NewRuleBased creates a new, ready to use rule based scanner with the given ruleset, that will process the given input rune slice.

Path	Synopsis
matcher Package matcher implements a matcher component, that can determine whether or not a rune is part of a custom character class.	Package matcher implements a matcher component, that can determine whether or not a rune is part of a custom character class.
ruleset Package ruleset implements rules that can be used in combination with a rule based scanner.	Package ruleset implements rules that can be used in combination with a rule based scanner.
test
token Package token implements tokens that are produced by the scanner.	Package token implements tokens that are produced by the scanner.