lexer

package

v1.0.0 Latest Latest Go to latest Published: Jan 3, 2019 License: Apache-2.0 Imports: 3 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Repository

github.com/jpeinelt/skit

Links

Open Source Insights

Documentation ¶

Constants ¶

View Source

const COLOR_BG = '_'

View Source

const COLOR_FG = '^'

View Source

const COMMENT = '!'

View Source

const CONTROL = '/'

View Source

const EOF rune = 0

View Source

const MEDIA = '@'

View Source

const TITLE = '#'

Variables ¶

This section is empty.

Functions ¶

This section is empty.

Types ¶

type Lexer ¶

type Lexer struct {
	// contains filtered or unexported fields
}

Lexer with an input, tokens and a state. Internally it tracks also a start pointer, a position pointer and the width of the current lexed item.

func BeginLexing ¶

func BeginLexing(input string) *Lexer

BeginLexing returns a new Lexer with a given input, a start state and a buffered Token channel.

func (*Lexer) NextToken ¶

func (l *Lexer) NextToken() Token

NextToken returns the next lexed Token in our channel. If there is none, it loops over doing nothing until we lexed a new Token.

type Token ¶

type Token struct {
	Typ TokenType
	Val string
}

Token represents a TokenType and a Value.

func (Token) String ¶

func (t Token) String() string

type TokenType ¶

type TokenType int

TokenType describes all possible Tokens.

const (
	TOKEN_ERROR TokenType = iota
	TOKEN_EOF

	TOKEN_NEWSLIDE

	TOKEN_TEXT
	TOKEN_TITLE // #
	TOKEN_MEDIA // @

	TOKEN_COLOR_BG // _
	TOKEN_COLOR_FG // ^

	TOKEN_COMMENT // !
)

Source Files ¶

View all Source files

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL