segment

package

v1.0.1 Latest Latest Go to latest Published: Jul 23, 2021 License: Apache-2.0 Imports: 13 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Repository

github.com/bububa/jiagu

Links

Open Source Insights

Documentation ¶

Overview ¶

Package segment 包含分词相关

Index ¶

Variables
type Route
- func NewRoute(i int, v float64) Route
type RouteSlice
- func NewRouteSlice(cap int) RouteSlice
type SegMode
type Segment
- func NewFromModel(vocabR io.Reader, aModel *perceptron.Perceptron) (*Segment, error)
- func NewFromReader(vocabR io.Reader, modelR io.Reader) (*Segment, error)

Constants ¶

This section is empty.

Variables ¶

View Source

var DefaultRoute = NewRoute(0, 0)

Functions ¶

This section is empty.

Types ¶

type Route ¶

type Route struct {
	I int
	V float64
}

func NewRoute ¶

func NewRoute(i int, v float64) Route

type RouteSlice ¶

type RouteSlice []Route

func NewRouteSlice ¶

func NewRouteSlice(cap int) RouteSlice

func (RouteSlice) Len ¶

func (s RouteSlice) Len() int

func (RouteSlice) Less ¶

func (s RouteSlice) Less(i, j int) bool

func (RouteSlice) Swap ¶

func (s RouteSlice) Swap(i, j int)

type SegMode ¶

type SegMode = string

const (
	Default_SegMode SegMode = "default"
	Probe_SegMode   SegMode = "probe"
)

type Segment ¶

type Segment struct {
	// contains filtered or unexported fields
}

Segment 分词主类

func NewFromModel ¶

func NewFromModel(vocabR io.Reader, aModel *perceptron.Perceptron) (*Segment, error)

NewFromModel 从model新建Segment

func NewFromReader ¶

func NewFromReader(vocabR io.Reader, modelR io.Reader) (*Segment, error)

NewFromReader 从io.Reader新建Segment

func (*Segment) AddVocab ¶

func (s *Segment) AddVocab(word string, freq int)

AddVocab 添加字典word

func (*Segment) CutSearch ¶

func (s *Segment) CutSearch(sentence string) []string

CutSearch search模式分词

func (*Segment) CutVocab ¶

func (s *Segment) CutVocab(sentence string) []string

CutVocab 字典模式分词

func (*Segment) CutWords ¶

func (s *Segment) CutWords(sentence string) []string

CutWords 切词模式

func (*Segment) DelVocab ¶

func (s *Segment) DelVocab(word string, freq int)

DelVocab 删除字典word

func (*Segment) LoadUserDict ¶

func (s *Segment) LoadUserDict(r io.Reader) error

LoadUserDict 加载用户字典

func (*Segment) LoadVocab ¶

func (s *Segment) LoadVocab(r io.Reader) error

LoadVocab 添加字典

func (*Segment) ModelCut ¶

func (s *Segment) ModelCut(sentence string) []string

ModelCut 模型模式分词

func (*Segment) Seg ¶

func (s *Segment) Seg(sentence string, mode SegMode) []string

Seg 分词用户调用

func (*Segment) SegDefault ¶

func (s *Segment) SegDefault(sentence string) []string

SegDefault 默认模式分词

func (*Segment) SegNewWords ¶

func (s *Segment) SegNewWords(sentence string) []string

SegNewWords 新词模式分词

Source Files ¶

View all Source files

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL