Documentation
¶
Index ¶
Constants ¶
View Source
const Name = "gojieba"
Variables ¶
View Source
var DictDir string
Functions ¶
This section is empty.
Types ¶
type JiebaTokenizer ¶
type JiebaTokenizer struct {
// contains filtered or unexported fields
}
func NewJiebaTokenizer ¶
func NewJiebaTokenizer(dictpath, hmmpath, userdictpath, idf, stop_words string) *JiebaTokenizer
func (*JiebaTokenizer) Free ¶
func (x *JiebaTokenizer) Free()
func (*JiebaTokenizer) Tokenize ¶
func (x *JiebaTokenizer) Tokenize(sentence []byte) analysis.TokenStream
Source Files
Click to show internal directories.
Click to hide internal directories.