watcher

package

v0.0.0-...-9a9dea5 Latest Latest Go to latest Published: Feb 17, 2021 License: MIT Imports: 7 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Repository

github.com/SNBen/ants-go

Links

Open Source Insights

Documentation ¶

Index ¶

Constants
type Distributer
- func NewDistributer(node node.Node, cluster cluster.Cluster, rpcClient action.RpcClientAnts) *Distributer
type Reporter
- func NewReporter(node node.Node, cluster cluster.Cluster, rpcClient action.RpcClientAnts, ...) *Reporter

Constants ¶

View Source

const (
	DISTRIBUTE_RUNING = iota
	DISTRIBUTE_PAUSE
	DISTRIBUTE_STOP
	DISTRIBUTE_STOPED
)

what a Distributer do * status,running|parse|stop * distribute a request,by some strategy * *

View Source

const (
	REPORT_STATUS_RUNNING = iota
	REPORT_STATUS_PAUSE
	REPORT_STATUS_STOP
	REPORT_STATUS_STOPED
)

Variables ¶

This section is empty.

Functions ¶

This section is empty.

Types ¶

type Distributer ¶

type Distributer struct {
	Status    int
	Cluster   cluster.Cluster
	Node      node.Node
	LastIndex int
	RpcClient action.RpcClientAnts
}

func NewDistributer ¶

func NewDistributer(node node.Node, cluster cluster.Cluster, rpcClient action.RpcClientAnts) *Distributer

func (*Distributer) Distribute ¶

func (this *Distributer) Distribute(request *http.Request)

if cookiejar > 0 means it require cookie context ,so we should send it to where it come from else distribute it by order

func (*Distributer) IsPause ¶

func (this *Distributer) IsPause() bool

func (*Distributer) IsStop ¶

func (this *Distributer) IsStop() bool

func (*Distributer) Pause ¶

func (this *Distributer) Pause()

func (*Distributer) Run ¶

func (this *Distributer) Run()

dead loop cluster pop request

func (*Distributer) Start ¶

func (this *Distributer) Start()

func (*Distributer) Stop ¶

func (this *Distributer) Stop()

func (*Distributer) Unpause ¶

func (this *Distributer) Unpause()

type Reporter ¶

type Reporter struct {
	Status      int
	ResultQuene *crawler.ResultQuene
	Node        node.Node
	// contains filtered or unexported fields
}

func NewReporter ¶

func NewReporter(node node.Node, cluster cluster.Cluster, rpcClient action.RpcClientAnts, resultQuene *crawler.ResultQuene, distributer action.Watcher) *Reporter

func (*Reporter) IsPause ¶

func (this *Reporter) IsPause() bool

func (*Reporter) IsStop ¶

func (this *Reporter) IsStop() bool

if it is stoped

func (*Reporter) JudgeAndStopNode ¶

func (this *Reporter) JudgeAndStopNode(result *crawler.ScrapeResult)

stop action is start by local report action so put it here

func (*Reporter) Pause ¶

func (this *Reporter) Pause()

func (*Reporter) Run ¶

func (this *Reporter) Run()

pop result quene if scraped new request set node name local node name send it to master

func (*Reporter) Start ¶

func (this *Reporter) Start()

func (*Reporter) Stop ¶

func (this *Reporter) Stop()

set it stop,if deap loop see this sign,make it stoped

func (*Reporter) Unpause ¶

func (this *Reporter) Unpause()

Source Files ¶

View all Source files

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL