mapjob

package
v1.0.1 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Apr 24, 2024 License: Apache-2.0 Imports: 16 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

This section is empty.

Types

type MapJobProcessor

type MapJobProcessor struct {
	processor.Processor
	// contains filtered or unexported fields
}

func NewMapJobProcessor

func NewMapJobProcessor() *MapJobProcessor

func (*MapJobProcessor) IsRootTask

func (rcvr *MapJobProcessor) IsRootTask(jobCtx *jobcontext.JobContext) bool

func (*MapJobProcessor) Kill

func (rcvr *MapJobProcessor) Kill(jobCtx *jobcontext.JobContext) error

func (*MapJobProcessor) Map

func (rcvr *MapJobProcessor) Map(jobCtx *jobcontext.JobContext, taskList []interface{}, taskName string) (*processor.ProcessResult, error)

Map distribute tasks to all workers. Every element in taskList shouldn't beyond 64KB.

type MapReduceJobProcessor

type MapReduceJobProcessor struct {
	*MapJobProcessor
}

func NewMapReduceJobProcessor

func NewMapReduceJobProcessor() *MapReduceJobProcessor

func (*MapReduceJobProcessor) Reduce

func (*MapReduceJobProcessor) RunReduceIfFail

func (rcvr *MapReduceJobProcessor) RunReduceIfFail(context *jobcontext.JobContext) bool

Directories

Path Synopsis

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL