arrowio

package
v1.15.0 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Mar 29, 2024 License: BSD-3-Clause Imports: 21 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

View Source
var (
	ErrMultipleTypes   = errors.New("arrowio: encountered multiple types (consider 'fuse')")
	ErrNotRecord       = errors.New("arrowio: not a record")
	ErrUnsupportedType = errors.New("arrowio: unsupported type")
)

Functions

This section is empty.

Types

type Reader

type Reader struct {
	// contains filtered or unexported fields
}

Reader is a zio.Reader for the Arrow IPC stream format.

func NewReader

func NewReader(zctx *zed.Context, r io.Reader) (*Reader, error)

func NewReaderFromRecordReader

func NewReaderFromRecordReader(zctx *zed.Context, rr pqarrow.RecordReader) (*Reader, error)

func (*Reader) Close

func (r *Reader) Close() error

func (*Reader) Read

func (r *Reader) Read() (*zed.Value, error)

type WriteCloser added in v1.8.0

type WriteCloser interface {
	Write(rec arrow.Record) error
	Close() error
}

type Writer

type Writer struct {
	NewWriterFunc func(io.Writer, *arrow.Schema) (WriteCloser, error)
	// contains filtered or unexported fields
}

Writer is a zio.Writer for the Arrow IPC stream format. Given Zed values with appropriately named types (see the newArrowDataType implementation), it can write all Arrow types except dictionaries and sparse unions. (Although dictionaries are not part of the Zed data model, write support could be added using a named type.)

func NewWriter

func NewWriter(w io.WriteCloser) *Writer

func (*Writer) Close

func (w *Writer) Close() error

func (*Writer) Write

func (w *Writer) Write(val zed.Value) error

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL