connector

package
v0.18.0-beta Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: May 17, 2024 License: MIT Imports: 22 Imported by: 4

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

This section is empty.

Types

type ConnectionSecrets

type ConnectionSecrets map[string]map[string]any

ConnectionSecrets contains the global connection secrets of each implemented connector (referenced by ID). Connectors may use these secrets to skip the connector configuration step and have a ready-to-run connection.

type Store

type Store struct {
	// contains filtered or unexported fields
}

Store holds in-memory information about the initialized connectors.

func Init

func Init(
	logger *zap.Logger,
	secrets ConnectionSecrets,
	usageHandlerCreators map[string]base.UsageHandlerCreator,
) *Store

Init initializes the different connector components and loads their information to memory.

func (*Store) CreateExecution

func (cs *Store) CreateExecution(defUID uuid.UUID, sysVars map[string]any, connection *structpb.Struct, task string) (*base.ExecutionWrapper, error)

CreateExecution initializes the execution of a connector given its UID.

func (*Store) GetConnectorDefinitionByID

func (cs *Store) GetConnectorDefinitionByID(defID string, sysVars map[string]any, component *pipelinePB.ConnectorComponent) (*pipelinePB.ConnectorDefinition, error)

GetConnectorDefinitionByID returns a connector definition by its ID.

func (*Store) GetConnectorDefinitionByUID

func (cs *Store) GetConnectorDefinitionByUID(defUID uuid.UUID, sysVars map[string]any, component *pipelinePB.ConnectorComponent) (*pipelinePB.ConnectorDefinition, error)

GetConnectorDefinitionByUID returns a connector definition by its UID.

func (*Store) Import

func (cs *Store) Import(con base.IConnector)

Import loads the connector definitions into memory.

func (*Store) IsSecretField

func (cs *Store) IsSecretField(defUID uuid.UUID, target string) (bool, error)

func (*Store) ListConnectorDefinitions

func (cs *Store) ListConnectorDefinitions(sysVars map[string]any, returnTombstone bool) []*pipelinePB.ConnectorDefinition

ListConnectorDefinitions returns all the loaded connector definitions.

Directories

Path Synopsis
airbyte
v0
archetypeai
v0
bigquery
v0
googlecloudstorage
v0
googlesearch
v0
huggingface
v0
instill
v0
numbers
v0
openai
v0
pinecone
v0
redis
v0
restapi
v0
slack
v0
stabilityai
v0
website
v0

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL