singer_sdk.SQLTap

class singer_sdk.SQLTap

Bases: Tap

A specialized Tap for extracting from SQL streams.

message_writer_class

alias of SimpleSingerWriter

classmethod append_builtin_config(config_jsonschema)

Appends built-in config to config_jsonschema if not already set.

Parameters:

config_jsonschema (dict) – [description]

Return type:

None

classmethod cb_config(ctx, param, value)

CLI callback to parse the config.

Returns:

A _ConfigInput object.

Parameters:

• ctx (Context)

• param (Option)

• value (tuple[str, ...])

Return type:

_ConfigInput

classmethod cb_discover(ctx, param, value)

CLI callback to run the tap in discovery mode.

Parameters:

• ctx (Context) – Click context.

• param (Option) – Click option.

• value (bool) – Whether to run in discovery mode.

Return type:

None

classmethod cb_test(ctx, param, value)

CLI callback to run the tap in test mode.

Parameters:

• ctx (Context) – Click context.

• param (Option) – Click option.

• value (bool) – Whether to run in test mode.

Return type:

None

classmethod cb_version(ctx, param, value)

CLI callback to print the plugin version and exit.

Parameters:

• ctx (Context) – Click context.

• param (Option) – Click parameter.

• value (bool) – Boolean indicating whether to print the version.

Return type:

None

classmethod get_plugin_version()

Return the package version number.

Returns:

The package version number.

Return type:

str

classmethod get_sdk_version()

Return the package version number.

Returns:

The package version number.

Return type:

str

classmethod get_singer_command()

Execute standard CLI handler for taps.

Returns:

A click.Command object.

Return type:

Command

classmethod get_supported_python_versions()

Return the supported Python versions.

Returns:

A list of supported Python versions.

Return type:

list[str] | None

classmethod instantiate_processor(instance, default_cls)

Instantiate a processor instance.

Parameters:

• instance (_T | None) – The instance to instantiate.

• default_cls (type[_T]) – The default class to instantiate.

Returns:

The instantiated processor instance.

Return type:

_T

classmethod invoke(*, about=False, about_format=None, config=None, state=None, catalog=None)

Invoke the tap’s command line interface.

Parameters:

• about (bool) – Display package metadata and settings.

• about_format (str | None) – Specify output style for –about.

• config (_ConfigInput | None) – Configuration file location or ‘ENV’ to use environment variables. Accepts multiple inputs as a tuple.

• catalog (IO[str] | None) – Use a Singer catalog file with the tap.”,

• state (IO[str] | None) – Use a bookmarks file for incremental replication.

Return type:

None

classmethod print_about(output_format=None)

Print capabilities and other tap metadata.

Parameters:

output_format (str | None) – Render option for the plugin information.

Return type:

None

classmethod print_version(print_fn=<built-in function print>)

Print help text for the tap.

Parameters:

print_fn (Callable[[Any], None]) – A function to use to display the plugin version. Defaults to print().

Return type:

None

static config_from_cli_args(*args)

Parse CLI arguments into a config dictionary.

Parameters:

args (str) – CLI arguments.

Raises:

FileNotFoundError – If the config file does not exist.

Returns:

A tuple containing the config dictionary and a boolean indicating whether the config file was found.

Return type:

tuple[list[Path], bool]

__init__(*args, **kwargs)

Initialize the SQL tap.

The SQLTap initializer additionally creates a cache variable for _catalog_dict.

Parameters:

• *args (Any) – Positional arguments for the Tap initializer.

• **kwargs (Any) – Keyword arguments for the Tap initializer.

Return type:

None

discover_streams()

Initialize all available streams and return them as a sequence.

Returns:

A sequence of discovered Stream objects.

Return type:

t.Sequence[Stream]

load_state(state)

Merge or initialize stream state with the provided state dictionary input.

Override this method to perform validation and backwards-compatibility patches on self.state. If overriding, we recommend first running super().load_state(state) to ensure compatibility with the SDK.

Parameters:

state (dict[str, Any]) – Initialize the tap’s state with this value.

Raises:

ValueError – If the tap’s own state is None, meaning it has not been initialized.

Return type:

None

load_streams()

Load streams from discovery and initialize DAG.

Return the output of self.discover_streams() to enumerate discovered streams.

Returns:

A list of discovered streams, ordered by name.

Return type:

list[Stream]

run_connection_test()

Run connection test, aborting each stream after 1 record.

Returns:

True if the test succeeded.

Return type:

bool

run_discovery()

Write the catalog json to STDOUT and return as a string.

Returns:

The catalog as a string of JSON.

Return type:

str

run_sync_dry_run(dry_run_record_limit=1, streams=None)

Run connection test.

Exceptions of type MaxRecordsLimitException and PartialSyncSuccessException will be ignored.

Parameters:

• dry_run_record_limit (int | None) – The max number of records to sync per stream object.

• streams (t.Iterable[Stream | str] | None) – The streams to test. If omitted, all streams will be tested.

Returns:

True if the test succeeded.

Return type:

bool

setup_mapper()

Initialize the plugin mapper for this tap.

Return type:

None

sync_all()

Sync all streams.

Return type:

None

write_message(message)

Write a message to the tap’s message writer.

Parameters:

message (Any)

Return type:

None

write_schemas()

Write a SCHEMA message for all known streams to STDOUT.

Return type:

None

capabilities: t.ClassVar[list[CapabilitiesEnum]] = [catalog, state, discover, activate-version, about, stream-maps, schema-flattening, batch, structured-logging]

A list of capabilities supported by this tap.

property catalog: Catalog

Get the tap’s working catalog.

Returns:

A Singer catalog object.

property catalog_dict: dict

Get catalog dictionary.

Returns:

The tap’s catalog as a dict

property catalog_json_text: str

Get catalog JSON.

Returns:

The tap’s catalog as formatted JSON text.

property config: Mapping[str, Any]

Get config.

Returns:

A frozen (read-only) config dictionary map.

default_stream_class: type[SQLStream]

The default stream class used to initialize new SQL streams from their catalog entries.

dynamic_catalog: bool = True

Whether the tap’s catalog is dynamic, enabling configuration validation in discovery mode. Set to True if the catalog is generated dynamically (e.g. by querying a database’s system tables).

exclude_schemas: t.Sequence[str] = []

Hard-coded list of stream names to skip when discovering the catalog.

property initialized_at: int

Start time of the plugin.

Returns:

The start time of the plugin.

property input_catalog: Catalog | None

Get the catalog passed to the tap.

Returns:

Catalog dictionary input, or None if not provided.

property mapper: PluginMapper

Plugin mapper for this tap.

Returns:

A PluginMapper object.

Raises:

MapperNotInitialized – If the mapper has not been initialized.

name: str

The executable name of the tap or target plugin. e.g. tap-foo

package_name: str | None = None

The package name of the plugin. e.g meltanolabs-tap-foo

property state: types.TapState

Get tap state.

Returns:

The tap’s state dictionary

Raises:

RuntimeError – If state has not been initialized.

property state_writer: StateWriter

Get the centralized state writer for this tap.

Returns:

The StateWriter instance for coordinated state message writing.

property streams: dict[str, Stream]

Get streams discovered or catalogued for this tap.

Results will be cached after first execution.

Returns:

A mapping of names to streams, using discovery or a provided catalog.

property tap_connector: SQLConnector

The connector object.

Returns:

The connector object.