src.internal.data_connector package

This module contains the Dataset Connector classes, which provides a common interface to allow the app to interact with different providers (e.g ClearML datasets, Weights and Biases artifacts, DVC, etc.).

class src.internal.data_connector.Dataset

Bases: object

Constructor class for different dataset connectors

static from_connector(connector_type: Connector, **kwargs) → ClearMLDataset

Create a new dataset

Parameters:

• connector_type (Connector) – Type of connector to use

• **kwargs – Keyword arguments to pass to connector

Raises:

KeyError – If connector type is not supported

Returns:

Created dataset

Return type:

DatasetConnector

Submodules

• src.internal.data_connector.clearml_dataset module
  • ClearMLDataset
    • ClearMLDataset._abc_impl
    • ClearMLDataset.add_files()
    • ClearMLDataset.artifacts
    • ClearMLDataset.create()
    • ClearMLDataset.delete()
    • ClearMLDataset.download()
    • ClearMLDataset.file_entries
    • ClearMLDataset.get()
    • ClearMLDataset.list_datasets()
    • ClearMLDataset.name
    • ClearMLDataset.project
    • ClearMLDataset.remove_files()
    • ClearMLDataset.tags
    • ClearMLDataset.upload()
• src.internal.data_connector.connector module
  • DatasetConnector
    • DatasetConnector._abc_impl
    • DatasetConnector.add_files()
    • DatasetConnector.artifacts
    • DatasetConnector.create()
    • DatasetConnector.delete()
    • DatasetConnector.download()
    • DatasetConnector.file_entries
    • DatasetConnector.get()
    • DatasetConnector.list_datasets()
    • DatasetConnector.name
    • DatasetConnector.project
    • DatasetConnector.remove_files()
    • DatasetConnector.upload()