mecfs_bio.build_system.meta.read_spec.dataframe_read_spec

Classes:

• DataFrameParquetFormat –
• DataFrameReadSpec –

  Specifies how a file containing a dataframe should be read.

• DataFrameTextFormat –
• DataFrameWhiteSpaceSepTextFormat –

Attributes:

• Compression –
• DataFrameFormat –

Compression module-attribute

Compression = Literal['gzip']

DataFrameFormat module-attribute

DataFrameFormat = (
    DataFrameTextFormat
    | DataFrameParquetFormat
    | DataFrameWhiteSpaceSepTextFormat
)

DataFrameParquetFormat

DataFrameReadSpec

Specifies how a file containing a dataframe should be read. Allows client code to operate without concern for the specifics of the dataframe format.

Attributes:

• format (DataFrameFormat) –

format instance-attribute

format: DataFrameFormat

DataFrameTextFormat

Attributes:

• column_names (list[str] | None) –
• comment_char (str | None) –
• has_header (bool) –
• null_values (Sequence[str] | None) –
• schema_overrides (Mapping[str, DataType]) –
• separator (str) –
• skip_rows (int) –

column_names class-attribute instance-attribute

column_names: list[str] | None = None

comment_char class-attribute instance-attribute

comment_char: str | None = None

has_header class-attribute instance-attribute

has_header: bool = True

null_values class-attribute instance-attribute

null_values: Sequence[str] | None = None

schema_overrides class-attribute instance-attribute

schema_overrides: Mapping[str, DataType] = field(
    factory=dict
)

separator instance-attribute

separator: str

skip_rows class-attribute instance-attribute

skip_rows: int = 0

DataFrameWhiteSpaceSepTextFormat

Attributes:

• col_names (list[str] | None) –
• comment_code (str) –

col_names class-attribute instance-attribute

col_names: list[str] | None = None

comment_code instance-attribute

comment_code: str