Skip to content

mecfs_bio.build_system.task.pipes.data_processing_pipe

Classes:

  • DataProcessingPipe –

    Abstract class representing a transformation of a lazy dataframe.

DataProcessingPipe

Bases: ABC

Abstract class representing a transformation of a lazy dataframe.

Methods:

process abstractmethod 

process(x: LazyFrame) -> narwhals.LazyFrame
Source code in mecfs_bio/build_system/task/pipes/data_processing_pipe.py 
13
14
15
@abstractmethod
def process(self, x: narwhals.LazyFrame) -> narwhals.LazyFrame:
    pass

process_eager_polars 

process_eager_polars(x: DataFrame) -> pl.DataFrame
Source code in mecfs_bio/build_system/task/pipes/data_processing_pipe.py 
21
22
23
def process_eager_polars(self, x: pl.DataFrame) -> pl.DataFrame:
    lx = narwhals.from_native(x).lazy()
    return self.process(lx).collect().to_polars()

process_pandas 

process_pandas(x: DataFrame) -> pd.DataFrame
Source code in mecfs_bio/build_system/task/pipes/data_processing_pipe.py 
17
18
19
def process_pandas(self, x: pd.DataFrame) -> pd.DataFrame:
    lx = narwhals.from_native(x).lazy()
    return self.process(lx).collect().to_pandas()