banhxeo.data.transforms module

class banhxeo.data.transforms.Transforms(*, metadata: Dict[str, Any] = {})

Bases: BaseModel

metadata: Dict[str, Any]

model_config: ClassVar[ConfigDict] = {}

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].

class banhxeo.data.transforms.ComposeTransforms(transforms)

Bases: object

Composes several transforms together. - Source: https://github.com/pytorch/vision/blob/main/torchvision/transforms/transforms.py - Example: >>> transforms.Compose([ >>> transforms.CenterCrop(10), >>> transforms.PILToTensor(), >>> transforms.ConvertImageDtype(torch.float), >>> ])

__init__(transforms)

class banhxeo.data.transforms.RemoveHTMLTag(*, metadata: Dict[str, Any] = {})

Bases: Transforms

model_config: ClassVar[ConfigDict] = {}

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].

class banhxeo.data.transforms.RemoveURL(*, metadata: Dict[str, Any] = {})

Bases: Transforms

model_config: ClassVar[ConfigDict] = {}

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].

class banhxeo.data.transforms.RemovePunctuation(*, metadata: Dict[str, Any] = {})

Bases: Transforms

model_config: ClassVar[ConfigDict] = {}

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].

class banhxeo.data.transforms.Strip(*, metadata: Dict[str, Any] = {})

Bases: Transforms

model_config: ClassVar[ConfigDict] = {}

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].

class banhxeo.data.transforms.SpellingCorrection(*, metadata: Dict[str, Any] = {})

Bases: Transforms

model_config: ClassVar[ConfigDict] = {}

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].