orkgnlp.annotation.tdm.encoder.TdmExtractorEncoder

class TdmExtractorEncoder(labels, batch_size)[source]

Bases: ORKGNLPBaseEncoder

The TdmExtractorEncoder encodes the given input to the arguments needed to execute an XLNetForSequenceClassification model.

Parameters:

  • labels (DataFrame) – TDM gold labels given as one-columned-dataframe

  • batch_size (int) – Size of the batches used during model prediction.

Methods

encode

Encodes the raw_input to a model-friendly format.

release_memory

Releases the memory of all available attributes in a pipeline component.
encode(raw_input, **kwargs)[source]

Encodes the raw_input to a model-friendly format.

Parameters:

raw_input (Any) – The user’s input to be encoded.

Return type:

Tuple[Any, Dict[str, Any]]

Returns:

The model-friendly output and kwargs.

release_memory()

Releases the memory of all available attributes in a pipeline component.