orkgnlp.annotation.tdm.encoder

TDM-Extraction service encoder.

Classes

TdmDataset

The TdmDataset is a customized torch.utils.data.Dataset that simplifies the tokenization of sequences and can be used afterwards in a torch.utils.data.Dataloader for batch creation.

TdmExtractorEncoder

The TdmExtractorEncoder encodes the given input to the arguments needed to execute an XLNetForSequenceClassification model.