Addressing the feature request mentioned in #4, which suggests to extend functionalities of the T2I class to already tokenized corpora, i.e. in the form of List[List[str]].
Addressing the feature request mentioned in #4, which suggests to extend functionalities of the T2I class to already tokenized corpora, i.e. in the form of List[List[str]].