HugeCTR V2.1

New Features:

• Supporting three important networks: Wide and Deep Learning (WDL), Deep Cross Network (DCN) and DeepFM.
• A new embedding implementation LocalizedSlotSparseEmbedding which reduces the memory transactions across GPUs and nodes resiliently to the number of GPUs.
• Supporting multiple Embeddings in one network.
• Supporting dense feature input.
• Supporting new layers like: Dropout / Split / Reshape / Multiply / FmOrder2 / MultCross / Add
• Check bits in data reader to enable data check and error skip.