DarkBERT: A Language Model for the Dark Side of the Internet Motivation Most of pretrained models are trained on the “Surface Web” data, i.e., the content that is readily available and indexed in ...

DIONYSUS: A Pre-trained Model for Low-Resource Dialogue Summarization Motivation The main challenge of dialogue summarization is to select the most relevant information, that could be spread acro...

Improving the Robustness of Summarization Systems with Dial Augmentation Motivation A robust summarization system should be able to capture the gist of the document, regardless of the specific word...

Generating Text from Language Models 📝 Slides Definition: Language Model is a probability distribution over strings. Objective of language generators: Steer strings distributions towards text wit...

Attending ACL 2023 in Toronto and will publish my notes here. If somebody is also here, I will be happy to chat in-person. Complex Reasoning in Natural Language 📝 Slides Definition: The ability t...

Classical Information Encoding In the field of computer science, there are numerous methods for encoding information. One such method is the Huffman code, which allows for the reconstruction of th...

Machine learning has revolutionized the way we solve complex problems, from natural language processing to image recognition. However, one major obstacle that machine learning practitioners face is...