
A 10-Step Workflow for NLP Shared Tasks on a Small Compute Budget
How to spend limited compute in an NLP shared task: a three-phase, 10-step workflow from my doctoral thesis.

How to spend limited compute in an NLP shared task: a three-phase, 10-step workflow from my doctoral thesis.
In this post I’ll focus on Demo papers and tools that could be relevant in research and development. GenGO: ACL Paper Explorer with Semantic Features Motivation The researchers aimed to create a ...
This post focuses on ACL’2024 papers, that are studying information extraction tasks. Hypergraph based Understanding for Document Semantic Entity Recognition Motivation The researchers aimed to i...
When Phrases Meet Probabilities: Enabling Open Relation Extraction with Cooperating Large Language Models Motivation Existing clustering-based open relation extraction methods use pre-trained lang...
This year, I attended ACL 2024 in Bangkok. In this series of posts, I’ll share my personal highlights from the conference, focusing primarily on papers and ideas with practical applications. Promp...
DarkBERT: A Language Model for the Dark Side of the Internet Motivation Most of pretrained models are trained on the “Surface Web” data, i.e., the content that is readily available and indexed in ...
DIONYSUS: A Pre-trained Model for Low-Resource Dialogue Summarization Motivation The main challenge of dialogue summarization is to select the most relevant information, that could be spread acro...
Improving the Robustness of Summarization Systems with Dial Augmentation Motivation A robust summarization system should be able to capture the gist of the document, regardless of the specific word...
Generating Text from Language Models 📝 Slides Definition: Language Model is a probability distribution over strings. Objective of language generators: Steer strings distributions towards text wit...
Attending ACL 2023 in Toronto and will publish my notes here. If somebody is also here, I will be happy to chat in-person. Complex Reasoning in Natural Language 📝 Slides Definition: The ability t...