CrisisTransformers | State-of-the-art contextual and semantically meaningful sentence embeddings for crisis-related social media texts

CrisisTransformers is a family of pre-trained language models and sentence encoders introduced in the following papers:

• Pre-trained models and sentence encoders: CrisisTransformers: Pre-trained language models and sentence encoders for crisis-related social media texts
• Multi-lingual sentence encoders: Semantically Enriched Cross-Lingual Sentence Embeddings for Crisis-related Social Media Texts
• Mini models: "Actionable Help" in Crises: A Novel Dataset and Resource-Efficient Models for Identifying Request and Offer Social Media Posts

The models were trained on a massive corpus of over 15 billion word tokens from tweets associated with 30+ crisis events, such as disease outbreaks, natural disasters, conflicts, etc.