Data & software

Collections, models and code

Most of our papers come with something others can reuse. First the resources we maintain, then everything we have published on GitHub and HuggingFace.

Everything we release 52

12 datasets and 19 models on HuggingFace, 21 repositories on GitHub. Gated items are approved by the authors on request.

Datasets

  • Hate speech ICWSM 2024

    MetaHate

    A meta-collection of 36 hate speech datasets from social media, unified under one binary label. Version 2.0 refines cross-dataset deduplication. MetaHateES is the Spanish counterpart.

  • Mental health CIKM 2025

    ReDSM5

    Reddit posts annotated sentence by sentence for the nine DSM-5 symptoms of a major depressive episode, each label with an expert rationale. A paraphrased 25-post sample needs no agreement.

  • Mental health

    eRisk Depression Severity Personas

    Personas of 116 Reddit users with self-reported depression and their BDI-II severity, for persona-conditioned user simulation (Eval4MHSim). A paraphrased three-user sample is open.

  • Hate speech

    Induced Hate Speech Classification Guidelines

    Classification guidelines induced by an LLM from labelled examples of the Measuring Hate Speech corpus. They quote hateful posts verbatim, so access is approved manually.

  • Crawling

    ProdCrawl

    A replayable test collection for focused crawling: static mirrors of 621 company websites with a relevance judgment for every page for "is this a product page?", plus the fine-tuned anchor-text encoder.

  • RAG & search

    LoreHopQA

    Multi-hop questions set in 61 invented worlds, so the retrieved context is the only source of the answer. Gated so that no evaluated model sees it in training; evaluation and publication are unrestricted.

  • Galician arXiv 2023

    Galician instruction data

    Galician translations of the Stanford Alpaca instructions (52K) and of ShareGPT conversations, used to train Cabuxa.

Models

Code

  • prodcrawl

    Focused crawler with BFS, DFS, classifier and retrieval-based anchor scoring, and the scripts to serve the ProdCrawl mirrors.

    Crawling Python ★ 2
  • lorehop-qa

    Validation experiments for LoreHopQA: closed-book answering, ablated evidence and complete context.

    RAG & search Python ★ 2
  • eval4sim

    Eval4Sim, an evaluation framework for persona simulation with LLMs.

    Paper Evaluation Python ★ 8
  • eval4mhsim

    Eval4MHSim, a persona collection and evaluation framework for simulating social media users with mental health conditions.

    Mental health Python ★ 10
  • llm-prf

    LLM-assisted pseudo-relevance feedback that filters noisy feedback documents before query expansion.

    ECIR 2026 RAG & search Java ★ 2
  • erisk-qrels-expansion

    Champion runs and LLM-assisted annotation to extend the shallow relevance judgments of eRisk collections.

    Evaluation Jupyter Notebook ★ 3
  • recsysipp

    LLM relevance judgments for evaluating recommender systems on MovieLens: judgment quality, augmented pools and popularity bias.

    Evaluation Python ★ 2
  • grpo-dsm5

    Group Relative Policy Optimization to make LLM reasoning about DSM-5 depression symptoms clinically reliable.

    Mental health Python ★ 7
  • rcl

    Hybrid pooling with LLMs through relevance context learning.

    SIGIR 2026 Evaluation Python ★ 2
  • hate-eval-agreement

    Whether LLMs can evaluate hate speech classifiers even where they annotate poorly.

    LREC 2026 Hate speech Python ★ 2
  • geographic-bias

    Geographic bias in LLM hate speech detection, and debias tuning.

    ICWSM 2026 Hate speech Python ★ 2
  • multiple-testing

    Statistical testing for comparing many retrieval systems at once.

    ECIR 2025 Evaluation Java ★ 1
  • Lost-in-the-Evidence-in-RAG-Virtual-Appendix

    Virtual appendix for a reproducibility study of document position and context size effects in RAG.

    RAG & search Jupyter Notebook ★ 3
  • bayesian-inference

    Bayesian inference with Stan for statistical comparisons between retrieval systems.

    Evaluation Java ★ 1
  • SIQSE

    Simulates users choosing query suggestions with LLMs, to evaluate suggestions beyond the top positions.

    SIGIR 2026 Evaluation Python ★ 7
  • depression-prompt-induction

    Symptom Induction: a teacher LLM distils labelled examples into interpretable guidelines for spotting evidence of depression symptoms.

    SIGIR 2026 Mental health Python ★ 2
  • ColBERTKP

    ColBERT adapted to keyphrase queries.

    IP&M 2025 RAG & search Python ★ 7
  • distil-metahate

    Distilling LLMs into efficient, explainable hate speech classifiers.

    ECIR 2025 Hate speech Python ★ 4
  • decoding-hate

    How language models react to hate speech, and how to stop them engaging with it.

    NAACL 2025 Hate speech Python ★ 2
  • metahate

    Scripts that build MetaHate from its 36 source datasets.

    ICWSM 2024 Hate speech Jupyter Notebook ★ 8
  • RAKS

    Retrieval-augmented generation for suggesting keyphrase synonyms.

    ECIR 2025 RAG & search Python ★ 4