HiTZ zentroa

All

17 repositories

Ranking-Over-Scoring-COLING-2025
Public
This is the repository related to our COLING 2025 paper named Ranking Over Scoring: Towards Reliable and Robust Automated Evaluation of LLM-Generated Medical Explanatory Arguments
Python
•
Apache License 2.0
•0•0•0•0•Updated Dec 19, 2024Dec 19, 2024
arena
Public
Hizkuntza-Eredu Handiak ebaluatzeko arena
0•0•0•0•Updated Dec 8, 2024Dec 8, 2024
vardial-2025
Public
HiTZ at VarDial 2025 Shared Tasks: Norwegian slot and intent detection and dialect identification (NorSID)
Python
•0•0•0•0•Updated Nov 24, 2024Nov 24, 2024
accelerate
Public
🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support
Python
•
Apache License 2.0
•997•0•0•0•Updated Nov 1, 2024Nov 1, 2024
eval-MCG-COLING-2025
Public
Jupyter Notebook
•
Apache License 2.0
•0•0•0•0•Updated Oct 31, 2024Oct 31, 2024
GoLLIE
Public
Guideline following Large Language Model for Information Extraction
training inference text-generation information-extraction transformer named-entity-recognition llama guidelines event-extraction relation-extraction
Python
•
Apache License 2.0
•22•323•2•1•Updated Oct 27, 2024Oct 27, 2024
cn-eval
Public
Jupyter Notebook
•
Apache License 2.0
•0•1•0•0•Updated Oct 16, 2024Oct 16, 2024
critical_questions_generation
Public
Python
•0•0•0•0•Updated Oct 10, 2024Oct 10, 2024
ses-lemma
Public
Evaluating Shortest Edit Script Methods for Contextual Lemmatization
Python
•
Apache License 2.0
•0•0•0•0•Updated Jul 18, 2024Jul 18, 2024
xnli-eu
Public
XNLIeu: a dataset for cross-lingual NLI in Basque
nlp translation machine-translation natural-language-inference basque euskara nli xnli human-translation
Jupyter Notebook
•0•0•0•0•Updated Jul 1, 2024Jul 1, 2024
latxa
Public
Latxa: An Open Language Model and Evaluation Suite for Basque
evaluation language-model basque huggingface gpt-neox llm lm-evaluation latxa
Shell
•
MIT License
•1•26•1•0•Updated Jun 11, 2024Jun 11, 2024
This-is-not-a-Dataset
Public
We introduce a large semi-automatically generated dataset of ~400,000 descriptive sentences about commonsense knowledge that can be true or false in which negation is present in about 2/3 of the corpus in different forms that we use to evaluate LLMs
benchmark decoder transformer llama scorer negation common-sense commonsense huggingface llm
Python
•
Apache License 2.0
•1•13•0•0•Updated May 13, 2024May 13, 2024
multilingual-abstrct
Public
1•0•0•0•Updated May 6, 2024May 6, 2024
lm-contamination
Public
The LM Contamination Index is a manually created database of contamination evidences for LMs.
lm language-model contamination large-language-models llm chatgpt
Python
•4•76•0•0•Updated Apr 11, 2024Apr 11, 2024
MedExpQA
Public
Python
•
Apache License 2.0
•0•1•0•0•Updated Apr 8, 2024Apr 8, 2024
lm-evaluation-harness
Public
A framework for few-shot evaluation of autoregressive language models.
Python
•
MIT License
•2k•0•0•0•Updated Oct 5, 2023Oct 5, 2023
eustagger-lite
Public
Eustagger Lite
C++
•
GNU General Public License v3.0
•0•2•1•0•Updated Feb 3, 2022Feb 3, 2022