rajpurkar/squad
Viewer • Updated • 98.2k • 148k • 363
How to use haritzpuerto/spanbert-large-cased_SQuAD with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("question-answering", model="haritzpuerto/spanbert-large-cased_SQuAD") # Load model directly
from transformers import AutoTokenizer, AutoModelForQuestionAnswering
tokenizer = AutoTokenizer.from_pretrained("haritzpuerto/spanbert-large-cased_SQuAD")
model = AutoModelForQuestionAnswering.from_pretrained("haritzpuerto/spanbert-large-cased_SQuAD")Trained on the SQuAD v1.1 dataset from the MRQA Shared Task. The public dev set was divided into two: one for dev and one for test.
"eval_exact_match": 88.15914715400723, "eval_f1": 93.91715796563734, "eval_samples": 5291
"test_exact_match": 86.52455272173582, "test_f1": 92.92134442432088 "predict_samples": 5294
More info in the paper: MetaQA: Combining Expert Agents for Multi-Skill Question Answering https://arxiv.org/abs/2112.01922