PalimpsestBERT

BERT-base continued-pretrained from GreekBERT (nlpaueb/bert-base-greek-uncased-v1) on a new Ancient Greek corpus derived from the Harvard institutional-books collection.

Pretraining

  • Best val loss: 1.5818, PPL: 4.864 (epoch 40/40)

Downstream (full results in the paper/repo)

TAG POS MORPH LEMMA UAS LAS SENT_F
98.66 98.64 94.95 94.40 87.85 84.47 74.01
Downloads last month
59
Safetensors
Model size
0.1B params
Tensor type
F32
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for pnadel/palimpsestBERT

Finetuned
(18)
this model

Dataset used to train pnadel/palimpsestBERT