Efficiency

SindBERT

The first large Turkish RoBERTa-style model, developed after PortBERT with extensive evaluations on private GPUs and the LRZ BayernKI H100 cluster. The study highlights the importance of corpus variance over sheer size.

PortBERT

A Portuguese RoBERTa model evaluated during a research stay on the Azores, highlighting efficiency-focused perspective models.