Robuta

https://replicate.com/lucataco/modernbert-base
ModernBERT-base is a modernized bidirectional encoder-only Transformer model (BERT-style) pre-trained on 2 trillion tokens of English and code data
modernbertbaserunapireplicate
https://arxiv.org/abs/2512.23065
Abstract page for arXiv paper 2512.23065: TabiBERT: A Large-Scale ModernBERT Foundation Model and A Unified Benchmark for Turkish
large scalefoundation modelmodernbert