French and English biomedical encoders: continual pretraining and the CLM-detour recipe. 170k+ downloads.
-
CamemBERT-bio: a Tasty French Language Model Better for your Health
Paper • 2306.15550 • Published • 4 -
A Causal Language Modeling Detour Improves Encoder Continued Pretraining
Paper • 2605.12438 • Published • 5 -
almanach/camembert-bio-base
Fill-Mask • 0.1B • Updated • 1.33k • • 21 -
almanach/ModernCamemBERT-bio-base
Fill-Mask • 0.1B • Updated • 253 • 3