CertBrain
Courses
Home
Blog
Sign in
← How Foundation Models Are Trained
1 / 9
Question
A pharmaceutical company has millions of unlabeled internal research papers. It wants a foundation model to understand its chemistry terms and research areas before any task-specific training. Which training method fits best?
1
Supervised fine-tuning on the unlabeled research papers
2
Pre-training a brand-new model from scratch
3
Continued pre-training on the research papers
4
Distillation from a larger teacher model
Press 1–4 to pick an answer