What are foundation models? ‘AI foundation models’ are defined as “models trained on broad data […] that can be adapted to a wide range of downstream tasks”. They generally use self-supervision at scale, which means these models can learn and label the data themselves during training.
Leave a Reply