Which of the following statements with regard to Large Language Models (LLMs) used in machine learning is/are correct?
- LLMs assign probabilities to the next possible words and then pick the one with the highest probability.
- LLMs process data through mathematical optimization to minimise prediction errors.
- LLMs produce unbiased outputs.
Select the answer using the code given below:
Correct answer: B
Explanation
LLMs are next-token predictors: they output a probability distribution over possible next tokens and typically sample from the top-probability candidates (1 correct). Training relies on mathematical optimisation (gradient descent on a loss function) to minimise prediction error across vast corpora (2 correct). Statement 3 is wrong — LLMs inherit and can amplify biases present in their training data, and bias mitigation is an active research problem. Hence 1 and 2 only.