AWS AI Practitioner
Which strategy will evaluate the performance of a foundation model (FM) in real-world applications?
A
Conducting A/B testing with users in a controlled environment
✓ Correcta
B
Human evaluation by subject matter experts
C
Measuring the model's accuracy on a training dataset
D
Analysis of the model's internal representations and attention patterns
Explicación
Conducting A/B testing with users in a controlled environment evaluates FM performance in real-world conditions by comparing different model versions or configurations against actual user interactions. This approach captures real usage patterns and user satisfaction, providing practical performance insights.