AWS AI Practitioner
A company needs to use a pre-trained foundation model (FM) without any extra training. The FM must give a response in 30 seconds or less. Which FM characteristic is MOST important for the company to consider?
A
Context window size
B
Model size
✓ Correcta
C
Model architecture
D
Training data recency
Explicación
Model size directly impacts inference speed. A smaller model will provide faster responses. Since the company needs responses within 30 seconds without any additional training, model size is the most critical factor to consider as it determines the latency of the FM's responses.