Question: What is the role of a load balancer in model deployment?
Options:
Correct Answer: To distribute incoming requests across multiple instances of a model
Solution:
A load balancer distributes incoming requests across multiple instances of a model to ensure efficient resource utilization and high availability.