Inference

inference · Machine learning, LLMs and agents · skill

Also known as: inference, real-time inference, model inference, llm inference, inference runtime, ai inference.

Also covered in

• GPU infrastructure and model serving for inference workloads
• Model serving architecture: inference APIs for batch and real-time demand

Pathways that reach it

• AI forward deployed engineer
• MLOps / ML platform engineer