Deploy model to NVIDIA Triton Inference Server
NVIDIA Triton Inference Server is a multi-framework, open-source software that is optimized for inference. It supports popular machine learning frameworks like TensorFlow, Open Neural Network Exchange (ONNX) Runtime, PyTorch, NVIDIA TensorRT, and more. It can be used for your CPU or GPU workloads. In this module, you deploy your production model to NVIDIA Triton server to perform inference on a cloud-hosted virtual machine.
User Reviews
Be the first to review “Deploy model to NVIDIA Triton Inference Server”
Related Products
Responsible AI Practices
Master Responsible AI Practices with this comprehensive course, featuring real-world case studies and interactive content.
Developing LLM Applications with LangChain
Discover how to build AI-powered applications using LLMs, prompts, chains, and agents in LangChain.
AI Ethics
Explore AI ethics focusing on principles, fairness, bias reduction, and trust in AI design.
There are no reviews yet.