CPU and GPU Model Deployment

CPU Model Deployment

If the model is to be deployed on a CPU device, please select CPU for Deployment device.

../../../_images/object_cpu_deployment.png

GPU Model Deployment

If the model is to be deployed on a GPU device, please select GPU for Deployment device.

There are two model types to choose from.

  • dlkmo: The model optimization takes about 5 minutes. This model type is for the situation where the GPU graphics card models are different for model training and model deployment.

  • dlkmt: No optimization is required for this type. This model type is for the situation where the GPU graphics card models are the same for model training and model deployment.

../../../_images/object_gpu_deployment.png