Get in Touch

Course Outline

Introduction to Huawei CloudMatrix

  • Overview of the CloudMatrix ecosystem and deployment workflow
  • Compatible models, formats, and deployment strategies
  • Common use cases and supported chipset architectures

Preparing Models for Deployment

  • Exporting models from training tools (MindSpore, TensorFlow, PyTorch)
  • Utilizing ATC (Ascend Tensor Compiler) for format conversion
  • Handling static versus dynamic shape models

Deploying to CloudMatrix

  • Creating services and registering models
  • Deploying inference services via the UI or command line
  • Managing routing, authentication, and access controls

Serving Inference Requests

  • Comparing batch and real-time inference flows
  • Implementing data preprocessing and postprocessing pipelines
  • Integrating CloudMatrix services into external applications

Monitoring and Performance Tuning

  • Reviewing deployment logs and tracking requests
  • Managing resource scaling and load balancing
  • Optimizing latency and throughput

Integration with Enterprise Tools

  • Connecting CloudMatrix with OBS and ModelArts
  • Leveraging workflows and model versioning
  • Implementing CI/CD for model deployment and rollback

End-to-End Inference Pipeline

  • Building a complete image classification pipeline
  • Benchmarking performance and validating accuracy
  • Simulating failover scenarios and system alerts

Summary and Next Steps

Requirements

  • A solid grasp of AI model training workflows
  • Familiarity with Python-based machine learning frameworks
  • Foundational knowledge of cloud deployment concepts

Target Audience

  • AI operations teams
  • Machine learning engineers
  • Cloud deployment specialists utilizing Huawei infrastructure
 21 Hours

Number of participants


Price per participant

Testimonials (2)

Upcoming Courses

Related Categories