MulticoreWare

Case Studies

Intermediate Representation Support for ML Engine

October 19, 2022

This case study emphasizes the role of MulticoreWare in creating and implementing a software layer to enable PyTorch backend support using the client’s existing software stack.

The Client

The client is one of the top chip manufacturers with a custom AI/ML accelerator for training and inference pipeline.

The Project

Enable PyTorch (An open-source machine learning framework that accelerates the path from research prototyping to production deployment) support for their custom hardware by extending the software stack in an optimised manner and provide an end-to-end test suite for the same.

Challenges

  1. Limited operator support in customer’s kernel Library
  2. Multiple abstraction layers in the customer’s software stack adds more complexity

Solutions Proposed

MulticoreWare’s engineers decided to use a combination of existing kernels to realize operators which were not supported in the kernel library of the customer.

Test suite with wide coverage to validate all operators for which support was added.

Creating and implementing a software layer to enable PyTorch backend support using the existing software stack

The MulticoreWare Advantage & Approach

MulticoreWare has 8+ years of experience working across layers of multiple clients’ ML Software stack. Be it kernel writing or kernel optimization or addition of ML Framework support or Model development & tuning, we have years of expertise on these areas.

In addition, we also have expertise from the much older Caffe framework to the current PyTorch. We quickly put together a team consisting of a solution architect, senior developers, and quality analysts to conduct a comprehensive assessment of the current technical ecosystem.

OUTCOME

80% of the OPs present in PyTorch framework were enabled to work in client’s hardware/software stack. These were validated using test suite for functional correctness.

Share Via

Explore More

Nov 10 2023

Exploring Binary Translation: A Case Study

The client, a prominent corporation, sought to create a Binary Translator for the conversion of binary code into LLVM Intermediate Representation (IR) tailored for specific backend compilation.

Read more
Aug 25 2023

Machine Learning and Predictive Analytics

The client is one of the leading chip manufacturers in the industry. They were trying to benchmark and enhance the multithreaded Machine Learning (ML) Inference Performance on high core count CPUs.

Read more
Jan 23 2023 Imaging RADAR and IMU based Static Mapping and Localization

Imaging RADAR & IMU based Static Mapping & Localization

This case study emphasize’s the Multicoreware role in Perception algorithm development with Automotive Radars for ADAS applications for one of our clients.

Read more

GET IN TOUCH