User Guide

Introduction

To accelerate the performance evaluation of AI models on target edge hardware platforms, Aplux has developed the Model Farm platform. Model Farm contains hundreds of mainstream open-source models across various functionalities, optimized for different hardware platforms, and provides measured benchmark performance metrics for reference. Developers can quickly complete evaluations based on actual requirements without investing significant costs or enduring long waiting periods.

Additionally, Model Farm provides ready-to-run model inference example code, which greatly reduces the difficulty and workload for developers testing model performance and developing AI functional code on existing hardware devices, shortening the overall process and accelerating solution deployment.

Features

Specifically, Model Farm helps developers accomplish the following:

• Query the AI performance of specific AI models on specific Qualcomm hardware.
• Download adapted and optimized AI models (capable of invoking NPU hardware compute units for inference acceleration).
• Download the corresponding pre/post-processing and model inference example code.
• View model adaptation and optimization steps, serving as a reference for developers to adapt and optimize their own fine-tuned models.

Model Farm Model Testing Workflow

User Fine-tuned Model Testing Workflow

Model Management Service (MMS)

Aplux provides the Model Management Service (MMS) component, allowing developers to access Model Farm without using a web browser. Through this service, model information and related file/code packages can be obtained directly on edge devices.

Prepare a Developer Account

Developers can browse model information and performance metrics on Model Farm without logging in.

A developer account is required when downloading models and sample code.

• Register as an Aplux Developer
• Please visit: Developer Account Registration
• Follow the registration form prompts to fill in the relevant developer information.
• After ensuring the information is correct, submit the account creation request.

Quick Start

The process for a developer to complete AI model inference on an edge device via Model Farm involves the following steps:

• Quick Start via Web: Quick Start with Web
• Quick Start via MMS: Quick Start with MMS (Recommended)