This example demonstrates how to use WasmEdge WASI-NN OpenVINO plugin to perform an inference task with Mobilenet model.

• Install rustup and Rust

  Go to the official Rust webpage and follow the instructions to install rustup and Rust.

  It is recommended to use Rust 1.68 or above in the stable channel.

  Then, add wasm32-wasi target to the Rustup toolchain:

  rustup target add wasm32-wasi

• Clone the example repo

  git clone https://github.com/second-state/WasmEdge-WASINN-examples.git

• Install OpenVINO

Please refer to WasmEdge Docs and OpenVINO™(2023) for the installation process.

bash WasmEdge-WASINN-examples/scripts/install_openvino.sh
ldconfig

• Install WasmEdge with Wasi-NN OpenVINO plugin

  export CMAKE_BUILD_TYPE=Release
  export VERSION=0.13.2
  
  curl -sSf https://raw.githubusercontent.com/WasmEdge/WasmEdge/master/utils/install.sh | bash -s -- -v $VERSION -p /usr/local --plugins wasi_nn-openvino
  ldconfig

• Download MobileNet model file

  cd openvino-mobilenet-image
  bash download_mobilenet.sh

• Build and run the example

  cd rust
  cargo build --target wasm32-wasi --release
  cd ..
  
  wasmedge --dir .:. ./rust/target/wasm32-wasi/release/wasmedge-wasinn-example-mobilenet.wasm mobilenet.xml mobilenet.bin input.jpg

  If the commands above run successfully, you will get the output:

  Read graph XML, size in bytes: 143525
  Read graph weights, size in bytes: 13956476
  Loaded graph into wasi-nn with ID: 0
  Created wasi-nn execution context with ID: 0
  Read input tensor, size in bytes: 602112
  Executed graph inference
     1.) [954](0.9789)banana
     2.) [940](0.0074)spaghetti squash
     3.) [951](0.0014)lemon
     4.) [969](0.0005)eggnog
     5.) [942](0.0005)butternut squash