Skip to content

Deep learning inference SW framework based on TensorFlow Lite for Aarch64 Linux with GPU and Hexagon delegate

Notifications You must be signed in to change notification settings

Hozzu/TFLite-aarch64-linux-with-delegate

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

34 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

TFLite for Aarch64 Linux with Delegate

Deep learning inference SW framework based on TensorFlow Lite with delegates for Aarch64 Linux

In order to run deep learning application on Aarch64 Linux system (non-Android), I built tensorflow lite for such system.
It is based on tensorflow v2.16.2.

I included XNNPACK, GPU, hexagon, and NNAPI delegates.
GPU delegate requires OpenCL library.
Hexagon delegate requires Qualcomm hexagon NN library.

I wrote on guide.txt how to build tensorflow lite and deleage for aarch64 Linux.

I made two versions: onboard and offboard.
Onboard version contains gcc, make as well as tensorflow lite and delegates in order to build deep learning applications on board.
Offboard version only contains tensorflow lite and delegates, assuming that use cross compiler toolchain.

For instruction, read README.md in each directory.

It was tested on Qualcomm SA8195 platform which works on AGL (Automotive Grade Linux).

image

About

Deep learning inference SW framework based on TensorFlow Lite for Aarch64 Linux with GPU and Hexagon delegate

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published