Feeding Tensorflow from GPU

About

Reference guides:

• Supercharging Object Detection in Video: from Glacial to Lightning Speed
• Setup
• First App
• Optimizing Decoding and Graph Feeding

Target projects:

• tensorflow-object-detection-cpp - contains a sample model, labels and a test video
• fast_od - contains feeding Tensorflow from GPU

Setup

Kubuntu 18.04:

mkdir -p ~/git/tf_cv_cu
cd ~/git/tf_cv_cu

git clone https://github.com/fierval/tensorflow-object-detection-cpp.git
git clone https://github.com/fierval/fast_od.git

wget https://github.com/Kitware/CMake/releases/download/v3.16.2/cmake-3.16.2.tar.gz
tar xzvf cmake-3.16.2.tar.gz
sudo apt install libssl-dev
sudo apt install qt4-default
cd cmake-3.16.2
./bootstrap -qt-gui
make -j8
sudo make install

cmake -version
cmake-gui -version

wget https://github.com/bazelbuild/bazel/releases/download/0.25.2/bazel_0.25.2-linux-x86_64.deb
sudo dpkg -i bazel_0.25.2-linux-x86_64.deb
wget https://github.com/tensorflow/tensorflow/archive/v1.15.0.tar.gz -O tensorflow-1.15.0.tar.gz
tar xzvf tensorflow-1.15.0.tar.gz
cd ~/git/tensorflow-1.15.0/
tensorflow/contrib/makefile/download_dependencies.sh
./configure
# pick all defaults except select yes for CUDA support
bazel build //tensorflow:libtensorflow_cc.so

wget https://github.com/opencv/opencv/archive/3.4.9.tar.gz -O opencv-3.4.9.tar.gz
tar xzvf opencv-3.4.9.tar.gz
wget https://github.com/opencv/opencv_contrib/archive/3.4.9.tar.gz -O opencv_contrib-3.4.9.tar.gz
tar xzvf opencv_contrib-3.4.9.tar.gz