Difference between revisions of "Quad stereo tensorflow eclipse"

From ElphelWiki
Jump to: navigation, search
(Created page with "==ImageJ plugin== * Install Eclipse * Clone and Import [https://git.elphel.com/Elphel/imagej-elphel imagej-elphel] <font color='tomato'>'''Note: if the project is updated/pull...")
 
(7 intermediate revisions by the same user not shown)
Line 2: Line 2:
 
* Install Eclipse
 
* Install Eclipse
 
* Clone and Import [https://git.elphel.com/Elphel/imagej-elphel imagej-elphel]
 
* Clone and Import [https://git.elphel.com/Elphel/imagej-elphel imagej-elphel]
<font color='tomato'>'''Note: if the project is updated/pulled outside Eclipse - need manual refresh'''</font>
+
<font color='red'>'''NOTE: if project is updated/pulled outside Eclipse - might need a manual refresh'''</font>
 +
* TF version is pulled from pom.xml
 +
* Trained TF model for EO sensors is auto-downloaded - [https://community.elphel.com/files/quad-stereo/ml/trained_model_v1.0.zip trained_model_v1.0.zip]
 +
* Get some image samples, provide paths
 +
* Before running the plugin (Eyesis_Correction), copy imagej options to /home/user/.imagejs/Eyesis_Correction.xml:
 +
<font size='1'>
 +
<?xml version="1.0" encoding="UTF-8"?>
 +
<!DOCTYPE properties SYSTEM "http://java.sun.com/dtd/properties.dtd">
 +
<properties>
 +
    <comment>last updated Thu Sep 08 14:09:47 MDT 2042</comment>
 +
    <entry key="ADVANCED_MODE">True</entry>
 +
    <entry key="DCT_MODE">True</entry>
 +
    <entry key="MODE_3D">False</entry>
 +
    <entry key="GPU_MODE">True</entry>
 +
    <entry key="LWIR_MODE">True</entry>
 +
</properties>
 +
</font>
 +
* Updaed pom.xml to TF 1.15 - package exists
 +
* Install cuDNN all 3 packages - runtime, dev and docs. Used docs to verify installation - built mnistCUDNN:
 +
https://docs.nvidia.com/deeplearning/sdk/cudnn-install/index.html
 +
* I think TF 1.15 maven package was built for CUDA 10.0 driver, and so it whines when 10.2 is installed.
 +
<font size=1 color=red>2019-12-27 13:05:15.754656: W tensorflow/stream_executor/platform/default/dso_loader.cc:55] Could not load dynamic library 'libcudart.so.10.0'; dlerror: libcudart.so.10.0: cannot open shared object file: No such file or directory
 +
2019-12-27 13:05:15.754756: W tensorflow/stream_executor/platform/default/dso_loader.cc:55] Could not load dynamic library 'libcublas.so.10.0'; dlerror: libcublas.so.10.0: cannot open shared object file: No such file or directory
 +
2019-12-27 13:05:15.754860: W tensorflow/stream_executor/platform/default/dso_loader.cc:55] Could not load dynamic library 'libcufft.so.10.0'; dlerror: libcufft.so.10.0: cannot open shared object file: No such file or directory
 +
2019-12-27 13:05:15.754970: W tensorflow/stream_executor/platform/default/dso_loader.cc:55] Could not load dynamic library 'libcurand.so.10.0'; dlerror: libcurand.so.10.0: cannot open shared object file: No such file or directory
 +
2019-12-27 13:05:15.755075: W tensorflow/stream_executor/platform/default/dso_loader.cc:55] Could not load dynamic library 'libcusolver.so.10.0'; dlerror: libcusolver.so.10.0: cannot open shared object file: No such file or directory
 +
2019-12-27 13:05:15.755178: W tensorflow/stream_executor/platform/default/dso_loader.cc:55] Could not load dynamic library 'libcusparse.so.10.0'; dlerror: libcusparse.so.10.0: cannot open shared object file: No such file or directory
 +
2019-12-27 13:05:15.762197: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7
 +
2019-12-27 13:05:15.762227: W tensorflow/core/common_runtime/gpu/gpu_device.cc:1641] Cannot dlopen some GPU libraries. Please make sure the missing libraries mentioned above are installed properly if you would like to use GPU. Follow the guide at https://www.tensorflow.org/install/gpu for how to download and setup the required libraries for your platform.
 +
Skipping registering GPU devices...</font>

Revision as of 12:32, 27 December 2019

ImageJ plugin

NOTE: if project is updated/pulled outside Eclipse - might need a manual refresh

  • TF version is pulled from pom.xml
  • Trained TF model for EO sensors is auto-downloaded - trained_model_v1.0.zip
  • Get some image samples, provide paths
  • Before running the plugin (Eyesis_Correction), copy imagej options to /home/user/.imagejs/Eyesis_Correction.xml:

<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE properties SYSTEM "http://java.sun.com/dtd/properties.dtd">
<properties>
    <comment>last updated Thu Sep 08 14:09:47 MDT 2042</comment>
    <entry key="ADVANCED_MODE">True</entry>
    <entry key="DCT_MODE">True</entry>
    <entry key="MODE_3D">False</entry>
    <entry key="GPU_MODE">True</entry>
    <entry key="LWIR_MODE">True</entry>
</properties>

  • Updaed pom.xml to TF 1.15 - package exists
  • Install cuDNN all 3 packages - runtime, dev and docs. Used docs to verify installation - built mnistCUDNN:
https://docs.nvidia.com/deeplearning/sdk/cudnn-install/index.html
  • I think TF 1.15 maven package was built for CUDA 10.0 driver, and so it whines when 10.2 is installed.
2019-12-27 13:05:15.754656: W tensorflow/stream_executor/platform/default/dso_loader.cc:55] Could not load dynamic library 'libcudart.so.10.0'; dlerror: libcudart.so.10.0: cannot open shared object file: No such file or directory
2019-12-27 13:05:15.754756: W tensorflow/stream_executor/platform/default/dso_loader.cc:55] Could not load dynamic library 'libcublas.so.10.0'; dlerror: libcublas.so.10.0: cannot open shared object file: No such file or directory
2019-12-27 13:05:15.754860: W tensorflow/stream_executor/platform/default/dso_loader.cc:55] Could not load dynamic library 'libcufft.so.10.0'; dlerror: libcufft.so.10.0: cannot open shared object file: No such file or directory
2019-12-27 13:05:15.754970: W tensorflow/stream_executor/platform/default/dso_loader.cc:55] Could not load dynamic library 'libcurand.so.10.0'; dlerror: libcurand.so.10.0: cannot open shared object file: No such file or directory
2019-12-27 13:05:15.755075: W tensorflow/stream_executor/platform/default/dso_loader.cc:55] Could not load dynamic library 'libcusolver.so.10.0'; dlerror: libcusolver.so.10.0: cannot open shared object file: No such file or directory
2019-12-27 13:05:15.755178: W tensorflow/stream_executor/platform/default/dso_loader.cc:55] Could not load dynamic library 'libcusparse.so.10.0'; dlerror: libcusparse.so.10.0: cannot open shared object file: No such file or directory
2019-12-27 13:05:15.762197: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7
2019-12-27 13:05:15.762227: W tensorflow/core/common_runtime/gpu/gpu_device.cc:1641] Cannot dlopen some GPU libraries. Please make sure the missing libraries mentioned above are installed properly if you would like to use GPU. Follow the guide at https://www.tensorflow.org/install/gpu for how to download and setup the required libraries for your platform.
Skipping registering GPU devices...