Difference between revisions of "Elphel Software Kit for Ubuntu"

From ElphelWiki
Jump to: navigation, search
(ImageJ and Elphel plugins for imageJ)
 
(32 intermediate revisions by 5 users not shown)
Line 3: Line 3:
 
This page is a simple howto for running Elphel software on (K)Ubuntu GNU/Linux.
 
This page is a simple howto for running Elphel software on (K)Ubuntu GNU/Linux.
  
Instructions below are updated for the [http://www.kubuntu.org Kubuntu 9.04] , should work with Ubuntu 9.04 also --[[User:Andrey.filippov|Andrey.filippov]] 02:52, 24 May 2009 (CDT)''
+
You can download this GNU/Linux distribution freely from http://www.kubuntu.org/
 +
 
 +
A <font size='3'>'''[http://community.elphel.com/files/live-dvd/ Live ISO image]'''</font> with almost all the packages pre-installed (except [[Elphel_Software_Kit_for_Ubuntu#Installation_of_the_source_code_of_Elphel_camera_software|Elphel camera source]] code and [[Elphel_Software_Kit_for_Ubuntu#Installing_Xilinx_WebPack_.28to_be_moved_to_a_separate_page.2C_just_a_link_here.29|Xilinx ISE WebPack]]) is available for downloading from [http://community.elphel.com/files/live-dvd/ here]:
 +
* [http://community.elphel.com/files/live-dvd/kubuntu-elphel-3.iso kubuntu-elphel-3.iso] is based on Kubuntu 9.10 LTS.
 +
* [http://community.elphel.com/files/live-dvd/kubuntu-elphel-4.iso kubuntu-elphel-4.iso] is based on Kubuntu 12.04 LTS.
  
You can download this GNU/Linux distribution freely from http://www.kubuntu.org/
 
  
 
=If you are new to GNU / Linux=
 
=If you are new to GNU / Linux=
Line 20: Line 23:
 
=User software=
 
=User software=
  
Some software need to be patched and recompiled even if they exist in Ubuntu software repositories, some softwares are not yet packaged in Ubuntu, so you have to compile them from sources also. We try to push our software patches to the mainstream applications, but it take time and is not always possible.
+
Some software need to be patched and recompiled even if they exist in Ubuntu software repositories, some softwares are not yet packaged in Ubuntu, so you have to compile them from sources also. We try to push our software patches to the mainstream applications, but it take time and is not always possible. For Ubuntu users some packages can be downloaded and upgraded using our [https://launchpad.net/~elphel/+archive/ppa ppa on launchpad].
  
 +
sudo add-apt-repository "deb http://ppa.launchpad.net/elphel/ppa/ubuntu natty main"
 +
sudo apt-get update
  
==Mplayer==
+
==Mplayer - Ubuntu 9.10 or later==
 
'''Kubuntu 9.10 includes MPlayer that is working with Elphel camera "out of the box"'''
 
'''Kubuntu 9.10 includes MPlayer that is working with Elphel camera "out of the box"'''
 
So for (K)Ubuntu 9.10 you just need to install
 
So for (K)Ubuntu 9.10 you just need to install
Line 34: Line 39:
 
Install gecko-mediaplayer before compiling/installing MPlayer, if you do it later it will install non-patched version of MPlayer
 
Install gecko-mediaplayer before compiling/installing MPlayer, if you do it later it will install non-patched version of MPlayer
  
  sudo apt-get gecko-mediaplayer
+
  sudo apt-get install gecko-mediaplayer
  
  
Line 132: Line 137:
 
  kdesudo kate /etc/exports
 
  kdesudo kate /etc/exports
 
Add at the end of the file:
 
Add at the end of the file:
  /nfs            192.168.0.0/255.255.0.0(rw,sync,no_root_squash)
+
  /nfs            192.168.0.0/255.255.0.0(rw,sync,no_root_squash,no_subtree_check)
 
save the file.
 
save the file.
  
Line 142: Line 147:
 
  sudo exportfs -a
 
  sudo exportfs -a
  
 +
(Had to reboot after in ubuntu 14.04)
  
 
== Installation of GCC Compiler kit for Axis ETRAX processor ==
 
== Installation of GCC Compiler kit for Axis ETRAX processor ==
==== Downloading and unpacking  gcc-cris ====
+
=== Automatic Installation ((K)Ubuntu 11.04 Natty Narwhal)===
 +
1.
 +
sudo add-apt-repository "deb http://ppa.launchpad.net/elphel/ppa/ubuntu natty main"
 +
 +
(The line above is equivalent to adding the following lines to your sources.list ('''sudo kate /etc/apt/sources.list''')):
 +
deb http://ppa.launchpad.net/elphel/ppa/ubuntu natty main
 +
deb-src http://ppa.launchpad.net/elphel/ppa/ubuntu natty main
 +
 
 +
2. (in case of) ...public key is not available...
 +
 
 +
sudo apt-key adv --keyserver keyserver.ubuntu.com --recv-keys 6050780EC7A72F76
 +
 
 +
3.
 +
sudo apt-get update
 +
sudo apt-get install cris-dist
 +
 
 +
=== Manual Installation ===
 +
====Downloading and unpacking  gcc-cris====
 
Download and install Cris-GCC compiler. It is needed to compile C and C++ programs for the CPU used in Elphel cameras - [http://en.wikipedia.org/wiki/ETRAX_CRIS Axis ETRAX FS] :
 
Download and install Cris-GCC compiler. It is needed to compile C and C++ programs for the CPU used in Elphel cameras - [http://en.wikipedia.org/wiki/ETRAX_CRIS Axis ETRAX FS] :
 
  mkdir -p ~/Downloads/axis ; cd ~/Downloads/axis
 
  mkdir -p ~/Downloads/axis ; cd ~/Downloads/axis
Line 164: Line 187:
 
  sudo ./install-cris-tools
 
  sudo ./install-cris-tools
 
answer by default (enter, enter, ...)
 
answer by default (enter, enter, ...)
 
If everything finished OK you may reinstall the GCC back (and add other packages you may have removed):
 
 
==== Re-installing current GCC and related packages ====
 
 
sudo apt-get install build-essential g++ gcc
 
  
 
<!--
 
<!--
Line 267: Line 284:
 
It is a very useful tool to do quantitative analysis of the camera images.
 
It is a very useful tool to do quantitative analysis of the camera images.
  
===ImageJ installation ===
+
* Download plugins:
 +
git clone https://git.elphel.com/Elphel/imagej-elphel.git
 +
git clone --branch v1.1 https://git.elphel.com/Elphel/imagej-elphel.git (for Eyesis4Pi393)
 +
* Download [http://www.eclipse.org/downloads/ Eclipse IDE for Java EE Developers] or any other with Maven integration
 +
* Edit ''eclipse.ini'':
 +
-clean -startup
 +
...
 +
-XX:MaxPermSize=24576m
 +
-Xms2048m
 +
-Xmx24576m
 +
* Kubuntu 18.04 might need:
 +
https://stackoverflow.com/questions/6784463/error-trustanchors-parameter-must-be-non-empty
 +
* From Eclipse:
 +
1. File -> Import -> Existing Maven Projects -> set imagej-elphel as Root Directory - a project will appear in the project list -> Finish
 +
    Importing will take some time
 +
 +
2. Create Run Configuration:
 +
    a. Run Configurations -> select Java Application -> New Launch Configuration -> find the needed plugin class -> Run
 +
        Classes:
 +
        * '''Aberration_Calibration''' - work with calibration data, regenerate kernels, etc.
 +
        * '''Eyesis_correction''' - postprocess images.
 +
    b. It will launch ''ImageJ & Aberration_Calibration plugin''
 +
    c. Other plugins are launched from ImageJ window from Plugins
 +
 
 +
<!--
 +
=== ImageJ installation ===
 
You may download ImageJ bundled with Java from the [http://rsbweb.nih.gov/ij/download.html download page]:
 
You may download ImageJ bundled with Java from the [http://rsbweb.nih.gov/ij/download.html download page]:
 +
 
==== With 32-bit Java ====  
 
==== With 32-bit Java ====  
cd ~/Download; wget "http://rsbweb.nih.gov/ij/download/linux/ij143-x86.tar.gz" ; tar zxvf ij143-x86.tar.gz
+
cd ~/Downloads; wget "http://rsbweb.nih.gov/ij/download/linux/ij147-linux32.zip" ; unzip ij147-linux32.zip
==== With 64-bit Java ====
+
 
cd ~/Download; wget "http://rsbweb.nih.gov/ij/download/linux/ij143-linux64.tar.gz" ; tar zxvf ij143-linux64.tar.gz
+
cd ~/Downloads; wget "http://rsbweb.nih.gov/ij/download/linux/ij149-linux64.zip" ; unzip ij149-linux64.zip
http://rsbweb.nih.gov/ij/download/linux/ij143-linux64.tar.gz - 64-bit Java version
+
 
 +
'''If any of the two direct download links above are broken, please use the [http://rsbweb.nih.gov/ij/download.html] to get the new ImageJ version'''
 +
 
 
===Running ImageJ ===
 
===Running ImageJ ===
 
There is "run" command the newly crated directory. You may start ImageJ with the following command:
 
There is "run" command the newly crated directory. You may start ImageJ with the following command:
Line 285: Line 330:
 
Then clone the repository - directly to the ImageJ plugins directory. Provided you used the same directory for ImageJ as written above:
 
Then clone the repository - directly to the ImageJ plugins directory. Provided you used the same directory for ImageJ as written above:
 
  cd  ~/Downloads/ImageJ/plugins
 
  cd  ~/Downloads/ImageJ/plugins
  git clone git://elphel.git.sourceforge.net/gitroot/elphel/ImageJ-Elphel
+
old url: git clone git://elphel.git.sourceforge.net/gitroot/elphel/ImageJ-Elphel
 +
git clone git://git.code.sf.net/p/elphel/ImageJ-Elphel
  
 
=== Updating Elphel plugins for ImageJ ===
 
=== Updating Elphel plugins for ImageJ ===
Line 297: Line 343:
  
 
When you'll update the source files, you 'll need to re-run "Compile and run...". meanwhile just use the item in Plugins->ImageJ-Elphel menu.
 
When you'll update the source files, you 'll need to re-run "Compile and run...". meanwhile just use the item in Plugins->ImageJ-Elphel menu.
 +
-->
 +
 +
[[Category:353]]

Latest revision as of 14:31, 4 June 2018

About

This page is a simple howto for running Elphel software on (K)Ubuntu GNU/Linux.

You can download this GNU/Linux distribution freely from http://www.kubuntu.org/

A Live ISO image with almost all the packages pre-installed (except Elphel camera source code and Xilinx ISE WebPack) is available for downloading from here:


If you are new to GNU / Linux

Many forums and wikis are available in many languages to help you to install and use Ubuntu. Ex: http://www.google.com/search?q=forum+ubuntu (you can add "&hl=fr" or any language code to the URL)

Most instructions below are commands that you need to enter in the in the terminal window. For the lines that do not end with "\" sign you just copy them one-by-one and paste in the terminal window (in KDE it is Konsole in the "System" menu). For pasting you can not use <cntrl-V> - you need to right-click in the terminal window and select "Paste" from the drop-down context menu. Alternatively you can use the middle mouse button to both copy (drag while middle mouse pressed) and paste - click it in the console window.

Character "\" at the end of the line means continuation, so you can copy the whole block of text where each line but the very last ends with "\" and paste them together.

Many of the commands start with "sudo" - first time system will ask you for your user password that you enter without any starts (provided you have administrative privileges).

If you get some problems it is very useful to copy the error message that system outputs (avoiding anything specific to your particular installation - like user directories names) and paste them into the search box of you browser.

User software

Some software need to be patched and recompiled even if they exist in Ubuntu software repositories, some softwares are not yet packaged in Ubuntu, so you have to compile them from sources also. We try to push our software patches to the mainstream applications, but it take time and is not always possible. For Ubuntu users some packages can be downloaded and upgraded using our ppa on launchpad.

sudo add-apt-repository "deb http://ppa.launchpad.net/elphel/ppa/ubuntu natty main"
sudo apt-get update

Mplayer - Ubuntu 9.10 or later

Kubuntu 9.10 includes MPlayer that is working with Elphel camera "out of the box" So for (K)Ubuntu 9.10 you just need to install

sudo apt-get install mplayer-nogui mplayer gecko-mediaplayer

Mplayer - installation for (K)Ubuntu older than 9.10 release

With the previous verions MPlayer has to be patched and recompiled, following instructions document how to do it on (K)Ubuntu or Debian based workstation.

Install gecko-mediaplayer before compiling/installing MPlayer, if you do it later it will install non-patched version of MPlayer

sudo apt-get install gecko-mediaplayer


First install some compilation dependencies, mainly libraries...


sudo apt-get install build-essential debhelper libncurses5-dev libesd0-dev liblircclient-dev libgtk2.0-dev \
libvorbis-dev libsdl1.2-dev sharutils libasound2-dev gawk libjpeg62-dev libaudiofile-dev \
libsmbclient-dev libxv-dev libpng12-dev libgif-dev libcdparanoia-dev libdv4-dev \
liblivemedia-dev libfreetype6-dev libgl1-mesa-dev libdvdread-dev libdts-dev libtheora-dev \
libglu1-mesa-dev libfontconfig-dev libxxf86dga-dev libxinerama-dev libxxf86vm-dev \
libxvmc-dev libggi2-dev libmpcdec-dev libspeex-dev libfribidi-dev libfaac-dev  libaa1-dev libcaca-dev \
libx264-dev  libpulse-dev libmad0-dev ladspa-sdk libdbus-glib-1-dev libaudio-dev liblzo2-dev libdvdnav-dev \
libopenal-dev libjack-dev libtwolame-dev libsvga1-dev libenca-dev libmp3lame-dev


Current MPlayer code is capable of working with full resolution video produced by Elphel cameras. That is not yet true for the MPlayer packages in Ubuntu repositories, so you'll have to obtain the source code from MPlayer recommended source - their Subversion (SVN) source. First you need to install Subversion itself:

sudo apt-get install subversion

Now create a download directory and get MPlayer source:

mkdir download; cd download
svn checkout svn://svn.mplayerhq.hu/mplayer/trunk mplayer

Configure, compile and prepare Debian package from that source (will take some time):

cd mplayer
sudo dpkg-buildpackage 

Occasionally dpkg-buildpackage fails to build, try the comon ./configure, make, make install way then.

Now uninstall the default Ubuntu's mplayer and mencoder & install the created package:

sudo apt-get remove mplayer mencoder mplayer-nogui
cd ..
sudo dpkg  --install mplayer_1.0svn*.deb

MPlayer - testing with Elphel camera

You should be able now to play videos with up to 5MB frames (highest quality 5MPix images are around 1 MB) as a multicast or unicast video stream. (the streamer in the camera should be ENABLED)

mplayer rtsp://192.168.0.9:554 -vo x11 -fs -zoom

Update 10/09/2009: In (K)Ubuntu 9.10 (Karmic Koala) repository the 50,000 bytes limit on the frame size is fixed, but unfortunately the other one -frame width limit of 2048 pixels (submitted to MPlayer SVN on May, 5, 2009) - is not--Andrey.filippov 19:03, 9 October 2009 (CDT)

The first (50,000) makes you picture break after the first 50,000 bytes (only top is shown), the second (current for the 9.10) makes MPlayer to report fatal error. So you still have to use MPlayer SVN to have the full resolution from Elphel cameras.

Additionally, to make MPlayer work inside the web page you need to specify video output as "x11" in the MPlayer config file - add a line

vo="x11"

To ~/.mplayer/config file

For developers

Following was written for (K)Ubuntu 9.10 and earlier, it also works with 10.04, please see revision-specific notes.

Adding universe and multiverse sources

Please follow this howto for adding universe and multiverse sources.

https://help.ubuntu.com/community/Repositories/Ubuntu

or

https://help.ubuntu.com/community/Repositories/Kubuntu

Install needed packages

Minimal packages:

sudo apt-get install cvs build-essential autoconf flex byacc bison libglib2.0-dev tcl gettext libncurses5-dev patch zlib1g-dev nfs-kernel-server bash xutils-dev

Suggested packages:

sudo apt-get install kinfocenter minicom firefox graphviz doxygen ctags cervisia php5 php5-cli xchat ssh kompare git-core

Configure your NFS server

Let's say you want to configure an NFS server on your machine and your IP address is 192.168.0.15.

Modify the configuration file:

kdesudo kate /etc/exports

Add at the end of the file:

/nfs            192.168.0.0/255.255.0.0(rw,sync,no_root_squash,no_subtree_check)

save the file.

If it does not yet exist make /nfs directory and make it world writable to make it possible to write logs from the camera.

sudo mkdir /nfs
sudo chmod 777 -R /nfs

And finally export the filesystem.

sudo exportfs -a

(Had to reboot after in ubuntu 14.04)

Installation of GCC Compiler kit for Axis ETRAX processor

Automatic Installation ((K)Ubuntu 11.04 Natty Narwhal)

1.

sudo add-apt-repository "deb http://ppa.launchpad.net/elphel/ppa/ubuntu natty main"

(The line above is equivalent to adding the following lines to your sources.list (sudo kate /etc/apt/sources.list)):
deb http://ppa.launchpad.net/elphel/ppa/ubuntu natty main 
deb-src http://ppa.launchpad.net/elphel/ppa/ubuntu natty main 

2. (in case of) ...public key is not available...

sudo apt-key adv --keyserver keyserver.ubuntu.com --recv-keys 6050780EC7A72F76

3.

sudo apt-get update
sudo apt-get install cris-dist

Manual Installation

Downloading and unpacking gcc-cris

Download and install Cris-GCC compiler. It is needed to compile C and C++ programs for the CPU used in Elphel cameras - Axis ETRAX FS :

mkdir -p ~/Downloads/axis ; cd ~/Downloads/axis
wget http://www.axis.com/ftp/pub/axis/tools/cris/compiler-kit/cris-dist-linux-headers-1.64.tar.gz   
wget http://www.axis.com/ftp/pub/axis/tools/cris/compiler-kit/cris-dist-linux-headersv32-1.64.tar.gz  
wget http://www.axis.com/ftp/pub/axis/tools/cris/compiler-kit/cris-dist-glibc-1.64.tar.gz 
wget http://www.axis.com/ftp/pub/axis/tools/cris/compiler-kit/cris-dist-1.64.tar.gz
wget http://www.axis.com/ftp/pub/axis/tools/cris/compiler-kit/cris-dist-1.64-1--1.64-2.patch
tar zxvf cris-dist-1.64.tar.gz
cd cris-dist-1.64/
tar zxvf ../cris-dist-linux-headers-1.64.tar.gz                                 
tar zxvf ../cris-dist-linux-headersv32-1.64.tar.gz                             
tar zxvf ../cris-dist-glibc-1.64.tar.gz
patch -p0 < ../cris-dist-1.64-1--1.64-2.patch

Compiling gcc-cris

Now you may proceed with compiling gcc-cris (takes some time):

sudo ./install-cris-tools

answer by default (enter, enter, ...)


Build Elphel Software

Get the script. Unpack & Launch.


Installation of Kdevelop 3.5

note: Newer KDevelop 4 does not work with Elphel software

pre (K)Ubuntu 9.10

sudo apt-get install kdevelop

(K)Ubuntu 9.10 (Karmic), 10.4 (Lucid)

see Installation of KDevelop 3.5 on (K)Ubuntu 9.10

Install Icarus Verilog and GTKWave

(If you plan to develop FPGA code or at least look how it works)

GTKWave is OK from repository:

sudo apt-get install gtkwave

But unfortunately Icarus Verilog (package verilog) is compiled without needed support for compressed output format, so you'll have to compile it

cd ~/Downloads
wget "ftp://ftp.icarus.com/pub/eda/verilog/v0.9/verilog-0.9.3.tar.gz"
tar zxvf verilog-0.9.3.tar.gz
cd verilog-0.9.3/
./configure
make
sudo make install

Installing Xilinx WebPack (to be moved to a separate page, just a link here)

If you plan to compile the FPGA code from the source code you will need to install appropriate software from the FPGA manufacturer web site. This is proprietary (and non-free) software provided by Xilinx free of charge. This software is called the ISE WebPACK and you may download it (currently some 2.2GB) after registering at Xilinx web site. Currently tested version is 10.1.03, we'll try to update our code when Xilinx will release the new version of their software.

You will also need that software if you would like to simulate the FPGA functionality. Elphel camera FPGA code (written in Verilog HDL) is licensed under GNU GPLv3, simulator and waveform viewer (see below) are also Free Software, but there are a few Verilog models of some primitives of Xilinx FPGA that are not and can be only obtained from Xilinx as a part of their unisims library. For simulation we use small subset of the unisims library components and only for functional simulation so it will probably make sense to re-write those primitives models so the 2.2 GB distribution will not be needed to extract just few kilobytes of required source code.

Such independent re-implementation will help us to solve another problem - we have to patch the Xilinx library components to make them work correctly with our code and the simulator we use and currently each Xilinx library update breaks our patches.

When you will build Elphel software (as described later) the installation script will try to locate Xilinx software on your computer and patch a copy of unisims library. If you'll install Xilinx WebPack after building the camera software - you'll need to navigate to fpga subdirectory of the source tree and execute

make clean ; make

It is described in file README.simulation in that subdirectory.


There are additional steps required for the Xilinx WebPACK installation if you have a 64-bit GNU/Linux operation system. The next command line detects if you are running on 64 bit version of GNU/Linux and conditionally installs ia64-libs. That library is needed if you'll install Xilinx WebPack software (Xilinx does not allow to use 64-bit programs in their free for download software and the provided installation script does not install 32-bit version on its own). There is another trick you'll need to be aware of if you are using 32-bit Xilinx WebPack on a 64-bit GNU/Linux system.

if [ `uname -m` = "x86_64" ] ; then sudo apt-get install ia32-libs ; fi

Installation of the source code of Elphel camera software

You may install Elphel source code by either of the two methods. Either from the CVS (the most current code) and form the tarball files.

Installation from the CVS

Get elphel353_80_install_from_cvs.sh open archive that contains the shell script and execute it. It is recommended that you create subdirectory in your home directory, i.e. "elphel_projects", move and execute elphel353_80_install_from_cvs.sh script there. Directory "distfiles" will be created there and used as a cache for software archives that will be downloaded during installation.

mkdir -p ~/elphel_projects; cd ~/elphel_projects
wget "http://downloads.sourceforge.net/elphel/elphel353_80_install_from_cvs.sh.tar.gz"
tar zxvf elphel353_80_install_from_cvs.sh.tar.gz
./elphel353_80_install_from_cvs.sh

Installation from the tarball (release file)

http://sourceforge.net/projects/elphel

  • get one of the elphel353-8.0.* releases
  • decompress the archive
  • execute the ./install_elphel script
./install_elphel

There will be created a file build.log in the top installation directory. If you get any installation problems you can compress that file and email it to Elphel support.

At the end of installation the script will generate a list of all the files in the target (camera) file system that are to be installed and compares it against the contents of the file target.list that is included in the distribution. If there are any differences -- they will be reported (there should be none). If there are some missing files it is likely that something failed to install correctly.

After the installation will be completed successfully you may want to execute the following command in the top installation directory (the one that has apps, configure-files, ... subdirectories)

./prep_kdevelop.php

That will create elphel353.kdevelop - a project file for KDevelop IDE (version 3.5.x), you can use it as described here - KDevelop



ImageJ and Elphel plugins for imageJ

ImageJ is a powerful open source image processing package, written in Java. There are plugins to work with Elphel cameras, the most universal one allows opening JP46 files (stored on a file system or downloaded directly from the camera). This plugin reads meta data from the image and un-applies in-camera non-linear conversion resulting in the linearized image, where each pixel is represented by a floating point value proportional to the number of photons that were detected in that pixel.

It is a very useful tool to do quantitative analysis of the camera images.

  • Download plugins:
git clone https://git.elphel.com/Elphel/imagej-elphel.git
git clone --branch v1.1 https://git.elphel.com/Elphel/imagej-elphel.git (for Eyesis4Pi393)
-clean -startup
...
-XX:MaxPermSize=24576m
-Xms2048m
-Xmx24576m
  • Kubuntu 18.04 might need:
https://stackoverflow.com/questions/6784463/error-trustanchors-parameter-must-be-non-empty
  • From Eclipse:
1. File -> Import -> Existing Maven Projects -> set imagej-elphel as Root Directory - a project will appear in the project list -> Finish
   Importing will take some time

2. Create Run Configuration:
   a. Run Configurations -> select Java Application -> New Launch Configuration -> find the needed plugin class -> Run
       Classes:
       * Aberration_Calibration - work with calibration data, regenerate kernels, etc.
       * Eyesis_correction - postprocess images.
   b. It will launch ImageJ & Aberration_Calibration plugin
   c. Other plugins are launched from ImageJ window from Plugins