Difference between revisions of "Elphel Eyesis4Pi"

From ElphelWiki
Jump to: navigation, search
(Status)
 
(46 intermediate revisions by 4 users not shown)
Line 1: Line 1:
 +
<!--== Brochure Download ==
 +
[http://elphel.com/files/Eyesis4Pi_Brochure_V24.pdf Eyesis 4Pi Brochure Download V24]-->
 +
 +
==Status==
 +
<font style="font-size:1em;color:black">Production</font>
 +
 +
The newer version <font style='font-size:1.5em;color:red'><b>EYESIS4PI-26-393</b></font> is <font style='font-size:1em;color:red'><b>available</b></font>. Jump to [[Eyesis4Pi_393|Eyesis4Pi-393 article]].
 +
 +
Features:
 +
* new [[10393]] system boards
 +
** faster recording
 +
** more powerful
 +
* more compact - the pole is 2 times shorter
 +
Compare 3D models:
 +
{|
 +
|
 +
{| border="0" cellpadding="3" style="border:1px solid lightgray;border-collapse:collapse;"
 +
|-
 +
| <span class="plainlinks" title="View model in the Web X3D Viewer">[http://community.elphel.com/x3d/index.html?nobuttons&animate&model=/x3d/x3d_model_files/x3d/EYESIS4PI-26-393-ASSY.x3d http://community.elphel.com/pictures/eyesis4pi/EYESIS4PI-26-393_resized_2.jpeg]</span>
 +
|-
 +
| <font style='color:red'><b>NEW</b></font> [http://community.elphel.com/x3d/index.html?nobuttons&animate&model=/x3d/x3d_model_files/x3d/EYESIS4PI-26-393-ASSY.x3d Eyesis4PI-26-393 3D]
 +
|}
 +
|
 +
{| border="0" cellpadding="3" style="border:1px solid lightgray;border-collapse:collapse;"
 +
| <span class="plainlinks" title="View model in the Web X3D Viewer">[http://community.elphel.com/x3d/index.html?nobuttons&animate&model=/x3d/x3d_model_files/x3d/EYESIS4PI-26-ASSY.x3d http://community.elphel.com/pictures/eyesis4pi/EYESIS4PI-26_resized_2.jpeg]</span>
 +
|-
 +
| [http://community.elphel.com/x3d/index.html?nobuttons&animate&model=/x3d/x3d_model_files/x3d/EYESIS4PI-26-ASSY.x3d Eyesis4PI-26 3D]
 +
|}
 +
|}
 +
 
== About  ==
 
== About  ==
 +
{|
 +
|- valign="top"
 +
|[[File:Eyesis4pi3d-dimensions-web.jpg | thumb | 80px | Dimensions (mm) ]]
 +
|[[File:Eyesis4pi3d-24-illustration.jpg | thumb |360px | Head Contents Schematic ]]
 +
|[[File:Eyesis4pi-internals-overview.jpg | thumb | 130px | Pole Contents Schematic ]]
 +
|[[File:Eyesis4pi assembly drawing scaled.jpeg|430px|thumb|Assembly Drawing, Download [http://community.elphel.com/pictures/eyesis4pi/eyesis4pi_assembly_drawing.jpeg JPEG],[http://community.elphel.com/pictures/eyesis4pi/eyesis4pi_assembly_drawing.pdf PDF]|link=http://community.elphel.com/pictures/eyesis4pi/eyesis4pi_assembly_drawing.jpeg]]
 +
|[[File:Eyesis4pi-fov.jpg | thumb | 200px | FOV of sub-cameras in Eyesis4Pi, color shows time of acquisition (from red to blue):1-8 horizontal sensors; 1t-8t top sensors;1b-8b bottom sensors]]
 +
|}
  
'''''Elphel Eyesis4Pi''''' is an open hardware / free software panoramic camera solution that is able to capture high-resolution - 64 MPix total (120 MPix before stitching) - 360° panoramas at a rate up to 5 frames per second at full resolution. It is the successor of the [[Elphel Eyesis]]. Images are recorded to 8 solid-state-discs (Eyesis4Pi Data Storage) which can store up to 11 hours of footage at full resolution. Meta-data like GPS-coordinates (geotags), viewing direction, movement speed, etc. are directly embedded into the images EXIF fields. Eyesis4Pi uses 24 sensor-front-ends and high-grade lenses that are triggered simultaneously with microsecond accuracy to ensure a full homogeneous spherical snapshot.  
+
'''''Elphel Eyesis4Pi''''' is an open hardware / free software panoramic camera solution that is able to capture high-resolution - 64 MPix total (120 MPix before stitching) - 360° panoramas at a rate up to 5 frames per second at full resolution. It is the successor of the [[Elphel Eyesis]]. Images are recorded to 8 solid-state-discs (Eyesis4Pi Data Storage) which can store up to 11 hours of footage at full resolution. Meta-data like GPS-coordinates (geotags), viewing direction, movement speed, etc. are directly embedded into the images EXIF fields. Eyesis4Pi uses 24+2 sensor-front-ends and high-grade lenses that are triggered simultaneously with microsecond accuracy to ensure a full homogeneous spherical snapshot.  
  
 
=== Usage Scenarios  ===
 
=== Usage Scenarios  ===
Line 11: Line 49:
 
=== Operation &amp; Monitoring  ===
 
=== Operation &amp; Monitoring  ===
  
Eyesis is controlled from a laptop, via a [[Eyesis gui|web-based interface (Eyesis GUI)]]. Which also displays real-time previews of your captured panorama footage.  
+
Eyesis4Pi is controlled from a laptop, via a [[Eyesis4Pi User Guide - Recording|web-based interface (Eyesis4Pi GUI)]]. Which also displays real-time previews of your captured panorama footage.  
  
Eyesis is supplied with 110V/220V AC and can be used with car power adapter (inverter), when mounted on a car roof. Power consumption is around&nbsp;???W.  
+
Eyesis is supplied with 110V/220V AC and can be used with car power adapter (inverter), when mounted on a car roof. Power consumption is about 50W.
  
 
=== Models<br>  ===
 
=== Models<br>  ===
  
4π (or 4Pi) corresponds to a full full spherical (360°x180°) field of view in steradians.<br>  
+
4π (or 4Pi) corresponds to a full spherical (360°x180°) field of view in steradians.<br>  
  
There are 2 version of the camera Eyesis4Pi with 24 image sensors and full spherical field of view and Eyesis3Pi with 16 sensors (without 8 bottom modules) with slightly smaller field of view.<br>
+
There are 2 version of the camera Eyesis4Pi with 24+2 image sensors and full spherical field of view and Eyesis3Pi with 16+2 sensors (without 8 bottom modules) with slightly smaller field of view.<br>
  
 
=== Comparison between Eyesis and Eyesis4Pi  ===
 
=== Comparison between Eyesis and Eyesis4Pi  ===
Line 41: Line 79:
 
| Number of image sensors<br>  
 
| Number of image sensors<br>  
 
| 9<br>  
 
| 9<br>  
| 24 (16)<br>  
+
| 24+2 (16+2)<br>  
 
| <br>
 
| <br>
 
|-
 
|-
Line 137: Line 175:
 
#Frame rate may be limited by the recording (or network if the SSD are not used) datarate for high compression quality (&gt;0.3 bytes/pixel), required for the aberration correction.<br><br>
 
#Frame rate may be limited by the recording (or network if the SSD are not used) datarate for high compression quality (&gt;0.3 bytes/pixel), required for the aberration correction.<br><br>
  
 +
<br>
 +
 +
=== Calibration ===
  
===Calibration===
+
We have developed full calibration process and post-processing software to compensate for optical aberrations, allowing to preserve full sensor resolution over the camera FOV, and distortions – for precise pixel-mapping for photogrammetry and 3D reconstruction. Check out this [http://blogs.elphel.com/2010/06/elphel-eyesis-camera-optics-and-lens-focus-adjustment/ Elphel Development Blog post] for more details.
The sensor-front-ends (SFE) - which were especially developed for Eyesis4Pi - allow the focus plane to be shifted and rotated with very high accuracy. This allows extremely precise calibration of each lens and SFE which is done with every Eyesis4Pi during assembly with custom developed software. Check out this [http://blogs.elphel.com/2010/06/elphel-eyesis-camera-optics-and-lens-focus-adjustment/ Elphel Development Blog post] for more details.
 
  
 
== Tech specs  ==
 
== Tech specs  ==
Line 145: Line 185:
 
'''Eyesis4Pi Camera'''  
 
'''Eyesis4Pi Camera'''  
  
*24x Color 5Mpix CMOS sensors in array  
+
* 24x Color 5MPix CMOS sensors in array that covers the sphere
*Resolution - 64MPix (120MPix before stitching)  
+
* 2x Color 5MPix CMOS sensors in the pole that make stereo pairs with corresponding sensors in the camera head.
*Up to 5 FPS at full resolution (120Mpix)  
+
* Resolution - 64MPix (120MPix before stitching)  
*highly customizable
+
* Up to 5 FPS at full resolution (120Mpix) - only if equipped with SSDs
*Web-based GUI  
+
* Web-based GUI  
*GPS powered geo-tagging  
+
* GPS powered geo-tagging  
*[http://en.wikipedia.org/wiki/Inertial_measurement_unit IMU] powered 3D inertial measurement  
+
* [http://en.wikipedia.org/wiki/Inertial_measurement_unit IMU] powered 3D inertial measurement  
*Precise image capture synchronization  
+
* Precise image capture synchronization  
*RAW or compressed image formats  
+
* RAW or compressed image formats  
*High resolution lenses: 24x M12 lens mount  
+
* High resolution lenses: 26x M12 lens mount  
*Very small parallax - distance between entrance pupils: 46.5 mm  
+
* Very small parallax - distance between entrance pupils: 46.5 mm  
*Weatherproof camera body and camera pole
+
* Weatherproof camera body and camera pole
 
+
* Highly Customizable
  
'''Eyesis Data Storage'''<br>
 
  
*8x swappable&nbsp;???GB - 1.8" - SSDs (Total&nbsp;???GB)<br>
+
'''Eyesis Data Storage'''
*Enough space for up to&nbsp;?? hours of full Resolution/FPS footage (depending on quality settings and actual image content)<br>  
+
*located inside weatherproof camera pole
*GigEthernet Switch
+
*9x 128 GB - 1.8" - SSDs  
*Weatherproof enclosure<br>
+
*Enough space for 3 hours of full Resolution/FPS footage (depending on quality settings and actual image content)<br>  
*Dimensions of Data Storage: 280 x 120 x 170 mm
 
  
<br>
 
  
'''Eyesis Computer'''  
+
'''Eyesis4Pi Computer'''  
  
The Eyesis Computer is a high-end-workstation with small form factor. It is intended for image post-processing and '''not''' required for recording footage.  
+
The Eyesis Computer is a high-end-workstation in a small form factor. It is intended for image post-processing and '''not''' required for recording footage.  
  
 
It comes with all Elphel developed software and tools required for processing panoramic images preinstalled.  
 
It comes with all Elphel developed software and tools required for processing panoramic images preinstalled.  
Line 179: Line 216:
 
*16 GB DDR3 RAM  
 
*16 GB DDR3 RAM  
 
*GeForce GTX 465 (Fermi) 1GB  
 
*GeForce GTX 465 (Fermi) 1GB  
*2 TB HDD  
+
*2 TB HDD<br>
*Same 2.5" drivebays as Eyesis Data Storage Box to load SSDs
 
  
<br> '''Tech Specs of a Single Image Sensor (Eyesis4Pi uses 24 of these, Eyesis3Pi uses 26 of these)'''  
+
<br> '''Tech Specs of a Single Image Sensor (Eyesis4Pi uses 24+2 of these, Eyesis4Pi-24 uses 24, and Eyesis4Pi-16 uses 16)'''  
  
 
{| border="1" class="wikitable"
 
{| border="1" class="wikitable"
Line 210: Line 246:
 
| Analog &amp; Digital (0 db to 12 db continuous)
 
| Analog &amp; Digital (0 db to 12 db continuous)
 
|}
 
|}
 +
 +
== Image Samples  ==
 +
* [[Eyesis4Pi_samples|Samples]]
 +
 +
== More Information  ==
 +
 +
'''Wiki:'''
 +
* [[Elphel_Eyesis4Pi|Eyesis4Pi Main Article]]
 +
* [[Eyesis4Pi_workflow|Workflow]]
 +
* [[Eyesis4Pi_User_Guide|User Guide - Recording]]
 +
* [[Eyesis4Pi_Footage_Procedures_page|User Guide - Post-Processing: Footage Procedures]]
 +
* [[Eyesis4pi_Post-Processing|User Guide - Post-processing: ImageJ]]
 +
* [[Eyesis4Pi_data_structure|Data Structure Description]]
 +
* [[Eyesis4Pi_Calibration|Calibration Process]]
 +
 +
'''Elphel Development Blog:'''
 +
*[http://blog.elphel.com/2011/02/eyesis-4pi/ Current state of the Eyesis project Introdcution of Eyesis4Pi]
 +
*[http://blogs.elphel.com/2010/11/zoom-in-now-enhance/ “Zoom in. Now… enhance.” – a practical implementation of the aberration measurement and correction in a digital camera]
 +
*[http://blogs.elphel.com/2010/12/zoom-in-now-enhance-results/ “Zoom in. Now… enhance.” – Results]
 +
*[http://blogs.elphel.com/2010/06/elphel-eyesis-camera-optics-and-lens-focus-adjustment/ Elphel Eyesis camera optics and lens focus adjustment]
 +
*[http://blogs.elphel.com/2010/07/elphel-eyesis-assembled/ Elphel-Eyesis, assembled]
 +
*[http://blogs.elphel.com/2010/06/elphel-eyesis-progress/ Elphel-Eyesis Progress]
 +
*[http://blogs.elphel.com/2010/03/first-elphel-eyesis-prototype-assembled/ First Elphel Eyesis Prototype assembled]
 +
 +
== FAQ ==
 +
 +
===Why are there 9 SSDs and not just a single bigger one?===
 +
 +
There are 26 sensor-front-ends. There are 9 system boards each connected to 3 sensor-front-ends and a one SSD. The shots of a single panorama are split up on 9 SSDs. 3 images to SSD1, 3 images to SSD2, 3 images to SSD3... and the last 2 - to SSD9
 +
 +
===Can I also use Eyesis4Pi with HDDs instead of SSDs?===
 +
 +
We initially tested the system with HDDs but due to strong vibrations when using Eyesis mounted to a car roof we experience massive write-rate drops with HDDs. After we switched to SSDs all these problems were gone. If your Eyesis application does not involve bumby roads or vibrations HDDs should work just fine though.
 +
 +
===How do I unload the data from Eyesis4Pi?===
 +
 +
The camera pole has 2 eSATA ports in a weatherproof sealed connector. With this connector you can connect to the SSDs inside the camera pole like to any external hard-drive with any laptop/computer.
 +
 +
===What software do I need on my laptop/computer to control Eyesis?===
 +
 +
Eyesis GUI requires a locally running webserver (apache2 + PHP5) and the [[Eyesis4Pi_User_Guide | Eyesis User Guide]] software.
 +
 +
===How do I connect my laptop/computer to Eyesis and how do I control image recording?===
 +
 +
The Eyesis4Pi hosts a Gigabit Ethernet switch so all you need is one Ethernet cable from the camera pole hose to your laptop/computer.
 +
 +
The Eyesis GUI is completely browser based so after you connected to the network you just start a browser type in the correct URL and you are ready to go.
 +
 +
See [[Eyesis4Pi_User_Guide | Eyesis4Pi User Guide]]
 +
 +
[[Category:Eyesis4Pi]]

Latest revision as of 14:45, 22 December 2016


Status

Production

The newer version EYESIS4PI-26-393 is available. Jump to Eyesis4Pi-393 article.

Features:

  • new 10393 system boards
    • faster recording
    • more powerful
  • more compact - the pole is 2 times shorter

Compare 3D models:

http://community.elphel.com/pictures/eyesis4pi/EYESIS4PI-26-393_resized_2.jpeg
NEW Eyesis4PI-26-393 3D
http://community.elphel.com/pictures/eyesis4pi/EYESIS4PI-26_resized_2.jpeg
Eyesis4PI-26 3D

About

Dimensions (mm)
Head Contents Schematic
Pole Contents Schematic
Assembly Drawing, Download JPEG,PDF
FOV of sub-cameras in Eyesis4Pi, color shows time of acquisition (from red to blue):1-8 horizontal sensors; 1t-8t top sensors;1b-8b bottom sensors

Elphel Eyesis4Pi is an open hardware / free software panoramic camera solution that is able to capture high-resolution - 64 MPix total (120 MPix before stitching) - 360° panoramas at a rate up to 5 frames per second at full resolution. It is the successor of the Elphel Eyesis. Images are recorded to 8 solid-state-discs (Eyesis4Pi Data Storage) which can store up to 11 hours of footage at full resolution. Meta-data like GPS-coordinates (geotags), viewing direction, movement speed, etc. are directly embedded into the images EXIF fields. Eyesis4Pi uses 24+2 sensor-front-ends and high-grade lenses that are triggered simultaneously with microsecond accuracy to ensure a full homogeneous spherical snapshot.

Usage Scenarios

The system was designed to be small and lightweight with a minimal distance between the entrance pupils (46.5mm) to achieve lowest possible parallax.

The primary usage scenario is to mount Eyesis4Pi on the roof of a vehicle. When driving at 50 mph (22.3 m/s) and recording at 5 FPS a full panorama is captured every 4.46 meters.

Operation & Monitoring

Eyesis4Pi is controlled from a laptop, via a web-based interface (Eyesis4Pi GUI). Which also displays real-time previews of your captured panorama footage.

Eyesis is supplied with 110V/220V AC and can be used with car power adapter (inverter), when mounted on a car roof. Power consumption is about 50W.

Models

4π (or 4Pi) corresponds to a full spherical (360°x180°) field of view in steradians.

There are 2 version of the camera Eyesis4Pi with 24+2 image sensors and full spherical field of view and Eyesis3Pi with 16+2 sensors (without 8 bottom modules) with slightly smaller field of view.

Comparison between Eyesis and Eyesis4Pi

Parameter
Eyesis

Eyesis4Pi

(Eyesis 3Pi without 8 bottom modules)

Notes
Combined field of view (steradians)
3*π
4*π (3*π)
Number of image sensors
9
24+2 (16+2)

Angular resolution +/-30° from the horizon
≥4.2Mpix/steradian
≥4.2Mpix/steradian
1
Angular resolution +30° to +90°(zenith)
≥0.83Mpix/steradian
≥4.2Mpix/steradian 1
Angular resolution -30° to -90°(nadir) none ≥4.2Mpix/steradian (none) 1
Combined megapixels 45.0 120.0 (80.0)
Combined megapixels (w/o overlapping areas) 34.0 64.0 (48.0)
Combined megapixels (w/o overlapping areas,
worst case resolution)
29.0 52.8 (39.6) 1,2
Distance between entrance pupils
of adjacent horizontal lenses
34.5mm 46.5mm
Distance between entrance pupils
of horizontal and top/bottom lenses
75mm 50mm 3
Maximal frame rate 5fps 5fps 4
Maximal recording data rate 48MB/s 128MB/s (96Mb/s)
Maximal direct network data rate 30MB/s 80MB/s (60MB/s)
GPS receiver external, USB External/internal, USB/RS232
GPS pulse-per-second input no
yes

IMU none ADIS163xx,ADIS164xx
Data unload removable SSD in cradles eSATAx2
Storage devices type 2.5″ SSD 1.8″SSD
Number of storage devices 3
8 (6)


Notes:

  1. Angular resolution per pixel differs in the sub-camera FOV, minimal resolution is used.
  2. Zenith area for Eyesis (covered by fisheye lens) is calculated separately.
  3. For Eyesis the distance is measured from the entrance pupil of the horizontal lens to that of the top fisheye, for Eysis-4pi – to the entrance pupil of the lens immediately above/below the first one.
  4. Frame rate may be limited by the recording (or network if the SSD are not used) datarate for high compression quality (>0.3 bytes/pixel), required for the aberration correction.


Calibration

We have developed full calibration process and post-processing software to compensate for optical aberrations, allowing to preserve full sensor resolution over the camera FOV, and distortions – for precise pixel-mapping for photogrammetry and 3D reconstruction. Check out this Elphel Development Blog post for more details.

Tech specs

Eyesis4Pi Camera

  • 24x Color 5MPix CMOS sensors in array that covers the sphere
  • 2x Color 5MPix CMOS sensors in the pole that make stereo pairs with corresponding sensors in the camera head.
  • Resolution - 64MPix (120MPix before stitching)
  • Up to 5 FPS at full resolution (120Mpix) - only if equipped with SSDs
  • Web-based GUI
  • GPS powered geo-tagging
  • IMU powered 3D inertial measurement
  • Precise image capture synchronization
  • RAW or compressed image formats
  • High resolution lenses: 26x M12 lens mount
  • Very small parallax - distance between entrance pupils: 46.5 mm
  • Weatherproof camera body and camera pole
  • Highly Customizable


Eyesis Data Storage

  • located inside weatherproof camera pole
  • 9x 128 GB - 1.8" - SSDs
  • Enough space for 3 hours of full Resolution/FPS footage (depending on quality settings and actual image content)


Eyesis4Pi Computer

The Eyesis Computer is a high-end-workstation in a small form factor. It is intended for image post-processing and not required for recording footage.

It comes with all Elphel developed software and tools required for processing panoramic images preinstalled.

  • Small form factor Shuttle PC
  • Intel Core i7-950 Quad-Core Processor
  • 16 GB DDR3 RAM
  • GeForce GTX 465 (Fermi) 1GB
  • 2 TB HDD


Tech Specs of a Single Image Sensor (Eyesis4Pi uses 24+2 of these, Eyesis4Pi-24 uses 24, and Eyesis4Pi-16 uses 16)

Color Image Sensor 1/2.5" bayer-pattern CMOS
Effective number of pixels 2592x1936 (5,018,112 pixels)
Aspect Ratio Chip 4:3, Region of interest freely adjustable in 16 pixel steps
Sensor Output 12 Bit ADC
Sensor Features Region of interest, on-chip binning and decimation
Dynamic Range 70 db (76 db at 2x2 binning)
Electronic Shutter 1 us to "very long" (~3h) in 1us steps
Gain Analog & Digital (0 db to 12 db continuous)

Image Samples

More Information

Wiki:

Elphel Development Blog:

FAQ

Why are there 9 SSDs and not just a single bigger one?

There are 26 sensor-front-ends. There are 9 system boards each connected to 3 sensor-front-ends and a one SSD. The shots of a single panorama are split up on 9 SSDs. 3 images to SSD1, 3 images to SSD2, 3 images to SSD3... and the last 2 - to SSD9

Can I also use Eyesis4Pi with HDDs instead of SSDs?

We initially tested the system with HDDs but due to strong vibrations when using Eyesis mounted to a car roof we experience massive write-rate drops with HDDs. After we switched to SSDs all these problems were gone. If your Eyesis application does not involve bumby roads or vibrations HDDs should work just fine though.

How do I unload the data from Eyesis4Pi?

The camera pole has 2 eSATA ports in a weatherproof sealed connector. With this connector you can connect to the SSDs inside the camera pole like to any external hard-drive with any laptop/computer.

What software do I need on my laptop/computer to control Eyesis?

Eyesis GUI requires a locally running webserver (apache2 + PHP5) and the Eyesis User Guide software.

How do I connect my laptop/computer to Eyesis and how do I control image recording?

The Eyesis4Pi hosts a Gigabit Ethernet switch so all you need is one Ethernet cable from the camera pole hose to your laptop/computer.

The Eyesis GUI is completely browser based so after you connected to the network you just start a browser type in the correct URL and you are ready to go.

See Eyesis4Pi User Guide