Difference between revisions of "Elphel Eyesis4Pi"
From ElphelWiki
(→What software do I need on my laptop/computer to control Eyesis?) |
(→Status) |
||
| (29 intermediate revisions by 3 users not shown) | |||
| Line 1: | Line 1: | ||
| − | == Brochure Download == | + | <!--== Brochure Download == |
| − | [http://elphel.com/files/Eyesis4Pi_Brochure_V24.pdf Eyesis 4Pi Brochure Download V24] | + | [http://elphel.com/files/Eyesis4Pi_Brochure_V24.pdf Eyesis 4Pi Brochure Download V24]--> |
| + | |||
| + | ==Status== | ||
| + | <font style="font-size:1em;color:black">Production</font> | ||
| + | |||
| + | The newer version <font style='font-size:1.5em;color:red'><b>EYESIS4PI-26-393</b></font> is <font style='font-size:1em;color:red'><b>available</b></font>. Jump to [[Eyesis4Pi_393|Eyesis4Pi-393 article]]. | ||
| + | |||
| + | Features: | ||
| + | * new [[10393]] system boards | ||
| + | ** faster recording | ||
| + | ** more powerful | ||
| + | * more compact - the pole is 2 times shorter | ||
| + | Compare 3D models: | ||
| + | {| | ||
| + | | | ||
| + | {| border="0" cellpadding="3" style="border:1px solid lightgray;border-collapse:collapse;" | ||
| + | |- | ||
| + | | <span class="plainlinks" title="View model in the Web X3D Viewer">[http://community.elphel.com/x3d/index.html?nobuttons&animate&model=/x3d/x3d_model_files/x3d/EYESIS4PI-26-393-ASSY.x3d http://community.elphel.com/pictures/eyesis4pi/EYESIS4PI-26-393_resized_2.jpeg]</span> | ||
| + | |- | ||
| + | | <font style='color:red'><b>NEW</b></font> [http://community.elphel.com/x3d/index.html?nobuttons&animate&model=/x3d/x3d_model_files/x3d/EYESIS4PI-26-393-ASSY.x3d Eyesis4PI-26-393 3D] | ||
| + | |} | ||
| + | | | ||
| + | {| border="0" cellpadding="3" style="border:1px solid lightgray;border-collapse:collapse;" | ||
| + | | <span class="plainlinks" title="View model in the Web X3D Viewer">[http://community.elphel.com/x3d/index.html?nobuttons&animate&model=/x3d/x3d_model_files/x3d/EYESIS4PI-26-ASSY.x3d http://community.elphel.com/pictures/eyesis4pi/EYESIS4PI-26_resized_2.jpeg]</span> | ||
| + | |- | ||
| + | | [http://community.elphel.com/x3d/index.html?nobuttons&animate&model=/x3d/x3d_model_files/x3d/EYESIS4PI-26-ASSY.x3d Eyesis4PI-26 3D] | ||
| + | |} | ||
| + | |} | ||
== About == | == About == | ||
{| | {| | ||
| − | |[[File:Eyesis4pi3d-dimensions-web.jpg | thumb | 80px | | + | |- valign="top" |
| + | |[[File:Eyesis4pi3d-dimensions-web.jpg | thumb | 80px | Dimensions (mm) ]] | ||
| + | |[[File:Eyesis4pi3d-24-illustration.jpg | thumb |360px | Head Contents Schematic ]] | ||
| + | |[[File:Eyesis4pi-internals-overview.jpg | thumb | 130px | Pole Contents Schematic ]] | ||
| + | |[[File:Eyesis4pi assembly drawing scaled.jpeg|430px|thumb|Assembly Drawing, Download [http://community.elphel.com/pictures/eyesis4pi/eyesis4pi_assembly_drawing.jpeg JPEG],[http://community.elphel.com/pictures/eyesis4pi/eyesis4pi_assembly_drawing.pdf PDF]|link=http://community.elphel.com/pictures/eyesis4pi/eyesis4pi_assembly_drawing.jpeg]] | ||
| + | |[[File:Eyesis4pi-fov.jpg | thumb | 200px | FOV of sub-cameras in Eyesis4Pi, color shows time of acquisition (from red to blue):1-8 horizontal sensors; 1t-8t top sensors;1b-8b bottom sensors]] | ||
|} | |} | ||
| − | '''''Elphel Eyesis4Pi''''' is an open hardware / free software panoramic camera solution that is able to capture high-resolution - 64 MPix total (120 MPix before stitching) - 360° panoramas at a rate up to 5 frames per second at full resolution. It is the successor of the [[Elphel Eyesis]]. Images are recorded to 8 solid-state-discs (Eyesis4Pi Data Storage) which can store up to 11 hours of footage at full resolution. Meta-data like GPS-coordinates (geotags), viewing direction, movement speed, etc. are directly embedded into the images EXIF fields. Eyesis4Pi uses 24 sensor-front-ends and high-grade lenses that are triggered simultaneously with microsecond accuracy to ensure a full homogeneous spherical snapshot. | + | '''''Elphel Eyesis4Pi''''' is an open hardware / free software panoramic camera solution that is able to capture high-resolution - 64 MPix total (120 MPix before stitching) - 360° panoramas at a rate up to 5 frames per second at full resolution. It is the successor of the [[Elphel Eyesis]]. Images are recorded to 8 solid-state-discs (Eyesis4Pi Data Storage) which can store up to 11 hours of footage at full resolution. Meta-data like GPS-coordinates (geotags), viewing direction, movement speed, etc. are directly embedded into the images EXIF fields. Eyesis4Pi uses 24+2 sensor-front-ends and high-grade lenses that are triggered simultaneously with microsecond accuracy to ensure a full homogeneous spherical snapshot. |
=== Usage Scenarios === | === Usage Scenarios === | ||
| Line 17: | Line 49: | ||
=== Operation & Monitoring === | === Operation & Monitoring === | ||
| − | + | Eyesis4Pi is controlled from a laptop, via a [[Eyesis4Pi User Guide - Recording|web-based interface (Eyesis4Pi GUI)]]. Which also displays real-time previews of your captured panorama footage. | |
| − | Eyesis is supplied with 110V/220V AC and can be used with car power adapter (inverter), when mounted on a car roof. Power consumption is | + | Eyesis is supplied with 110V/220V AC and can be used with car power adapter (inverter), when mounted on a car roof. Power consumption is about 50W. |
=== Models<br> === | === Models<br> === | ||
| − | 4π (or 4Pi) corresponds to a | + | 4π (or 4Pi) corresponds to a full spherical (360°x180°) field of view in steradians.<br> |
| − | There are 2 version of the camera Eyesis4Pi with 24 image sensors and full spherical field of view and Eyesis3Pi with 16 sensors (without 8 bottom modules) with slightly smaller field of view.<br> | + | There are 2 version of the camera Eyesis4Pi with 24+2 image sensors and full spherical field of view and Eyesis3Pi with 16+2 sensors (without 8 bottom modules) with slightly smaller field of view.<br> |
=== Comparison between Eyesis and Eyesis4Pi === | === Comparison between Eyesis and Eyesis4Pi === | ||
| Line 47: | Line 79: | ||
| Number of image sensors<br> | | Number of image sensors<br> | ||
| 9<br> | | 9<br> | ||
| − | | 24 (16)<br> | + | | 24+2 (16+2)<br> |
| <br> | | <br> | ||
|- | |- | ||
| Line 147: | Line 179: | ||
=== Calibration === | === Calibration === | ||
| − | + | We have developed full calibration process and post-processing software to compensate for optical aberrations, allowing to preserve full sensor resolution over the camera FOV, and distortions – for precise pixel-mapping for photogrammetry and 3D reconstruction. Check out this [http://blogs.elphel.com/2010/06/elphel-eyesis-camera-optics-and-lens-focus-adjustment/ Elphel Development Blog post] for more details. | |
== Tech specs == | == Tech specs == | ||
| Line 153: | Line 185: | ||
'''Eyesis4Pi Camera''' | '''Eyesis4Pi Camera''' | ||
| − | *24x Color | + | * 24x Color 5MPix CMOS sensors in array that covers the sphere |
| − | *Resolution - 64MPix (120MPix before stitching) | + | * 2x Color 5MPix CMOS sensors in the pole that make stereo pairs with corresponding sensors in the camera head. |
| − | *Up to 5 FPS at full resolution (120Mpix) | + | * Resolution - 64MPix (120MPix before stitching) |
| − | + | * Up to 5 FPS at full resolution (120Mpix) - only if equipped with SSDs | |
| − | *Web-based GUI | + | * Web-based GUI |
| − | *GPS powered geo-tagging | + | * GPS powered geo-tagging |
| − | *[http://en.wikipedia.org/wiki/Inertial_measurement_unit IMU] powered 3D inertial measurement | + | * [http://en.wikipedia.org/wiki/Inertial_measurement_unit IMU] powered 3D inertial measurement |
| − | *Precise image capture synchronization | + | * Precise image capture synchronization |
| − | *RAW or compressed image formats | + | * RAW or compressed image formats |
| − | *High resolution lenses: | + | * High resolution lenses: 26x M12 lens mount |
| − | *Very small parallax - distance between entrance pupils: 46.5 mm | + | * Very small parallax - distance between entrance pupils: 46.5 mm |
| − | *Weatherproof camera body and camera pole | + | * Weatherproof camera body and camera pole |
| + | * Highly Customizable | ||
'''Eyesis Data Storage''' | '''Eyesis Data Storage''' | ||
*located inside weatherproof camera pole | *located inside weatherproof camera pole | ||
| − | * | + | *9x 128 GB - 1.8" - SSDs |
| − | *Enough space for | + | *Enough space for 3 hours of full Resolution/FPS footage (depending on quality settings and actual image content)<br> |
| − | ''' | + | '''Eyesis4Pi Computer''' |
| − | The Eyesis Computer is a high-end-workstation | + | The Eyesis Computer is a high-end-workstation in a small form factor. It is intended for image post-processing and '''not''' required for recording footage. |
It comes with all Elphel developed software and tools required for processing panoramic images preinstalled. | It comes with all Elphel developed software and tools required for processing panoramic images preinstalled. | ||
| Line 185: | Line 218: | ||
*2 TB HDD<br> | *2 TB HDD<br> | ||
| − | <br> '''Tech Specs of a Single Image Sensor (Eyesis4Pi uses 24 of these, | + | <br> '''Tech Specs of a Single Image Sensor (Eyesis4Pi uses 24+2 of these, Eyesis4Pi-24 uses 24, and Eyesis4Pi-16 uses 16)''' |
{| border="1" class="wikitable" | {| border="1" class="wikitable" | ||
| Line 214: | Line 247: | ||
|} | |} | ||
| − | == | + | == Image Samples == |
| + | * [[Eyesis4Pi_samples|Samples]] | ||
== More Information == | == More Information == | ||
'''Wiki:''' | '''Wiki:''' | ||
| − | + | * [[Elphel_Eyesis4Pi|Eyesis4Pi Main Article]] | |
| − | *[[Eyesis4Pi_User_Guide| | + | * [[Eyesis4Pi_workflow|Workflow]] |
| − | *[[Eyesis4pi_Post-Processing| | + | * [[Eyesis4Pi_User_Guide|User Guide - Recording]] |
| − | *[[Eyesis4Pi_data_structure| | + | * [[Eyesis4Pi_Footage_Procedures_page|User Guide - Post-Processing: Footage Procedures]] |
| − | *[[ | + | * [[Eyesis4pi_Post-Processing|User Guide - Post-processing: ImageJ]] |
| − | + | * [[Eyesis4Pi_data_structure|Data Structure Description]] | |
| + | * [[Eyesis4Pi_Calibration|Calibration Process]] | ||
'''Elphel Development Blog:''' | '''Elphel Development Blog:''' | ||
| Line 237: | Line 272: | ||
== FAQ == | == FAQ == | ||
| − | ===Why are there | + | ===Why are there 9 SSDs and not just a single bigger one?=== |
| − | There are | + | There are 26 sensor-front-ends. There are 9 system boards each connected to 3 sensor-front-ends and a one SSD. The shots of a single panorama are split up on 9 SSDs. 3 images to SSD1, 3 images to SSD2, 3 images to SSD3... and the last 2 - to SSD9 |
===Can I also use Eyesis4Pi with HDDs instead of SSDs?=== | ===Can I also use Eyesis4Pi with HDDs instead of SSDs?=== | ||
| Line 247: | Line 282: | ||
===How do I unload the data from Eyesis4Pi?=== | ===How do I unload the data from Eyesis4Pi?=== | ||
| − | The camera pole has 2 eSATA ports in a | + | The camera pole has 2 eSATA ports in a weatherproof sealed connector. With this connector you can connect to the SSDs inside the camera pole like to any external hard-drive with any laptop/computer. |
===What software do I need on my laptop/computer to control Eyesis?=== | ===What software do I need on my laptop/computer to control Eyesis?=== | ||
| Line 260: | Line 295: | ||
See [[Eyesis4Pi_User_Guide | Eyesis4Pi User Guide]] | See [[Eyesis4Pi_User_Guide | Eyesis4Pi User Guide]] | ||
| + | |||
| + | [[Category:Eyesis4Pi]] | ||
Latest revision as of 14:45, 22 December 2016
Contents
- 1 Status
- 2 About
- 3 Tech specs
- 4 Image Samples
- 5 More Information
- 6 FAQ
- 6.1 Why are there 9 SSDs and not just a single bigger one?
- 6.2 Can I also use Eyesis4Pi with HDDs instead of SSDs?
- 6.3 How do I unload the data from Eyesis4Pi?
- 6.4 What software do I need on my laptop/computer to control Eyesis?
- 6.5 How do I connect my laptop/computer to Eyesis and how do I control image recording?
Status
Production
The newer version EYESIS4PI-26-393 is available. Jump to Eyesis4Pi-393 article.
Features:
- new 10393 system boards
- faster recording
- more powerful
- more compact - the pole is 2 times shorter
Compare 3D models:
|
|
About
Elphel Eyesis4Pi is an open hardware / free software panoramic camera solution that is able to capture high-resolution - 64 MPix total (120 MPix before stitching) - 360° panoramas at a rate up to 5 frames per second at full resolution. It is the successor of the Elphel Eyesis. Images are recorded to 8 solid-state-discs (Eyesis4Pi Data Storage) which can store up to 11 hours of footage at full resolution. Meta-data like GPS-coordinates (geotags), viewing direction, movement speed, etc. are directly embedded into the images EXIF fields. Eyesis4Pi uses 24+2 sensor-front-ends and high-grade lenses that are triggered simultaneously with microsecond accuracy to ensure a full homogeneous spherical snapshot.
Usage Scenarios
The system was designed to be small and lightweight with a minimal distance between the entrance pupils (46.5mm) to achieve lowest possible parallax.
The primary usage scenario is to mount Eyesis4Pi on the roof of a vehicle. When driving at 50 mph (22.3 m/s) and recording at 5 FPS a full panorama is captured every 4.46 meters.
Operation & Monitoring
Eyesis4Pi is controlled from a laptop, via a web-based interface (Eyesis4Pi GUI). Which also displays real-time previews of your captured panorama footage.
Eyesis is supplied with 110V/220V AC and can be used with car power adapter (inverter), when mounted on a car roof. Power consumption is about 50W.
Models
4π (or 4Pi) corresponds to a full spherical (360°x180°) field of view in steradians.
There are 2 version of the camera Eyesis4Pi with 24+2 image sensors and full spherical field of view and Eyesis3Pi with 16+2 sensors (without 8 bottom modules) with slightly smaller field of view.
Comparison between Eyesis and Eyesis4Pi
| Parameter |
Eyesis |
Eyesis4Pi (Eyesis 3Pi without 8 bottom modules) |
Notes |
|---|---|---|---|
| Combined field of view (steradians) |
3*π |
4*π (3*π) | |
| Number of image sensors |
9 |
24+2 (16+2) |
|
| Angular resolution +/-30° from the horizon |
≥4.2Mpix/steradian |
≥4.2Mpix/steradian |
1 |
| Angular resolution +30° to +90°(zenith) |
≥0.83Mpix/steradian |
≥4.2Mpix/steradian | 1 |
| Angular resolution -30° to -90°(nadir) | none | ≥4.2Mpix/steradian (none) | 1 |
| Combined megapixels | 45.0 | 120.0 (80.0) | |
| Combined megapixels (w/o overlapping areas) | 34.0 | 64.0 (48.0) | |
| Combined megapixels (w/o overlapping areas, worst case resolution) |
29.0 | 52.8 (39.6) | 1,2 |
| Distance between entrance pupils of adjacent horizontal lenses |
34.5mm | 46.5mm | |
| Distance between entrance pupils of horizontal and top/bottom lenses |
75mm | 50mm | 3 |
| Maximal frame rate | 5fps | 5fps | 4 |
| Maximal recording data rate | 48MB/s | 128MB/s (96Mb/s) | |
| Maximal direct network data rate | 30MB/s | 80MB/s (60MB/s) | |
| GPS receiver | external, USB | External/internal, USB/RS232 | |
| GPS pulse-per-second input | no |
yes |
|
| IMU | none | ADIS163xx,ADIS164xx | |
| Data unload | removable SSD in cradles | eSATAx2 | |
| Storage devices type | 2.5″ SSD | 1.8″SSD | |
| Number of storage devices | 3 |
8 (6) |
|
Notes:
- Angular resolution per pixel differs in the sub-camera FOV, minimal resolution is used.
- Zenith area for Eyesis (covered by fisheye lens) is calculated separately.
- For Eyesis the distance is measured from the entrance pupil of the horizontal lens to that of the top fisheye, for Eysis-4pi – to the entrance pupil of the lens immediately above/below the first one.
- Frame rate may be limited by the recording (or network if the SSD are not used) datarate for high compression quality (>0.3 bytes/pixel), required for the aberration correction.
Calibration
We have developed full calibration process and post-processing software to compensate for optical aberrations, allowing to preserve full sensor resolution over the camera FOV, and distortions – for precise pixel-mapping for photogrammetry and 3D reconstruction. Check out this Elphel Development Blog post for more details.
Tech specs
Eyesis4Pi Camera
- 24x Color 5MPix CMOS sensors in array that covers the sphere
- 2x Color 5MPix CMOS sensors in the pole that make stereo pairs with corresponding sensors in the camera head.
- Resolution - 64MPix (120MPix before stitching)
- Up to 5 FPS at full resolution (120Mpix) - only if equipped with SSDs
- Web-based GUI
- GPS powered geo-tagging
- IMU powered 3D inertial measurement
- Precise image capture synchronization
- RAW or compressed image formats
- High resolution lenses: 26x M12 lens mount
- Very small parallax - distance between entrance pupils: 46.5 mm
- Weatherproof camera body and camera pole
- Highly Customizable
Eyesis Data Storage
- located inside weatherproof camera pole
- 9x 128 GB - 1.8" - SSDs
- Enough space for 3 hours of full Resolution/FPS footage (depending on quality settings and actual image content)
Eyesis4Pi Computer
The Eyesis Computer is a high-end-workstation in a small form factor. It is intended for image post-processing and not required for recording footage.
It comes with all Elphel developed software and tools required for processing panoramic images preinstalled.
- Small form factor Shuttle PC
- Intel Core i7-950 Quad-Core Processor
- 16 GB DDR3 RAM
- GeForce GTX 465 (Fermi) 1GB
- 2 TB HDD
Tech Specs of a Single Image Sensor (Eyesis4Pi uses 24+2 of these, Eyesis4Pi-24 uses 24, and Eyesis4Pi-16 uses 16)
| Color Image Sensor | 1/2.5" bayer-pattern CMOS |
| Effective number of pixels | 2592x1936 (5,018,112 pixels) |
| Aspect Ratio | Chip 4:3, Region of interest freely adjustable in 16 pixel steps |
| Sensor Output | 12 Bit ADC |
| Sensor Features | Region of interest, on-chip binning and decimation |
| Dynamic Range | 70 db (76 db at 2x2 binning) |
| Electronic Shutter | 1 us to "very long" (~3h) in 1us steps |
| Gain | Analog & Digital (0 db to 12 db continuous) |
Image Samples
More Information
Wiki:
- Eyesis4Pi Main Article
- Workflow
- User Guide - Recording
- User Guide - Post-Processing: Footage Procedures
- User Guide - Post-processing: ImageJ
- Data Structure Description
- Calibration Process
Elphel Development Blog:
- Current state of the Eyesis project Introdcution of Eyesis4Pi
- “Zoom in. Now… enhance.” – a practical implementation of the aberration measurement and correction in a digital camera
- “Zoom in. Now… enhance.” – Results
- Elphel Eyesis camera optics and lens focus adjustment
- Elphel-Eyesis, assembled
- Elphel-Eyesis Progress
- First Elphel Eyesis Prototype assembled
FAQ
Why are there 9 SSDs and not just a single bigger one?
There are 26 sensor-front-ends. There are 9 system boards each connected to 3 sensor-front-ends and a one SSD. The shots of a single panorama are split up on 9 SSDs. 3 images to SSD1, 3 images to SSD2, 3 images to SSD3... and the last 2 - to SSD9
Can I also use Eyesis4Pi with HDDs instead of SSDs?
We initially tested the system with HDDs but due to strong vibrations when using Eyesis mounted to a car roof we experience massive write-rate drops with HDDs. After we switched to SSDs all these problems were gone. If your Eyesis application does not involve bumby roads or vibrations HDDs should work just fine though.
How do I unload the data from Eyesis4Pi?
The camera pole has 2 eSATA ports in a weatherproof sealed connector. With this connector you can connect to the SSDs inside the camera pole like to any external hard-drive with any laptop/computer.
What software do I need on my laptop/computer to control Eyesis?
Eyesis GUI requires a locally running webserver (apache2 + PHP5) and the Eyesis User Guide software.
How do I connect my laptop/computer to Eyesis and how do I control image recording?
The Eyesis4Pi hosts a Gigabit Ethernet switch so all you need is one Ethernet cable from the camera pole hose to your laptop/computer.
The Eyesis GUI is completely browser based so after you connected to the network you just start a browser type in the correct URL and you are ready to go.
