ElphelWiki - User contributions [en]

2008.RMLL.info recording

2008-06-24T23:54:30Z

Beug: /* Streaming */

=Prefix=
We had some contacts with organizers of http://2008.rmll.info/?lang=en and decided to participate recording all conferences with Elphel NC353L network cameras.

=Goals=
The goal is:

* record all the conferences in high resolution. (from 640x480 to 1920x1080p)
* restream few conferences in real time
* upload ALL conferences on RMLL site and google video and as many support as possible.
* keep high quality 1920x1080p MJPEG sources for all conferences what will be post processed.
* have at least 1 camera per conference room and 2-4 camera for a very important conferences what will be post processed.
* do all that with exclusively FreeSoftware

=Hardware=
This section will describe used hardware.

==Cameras==
We will bring 14 cameras with lenses and POE injectors.

===POE injectors===
We will bring POE injectors with us.

===Lenses===
We will use Computar H2Z0414C-MP Varifocal Lens, 4-8mm F1.4 Manual Iris Vari-Focal C-Mount, 3MPix. We will have 10-12 of such lense + 2 5MPix fisheyes. Maybe we will have some other good quality lenses.

==PC==

===Requirement===

If we do not want to stream or transcode in live a X40 IBM thinkpad or equivalent is OK.

If we do want to mux, transcode and stream in realtime a core2duo or quadro 2.4 Ghz and with 2GB RAM minimum is more welcome.

=Microphones=

=Tripods=

=Network=

=Software=

==FreeSoftware==

List of freesoftware needed to record video/audio, mux and stream.

Of course standard GNU/Linux

mencoder to record video

gstreamer-0.10 to record audio

ogmmerge from ogmtools to mux ogg vorbis sound produce by gstreamer and mjpeg video from mencoder

ffmpeg2theora to encode on theora ( minimum version is 0.19 )

oggfwd to send video and icecast server

icecast2 for streaming the ogg/theora file

On standard ubuntu 7.10 i've got all this software with apt-get.

==Ubuntu Desktop==

==Special scripts for recording==

===Pure-Data patch===

Here there is a simple patch for pure data to record, mux sound and stream on icecast server.
You can download this patch here :

http://community.elphel.com/files/elencode.pd

Change the path of your need and launch this with pd name_you_choose.pd

===Recording audio===

To record audio there is new elphel cam with USB where you can plug USB microphone ( recommended SAMSON USB MIC ) BUT
she is not avaivable for this events :( so we need to find solution to record audio.

The solution is a computer ... :(

For this we need standard computer with soundcard alsa compatible and gstreamer-0.10 software.
To record audio i use this scripts made by luxigo.

<pre>
#!/bin/sh

# audio settings
AUDIO_DEVICE="hw:0,0"
AUDIO_BITRATE=48000

# output file name
OUTFILE="out.ogg"

DEBUG="-v -m"

gst-launch-0.10 $DEBUG \
\
oggmux name=mux \
! filesink location="$OUTFILE" \
\
fdsrc fd=0 \
! queue \
! oggparse \
! oggdemux \
! ogmvideoparse \
! mux. \
\
alsasrc \
device="$AUDIO_DEVICE" \
! queue \
! audioconvert \
! vorbisenc bitrate=$AUDIO_BITRATE \
! mux.

# Description of the gst-launch command above:

# - the muxed stream (the output from the oggmux element) will be
# stored in a file (filesink)

# - The video comes from ElphelOgm through stdin (fdsrc fd=0).
# - The ogg stream is parsed for security (optional?) and demuxed.
# - The ogmvideo stream is also parsed for security (optional?).
# - The resulting mjpeg stream is sent to the ogg muxer through the
# "mux." element (defined with "oggmux name=mux").
# (This syntax could also be used for oggdemux but here there's only
# a single stream in the incoming ogg container so we dont need to
# complicate things here)

# - The sound comes from an alsa device through alsasrc,
# - The sound is converted in a suitable format then encoded in vorbis,
# before being muxed with the video stream
</pre>

===Recording video===

We've got different way to record video from elphel camera. The newest way to record is camogm/cam2ogm but we need nfs server or hard drive directly connected to the camera but we don't have camera with harddrive and nfs server is not what i prefer.. We can also use ElphelOgm but we are some artefact with this so i choose to use classic mencoder way to record video like this :

<pre>
mencoder rtsp://ipcamera:554 -ovc copy -fps 24.99 -frames 250000 -o outputv.avi

</pre>

the option frames 250000 produce approximatively 2 hours of video on 1920x1088 format.

===Muxing audio with video===

To mux of audio and video we use ogmmerge from ogmtools like this :

<pre>
ogmmerge -o sync.ogg out.ogg outputv.avi
</pre>

There is an option -sync if you need an audio track synchronized.

<pre>
$ ogmmerge -o goodsync.ogm -A source.avi -s 200 outofsync.ogg

This would add 200ms of silence at the beginning of the audio tracks
taken from outofsync.ogg. And -s always applies to all audio tracks in
a source file. If you want to apply -s only to a specific track then
take the same source file more than once and add -a and -s accordingly.

</pre>
from man ogmmerge

===Transcoding to Theora/Vorbis===

For the the transcoding we use ffmpeg2theora ( minimum version 0.19 ) to encode the mjpeg and oggvorbis on the ogg/theora file.

<pre>
cat sync.ogg | ffmpeg2theora -p preview -o final.ogg -
</pre>

===Streaming===

Finally to stream for the world we use icecast2 server.

Send the ogg/theora files with oggfwd like this.

<pre>
cat final.ogg | oggfwd ip_of_icecast_server port password /stream.ogg
</pre>

Of course you need to configure icecast2 server before.

2008.RMLL.info recording

2008-06-24T23:51:35Z

Beug: /* Transcoding to Theora/Vorbis */

2008.RMLL.info recording

2008-06-24T23:49:23Z

Beug: /* Muxing audio with video */

2008.RMLL.info recording

2008-06-24T23:43:32Z

Beug: /* Recording video */

=Prefix=
We had some contacts with organizers of http://2008.rmll.info/?lang=en and decided to participate recording all conferences with Elphel NC353L network cameras.

=Goals=
The goal is:

* record all the conferences in high resolution. (from 640x480 to 1920x1080p)
* restream few conferences in real time
* upload ALL conferences on RMLL site and google video and as many support as possible.
* keep high quality 1920x1080p MJPEG sources for all conferences what will be post processed.
* have at least 1 camera per conference room and 2-4 camera for a very important conferences what will be post processed.
* do all that with exclusively FreeSoftware

=Hardware=
This section will describe used hardware.

==Cameras==
We will bring 14 cameras with lenses and POE injectors.

===POE injectors===
We will bring POE injectors with us.

===Lenses===
We will use Computar H2Z0414C-MP Varifocal Lens, 4-8mm F1.4 Manual Iris Vari-Focal C-Mount, 3MPix. We will have 10-12 of such lense + 2 5MPix fisheyes. Maybe we will have some other good quality lenses.

==PC==

===Requirement===

If we do not want to stream or transcode in live a X40 IBM thinkpad or equivalent is OK.

If we do want to mux, transcode and stream in realtime a core2duo or quadro 2.4 Ghz and with 2GB RAM minimum is more welcome.

=Microphones=

=Tripods=

=Network=

=Software=

==FreeSoftware==

List of freesoftware needed to record video/audio, mux and stream.

Of course standard GNU/Linux

mencoder to record video

gstreamer-0.10 to record audio

ogmmerge from ogmtools to mux ogg vorbis sound produce by gstreamer and mjpeg video from mencoder

ffmpeg2theora to encode on theora ( minimum version is 0.19 )

oggfwd to send video and icecast server

icecast2 for streaming the ogg/theora file

On standard ubuntu 7.10 i've got all this software with apt-get.

==Ubuntu Desktop==

==Special scripts for recording==

===Pure-Data patch===

Here there is a simple patch for pure data to record, mux sound and stream on icecast server.
You can download this patch here :

http://community.elphel.com/files/elencode.pd

Change the path of your need and launch this with pd name_you_choose.pd

===Recording audio===

To record audio there is new elphel cam with USB where you can plug USB microphone ( recommended SAMSON USB MIC ) BUT
she is not avaivable for this events :( so we need to find solution to record audio.

The solution is a computer ... :(

For this we need standard computer with soundcard alsa compatible and gstreamer-0.10 software.
To record audio i use this scripts made by luxigo.

<pre>
#!/bin/sh

# audio settings
AUDIO_DEVICE="hw:0,0"
AUDIO_BITRATE=48000

# output file name
OUTFILE="out.ogg"

DEBUG="-v -m"

gst-launch-0.10 $DEBUG \
\
oggmux name=mux \
! filesink location="$OUTFILE" \
\
fdsrc fd=0 \
! queue \
! oggparse \
! oggdemux \
! ogmvideoparse \
! mux. \
\
alsasrc \
device="$AUDIO_DEVICE" \
! queue \
! audioconvert \
! vorbisenc bitrate=$AUDIO_BITRATE \
! mux.

# Description of the gst-launch command above:

# - the muxed stream (the output from the oggmux element) will be
# stored in a file (filesink)

# - The video comes from ElphelOgm through stdin (fdsrc fd=0).
# - The ogg stream is parsed for security (optional?) and demuxed.
# - The ogmvideo stream is also parsed for security (optional?).
# - The resulting mjpeg stream is sent to the ogg muxer through the
# "mux." element (defined with "oggmux name=mux").
# (This syntax could also be used for oggdemux but here there's only
# a single stream in the incoming ogg container so we dont need to
# complicate things here)

# - The sound comes from an alsa device through alsasrc,
# - The sound is converted in a suitable format then encoded in vorbis,
# before being muxed with the video stream
</pre>

===Recording video===

We've got different way to record video from elphel camera. The newest way to record is camogm/cam2ogm but we need nfs server or hard drive directly connected to the camera but we don't have camera with harddrive and nfs server is not what i prefer.. We can also use ElphelOgm but we are some artefact with this so i choose to use classic mencoder way to record video like this :

<pre>
mencoder rtsp://ipcamera:554 -ovc copy -fps 24.99 -frames 250000 -o outputv.avi

</pre>

the option frames 250000 produce approximatively 2 hours of video on 1920x1088 format.

===Muxing audio with video===

===Transcoding to Theora/Vorbis===

===Streaming===

2008.RMLL.info recording

2008-06-24T23:35:18Z

Beug: /* Recording audio */

=Prefix=
We had some contacts with organizers of http://2008.rmll.info/?lang=en and decided to participate recording all conferences with Elphel NC353L network cameras.

=Goals=
The goal is:

* record all the conferences in high resolution. (from 640x480 to 1920x1080p)
* restream few conferences in real time
* upload ALL conferences on RMLL site and google video and as many support as possible.
* keep high quality 1920x1080p MJPEG sources for all conferences what will be post processed.
* have at least 1 camera per conference room and 2-4 camera for a very important conferences what will be post processed.
* do all that with exclusively FreeSoftware

=Hardware=
This section will describe used hardware.

==Cameras==
We will bring 14 cameras with lenses and POE injectors.

===POE injectors===
We will bring POE injectors with us.

===Lenses===
We will use Computar H2Z0414C-MP Varifocal Lens, 4-8mm F1.4 Manual Iris Vari-Focal C-Mount, 3MPix. We will have 10-12 of such lense + 2 5MPix fisheyes. Maybe we will have some other good quality lenses.

==PC==

===Requirement===

If we do not want to stream or transcode in live a X40 IBM thinkpad or equivalent is OK.

If we do want to mux, transcode and stream in realtime a core2duo or quadro 2.4 Ghz and with 2GB RAM minimum is more welcome.

=Microphones=

=Tripods=

=Network=

=Software=

==FreeSoftware==

List of freesoftware needed to record video/audio, mux and stream.

Of course standard GNU/Linux

mencoder to record video

gstreamer-0.10 to record audio

ogmmerge from ogmtools to mux ogg vorbis sound produce by gstreamer and mjpeg video from mencoder

ffmpeg2theora to encode on theora ( minimum version is 0.19 )

oggfwd to send video and icecast server

icecast2 for streaming the ogg/theora file

On standard ubuntu 7.10 i've got all this software with apt-get.

==Ubuntu Desktop==

==Special scripts for recording==

===Pure-Data patch===

Here there is a simple patch for pure data to record, mux sound and stream on icecast server.
You can download this patch here :

http://community.elphel.com/files/elencode.pd

Change the path of your need and launch this with pd name_you_choose.pd

===Recording audio===

To record audio there is new elphel cam with USB where you can plug USB microphone ( recommended SAMSON USB MIC ) BUT
she is not avaivable for this events :( so we need to find solution to record audio.

The solution is a computer ... :(

For this we need standard computer with soundcard alsa compatible and gstreamer-0.10 software.
To record audio i use this scripts made by luxigo.

<pre>
#!/bin/sh

# audio settings
AUDIO_DEVICE="hw:0,0"
AUDIO_BITRATE=48000

# output file name
OUTFILE="out.ogg"

DEBUG="-v -m"

gst-launch-0.10 $DEBUG \
\
oggmux name=mux \
! filesink location="$OUTFILE" \
\
fdsrc fd=0 \
! queue \
! oggparse \
! oggdemux \
! ogmvideoparse \
! mux. \
\
alsasrc \
device="$AUDIO_DEVICE" \
! queue \
! audioconvert \
! vorbisenc bitrate=$AUDIO_BITRATE \
! mux.

# Description of the gst-launch command above:

# - the muxed stream (the output from the oggmux element) will be
# stored in a file (filesink)

# - The video comes from ElphelOgm through stdin (fdsrc fd=0).
# - The ogg stream is parsed for security (optional?) and demuxed.
# - The ogmvideo stream is also parsed for security (optional?).
# - The resulting mjpeg stream is sent to the ogg muxer through the
# "mux." element (defined with "oggmux name=mux").
# (This syntax could also be used for oggdemux but here there's only
# a single stream in the incoming ogg container so we dont need to
# complicate things here)

# - The sound comes from an alsa device through alsasrc,
# - The sound is converted in a suitable format then encoded in vorbis,
# before being muxed with the video stream
</pre>

===Recording video===

===Muxing audio with video===

===Transcoding to Theora/Vorbis===

===Streaming===

2008.RMLL.info recording

2008-06-24T23:23:40Z

Beug: /* FreeSoftware */

2008.RMLL.info recording

2008-06-24T23:06:42Z

Beug: /* Pure-Data patch */

Linuxdevices.com Articles Discussion

2008-03-06T22:34:09Z

Beug:

[[AJAX, LAMP, and liveDVD for a Linux-based camera, Andrey Filippov (Mar. 27, 2006)]]

TODO

2007-09-01T19:10:04Z

Beug: /* Ethernet LEDs */

Some project ideas

= Add support for wifi and bluetooth =

Add support for most used USB wifi and bluetooth USB keys.

= Bluetooth remote control =

Add a remote control via bluetooth and wifi.

= Make more human-readable flash.log =

The flash.log in the nfs share more human-readable. Maybe add some more info inside.

= PHP interface for reflashing camera(s) =

PHP web interface to reflash one or multiple cameras with ktest (show camera status), control options, browse log files. It would be useful to add memory, FPGA and other hardware and show results -- i.e. get JPEG image and check if the image is "normal". The interface should allow to configure all ktest parameters (and probably much more) individually per camera.

For production flashing include PoE switch control to reboot the camera.

= The streamer =

== Audio ==

Implement audio from alsa source synced with video.

== Subtitles ==

Implement subtitles what might be optionally read by the client. Subtitles should be able to handle info from EXIF and any user defined data.

== Write to disk ==

Implement an option to stream to the network and/or to the hard drive / CF.

= Exif =

Add fields for geo-location (GPS), orientation of the camera and some user defined data. The camera model should also include sensor type and model.

= Make a block diagram of the boot process =

It is needed for new devs and to be able to have an overview of the process and be able to enhance it.

= Better usage of busybox =

Enable cool and useful staff from busybox such as passwd, cfdisk, minicom, ...
(Please post a list to this section for discussion before doing what)

= Hardware Test Software =

Hmm... will be described later.

= Do some magic to be able to pass params to the kernel over reboot =

Implement (or just improve - something is already done) passing parameters to the next booted kernel. This can be done in different ways:

* passing kernel params truth RAM
* using KEXEC kernel function
* simulate the green button pressure at boot time (to boot in flashing mode)
* destroy signature magic after usage - even powered down SDRAM can hold data for many seconds

= Green button =

The green button on the back of the camera can be used in different ways:

* at power up to put the CPU in flashing mode
* 1-2 seconds after power up and hold for ~8 seconds to boot the camera with squashfs and tmpfs instead of jffs. When a special script can be used to relink safe files from sqauashfs to jffs. (cf [http://wiki.elphel.com/index.php?title=TODO&action=submit#Change_the_structure_of_the_boot_process])
* something else user configurable after init 5

= Init levels =

Implement init levels, init 3 should have only GNU/Linux with telnetd, everything camera specific should run from init 5. The default level will be 5, but ktest should be able to pass init=3 to the kernel.

= Ktest =

== Rename ktest ==
Ktest should be renamed to something else resuming it's function.

== Better output ==
Some more output should be added to ktest to make it more verbose and user-friendly.

== New function ==
Add new function and param to read & copy partitions from the flash to NFS for debuging.

= Ethernet LEDs =

Hack in to the ethernet driver to make a better usage of leds. For example during flash with pressed button boot with orange led ON, blink orange while booting the kernel, blink with the green led while copying from NFS to flash and green ON when completely flashed and ready to be rebooted. While normal operation leds can be used in a more nice way when now.

= Idea:Change the structure of the boot process =

I like how partitions are organized in OpenWRT. The root partition should be read only squashfs. The same root partition should be used to boot from flash or from ktest. Then a read/write flash or tmpfs partition can be mounted, squashfs remounted to a new directory. And files from / linked to the /squashfs directory.

During the flash process files from squashfs will be symlinked to the tmpfs and to the flash r/w partition.

Like what we always have a clean squashfs, links from the r/w jffs partition can be removed and replaced by real files with different content. We can also implement a function for the green button to erase the files from the r/w partition and relink them to /squashfs. It's a simple way to get back to a known point without reflashing the camera.

= Genres =

Enhance Genres plugin to get rid of multiple languages and dependences and rewrite all using only one programming language. Make it more stable.

= camvc =

Repair broken/buggy AJAX code, port CGIs to PHP and move to lighthttpd instead of boa. (keep them both at least at the beginning to compare te speed and stability)

= Security =

== Lighthttpd ==

Add https to lighthttpd and add .htaccess protected directories.

== Add SSH ==

== Separate user privileges ==

Add passwd command, implement users and groups with separated privileges. Make groups for FPGA and other hardware (as HD) access and make Lighthttpd/PHP run as user.

== Netfilter firewall ==

Port the latest netfilter to be able to setup a firewall on the camera.