Re: [Elphel-support] Elphel Storage Drive

[Oleg]

Mohamed,

I think the problem was in the driver - the delay after sensor reset was
too close to a minimum from docs. Try new uImage from here
 -
the same file for mmc and nand (also updated the archive).

Regards,
Oleg


On Mon, Apr 9, 2018 at 1:16 PM, Oleg 
wrote:

> There's no need to remove them - sda2 is written like a memory buffer in
> a circular way - overwriting old images.
>
> Right now you need to read /mnt/sda1/camogm.disk to track where recording
> started/stopped.
>
> If you remove it the recording will be started from the beginning of the
> partition:
> elphel393~# rm /mnt/sda1/camogm.disk (camogm might need to be restarted
> after this)
>
> To actually erase data you can use dd, getting data from "if=/dev/zero"
> and writing to "of=/dev/sda2".
>
> Sometimes only one shows up (it isn't always the same port).
>>
> Reproduced the problem.
>
> Oleg
>
> On Mon, Apr 9, 2018 at 12:39 PM, Mohamed Morsy  wrote:
>
>> Also, how can I remove the files from the sda2 partition once I'm done?
>>
>> On Mon, Apr 9, 2018 at 2:26 PM, Mohamed Morsy  wrote:
>>
>>> I'm using 3 sensors. Sometimes only one shows up (it isn't always the
>>> same port).
>>>
>>> On Mon, Apr 9, 2018 at 1:58 PM, Oleg 
>>> wrote:
>>>
 Mohamed,


> I reformatted the drive so sda2 is raw. Now I'm trying to copy a
> recording from there. I'm not sure what you meant by:
> run https://git.elphel.com/Elphel/eyesis4pi-393-gui/blob/mas
> ter/footage_downloader/split_mov.php from inside the directory with
> image.bin
>

 I meant - download the script and run it (provided php is installed),
 for example:
 * save the split_mov.php to directory with downloaded footage
 ()
 Then in terminal:
 $ cd 
 $ php split_mov.php

 * The footage can be the one you downloaded from the raw partition or
 you can test with any .mov (just change the extension to .bin).
 * The script scans the working directory () for *.bin files
 then opens them as binary, looks for images (by exif header marker) and
 extracts them.

 Also, when I use the 14MPx sensors with nand, the cameras don't always
> show up. Sometimes only one shows up or none of them do. Any ideas what
> might be wrong?
>
 Don't know, need to test.
 Are there 2 sensors?
 When a single sensor shows up - is it always the same port? which one?

 Best regards,
 Oleg Dzhimiev
 Electronics Engineer
 phone: +1 801 783  x124
 Elphel, Inc.

>>>
>>>
>>
>> ___
>> Support-list mailing list
>> Support-list@support.elphel.com
>> http://support.elphel.com/mailman/listinfo/support-list_supp
>> ort.elphel.com
>>
>


-- 
Best regards,
Oleg Dzhimiev
Electronics Engineer
phone: +1 801 783  x124
Elphel, Inc.
___
Support-list mailing list
Support-list@support.elphel.com
http://support.elphel.com/mailman/listinfo/support-list_support.elphel.com

Re: [Elphel-support] Elphel Storage Drive

[Oleg]

Mohamed,


> I reformatted the drive so sda2 is raw. Now I'm trying to copy a recording
> from there. I'm not sure what you meant by:
> run https://git.elphel.com/Elphel/eyesis4pi-393-gui/blob/
> master/footage_downloader/split_mov.php from inside the directory with
> image.bin
>

I meant - download the script and run it (provided php is installed), for
example:
* save the split_mov.php to directory with downloaded footage ()
Then in terminal:
$ cd 
$ php split_mov.php

* The footage can be the one you downloaded from the raw partition or you
can test with any .mov (just change the extension to .bin).
* The script scans the working directory () for *.bin files then
opens them as binary, looks for images (by exif header marker) and extracts
them.

Also, when I use the 14MPx sensors with nand, the cameras don't always show
> up. Sometimes only one shows up or none of them do. Any ideas what might be
> wrong?
>
Don't know, need to test.
Are there 2 sensors?
When a single sensor shows up - is it always the same port? which one?

Best regards,
Oleg Dzhimiev
Electronics Engineer
phone: +1 801 783  x124
Elphel, Inc.
___
Support-list mailing list
Support-list@support.elphel.com
http://support.elphel.com/mailman/listinfo/support-list_support.elphel.com

Re: [Elphel-support] Elphel Storage Drive

[Mohamed Morsy]

Also, how can I remove the files from the sda2 partition once I'm done?

On Mon, Apr 9, 2018 at 2:26 PM, Mohamed Morsy  wrote:

> I'm using 3 sensors. Sometimes only one shows up (it isn't always the same
> port).
>
> On Mon, Apr 9, 2018 at 1:58 PM, Oleg 
> wrote:
>
>> Mohamed,
>>
>>
>>> I reformatted the drive so sda2 is raw. Now I'm trying to copy a
>>> recording from there. I'm not sure what you meant by:
>>> run https://git.elphel.com/Elphel/eyesis4pi-393-gui/blob/mas
>>> ter/footage_downloader/split_mov.php from inside the directory with
>>> image.bin
>>>
>>
>> I meant - download the script and run it (provided php is installed), for
>> example:
>> * save the split_mov.php to directory with downloaded footage ()
>> Then in terminal:
>> $ cd 
>> $ php split_mov.php
>>
>> * The footage can be the one you downloaded from the raw partition or you
>> can test with any .mov (just change the extension to .bin).
>> * The script scans the working directory () for *.bin files
>> then opens them as binary, looks for images (by exif header marker) and
>> extracts them.
>>
>> Also, when I use the 14MPx sensors with nand, the cameras don't always
>>> show up. Sometimes only one shows up or none of them do. Any ideas what
>>> might be wrong?
>>>
>> Don't know, need to test.
>> Are there 2 sensors?
>> When a single sensor shows up - is it always the same port? which one?
>>
>> Best regards,
>> Oleg Dzhimiev
>> Electronics Engineer
>> phone: +1 801 783  x124
>> Elphel, Inc.
>>
>
>
___
Support-list mailing list
Support-list@support.elphel.com
http://support.elphel.com/mailman/listinfo/support-list_support.elphel.com

Re: [Elphel-support] Elphel Storage Drive

[Mohamed Morsy]

I'm using 3 sensors. Sometimes only one shows up (it isn't always the same
port).

On Mon, Apr 9, 2018 at 1:58 PM, Oleg 
wrote:

> Mohamed,
>
>
>> I reformatted the drive so sda2 is raw. Now I'm trying to copy a
>> recording from there. I'm not sure what you meant by:
>> run https://git.elphel.com/Elphel/eyesis4pi-393-gui/blob/mas
>> ter/footage_downloader/split_mov.php from inside the directory with
>> image.bin
>>
>
> I meant - download the script and run it (provided php is installed), for
> example:
> * save the split_mov.php to directory with downloaded footage ()
> Then in terminal:
> $ cd 
> $ php split_mov.php
>
> * The footage can be the one you downloaded from the raw partition or you
> can test with any .mov (just change the extension to .bin).
> * The script scans the working directory () for *.bin files then
> opens them as binary, looks for images (by exif header marker) and extracts
> them.
>
> Also, when I use the 14MPx sensors with nand, the cameras don't always
>> show up. Sometimes only one shows up or none of them do. Any ideas what
>> might be wrong?
>>
> Don't know, need to test.
> Are there 2 sensors?
> When a single sensor shows up - is it always the same port? which one?
>
> Best regards,
> Oleg Dzhimiev
> Electronics Engineer
> phone: +1 801 783  x124
> Elphel, Inc.
>
___
Support-list mailing list
Support-list@support.elphel.com
http://support.elphel.com/mailman/listinfo/support-list_support.elphel.com

Re: [Elphel-support] Elphel Storage Drive

[Mohamed Morsy]

Oleg,

I reformatted the drive so sda2 is raw. Now I'm trying to copy a recording
from there. I'm not sure what you meant by:
run https://git.elphel.com/Elphel/eyesis4pi-393-gui/blob/master/
footage_downloader/split_mov.php from inside the directory with image.bin

Also, when I use the 14MPx sensors with nand, the cameras don't always show
up. Sometimes only one shows up or none of them do. Any ideas what might be
wrong?

Thanks,

Mohamed

On Fri, Apr 6, 2018 at 6:11 PM, Oleg 
wrote:

> Mohamed,
>
> I formatted the drive using ip_address/format_disk.php. This created sda1
>> and raw sda2. Then I used mkfs.ext4 /dev/sda2 to format the 2nd partition.
>> I made a directory sda2 in mnt and mounted /dev/sda2 there. I can copy
>> files from /mnt/sda2 using scp. Is this the right way? I'm not sure why
>> I need 2 partitions.
>>
>
> 2 partitions are used for 'fast recording'. Not having a file system on
> sda2 partition saves some time to perform writes, and also should reduce
> the wearing out of SSD. And ext4 sda1 partition is intended to store
> information where to start/continue recording from (camogm.disk).
>
> You don't have to use it if normal recording works. In this case you can
> have only a single partition - use fdisk to repartition.
> But if you increase the image quality normal recording might be too slow -
> you can test this - in camogm gui click on the 'show buffers' and run
> recording.
>
> When I use the Apple Quicktime Movie format, I get videos of the frames
>> from each port alternating. Is there a way to separate them so I get a
>> video for each port?
>>
> Camogm does not have an option to store different ports into separate
> files. Though it's possible to implement but will probably slow down
> recording.
> You can separate them on your PC.
> split_mov.php which I mentioned before - does splitting and naming files
> as _. Then they can be combined back to movs with
> ffmpeg, for example.
>
> For image format, COLOR is set as 0. Does that matter?
>>
> JP4 is a kind of a raw image format we implemented - see this article
> .
>
>
>> By the way, I was curious if it's possible to use 14 MPix sensors with
>> nand?
>>
> Yes. I didn't include the device tree for nand for 14MPx. Now it's
> here(devicetree.dtb)
> .
>
> Best regards,
> Oleg Dzhimiev
> Electronics Engineer
> phone: +1 801 783  x124
> Elphel, Inc.
>
___
Support-list mailing list
Support-list@support.elphel.com
http://support.elphel.com/mailman/listinfo/support-list_support.elphel.com

Re: [Elphel-support] Elphel Storage Drive

[Oleg]

Mohamed,

I formatted the drive using ip_address/format_disk.php. This created sda1
> and raw sda2. Then I used mkfs.ext4 /dev/sda2 to format the 2nd partition.
> I made a directory sda2 in mnt and mounted /dev/sda2 there. I can copy
> files from /mnt/sda2 using scp. Is this the right way? I'm not sure why I
> need 2 partitions.
>

2 partitions are used for 'fast recording'. Not having a file system on
sda2 partition saves some time to perform writes, and also should reduce
the wearing out of SSD. And ext4 sda1 partition is intended to store
information where to start/continue recording from (camogm.disk).

You don't have to use it if normal recording works. In this case you can
have only a single partition - use fdisk to repartition.
But if you increase the image quality normal recording might be too slow -
you can test this - in camogm gui click on the 'show buffers' and run
recording.

When I use the Apple Quicktime Movie format, I get videos of the frames
> from each port alternating. Is there a way to separate them so I get a
> video for each port?
>
Camogm does not have an option to store different ports into separate
files. Though it's possible to implement but will probably slow down
recording.
You can separate them on your PC.
split_mov.php which I mentioned before - does splitting and naming files as
_. Then they can be combined back to movs with ffmpeg,
for example.

For image format, COLOR is set as 0. Does that matter?
>
JP4 is a kind of a raw image format we implemented - see this article
.


> By the way, I was curious if it's possible to use 14 MPix sensors with
> nand?
>
Yes. I didn't include the device tree for nand for 14MPx. Now it's
here(devicetree.dtb)
.

Best regards,
Oleg Dzhimiev
Electronics Engineer
phone: +1 801 783  x124
Elphel, Inc.
___
Support-list mailing list
Support-list@support.elphel.com
http://support.elphel.com/mailman/listinfo/support-list_support.elphel.com

Re: [Elphel-support] Elphel Storage Drive

[Oleg]

Hi Mohamed,

1. For 14MPx - there's incorrect fps from the sensor in the firmware you've
been using - we have fixed it - you can find it here (20180406)
.
To enable 14Mpx - apart from the changes in the device tree and 10389's
eeprom, set the TRIG parameter to 0 (the default config is 0x4 meaning
triggered mode) then you can check the timestamps in
http://camera-ip/parsedit.php > "last 9 images, 3 per row, scale=0.2". It
should be ~11.07 for the full frame. Then you can save the config at
http://192.168.0.9/autocampars.php?sensor_port=0

2. About recording.
Don't know how you are downloading the footage. Do you record on the sda1
or sda2? Also, image format jpeg (COLOR=0) or jp4 (COLOR=5)?

If sda1 - it's scp over network or switching camera's SSD to PC, mounting
and copying.

If sda2 (which is the raw partition) - don't know if you figured out how to
download images - there are a few ways:

   - over network using dd:

Note: When recording to the raw parition the driver creates a file
/mnt/sda1/camogm.disk and stores partition info with write pointers
measured in LBA units (512B each). It uses the info to restart recording
from where it left of (to start from the beginning remove this file).
This camogm.disk will also tell you how much you need to download from the
partition.

# line below will download 200MB from the start of the partition:
ssh root@camera-ip "dd if=/dev/sda2 bs=20M count=10 | gzip -1 -" | dd
of=image.bin.gz
unpack to image.bin
run
https://git.elphel.com/Elphel/eyesis4pi-393-gui/blob/master/footage_downloader/split_mov.php
from inside the directory with image.bin

   - via eSATA cable connected to PC and the camera:

Try using int_ssd_download.py (from
https://git.elphel.com/Elphel/elphel-tools-x393). Then you will need
split_mov.php as well.


Best regards,
Oleg Dzhimiev
Electronics Engineer
phone: +1 801 783  x124
Elphel, Inc.
___
Support-list mailing list
Support-list@support.elphel.com
http://support.elphel.com/mailman/listinfo/support-list_support.elphel.com

Re: [Elphel-support] Elphel Storage Drive

[Mohamed Morsy]

Hi Oleg,

I formatted the drive using ip_address/format_disk.php. This created sda1
and raw sda2. Then I used mkfs.ext4 /dev/sda2 to format the 2nd partition.
I made a directory sda2 in mnt and mounted /dev/sda2 there. I can copy
files from /mnt/sda2 using scp. Is this the right way? I'm not sure why I
need 2 partitions.

When I use the Apple Quicktime Movie format, I get videos of the frames
from each port alternating. Is there a way to separate them so I get a
video for each port?

For image format, COLOR is set as 0. Does that matter?

By the way, I was curious if it's possible to use 14 MPix sensors with nand?

Thanks,

Mohamed

On Fri, Apr 6, 2018 at 1:47 PM, Oleg 
wrote:

> Hi Mohamed,
>
> 1. For 14MPx - there's incorrect fps from the sensor in the firmware
> you've been using - we have fixed it - you can find it here (20180406)
> .
> To enable 14Mpx - apart from the changes in the device tree and 10389's
> eeprom, set the TRIG parameter to 0 (the default config is 0x4 meaning
> triggered mode) then you can check the timestamps in
> http://camera-ip/parsedit.php > "last 9 images, 3 per row, scale=0.2". It
> should be ~11.07 for the full frame. Then you can save the config at
> http://192.168.0.9/autocampars.php?sensor_port=0
>
> 2. About recording.
> Don't know how you are downloading the footage. Do you record on the sda1
> or sda2? Also, image format jpeg (COLOR=0) or jp4 (COLOR=5)?
>
> If sda1 - it's scp over network or switching camera's SSD to PC, mounting
> and copying.
>
> If sda2 (which is the raw partition) - don't know if you figured out how
> to download images - there are a few ways:
>
>- over network using dd:
>
> Note: When recording to the raw parition the driver creates a file
> /mnt/sda1/camogm.disk and stores partition info with write pointers
> measured in LBA units (512B each). It uses the info to restart recording
> from where it left of (to start from the beginning remove this file).
> This camogm.disk will also tell you how much you need to download from the
> partition.
>
> # line below will download 200MB from the start of the partition:
> ssh root@camera-ip "dd if=/dev/sda2 bs=20M count=10 | gzip -1 -" | dd
> of=image.bin.gz
> unpack to image.bin
> run https://git.elphel.com/Elphel/eyesis4pi-393-gui/blob/master/
> footage_downloader/split_mov.php from inside the directory with image.bin
>
>- via eSATA cable connected to PC and the camera:
>
> Try using int_ssd_download.py (from https://git.elphel.com/
> Elphel/elphel-tools-x393). Then you will need split_mov.php as well.
>
>
> Best regards,
> Oleg Dzhimiev
> Electronics Engineer
> phone: +1 801 783  x124
> Elphel, Inc.
>
___
Support-list mailing list
Support-list@support.elphel.com
http://support.elphel.com/mailman/listinfo/support-list_support.elphel.com

Re: [Elphel-support] Elphel Storage Drive

[Mohamed Morsy]

Oleg,

Thank you. That worked.

I was also having another problem. I've been using 14 MPix sensors. I
followed the instructions on the new update and was able to get them to
work. However, when I use this SSD, the sensors don't seem to work anymore.
Is there a fix for this?

Regards,

Mohamed

On Thu, Apr 5, 2018 at 4:41 PM, Oleg 
wrote:

> Hi Mohamed,
>
> 1. http://camera-ip > Recorder
> docs: https://wiki.elphel.com/wiki/Camogmgui
>
> 2. There should be 2 partitions on SSD:
> sda1 ~6GB - formatted to EXT4 - sda1 is automounted to /mnt/sda1 (check
> with 'df -h' or )
> sda2 ~122GB - not formatted - for 'raw' recording
>
> If it's not formatted, see 4b..
>
> Other info:
> 3. To check if SSD is detected:
>
> 3a.
>
>> root@elphel393:~# cat /proc/partitions
>
>
> 3b.
>
>> root@elphel393:~# dmesg
>
>
> Example output:
>
>> [   23.160946] ata1: SATA max UDMA/133 mmio [mem 0x8000-0x8fff]
>> port 0x100 irq 163
>> [   23.510004] ata1: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
>> [   23.517599] ata1.00: ATA-9: TS128GMTS600, P1225CE, max UDMA/133
>> [   23.523846] ata1.00: 250069680 sectors, multi 1: LBA48 NCQ (depth 0/32)
>> [   23.532486] ata1.00: configured for UDMA/133
>> [   23.541610] scsi 0:0:0:0: Direct-Access ATA  TS128GMTS600
>> 5CE  PQ: 0 ANSI: 5
>> [   23.555202] sd 0:0:0:0: Attached scsi generic sg0 type 0
>> [   23.555418] sd 0:0:0:0: [sda] 250069680 512-byte logical blocks: (128
>> GB/119 GiB)
>> [   23.556425] sd 0:0:0:0: [sda] Write Protect is off
>> [   23.556437] sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
>> [   23.556545] sd 0:0:0:0: [sda] Write cache: enabled, read cache:
>> enabled, doesn't support DPO or FUA
>> [   23.583494]  sda: sda1 sda2
>> [   23.591877] sd 0:0:0:0: [sda] Attached SCSI disk
>> [   24.171488] random: nonblocking pool is initialized
>> [   24.950555] EXT4-fs (sda1): recovery complete
>> [   24.956238] EXT4-fs (sda1): mounted filesystem with ordered data mode.
>> Opts: (null)
>
>
> 3c.
>
>> root@elphel393:~# hdparm -I /dev/sda
>
>
>
>
> 4. Some information if you would like to reformat it:
> 4a. https://wiki.elphel.com/wiki/Format_SSD_MMC#SSD_or_USB
> Mainly it's 2 programs: fdisk and mkfs
>
> 4b. http://192.168.0.9/format_disk.php
>
> Let me know if you have any further questions or need more details.
>
> Best regards,
> Oleg Dzhimiev
> Electronics Engineer
> phone: +1 801 783  x124
> Elphel, Inc.
>
___
Support-list mailing list
Support-list@support.elphel.com
http://support.elphel.com/mailman/listinfo/support-list_support.elphel.com

Re: [Elphel-support] Elphel Storage Drive

[Oleg]

Hi Mohamed,

1. http://camera-ip > Recorder
docs: https://wiki.elphel.com/wiki/Camogmgui

2. There should be 2 partitions on SSD:
sda1 ~6GB - formatted to EXT4 - sda1 is automounted to /mnt/sda1 (check
with 'df -h' or )
sda2 ~122GB - not formatted - for 'raw' recording

If it's not formatted, see 4b..

Other info:
3. To check if SSD is detected:

3a.

> root@elphel393:~# cat /proc/partitions


3b.

> root@elphel393:~# dmesg


Example output:

> [   23.160946] ata1: SATA max UDMA/133 mmio [mem 0x8000-0x8fff]
> port 0x100 irq 163
> [   23.510004] ata1: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
> [   23.517599] ata1.00: ATA-9: TS128GMTS600, P1225CE, max UDMA/133
> [   23.523846] ata1.00: 250069680 sectors, multi 1: LBA48 NCQ (depth 0/32)
> [   23.532486] ata1.00: configured for UDMA/133
> [   23.541610] scsi 0:0:0:0: Direct-Access ATA  TS128GMTS600
> 5CE  PQ: 0 ANSI: 5
> [   23.555202] sd 0:0:0:0: Attached scsi generic sg0 type 0
> [   23.555418] sd 0:0:0:0: [sda] 250069680 512-byte logical blocks: (128
> GB/119 GiB)
> [   23.556425] sd 0:0:0:0: [sda] Write Protect is off
> [   23.556437] sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
> [   23.556545] sd 0:0:0:0: [sda] Write cache: enabled, read cache:
> enabled, doesn't support DPO or FUA
> [   23.583494]  sda: sda1 sda2
> [   23.591877] sd 0:0:0:0: [sda] Attached SCSI disk
> [   24.171488] random: nonblocking pool is initialized
> [   24.950555] EXT4-fs (sda1): recovery complete
> [   24.956238] EXT4-fs (sda1): mounted filesystem with ordered data mode.
> Opts: (null)


3c.

> root@elphel393:~# hdparm -I /dev/sda




4. Some information if you would like to reformat it:
4a. https://wiki.elphel.com/wiki/Format_SSD_MMC#SSD_or_USB
Mainly it's 2 programs: fdisk and mkfs

4b. http://192.168.0.9/format_disk.php

Let me know if you have any further questions or need more details.

Best regards,
Oleg Dzhimiev
Electronics Engineer
phone: +1 801 783  x124
Elphel, Inc.
___
Support-list mailing list
Support-list@support.elphel.com
http://support.elphel.com/mailman/listinfo/support-list_support.elphel.com