Please Help! .DAT file problem on 6d

[Rikoshet]

I hope this is the right subforum!
So: the camera stops recording with error 70, must reinset the battery to get it working again! The log is:
ASSERT: FALSE
at ./Memory/Memory.c:187, task ASIF
lv:1 mode:3


Magic Lantern version : v2.3.NEXT.2013Sep22.6D113
Mercurial changeset   : 223e924813e5+ (unified) tip
Built on 2013-09-22 15:54:35 UTC by user@D610.
Free Memory  : 379K + 418K

My problem is now I have 2 dat file (1.44GB and 1.73GB), can't edit atoms because Atom Inspector cant open it
(even if I change extension to mov or mp4)!
I need this files! Please help me to repair them!
Thanks!

[1%]

Whoa... holy hell. Only 400KB free memory? I have 1800KB free loading all modules.

The files are a raw H264 stream with no container. ... .264, etc.

http://forum.doom9.org/archive/index.php/t-129096.html

hmmm... ok, found your bug, wav is not freeing memory anymore.
... and fixed... use fio_malloc/tmp_malloc or bad things happen

on 7D, memory error, double free... 6D this.

[Rikoshet]

Thank you for your answer, 1%!
I tried solutions in that thread, none of these worked for me! I changed extension to *.264 and *.h264,
an even without extension-nothing! The video was shooted with default codec options! Those are a couple of
interviews from Fiera di Milano that I willy need! Do you think it will be possible to create a ffmpeg
version vor this kind of ML dat files?
Last try I did was using ffmpeg, this is the result:

riko-pc:~ rikomoon$ /Volumes/ADATA\ CH11/Raw\ h264/SnowLeopard_Lion_Mountain_Lion_15.08.2013/ffmpeg  -f h264 -i /Volumes/ADATA\ CH11/2013.10.04\ MIlano/Video/Intervista\ russi/Intervista\ russi\ 6d/MVI_9156.264 -vcodec copy angel.mp4
ffmpeg version 2.0.1 Copyright (c) 2000-2013 the FFmpeg developers
  built on Aug 15 2013 10:56:46 with llvm-gcc 4.2.1 (LLVM build 2336.11.00)
  configuration: --prefix=/Volumes/Ramdisk/sw --enable-gpl --enable-pthreads --enable-version3 --enable-libspeex --enable-libvpx --disable-decoder=libvpx --enable-libmp3lame --enable-libtheora --enable-libvorbis --enable-libx264 --enable-avfilter --enable-libopencore_amrwb --enable-libopencore_amrnb --enable-filters --enable-libgsm --arch=x86_64 --enable-runtime-cpudetect
  libavutil      52. 38.100 / 52. 38.100
  libavcodec     55. 18.102 / 55. 18.102
  libavformat    55. 12.100 / 55. 12.100
  libavdevice    55.  3.100 / 55.  3.100
  libavfilter     3. 79.101 /  3. 79.101
  libswscale      2.  3.100 /  2.  3.100
  libswresample   0. 17.102 /  0. 17.102
  libpostproc    52.  3.100 / 52.  3.100
[h264 @ 0x7fa633822c00] missing picture in access unit with size 1729462272
[h264 @ 0x7fa633822c00] no frame!
[h264 @ 0x7fa63381a600] Stream #0: not enough frames to estimate rate; consider increasing probesize
[h264 @ 0x7fa63381a600] decoding for stream 0 failed
[h264 @ 0x7fa63381a600] Could not find codec parameters for stream 0 (Video: h264): unspecified size
Consider increasing the value for the 'analyzeduration' and 'probesize' options
/Volumes/ADATA CH11/2013.10.04 MIlano/Video/Intervista russi/Intervista russi 6d/MVI_9156.264: could not find codec parameters

[1%]

What I did when this happened to me was open the files as .264 with

http://www.jongbel.com/atombox-studio-product1.html

I only used the demo then resaved the stream... they have a bunch of players, etc Try some under win, it won't let you run it in a virtual machine I believe.

Also might be worth posting on DOOM9 forum and getting those guys involved... when my card went belly up it would recover the .dat and the mov separately I have to see if I have any left as this needs a solution.

[Rikoshet]

How did you resaved it? There is no such a function in File menu.

Another bug (?):
video and audio is out of sync AND must use Rate stretch tool on audio trak (about 98%, depends on lenght),
all videos I shooted with that version of ML!

Yesterday I made a test with magiclantern-v2.3.NEXT.2013Oct07.6D113 until the card goes full, I have
3 splitted video files:
1. there is no audio
2. when the card becomes full I have error 04 AND the last one is a*.dat file+33KB *.mov file...

So this "*.dat file issue" is generic to all ML builds...hope not!

Developers, take a look at this please, I'm immediatly going to doom9 forum, but not shure if they can
help me/us, so may be you'll be able to make an utility....

[1%]

video and audio is out of sync AND must use Rate stretch tool on audio trak (about 98%, depends on lenght),

That happens, I think your audio is at 25P by default as sync function is away.

Yesterday I made a test with magiclantern-v2.3.NEXT.2013Oct07.6D113

Does mine have that too? Nightly doesn't have the audio fix.

33KB *.mov

This has your atoms and all that, look at a good mov and try to hex edit it together.

Dat files are an issue on everything, in fact they hang the player. Canon is very aggressive about deleting them too so watch out. Mainly you get to see them on digic V because it only writes at the end in case it has to split... it should be a raw H264 stream tho.

[Rikoshet]

I know magiclantern-v2.3.NEXT.2013Oct07.6D113 is not your build, but maybe you can quicker comunicate with developers...
Your build testing now!
 Oh, audio missing was my error, in earler build audio is disabled in canon menu by default and ML write
a separate wav file anyway, in this last builds, your and official, audio must be enabled in canon menu...

The font is white now... I love colored sutter speed/focal lenght/iso/etc indications!

[1%]

Nightly has no audio controls/headphone yet. It has wav but done the old way and still using the mem back end for it so after ~3min memory crash [and dat files ].

[Rikoshet]

Little problem on doom9 forum:
You are not allowed to post or reply until you have been registered for at least 5 days. 
I must finish this interviews until tomorrow evening... 

Ok, your [6D] 2013-10-05 version is ok, create 2 files, and the last one is a *.mov!  And audio
now is embedded, cool!

[1%]

Yea, plus I tested wav upto 20 mins, no crash.

Shit, I'll look for some dat files today or I'll run recovery on my card and try to find some old deleted MOV.

[Rikoshet]

You need a dat file? I did another test with magiclantern-v2.3.NEXT.2013Oct07.6D113 and i have a
101MB dat file. I can uploud it but maybe it is easier if you do same rec test:
left on car 4.3GB and push rec button, so you'll have a 4.26GB mov and a little dat file!

[Rikoshet]

I did a rude/rough test:
opened in hexedit my dat file an a good mov file and did a copy of "good" data to dat file, now I can import it to premiere but don't have entire image, look here:



Oh, I remember, the last frames were black!

[Rikoshet]

A curios thing:
after minimizing Premiere it shows me in preview another picture:



but exporting some seconds gives me same black picture with some pixels/squers on top of the picture...

[1%]

Yea, upload that 100MB dat. I think the movie has to be re-saved after you get something to read it. I wouldn't just import it into premiere.

[Rikoshet]

Try this:

https://www.dropbox.com/s/j94r5efq7kgupnm/MVI_9197.DAT

[1%]

Still stuck. The jongbel stuff expired and elecard won't open it.

It seems to have written from ¥¥¥¥¥¥¥¥... on a normal file the header is before that and then I think thumbnail. then data.

[Rikoshet]

Hi 1%! Any prgress?
May be I can help you? I have jongbel vor another 4-5 days, it can open this files but there are no atoms!
And I dont see how can I resave the file!

[1%]

It should have a save stream in one of the menus. I'll try again when I get my laptop and have a fresh OS to install the trial on.

[Rikoshet]

I have AtomBox Studio and Media Muxer an no Save option... 
Ok, I'll waiting your fresh install...
Thanks!

[1%]

There is also a H264 viewer that they have.

http://www.jongbel.com/h264-video-es-viewer-pro-product21.html

I think the option was under tools somewhere.

[Rikoshet]

1% I'll take a look at H264VideoESViewer_Trial but until I have some news!

http://aeroquartet.com/ is a Movie Repair Service and they have an utility: Treasured.app that allows you to see if
the video can be recovered! Look inside this app (show package contents) it uses some intresting utility!

So:
it opens dat file but has a strange color shift:



Ok, now, after I did a roughly copy/paste of initial data (header?) in hexedit my dat file looks like:



Ok, now I know that video is there, must find a way to recover it!
Aeroquartet is not an option, the price for repair a clip is 139$, I can not afford it!

Quicktime player can open it but the image is black! So there is some other things to do...

[1%]

The whole stream is there but all the meta data and lenght isn't.

[1%]

Do you have a reference movie that you recorded exactly like this? Preferably a small one.

[Rikoshet]

OK! All tis time I was looking for a solution, so if someone need it here is it:

http://fpvlab.com/forums/showthread.php?8654-How-to-repair-corrupted-MP4-files-from-a-GoPro.....for-free!

I'm shure there must be onother solutions, but I'll stop here my research, I'm tired...

Good night all!

[KurtAugust]

Ah! The joy of the Magic Lantern forum. The post above saved a friend's corrupted movie clip. It does help that Magic Lantern has made us all little hackers.