Author Topic: Problem with playing back whole raw card (Read 9388 times)

dfgh · « **on:** November 08, 2017, 08:41:41 PM »

Hello!

I've used magic lantern a fair bit for lots of different shoots but today I've come across a new problem. I have a whole card of footage that will not playback or export. MLrawviewer just will not open any of the files from that card.

Can anyone shed light on this, as I obviously really need this footage, or I will have reschedule a reshoot.

bpv5P · « **Reply #1 on:** November 08, 2017, 09:19:38 PM »

The data is probably there, since the file is not empty.
Try another software, so you can confirm that it's not a MLrawViewer issue. If none of them can open it, try to put the card back in camera, turn on the file_man module and try to playback the .RAW file inside the camera. If the preview works, then you're data is actually there, but for some reason you can't read it. In that case, it would be needed more information about your system (maybe the filesystem is read-only?)...

Kharak · « **Reply #2 on:** November 08, 2017, 09:30:08 PM »

It is most likely because your card is Full to the brim. MLrawviewer creates MRX (metadata) files and makes new WAV-"sidecar" files on the side of each MLV (2x audio files). If your card is Maxed out, there is no space for MLRawViewer to playback/export the files.

Copy/cut one MLV to your computer and the that should be enough space to play the rest of the files on the card.

dfgh · « **Reply #3 on:** November 08, 2017, 09:46:10 PM »

I've tried other software and tried rewriting the hex data with another hexcode I've found on the forum. The former ( other software ) doesn't work and the latter opens the file, but in a scrambled mess.

I'm viewing these on my computer, they've been copied over

I've had this happen before on files at the end of space on a card, but never on every file on that card that played fine in the camera

I viewed the files in ML on the camera after I recorded them.

bpv5P · « **Reply #4 on:** November 08, 2017, 10:18:08 PM »

So, you can play the file inside the camera, but cannot extract the dng from the .raw file?
If that's the case, then the data corruption hypothesis is not the problem. If you make sure you really can't process it with the latest raw2dng, then the problem is also not on the processing software. You also said you copied the files to the computer, so it's read-write.
Considering your hardware is performing well and the software (operating system) is also OK (could try in another computer?), I can't see the solution, sorry. Maybe some developer have the answer...

dfgh · « **Reply #5 on:** November 08, 2017, 10:20:41 PM »

I have a lot of other files from other cards today and they're all playing fine. It's just every one this particular card dump, doesn't open. If I alter the hex footer then they open, but scrambled, with various frames from what I shot blended in.

Danne · « **Reply #6 on:** November 08, 2017, 10:23:16 PM »

You can try transcoding them in program Switch. In there you can convert to MLV and see if that works better. Or just transcode your RAW files directly.

dfgh · « **Reply #7 on:** November 08, 2017, 10:27:41 PM »

Thanks Danne, I'll give this a go

dfort · « **Reply #8 on:** November 08, 2017, 10:32:41 PM »

You are still shooting "RAW" version 1.0 files? There have been so many updates and changes since that format was retired. You should really update your Magic Lantern workflow.

The only way anyone can help you is if you could upload one of these files. Yeah, they're huge so try to pick the smallest .RAW file. Maybe convert to MLV and trim before uploading? You can also do that in Switch. Don't know if that will work.

dfgh · « **Reply #9 on:** November 08, 2017, 10:40:53 PM »

Quote from: Danne on November 08, 2017, 10:23:16 PM

You can try transcoding them in program Switch. In there you can convert to MLV and see if that works better. Or just transcode your RAW files directly.

Doesn't seem to want to work
Doesn't produce any files.

Code: [Select]

M06-1238.RAW
/tmp/DUALISO/RAW_demolish
/tmp/DUALISO/RAW_demolish
/tmp/DUALISO/RAW_demolish
/tmp/DUALISO/RAW_demolish
/tmp/DUALISO/RAW_demolish
/tmp/DUALISO/RAW_demolish
/tmp/DUALISO/RAW_demolish
/tmp/DUALISO/RAW_demolish
/tmp/DUALISO/RAW_demolish
/tmp/DUALISO/RAW_demolish
/tmp/DUALISO/RAW_demolish
/tmp/DUALISO/RAW_demolish
/tmp/DUALISO/RAW_demolish
/tmp/DUALISO/RAW_demolish
/tmp/DUALISO/RAW_demolish
/tmp/DUALISO/RAW_demolish
/tmp/DUALISO/RAW_demolish
/tmp/DUALISO/RAW_demolish
/tmp/DUALISO/RAW_demolish
/tmp/DUALISO/RAW_demolish
/tmp/DUALISO/RAW_demolish
/tmp/DUALISO/RAW_demolish
/tmp/DUALISO/RAW_demolish
/tmp/DUALISO/RAW_demolish
/tmp/DUALISO/RAW_demolish
/tmp/DUALISO/RAW_demolish
/tmp/DUALISO/RAW_demolish
/tmp/DUALISO/RAW_demolish
ls: /tmp/DUALISO/RAW_demolish: No such file or directory
/tmp/DUALISO/RAW
01_legacy_RAW_to_MLV
M06-1238.RAW
M06-1241.RAW
M06-1243.RAW
M06-1248.RAW
M06-1250.RAW
M06-1255.RAW
M06-1256.RAW
M06-1300.RAW
M06-1301.RAW
M06-1307.RAW
M06-1308.RAW
M06-1337.RAW
M06-1338.RAW
M06-1339.RAW
M06-1340.RAW
M06-1342.RAW
Error: This ain't a lv_rec RAW file


Found file M06-1238.RAW
--- End of sequence ---
M06-1241.RAW
M06-1243.RAW
M06-1248.RAW
M06-1250.RAW
M06-1255.RAW
M06-1256.RAW
M06-1300.RAW
M06-1301.RAW
M06-1307.RAW
M06-1308.RAW
M06-1337.RAW
M06-1338.RAW
M06-1339.RAW
M06-1340.RAW
M06-1342.RAW
Error: This ain't a lv_rec RAW file


Found file M06-1241.RAW
--- End of sequence ---
M06-1243.RAW
M06-1248.RAW
M06-1250.RAW
M06-1255.RAW
M06-1256.RAW
M06-1300.RAW
M06-1301.RAW
M06-1307.RAW
M06-1308.RAW
M06-1337.RAW
M06-1338.RAW
M06-1339.RAW
M06-1340.RAW
M06-1342.RAW
Error: This ain't a lv_rec RAW file


Found file M06-1243.RAW
--- End of sequence ---
M06-1248.RAW
M06-1250.RAW
M06-1255.RAW
M06-1256.RAW
M06-1300.RAW
M06-1301.RAW
M06-1307.RAW
M06-1308.RAW
M06-1337.RAW
M06-1338.RAW
M06-1339.RAW
M06-1340.RAW
M06-1342.RAW
Error: This ain't a lv_rec RAW file


Found file M06-1248.RAW
--- End of sequence ---
M06-1250.RAW
M06-1255.RAW
M06-1256.RAW
M06-1300.RAW
M06-1301.RAW
M06-1307.RAW
M06-1308.RAW
M06-1337.RAW
M06-1338.RAW
M06-1339.RAW
M06-1340.RAW
M06-1342.RAW
Error: This ain't a lv_rec RAW file


Found file M06-1250.RAW
Found file M06-1250.R00
--- End of sequence ---
M06-1255.RAW
M06-1256.RAW
M06-1300.RAW
M06-1301.RAW
M06-1307.RAW
M06-1308.RAW
M06-1337.RAW
M06-1338.RAW
M06-1339.RAW
M06-1340.RAW
M06-1342.RAW
Error: This ain't a lv_rec RAW file


Found file M06-1255.RAW
--- End of sequence ---
M06-1256.RAW
M06-1300.RAW
M06-1301.RAW
M06-1307.RAW
M06-1308.RAW
M06-1337.RAW
M06-1338.RAW
M06-1339.RAW
M06-1340.RAW
M06-1342.RAW
Error: This ain't a lv_rec RAW file


Found file M06-1256.RAW
--- End of sequence ---
M06-1300.RAW
M06-1301.RAW
M06-1307.RAW
M06-1308.RAW
M06-1337.RAW
M06-1338.RAW
M06-1339.RAW
M06-1340.RAW
M06-1342.RAW
Error: This ain't a lv_rec RAW file


Found file M06-1300.RAW
--- End of sequence ---
M06-1301.RAW
M06-1307.RAW
M06-1308.RAW
M06-1337.RAW
M06-1338.RAW
M06-1339.RAW
M06-1340.RAW
M06-1342.RAW
Error: This ain't a lv_rec RAW file


Found file M06-1301.RAW
--- End of sequence ---
M06-1307.RAW
M06-1308.RAW
M06-1337.RAW
M06-1338.RAW
M06-1339.RAW
M06-1340.RAW
M06-1342.RAW
Error: This ain't a lv_rec RAW file


Found file M06-1307.RAW
--- End of sequence ---
M06-1308.RAW
M06-1337.RAW
M06-1338.RAW
M06-1339.RAW
M06-1340.RAW
M06-1342.RAW
Error: This ain't a lv_rec RAW file


Found file M06-1308.RAW
--- End of sequence ---
M06-1337.RAW
M06-1338.RAW
M06-1339.RAW
M06-1340.RAW
M06-1342.RAW
Error: This ain't a lv_rec RAW file


Found file M06-1337.RAW
Found file M06-1337.R00
--- End of sequence ---
M06-1338.RAW
M06-1339.RAW
M06-1340.RAW
M06-1342.RAW
Error: This ain't a lv_rec RAW file


Found file M06-1338.RAW
--- End of sequence ---
M06-1339.RAW
M06-1340.RAW
M06-1342.RAW
Error: This ain't a lv_rec RAW file


Found file M06-1339.RAW
--- End of sequence ---
M06-1340.RAW
M06-1342.RAW
Error: This ain't a lv_rec RAW file


Found file M06-1340.RAW
--- End of sequence ---
M06-1342.RAW
Error: This ain't a lv_rec RAW file


Found file M06-1342.RAW
--- End of sequence ---

Danne · « **Reply #10 on:** November 08, 2017, 10:45:07 PM »

Seems something corrupted as you said.
You seem to be one of tha last RAW format shooters around

dfgh · « **Reply #11 on:** November 08, 2017, 10:47:02 PM »

Yeah, I only shot it because I find MLV doesn't perform long takes on my camera very well for some reason.

The question is, can I reverse this corruption

bpv5P · « **Reply #12 on:** November 08, 2017, 10:50:48 PM »

I don't think that's corruption, else it wouldn't decode inside the camera... have you tried to check if your copy is exactly what's on the card (using a hashing algorithm, for example)? Maybe while you were doing the copy it just corrupted. The 7zip has a simple checksum tool, try it, please.

dfgh · « **Reply #13 on:** November 08, 2017, 10:56:36 PM »

The card is now formatted and was used later in the day unfortunately, so I can't check it but it was playing the files as I viewed them back
How do I perform the 7zip checksum?

Danne · « **Reply #14 on:** November 08, 2017, 11:02:46 PM »

Quote

Yeah, I only shot it because I find MLV doesn't perform long takes on my camera very well for some reason.

Tried mlv_lite and 12bit mode for instance?

bpv5P · « **Reply #15 on:** November 08, 2017, 11:04:19 PM »

You can't now, since the original file is gone (hash algorithms create a unique number for a file, so you can make sure it's not alterated)...

tl;dr unless someone appear with a magical solution or you have the skills to fix the file yourself (it would take too much time and effort to even consider), the files can't be converted. Better reschedule a reshoot. Make sure to use MLV module instead now. Magic Lantern is experimental, sometimes things can go bad.

dfort · « **Reply #16 on:** November 08, 2017, 11:25:16 PM »

Quote from: dfort on November 08, 2017, 10:32:41 PM

The only way anyone can help you is if you could upload one of these files.

Still applies.

dfgh · « **Reply #17 on:** November 08, 2017, 11:28:37 PM »

Ok I'll do that

dfgh · « **Reply #18 on:** November 08, 2017, 11:51:17 PM »

This is what I get from raw2dng

raw2dng converter GUI for OsX
Beta ver.0.13

M06-1342 File Supported
Error: This ain't a lv_rec RAW file

Generating ProResHQ 4444 with FPS:
*.dng: No such file or directory
ffmpeg version 1.2.1-tessus Copyright (c) 2000-2013 the FFmpeg developers
built on May 9 2013 21:58:14 with llvm-gcc 4.2.1 (LLVM build 2336.1.00)
configuration: --prefix=/Users/tessus/data/ext/ffmpeg/sw --as=yasm --extra-version=tessus --disable-shared --enable-static --disable-ffplay --enable-gpl --enable-pthreads --enable-postproc --enable-libmp3lame --enable-libtheora --enable-libvorbis --enable-libx264 --enable-libxvid --enable-libspeex --enable-bzlib --enable-zlib --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libxavs --enable-version3 --enable-libvo-aacenc --enable-libvo-amrwbenc --enable-libvpx --enable-libgsm --enable-libopus --enable-fontconfig --enable-libfreetype --enable-libass --enable-filters --enable-runtime-cpudetect
libavutil 52. 18.100 / 52. 18.100
libavcodec 54. 92.100 / 54. 92.100
libavformat 54. 63.104 / 54. 63.104
libavdevice 54. 3.103 / 54. 3.103
libavfilter 3. 42.103 / 3. 42.103
libswscale 2. 2.100 / 2. 2.100
libswresample 0. 17.102 / 0. 17.102
libpostproc 52. 2.100 / 52. 2.100
[image2pipe demuxer @ 0x10281f400] Could not parse framerate: .
pipe:0: Invalid argument
Done

bpv5P · « **Reply #19 on:** November 09, 2017, 12:18:12 AM »

The raw2dng can't read it. The header is probably fucked.
Can you reproduce this error? Other files recorded with this camera gets the same error?
You could send the file as @dford suggested, if it's not something that require strict privacy. Compression with LZMA2 can be done with 7zip (again), so it will take less time to upload.

dfgh · « **Reply #20 on:** November 09, 2017, 12:40:26 AM »

I am currently uploading but it's going to take a few hours. I have copied and pasted hex footer data from a working clip into the footer of a clip that doesn't work and I got it to load up albeit pink fuzzy and distorted, so I have some hope there's a solution

dfort · « **Reply #21 on:** November 09, 2017, 01:32:18 AM »

Have you tried this yet?

Quote from: ted ramasola on April 03, 2014, 07:35:29 AM

try using chmee's raw2cdng, it seems to have a better tolerance when i have a corrupt first frame from my file and the raw to dng converters, browse sharp and tonybeccar's windows dng converter and rawanizer can't convert them, the cdng converter always get past the corruption and convert the file, including the corrupt frames.

dfgh · « **Reply #22 on:** November 09, 2017, 05:24:35 AM »

I haven't tried those dfort thanks, I'll give them a go.

In the meantime here is a RAW to download https://wetransfer.com/downloads/4331bcf5c6beb4abb4553b8ca57633c520171108223510/caf5e097adf10e503ea522c0804a3f2920171108223510/37fe82

Danne · « **Reply #23 on:** November 09, 2017, 05:33:43 AM »

Downloading. Meanwhile, chew on this:
http://www.magiclantern.fm/forum/index.php?topic=5732.msg41099#msg41099

*Update
Seems corrupted. Just for fun I commented out following in raw2dng.c to see what comes out of raw2dng:

Code: [Select]

    if (strncmp((char*)lv_rec_footer.magic, "RAWM", 4))
        FAIL("This ain't a lv_rec RAW file\n");
    
    if (raw_info.api_version != 1)
        FAIL("API version mismatch: %d\n", raw_info.api_version);

Gives the following info. Not even exiftool could fix this one

:

Code: [Select]

Resolution  : 44486 x 38704
Frames      : 1252570185
Frame size  : 340438548 bytes
FPS         : 3182729.412
Black level : -1592480841
White level : 67810884

Processing frame 1 of 1252570185 Segmentation fault: 11
dans-MBP:lv_rec dan$

You should try the replace footer solution.

*Update
http://www.magiclantern.fm/forum/index.php?topic=5732.msg41179#msg41179
Added the 8gb footer above and out comes dng files however all are corrupted:

dfgh · « **Reply #24 on:** November 09, 2017, 06:01:44 AM »

By copying this from and pasting it in the footer

Code: [Select]

AAAA5555AAAAAAAA55555555AAAA5555AAAA5555AAAAAAAA55555555AAAA5555AAAA5555AAAAAAAA55555555AAAA5555AAAA5555AAAAA
AAA55555555AAAA5555AAAA5555AAAAAAAA55555555AAAA5555AAAA5555AAAAAAAA55555555AAAA5555AAAA5555AAAAAAAA55555555AAAA555
5AAAA5555AAAAAAAA55555555AAAA5555AAAA5555AAAAAAAA55555555AAAA5555AAAA5555AAAAAAAA555555555241574D80073804006037004A
02000001000000A8610000D8470400000000000100000000A0314D2605000020080000380E0000503449000E000000FE070000983A000000000000
000000008C0700000A0500001C00000092000000260500001E08000000000000000000000001010201000000421A00001027000085FDFFFF102700
003DFCFFFF1027000041EFFFFF10270000AC30000010270000EC0700001027000074FCFFFF1027000072080000102700002416000010270000F4030
000

I can get MLviewer to play it, but it's distorted and sectioned into pink bits and a bit of normal colour, so the footage is certainly there

News:

Author Topic: Problem with playing back whole raw card (Read 9388 times)