Messages

My problem has already been fixed, but for future reference, I indicated I had the wrong build - this is my correct build.

Nightly.2014May22.5D3113

@bouncyball

BTW audio level is very low

I indicated that I used a Zoom H1 and short boom mic connected to the mic jack of my Canon 5D3, but that was wrong. For this particular shot I recorded, I didn't use a mic, instead I used the built in mic of the camera. So I did the below to increase the audio level, which I will make sure to keep for future shoots.

I corrected this by entering my Canon 5D's menu (not MLV's) and going to the SHOOT4 window, to Sound recording, and setting Rec level to 75% (it was previously set to 25%). The audio level seems normal now based on audio meter levels.

I've also Enabled Wind Filter to see if it would help - I need to test extensively to verify.

And Sound Rec. is set to Manual, as it was previously.

@Danne:
Tested mlv_dump_on_steriods with altered Script you provided and it works like a charm! Thank you for that!
I can run it once inside a folder with all my .mlv files and it converts and organizes without a problem.

I'm still using OSX Mountain Lion 10.8.5 (I know, it's really old and I'll have to upgrade soon).
It works well with Davinci Resolve 10 Lite and Adobe CS6. Tried the upgrade to El Capitan to use Resolve 11 and 12, but too many little issues with CS6 and not enough good reasons to use Resolve 11/12 turned me away. But when I upgrade to Sierra or above, I'm going to try the Mac Switch.

@Danne
Thank you for your mlv_dump also - I downloaded and tried yours as well and it works great!

Thanks again to EVERYONE for all your great help!

I took out the .osx as you instructed and it worked! Thank you @dfort!
Also took out the -m option as well.

How can I make this script recursive?

Code Select Expand

workingDir=`dirname "$0"`
cd "${workingDir}"

sudo mv ./mlv_dump /usr/bin/mlv_dump
sudo chmod +x /usr/bin/mlv_dump

for FILE in `ls -A1 *.MLV *.mlv 2>/dev/null`; do
    BASE=`echo $FILE | cut -d "." -f1`;
    mkdir $BASE;
    mv ./"$BASE".M* ./$BASE
    cd ./$BASE
    /usr/bin/mlv_dump -x $FILE
    /usr/bin/mlv_dump --dng -o ${BASE}_frame_ $FILE
    /usr/bin/mlv_dump -o meta.mlv $FILE
    /usr/bin/mlv_dump -v meta.mlv >$FILE.txt
    rm ./meta.mlv
    rm ./meta.mlv.wav
    cd ..
done

@dfort
Thank you very much for compiling the new and working mlv_dump! I hope to increase my IQ to be able to do that.

IT WORKS!!! Thank you so much @a1ex, @Danne and @dfort!!!

All frames are rendered, audio too, from beginning to end.

Is there a command to create a folder (M15-0904) to put all .dng from (M15-0904.MLV + M15-0904.M00) into it automatically and do the same for all other clips?

I've been using the script below, which made it easier to convert 20-30 files at once and keep them organized.

I tried it, but the conversion stops at frame 780.

Code Select Expand

workingDir=`dirname "$0"`
cd "${workingDir}"

sudo mv ./mlv_dump.osx /usr/bin/mlv_dump
sudo chmod +x /usr/bin/mlv_dump

for FILE in `ls -A1 *.MLV *.mlv 2>/dev/null`; do
    BASE=`echo $FILE | cut -d "." -f1`;
    mkdir $BASE;
    mv ./"$BASE".M* ./$BASE
    cd ./$BASE
    /usr/bin/mlv_dump -x $FILE
    /usr/bin/mlv_dump --dng -o ${BASE}_frame_ $FILE
    /usr/bin/mlv_dump -m -o meta.mlv $FILE
    /usr/bin/mlv_dump -v meta.mlv >$FILE.txt
    rm ./meta.mlv
    rm ./meta.mlv.wav
    cd ..
done

Again, I'm still learning... I'm sure I'm doing something wrong.

I downloaded mlv_dump.osx under Last Successful Artifact provided by g3gg0 here.

And @a1ex patch - mlv_dump_bruteforce-v2.patch

Tried to run patch, but failed:

patch < mlv_dump_bruteforce-v2.patch

File to patch: mlv_dump.osx
patching file mlv_dump.osx
Hunk #1 FAILED at 448.
Hunk #2 FAILED at 1239.
Hunk #3 FAILED at 2155.
Hunk #4 FAILED at 4112.
4 out of 4 hunks FAILED -- saving rejects to file mlv_dump.osx.rej

@Danne
Thanks for that, I'll study compiling macintosh docs to get a better understanding of this stuff.

@dfort
I missed that! I'm uploading M15-0904.M00 now (it's 1.4 GB) and will post link shortly.

@a1ex
I haven't had this problem for 3 years using the build I have with same camera and settings, CF cards and Mac OSX 10.85. Could I have some virus or a conflicting software that's affecting this?

@ bouncyball

BTW audio level is very low)

I need to update to latest build - but what I have now only allows me to adjust speaker level (which is set to 3). I'll need to test with level 4 or 5 once I get this issue settled. Latest build may be updated, so I'll look into that.

I recorded with short boom mic into Zoom H1 which was routed into my Canon 5D3 via mic port. Levels looked normal on screen, but your right, the audio is a little too soft.

Ok, so I tried @Danne's mlv_dump and it's an improvement!

I don't know how to run the patch, which I probably need.

Rendered frames 1-1343 and 1582-2090 (frame 2090 is the end, so missing 238 continuous frames)

These are the errors I got:

Code Select Expand

MLV Dumper
-----------------

Mode of operation:
   - Input MLV file: 'M15-0904.MLV'
   - Using output path 'M15-0904_' for DNGs
   - Convert to DNG frames
   - Output into 'M15-0904_'
File M15-0904.MLV opened
File M15-0904.M00 opened
File M15-0904.M01 not existing.
Processing...
Unknown Block: %%, skipping
Next known block: NULL at 0x7db66ae0+0x280 = 0x7db66d60
[ERROR] Invalid block size at position 0xd95feae0
Next known block: NULL at 0xe15feaf0+0x270 = 0xe15feaf0
[ERROR] Invalid block size at position 0xe15feaf0
Next known block: NULL at 0xe95feb00+0x11a260 = 0xe95feb00
[ERROR] Invalid block size at position 0xe95feb00
Next known block: NULL at 0xf15feb10+0x233fd0 = 0xf15feb10
[ERROR] Invalid block size at position 0xf15feb10
Next known block: NULL at 0xf95feb20+0xb9240 = 0xf95feb20
[ERROR] Invalid block size at position 0xf95feb20
Next known block: NULL at 0xfff1a260+0x1d2fb0 = 0xfff1a260

Reached end of chunk 1/2 after 3512 blocks
[ERROR] Invalid block size at position 0x00a538b4
Next known block: NULL at 0xa538c4+0x270 = 0xa53b34
[ERROR] Invalid block size at position 0x012128b4
Next known block: NULL at 0x12128c4+0x270 = 0x1212b34
[ERROR] Invalid block size at position 0x0173c8b4

Code Select Expand

Next known block: NULL at 0x512c28c4+0x270 = 0x512c2b34
[ERROR] Invalid block size at position 0x517ec8b4
Next known block: NULL at 0x517ec8c4+0x270 = 0x517ecb34
[ERROR] Invalid block size at position 0x51d168b4
Next known block: NULL at 0x51d168c4+0x270 = 0x51d16b34
[ERROR] Invalid block size at position 0x522408b4
Next known block: NULL at 0x522408c4+0x270 = 0x52240b34

Reached end of chunk 2/2 after 1532 blocks
Processed 1853 video frames at 24.00 FPS (77.21 s)
Done


Thanks for all of your diligent investigating of this problem!

Bare with me, I'm still learning my ABC's...

I tried to run the patches @a1ex and @Danne provided. I'm unsure if this the correct command?

Code Select Expand

mlv_dump patch < patch.patch M15-0904.MLV

Cause I got this error...

MLV Dumper v1.0
-----------------

Mode of operation:
   - Input MLV file: 'patch'
   - Verify file structure
[ERROR] Failed to open file 'patch'


Then got message from @Danne and since I'm on a MAC, I ran unix2dos command, but...

My mac (OSX 10.85) doesn't recognize unix2dos. Researched online and found [url https://brew.sh/]Homebrew[/url] to allow me to use unix2dos, but wouldn't install. Does anyone know why? Or is there another way of doing this?

Code Select Expand

==> Downloading and installing Homebrew...
curl: (35) error:1407742E:SSL routines:SSL23_GET_SERVER_HELLO:tlsv1 alert protocol version
Failed during: /bin/bash -o pipefail -c '/usr/bin/curl -fsSL https://github.com/Homebrew/brew/tarball/master | /usr/bin/tar xz -m --strip 1'

Here it is...


M15-0904.MLV

Thanks for the mlv_dump via email.

It didn't make it past the same frame.

./mlv_dump --dng --relaxed M15-0904.MLV

MLV Dumper
-----------------

Mode of operation:
   - Input MLV file: 'M15-0904.MLV'
   - Using output path 'M15-0904_' for DNGs
   - Convert to DNG frames
   - Output into 'M15-0904_'
File M15-0904.MLV opened
File M15-0904.M00 opened
File M15-0904.M01 not existing.
Processing...
Unknown Block: %%, skipping
[ERROR] Invalid block size at position 0x7dd46afe
Processed 777 video frames at 24.00 FPS (32.38 s)
Done

Uploading 4GB affected file to Google Drive - another 1.5 hrs left. I'll provide link shortly.

I used 3x different KomputerBay CF cards 128GB 1000x cards and also tested problem with 3x different 64GB 1000x cards. Nearly every clip would only convert up to around 45-55 seconds and spit out 1-4 frames at the end of clip.

Is there something wrong with my CF cards?

MLV Dumper v1.0
-----------------

Mode of operation:
   - Input MLV file: 'M15-0904.MLV'
   - Verify file structure
   - Output .idx file for faster processing
File M15-0904.MLV opened
File M15-0904.M00 opened
Processing...
Unknown Block: %%, skipping
Unknown Block: ;?H, skipping
Reached end of chunk 1/2 after 2059 blocks
Unknown Block: ?, skipping
Reached end of chunk 2/2 after 10 blocks
Processed 781 video frames
XREF table contains 1286 entries
File M15-0904.IDX opened for writing
Done

Hey dfort! We're neighbors! Yeah, we should meet up! How do I PM you? Sorry for being clueless 

Regarding the KomputerBay CF cards, I used 3x 128GB 1000x cards on the day of the shoot 4 days ago. I noticed that nearly every clip I converted that was over 45 seconds, would cut off around 45-55 seconds. And only 1-4 frames were converted at the end of the clip.
I tested 3x other KomputerBay CF cards I haven't used in nearly 3 years that are all 64GB 1000x cards, and these also are cutting off around 45-55 seconds from the beginning of the clip.
Do you think it's still a CF card error if all 6 cards are doing the same thing?

I'd love to try an updated mlv-dump to test the "--relaxed" command, but I can't seem to find anything for OSX that's more recent than v1.0 - can you point me in the right direction?

Is there a way to fix this problem via a hex editor? I researched the forum and read that some who've encountered corrupt frames or blocks were able to manipulate the data to pull out most or all of their affected footage. One topic that stood out for me is located here:

https://www.magiclantern.fm/forum/index.php?topic=13653.0

Could this route work? If so, what data should I manipulate and to what data should it be changed to?

Regarding the 80 min feature film...
I am completing the website for the film and have trailers ready to go, which I'll have available to watch via the website, YouTube and Vimeo shortly. I am preparing for its launch - 3 yrs in the making. I'll be sure to share it here because it was shot entirely with MLV RAW on my Canon 5D3. What a God send!!!

Regarding MLV work flow...
Shot MLV RAW on Canon 5D3
Quick color and proxy output from Davinci Resolve 10 Lite into Premiere Pro CS6
Roundtrip to Davinci once PPro edit was locked
Final color in Davinci
Final audio work in Audition CS6
Output Cinema DNG sequence from Davinci into After Effects CS6 for effects/fixes/titles etc.
Output final from AE with final audio (5.1 and stereo)
I can also create DCP, which I've tested in a theater with a small clip of the film, from AE

(I"ll post this in its proper place - just wanted to introduce myself and explain why I'm here)

Been using ML since 2015 and shot an 80 min feature with ML + Canon 5D3. Have had great success and results!!! Haven't changed build since shooting feature film - since it worked without any problems.

Until now... I'm getting Unknown Block errors after 1 day shoot using same build, CF cards and settings on Canon 5D3. Tried transferring files from CF card to 3x different USB 3.0 HD and 1x SSD via 2x different USB 3.0 ports, but no change in errors.

MLV Dumper v1.0
-----------------

Mode of operation:
   - Input MLV file: 'M15-0904.MLV'
   - Rewrite MLV
   - Output into 'meta.mlv'
File M15-0904.MLV opened
File M15-0904.M00 opened
File M15-0904.IDX opened (XREF)
XREF table contains 1286 entries
Processing...
Unknown Block: ?, skipping
Unknown Block: %%, skipping
Unknown Block: ;?H, skipping
Reached end of all files after 1286 blocks
Processed 781 video frames
Done

logout

[Process completed]


I hope I can salvage the 30% remaining unconverted footage.

Regardless, I'd like to THANK THE MAGIC LANTERN WIZARDS for existing for all of us independent filmmakers!!!

Canon 5D Mark III / KomputerBay 1000x 128GB CF
ML for 5d3 2014.01.08 Build
Firmware Version 1.1.3-ml-v2.3