Headline news

Magic Lantern joins forces with Apertus to create THE ultimate open source camera. We need your help. NOW!

You can find our live webchat here: [email protected]

Author Topic: OSX: Batch Convert "App" for MLV files: DNG with WAVs and Metadata  (Read 9901 times)

dubzeebass

  • Supporter
  • Senior
  • *****
  • Posts: 251
Hello everyone,

This script is a joint effort from myself, Danne, g3gg0, jerrykil, daisermac.  It's tested as working on Mavericks.

1. Download all of the files here: https://drive.google.com/file/d/0B4tCJMlOYfircUtNdXVYZDJfQW8/edit?usp=sharing
2. Extract recursive0.4.command and mlv_dump.osx in the same folder
3. Double-click recursive0.4.command and type your administrator password then hit Enter.  This will only need to be done once as this should place your mlv_dump.osx in the folders called by the script.  mlv_dump will seem to disappear but it's just moved to usr/bin.  NOTE: If you get permission errors, use Terminal to go to the folder you extracted files from step #2, and write chmod +rxw recursive0.4.command - this will give all permissions needed)
4. Place your .mlv files in same folder as recursive0.4.command and double-click which should start converting the files to folders.  The MLV files will move to the folder with a corresponding name, and you'll have the .DNGs, a .WAV, a .IDX, and a .TXT (for metadata).

Tested with the latest build of mlv_dump.osx, mlv_rec and mlv_snd from 1/11/2014.

::[ Feature List ]::
- Extract all MLV files in a folder to folders based on the MLV name
- Create a WAV file from the MLV file
- Export the metadata as a TXT file
- Export the Take information to a separate [filename]-take.txt file (use IME module to input information)

::[ Version History ]::
0.4 - added TAKE text extraction
0.3 - added .IDX creation for proper .WAV extraction
0.2 - added FOR IN per g33go to recursively extract all MLV files in a directory
0.1 - created extraction script that only worked from the command line with minimal input


Respect!
-dubzee
« Last Edit: January 11, 2014, 06:11:27 PM by dubzeebass »

nick.p

  • Freshman
  • **
  • Posts: 93
OSX: Batch Convert "App" for MLV files: DNG with WAVs and Metadata
« Reply #1 on: December 30, 2013, 05:13:44 AM »
Thanks guys

Midphase

  • Hero Member
  • *****
  • Posts: 712
OSX: Batch Convert "App" for MLV files: DNG with WAVs and Metadata
« Reply #2 on: December 30, 2013, 07:51:18 AM »
Neato! Works as advertised over here, although I haven't tried the wav recording yet on my camera.

Thanks guys!

Danne

  • Supporter
  • Hero Member
  • *****
  • Posts: 1008
OSX: Batch Convert "App" for MLV files: DNG with WAVs and Metadata
« Reply #3 on: December 30, 2013, 12:03:34 PM »
Nice :)

Mike Bluestone

  • New to the forum
  • *
  • Posts: 4
OSX: Batch Convert "App" for MLV files: DNG with WAVs and Metadata
« Reply #4 on: December 30, 2013, 05:09:20 PM »
Does this support the 5D3 writing to separate cards?

Danne

  • Supporter
  • Hero Member
  • *****
  • Posts: 1008
OSX: Batch Convert "App" for MLV files: DNG with WAVs and Metadata
« Reply #5 on: December 30, 2013, 05:15:49 PM »
I, m not sure. Could you try?

Danne

  • Supporter
  • Hero Member
  • *****
  • Posts: 1008
OSX: Batch Convert "App" for MLV files: DNG with WAVs and Metadata
« Reply #6 on: December 30, 2013, 05:42:18 PM »
Just tried with spanning on and it seems converting fine with the script. Audio also
Also tried with files bigger the 4gb which splits files. Also seems to convert fine. Audio also

I did not test to sync the clips yet. Filmed in 1920x1080 24fps, audio on

dubzeebass

  • Supporter
  • Senior
  • *****
  • Posts: 251
OSX: Batch Convert "App" for MLV files: DNG with WAVs and Metadata
« Reply #7 on: December 30, 2013, 05:53:22 PM »
Yes that would work because it moves all files with the MLV date stamp.

Danne

  • Supporter
  • Hero Member
  • *****
  • Posts: 1008
OSX: Batch Convert "App" for MLV files: DNG with WAVs and Metadata
« Reply #8 on: December 30, 2013, 06:26:34 PM »
@dubzeebass
Would it be hard to include a ProRes export in the script? Using ffmpeg like with the raw2dng app?

dubzeebass

  • Supporter
  • Senior
  • *****
  • Posts: 251
OSX: Batch Convert "App" for MLV files: DNG with WAVs and Metadata
« Reply #9 on: December 30, 2013, 08:32:10 PM »
I don't need it cuz I use Resolve to transcode after MLV extraction and preliminary CC/WB ... but since this is a group effort I encourage anyone else to add to the script :)

Danson Delta-40

  • New to the forum
  • *
  • Posts: 25
  • GOING POSTAL SINCE 1995 - 7D FTW
OSX: Batch Convert "App" for MLV files: DNG with WAVs and Metadata
« Reply #10 on: December 31, 2013, 07:14:57 AM »
Problem getting permissions:

How the heck do i change directory, and when i think I did change it, it says it cant find the file...

This is what it says in terminal:
Kerricks-iMac:~ FlashPointFilms$ /Users/FlashPointFilms/Desktop/mlvdump chmod +rxw recursive.command0.3
-bash: /Users/FlashPointFilms/Desktop/mlvdump: is a directory
Kerricks-iMac:~ FlashPointFilms$ chmod +rxw recursive.command0.3
chmod: recursive.command0.3: No such file or directory
Kerricks-iMac:~ FlashPointFilms$



EDIT: Nvm Im stupid. You have to give permission to the ZIP file! I didnt initially see a "dl all" option so I dl'ed individually and tried it on the base command file. derp.

i hate coding.
« Last Edit: December 31, 2013, 07:32:55 AM by Danson Delta-40 »
GOING POSTAL SINCE 1995 BABY

Danne

  • Supporter
  • Hero Member
  • *****
  • Posts: 1008
OSX: Batch Convert "App" for MLV files: DNG with WAVs and Metadata
« Reply #11 on: December 31, 2013, 07:30:30 AM »
Did it work at any point?  I tried it on an external desktop and it converted fine here. What happens if you redo ALL the steps from the new directory?

Danson Delta-40

  • New to the forum
  • *
  • Posts: 25
  • GOING POSTAL SINCE 1995 - 7D FTW
OSX: Batch Convert "App" for MLV files: DNG with WAVs and Metadata
« Reply #12 on: December 31, 2013, 07:33:56 AM »
Did it work at any point?  I tried it on an external desktop and it converted fine here. What happens if you redo ALL the steps from the new directory?


I derped. Nothing new to report (I figured it out).
GOING POSTAL SINCE 1995 BABY

poromaa

  • Supporter
  • Freshman
  • *****
  • Posts: 96
OSX: Batch Convert "App" for MLV files: DNG with WAVs and Metadata
« Reply #13 on: January 02, 2014, 03:45:51 PM »
Is it possible to merge the wav with the video, creating a prores using ffmpeg?
cheers!

ouuzi

  • Freshman
  • **
  • Posts: 65
OSX: Batch Convert "App" for MLV files: DNG with WAVs and Metadata
« Reply #14 on: January 02, 2014, 03:54:23 PM »
I second that request!!

dubzeebass

  • Supporter
  • Senior
  • *****
  • Posts: 251
OSX: Batch Convert "App" for MLV files: DNG with WAVs and Metadata
« Reply #15 on: January 02, 2014, 06:01:57 PM »
The issue with doing so is that you'll end up with ProRes file with no white balance done and the files that come out of this don't have any white balance info from the camera (i.e., Sunlight/Cloudy/Tungsten), so your colours will be way off.

Resolve to learn Resolve, just for the initial CC even.

I invite anyone else to add to the script, but I don't need the ProRes files so can't spend any time on it.

gary2013

  • Hero Member
  • *****
  • Posts: 661
OSX: Batch Convert "App" for MLV files: DNG with WAVs and Metadata
« Reply #16 on: January 03, 2014, 02:17:08 AM »
sorry, I didn't mean to post here.
« Last Edit: January 03, 2014, 02:22:15 AM by gary2013 »

poromaa

  • Supporter
  • Freshman
  • *****
  • Posts: 96
OSX: Batch Convert "App" for MLV files: DNG with WAVs and Metadata
« Reply #17 on: January 03, 2014, 01:27:18 PM »
I know resolve and have used it for several years now, but I still need a more batch-like approach when working on my mac book air (yes, it's working with raw). Resolve is veeeery slow on my mac book air making any dng->prores very cumbersome. working with prores in AE or Premiere works like a charm and ideal (for me) would be to have a batch going from MLV -> Prores (w. correct WB) + audio.

I don't know how these formats work and how white balance is burned into prores but not dng (need to do some research there), however hasn't the white balance been saved in the "exif"info of the new MLV format?

Good work so far though!

dubzeebass

  • Supporter
  • Senior
  • *****
  • Posts: 251
OSX: Batch Convert "App" for MLV files: DNG with WAVs and Metadata
« Reply #18 on: January 03, 2014, 08:16:07 PM »
Thanks!

It has been saved incorrectly.  It doesn't read what the camera is using as a WB because raw with baked in WB isn't raw anymore.  There's a default WB which you can see when you open any of the DNGs my method creates.

You could batch export from Photoshop ACR but I don't think it'll be particularly fast.  As an aside, a MBA will encode ProRes incredibly slowly as well, there's no magic bullet for an integrated GPU and a low-end Intel chip.

poromaa

  • Supporter
  • Freshman
  • *****
  • Posts: 96
OSX: Batch Convert "App" for MLV files: DNG with WAVs and Metadata
« Reply #19 on: January 08, 2014, 08:01:51 PM »
No magic bullet, but I would appreciate not having to use the resolve GUI on my mac book air (takes minutes to just load it with dngs :) so, for me a batch approach would save time (the time I sleep :P )

timbytheriver

  • Freshman
  • **
  • Posts: 81
OSX: Batch Convert "App" for MLV files: DNG with WAVs and Metadata
« Reply #20 on: January 10, 2014, 07:13:54 PM »
Thank you for this @dubzeebass! :)

When I open the dngs in ACR I get the following on the top bar: 'Camera Raw 8.3 - ERR:1 md:0x   0 ml:0' and all I get offered [in ACR] is the embedded profile with crazy green w/b. I can correct for this, but I'd like to be able to use the VisionLOG profile as a quick option if this is possible.

Is there a way of ACR correctly reading camera ID from the dngs produced by your app?

Thank-you.

tim

« Last Edit: January 10, 2014, 07:21:49 PM by timbytheriver »

Danne

  • Supporter
  • Hero Member
  • *****
  • Posts: 1008
OSX: Batch Convert "App" for MLV files: DNG with WAVs and Metadata
« Reply #21 on: January 10, 2014, 07:30:43 PM »
The script reads the mlv_dump.osx. You should download the latest version from g3gg0 site and redo the procedure. It will give you a standard wb5500 I think.

@dubzeebass, If you,re out there please update the post with the latest mlv_dump.osx :)
Thanks!
/D

timbytheriver

  • Freshman
  • **
  • Posts: 81
OSX: Batch Convert "App" for MLV files: DNG with WAVs and Metadata
« Reply #22 on: January 10, 2014, 07:38:23 PM »
@Danne

Thanks for the advice! Does g3gg0 have an external site I should be going to for the latest mlv_dump?

Danne

  • Supporter
  • Hero Member
  • *****
  • Posts: 1008
OSX: Batch Convert "App" for MLV files: DNG with WAVs and Metadata
« Reply #23 on: January 10, 2014, 08:53:33 PM »
http://www.magiclantern.fm/forum/index.php?topic=7122.0

Where it says Here inside the package

timbytheriver

  • Freshman
  • **
  • Posts: 81
OSX: Batch Convert "App" for MLV files: DNG with WAVs and Metadata
« Reply #24 on: January 10, 2014, 08:59:00 PM »
Many thanks Danne!