Hello everyone,
This script is a joint effort from myself, Danne, g3gg0, jerrykil, daisermac. It's tested as working on Mavericks.
1. Download all of the files here: https://drive.google.com/file/d/0B4tCJMlOYfircUtNdXVYZDJfQW8/edit?usp=sharing
2. Extract recursive0.4.command and mlv_dump.osx in the same folder
3. Double-click recursive0.4.command and type your administrator password then hit Enter. This will only need to be done once as this should place your mlv_dump.osx in the folders called by the script. mlv_dump will seem to disappear but it's just moved to usr/bin. NOTE: If you get permission errors, use Terminal to go to the folder you extracted files from step #2, and write chmod +rxw recursive0.4.command - this will give all permissions needed)
4. Place your .mlv files in same folder as recursive0.4.command and double-click which should start converting the files to folders. The MLV files will move to the folder with a corresponding name, and you'll have the .DNGs, a .WAV, a .IDX, and a .TXT (for metadata).
Tested with the latest build of mlv_dump.osx, mlv_rec and mlv_snd from 1/11/2014.
::[ Feature List ]::
- Extract all MLV files in a folder to folders based on the MLV name
- Create a WAV file from the MLV file
- Export the metadata as a TXT file
- Export the Take information to a separate [filename]-take.txt file (use IME module to input information)
::[ Version History ]::
0.4 - added TAKE text extraction
0.3 - added .IDX creation for proper .WAV extraction
0.2 - added FOR IN per g33go to recursively extract all MLV files in a directory
0.1 - created extraction script that only worked from the command line with minimal input
Respect!
-dubzee
Thanks guys
Neato! Works as advertised over here, although I haven't tried the wav recording yet on my camera.
Thanks guys!
Nice :)
Does this support the 5D3 writing to separate cards?
I, m not sure. Could you try?
Just tried with spanning on and it seems converting fine with the script. Audio also
Also tried with files bigger the 4gb which splits files. Also seems to convert fine. Audio also
I did not test to sync the clips yet. Filmed in 1920x1080 24fps, audio on
Yes that would work because it moves all files with the MLV date stamp.
@dubzeebass
Would it be hard to include a ProRes export in the script? Using ffmpeg like with the raw2dng app?
I don't need it cuz I use Resolve to transcode after MLV extraction and preliminary CC/WB ... but since this is a group effort I encourage anyone else to add to the script :)
Problem getting permissions:
How the heck do i change directory, and when i think I did change it, it says it cant find the file...
This is what it says in terminal:
Kerricks-iMac:~ FlashPointFilms$ /Users/FlashPointFilms/Desktop/mlvdump chmod +rxw recursive.command0.3
-bash: /Users/FlashPointFilms/Desktop/mlvdump: is a directory
Kerricks-iMac:~ FlashPointFilms$ chmod +rxw recursive.command0.3
chmod: recursive.command0.3: No such file or directory
Kerricks-iMac:~ FlashPointFilms$
EDIT: Nvm Im stupid. You have to give permission to the ZIP file! I didnt initially see a "dl all" option so I dl'ed individually and tried it on the base command file. derp.
i hate coding.
Did it work at any point? I tried it on an external desktop and it converted fine here. What happens if you redo ALL the steps from the new directory?
Quote from: Danne on December 31, 2013, 07:30:30 AM
Did it work at any point? I tried it on an external desktop and it converted fine here. What happens if you redo ALL the steps from the new directory?
I derped. Nothing new to report (I figured it out).
Is it possible to merge the wav with the video, creating a prores using ffmpeg?
cheers!
I second that request!!
The issue with doing so is that you'll end up with ProRes file with no white balance done and the files that come out of this don't have any white balance info from the camera (i.e., Sunlight/Cloudy/Tungsten), so your colours will be way off.
Resolve to learn Resolve, just for the initial CC even.
I invite anyone else to add to the script, but I don't need the ProRes files so can't spend any time on it.
sorry, I didn't mean to post here.
I know resolve and have used it for several years now, but I still need a more batch-like approach when working on my mac book air (yes, it's working with raw). Resolve is veeeery slow on my mac book air making any dng->prores very cumbersome. working with prores in AE or Premiere works like a charm and ideal (for me) would be to have a batch going from MLV -> Prores (w. correct WB) + audio.
I don't know how these formats work and how white balance is burned into prores but not dng (need to do some research there), however hasn't the white balance been saved in the "exif"info of the new MLV format?
Good work so far though!
Thanks!
It has been saved incorrectly. It doesn't read what the camera is using as a WB because raw with baked in WB isn't raw anymore. There's a default WB which you can see when you open any of the DNGs my method creates.
You could batch export from Photoshop ACR but I don't think it'll be particularly fast. As an aside, a MBA will encode ProRes incredibly slowly as well, there's no magic bullet for an integrated GPU and a low-end Intel chip.
No magic bullet, but I would appreciate not having to use the resolve GUI on my mac book air (takes minutes to just load it with dngs :) so, for me a batch approach would save time (the time I sleep :P )
Thank you for this @dubzeebass! :)
When I open the dngs in ACR I get the following on the top bar: 'Camera Raw 8.3 - ERR:1 md:0x 0 ml:0' and all I get offered [in ACR] is the embedded profile with crazy green w/b. I can correct for this, but I'd like to be able to use the VisionLOG profile as a quick option if this is possible.
Is there a way of ACR correctly reading camera ID from the dngs produced by your app?
Thank-you.
tim
The script reads the mlv_dump.osx. You should download the latest version from g3gg0 site and redo the procedure. It will give you a standard wb5500 I think.
@dubzeebass, If you,re out there please update the post with the latest mlv_dump.osx :)
Thanks!
/D
@Danne
Thanks for the advice! Does g3gg0 have an external site I should be going to for the latest mlv_dump?
http://www.magiclantern.fm/forum/index.php?topic=7122.0
Where it says Here inside the package
Many thanks Danne!
pop-corn. >:(
Quote from: Danne on January 10, 2014, 08:53:33 PM
http://www.magiclantern.fm/forum/index.php?topic=7122.0
Where it says Here inside the package
@Danne Have installed the new mlv_dump, but am still getting the same error in ACR, and only embedded camera profile available.
Do I perhaps need to purge the old version of mlv_dump somehow from usr/ ? Terminal is showing:
MLV Dumper v1.0
-----------------
Sorry to be a pain!
UPDATE: This has now been fixed by me doing a clean install of ML on the CF card. Not sure where the problem was... :o
Not sure whats going on here. Could be acr. Gotta try myself when I get home.
You can put older mlv dumps in the script workflow if they work
Tried. Works fine in acr 8.2 mavericks adobe cs6 over here.
@Danne Thanks for checking. Maybe it's a weird gremlin in my ACR 8.3/CC/Osx 10.7.5 setup... :o
PS Just out of interest, does your ACR report your camera ID correctly i.e 'Canon 5D MkII' (or whatever) in the top bar?
Does your dng works when working with raw instead of mlv?
You mean mlv > raw > dng ?
I haven't tried that – not sure how actually (yet) :-[
Regular raw recordings and ectracted dng, s, not mlv. Is there any difference in the dngs for you?
Oh, I see. Yes indeed – dngs extracted from a normal raw file work fine in various apps (RawMagic, raw2dng, raw2Cdng) reporting the ID as either 'Canon 5D2 Mk II' or 'Canikon'
It's only mlv that's giving me the error in the dng tag. :/
I'd post on the relevant mlv thread for exploration by the coders. Will update original post later thanks Danne.
Cool dubzeebass.
@timbytheriver
Put up the question in the main mlv thread by g3gg0. Be very specific.
//D
@Danne Thanks.
Have continued the post here for anyone who's following: http://www.magiclantern.fm/forum/index.php?topic=7122.msg95511#msg95511
UPDATE: This has now been fixed by me doing a clean install of ML on the CF card. Not sure where the problem was... :o
Hi,
I have the following situation :
Mode of operation:
- Input MLV file: 'M13-1054.mlv'
- Convert to DNG frames
- Output into 'M13-1054_frame_'
[ERROR] Failed to open file 'M13-1054.mlv'
MLV Dumper v1.0
-----------------
Mode of operation:
- Input MLV file: 'M13-1054.mlv'
- Rewrite MLV
- Output into 'meta.mlv'
[ERROR] Failed to open file 'M13-1054.mlv'
[ERROR] Failed to open file 'meta.mlv'
rm: ./meta.mlv: No such file or directory
rm: ./meta.mlv.wav: No such file or directory
rm: ./M13-1054.IDX: No such file or directory
logout
I followed all instructions .... please help.
Thanks
Did you run it in same directory as the MLV file?
If so there's something wrong with your file and mlv_dump can't open it... Make sure you've got the latest archive from the original post and last MLV_DUMP
how can i batch process in windows?
Hi dubzeebass,
yes i did. I copie the MLV file iim the same directory.
My OS X version in 10.8.5.
Magic Lantern Version is 2.3 (december).
Camera : 5D MKIII
When double click on MLV file only two empty TXT file are generated.
What do you think ?
Try running mlv_dump from the terminal in the same folder as: ./mlv_dump --dng filename.mlv
Let me know if it dumps.
Cross question from the other "Feature Request: Batch Convert MLV files to DNG" thread:
is there a way for me to set a specific destination folder, by altering or adding a line to the script?
I tried variations of altering the mkdir, mv, and cd lines to a specific folder but had no luck. The folder was made thanks to mkdir but all the .dngs just got dumped in in the same folder the .mlv was in.
By now I am copying .mlv files from the CF Card to a certain folder and then run the script in there. As the folder is on an external hdd, the time for the copying process and mlv_dump to process the files could be greatly reduced by reading from one disk and writing to another.
Any help is deeply appreciated, the same way all your work already is.
Thank you very much in advance
have all dng, the mlv file and the two txt files but no "WAV" file!!! why?
i get this error!!!
Quoterm: ./meta.mlv.wav: No such file or directory
logout
is sound enabled in camera? Both module and in ML menu?
Quote from: Danne on January 19, 2014, 02:13:36 AM
is sound enabled in camera? Both module and in ML menu?
in ml menü? i use my rode microphone. bevor i make the mlv raw.. i creat normal hd with canon without ml.. then i start to make one raw mlv to see the difference.
how i can start audio too and how i can now make i video from the DNG files?
Well there,s a lot of links to follow but if you know how to film and enable raw modules you should be able to do the same to mlv.
I would suggest to follow this link and start reading
http://www.magiclantern.fm/forum/index.php?topic=7122.msg96859#msg96859
The first page of the link has the sound module and the mlv module needed to record audio (a wav file) which you have to synch in post.
Good luck
Danne thanks for stepping in whenever people ask for help. I don't have the time nor patience for people who don't RTFM.
8)
yeah, know exactly what you mean ;)
Does anyone have problems with "access privileges" opening or better not opening file recursive0.4.command?
I getting error:
The file "recursive0.4.command" could not be executed because you do not have appropriate access privileges.
To view or change access privileges, select the file in the Finder and choose File > Get Info.
But all privileges in the file are set to Read & Write.
You have to follow the steps in the first post.
"NOTE: If you get permission errors, use Terminal to go to the folder you extracted files from step #2, and write
chmod +rxw recursive0.4.command - this will give all permissions needed)"
.
My folder is on my desktop and I do following. Check the uploaded picture
In terminal I write as follows:
cd desktop (enter)
cd mlvaudio (enter)
chmod +rxw recursive0.4.command (enter)
(http://s29.postimg.org/4avakia6v/Ska_rmavbild_2014_01_29_kl_13_10_51.png)
.
problems with dng previews
http://www.magiclantern.fm/forum/index.php?topic=9727.0
This script gives dng-files, feel free to modify the script to get raw or something else.
Sorry for low post count, long time viewer but never needed to contribute before. Been using batch convert and i'm finding that it works great - the only issue is the recorded .wav file alway stops after 0:49 seconds, which is when the .mlv file stops and the .mo1 file begins. Is anyone else having this issue, and is there a fix that anyone is aware of?
Really sorry, card spanning was on and i didn't notice :-[. I can confirm that MLV_REC and MLV_SND are working perfectly on the 5dmkiii
Keep up the awesome work guys!
I tested this :
1— MLVBrowseSharp / DNG+Wav
2— MLVBrowseSharp / RAW+Wav / + RAWMagic / DNG
There is a small difference between both:
1— DNG are a bit more grainy, more regular. (usable in ACR. Unusable with with Resolve 9, maybe it is on 10, I have to try)
2— DNG are less clean in the low area (more strange colors). The grain is less visible in the mid-high area. (Usable on both ACR and Resolve 9)
This "app" is great, but is there any way to generate CDNG instead of regular DNG?
While Resolve can see DNG file sequences, as of right now Premiere is unable to import them. While I suspect that Premiere's support for CDNG is only going to get better, I doubt that it will support regular DNG files in the future.
To Midphase and g3gg0
Yes, and it would be more simple if the RAWMagic App could include the MLV files and not only Raw (for a CDNG option) because, even if MLVBroweSharp is a great App, I noticed the RAWMagic is really faster.
Do you think it's possible ?
Wrong thread bud go talk to the RAWMagic creator :-)
What about my inquiry?
many thanks! worked just fine :)
Hi eyeryone, I am new here and having some problems trying to double-click recursive0.4.command file.. I don't have enough permission to open it. When I go then in my terminal and follow the instructions it's saying this: Mac-Mini-Mark-Bakker:~ markbakkerlicht$ /Users/markbakkerlicht/Desktop/mlv chmod +rxw recursive0.4.command
-bash: /Users/markbakkerlicht/Desktop/mlv: is a directory
Mac-Mini-Mark-Bakker:~ markbakkerlicht$
I don't know what to do, tried everything..
I am not really a wizard in these thing, can someone please help?
Thanx
Check reply #53
Thank you so much! It finally worked! I was doing it wrong by typing 'Bureaublad' instead of 'Desktop' because I thought I had to write it in my own language.. It's gonna be a lovely sundaymorning!!
Cheers
Folks, my development on this will cease as of today.
Recommend using: http://www.magiclantern.fm/forum/index.php?topic=10466
March 22, 2014 note: working on dumping to another folder.
I'm back ... g3ggo or danne, do either of you know how we could code this to have the MLVs dumped to a folder say on the user's desktop without moving the entire MLV over there, then dumping?
That way people could run the command from on their CF card and dump to another drive.
Hi Dubzeebass and welcome back :) I have no idea on this unfortunately.
Great to hear that development on this "app" will continue. This has been my go-to for MLV conversion for a while now. No issues whatsoever. Vertical stripe correction is really helpful.
The only addition that I'd like to see (and I understand this to be very complicated from the other conversion threads) is if the WAV file could be automatically associated with footage in Resolve.
Quote from: QuickHitRecord on March 22, 2014, 09:08:44 PM
Great to hear that development on this "app" will continue. This has been my go-to for MLV conversion for a while now. No issues whatsoever. Vertical stripe correction is really helpful.
The only addition that I'd like to see (and I understand this to be very complicated from the other conversion threads) is if the WAV file could be automatically associated with footage in Resolve.
Thanks man, glad to hear you find value in this. I'm not sure how we could incorporate the auto associate since I'm not clear on how to embed the metadata. I've been manually associating in Resolve. Time consuming but what ya gonna do!