Messages

Looks like 0.3.0 made a lot more sense!

[My workflow]

To make a better workflow for myself I created this windows app. Thought I should share it in case anyone else find it useful.

It's just i quick dev. No extensive testing done. No guarantee of anything. Use at your own risk! Only works on windows and is using raw2dng, dcraw and ffmpeg.

My workflow
As of version 0.3.0 I have tried to get this app to help me with my whole workflow which centers around Lightroom as RAW converter. Here is how I do it:
-Copy raw files to folder on local computer (SSD disk will improve conversion speed alot)
-Open RAWanizer, select folder, choose video settings and press start. This will extract dng from raw file, create proxy tiff files and a proxy video file.
-For a fast preview of the sequence, I choose tiff size half and mp4 option. This will give me a preview that I can use to decide which files to do real conversions for.
-Once I know which files I want to do deal with I have two options:

---Go to Lightroom or other raw converter and do conversion there. Export files as tiff and put them in 'tiff' sub folder to the dng folder (in Lightroom there is a nice option to do this easy)
---Go back to RAWanizer and choose 'video' instead of 'proxy video', select a higher quality video codec and hit start. This will give me a video file to work in my NLE.
---If I want to go back and change some settings in Lightroom I can do that and reexport to the same folder as before. Then open RAW anizer and just hit start again and it will replace the previously created video file. This will automatically have the clip in your NLE  get updated.

---OR

---Instead of lightroom, in RAWanizer I hit custom button which brings up a dialog for making settings for dcraw conversion. Tweak the settings and hit save. This is now the settings use for conversions. If I'm satisfied with the quality I choose to use a high quality codec and hit start. Now I have a file ready for my NLE

Important The 'video' settings to the left of start button has these meanings:
-Proxy video: Extracts the dng from raw file. Then creates tiff files from dng and finally creates a video file from the tiffs.
-Video: Looks for tiff files in 'tiff' sub folder in the dng subfolder and creates video file from them. Use this option if you have developed the dng in other converter.
-No video: Only extracts the dng from raw file. No tiffs created and no video file created.


Open the folder with raw files. Choose frame rate (for example 23.976) and size for proxy video. Click start and wait.

RAWanizer will create a sub folder for each raw file and put the dng files there. When proxy is created a sub folder in the dng folder will be created with tiffs. The final proxy video is created from the tiffs and put in the same folder as the original raw file. If there is a wav file with the same name as the raw file it will be included in the proxy video.

The proxy file generated can be either mp4 (5mbit) or DNxHD (185mbit). The mp4 file is created in the resolution of the tiff files.  Since DNxHD only supports two resolutions, the image is upscaled to 1920x1080 with black bars if not a perfect fit.

If people find it useful I might put some more time on it. What improvements would you like?

Download full install 0.6.0
Patch 0.6.1 Save .exe in previous installation folder.
If you have installed a previous version, when using full install, you have to use windows 'add and remove progam' to uninstall the previous version first. You may also be prompted to download and install .net 4.5 when you start the program for the first time.


version 0.6.1
-dng subfolder is named -dng instead of .dng so Resolve can recognize the files.

version 0.6.0
-fixed processing of multiple spanned files
-added option to save all dng files in same folder
-included the latest raw2dng

version 0.5.5
-added setting to delete dng files after video creation. For safety reasons this only works if original is a RAW file, not a Dng folder.
-added button to restore default presets
-some file handling bugfixes

version 0.5.4
-the settings are applied when processing starts and not when added to queue, this has confused some people so I hope this will help some, but now you can't get different settings for different files in the queue.

version 0.5.3
-bug fixes

version 0.5.2
-bug fixes
-use framrate from raw file when creating video

version 0.5.1
-automatic merging of split files (>4Gb) (there is a setting under file tab where you can choose to write to the original RAW file. This is faster, cleaner and the result is just one single RAW file. But if something fails along the way you probably end up with at corrupt RAW file, so use with caution, preferably a backup. If not checked it will create a new RAW file with prefix 'M-' and the originals will still be there, safer if you have no backup)
-some more options for dcraw conversions
-now possible to save more than one custom preset for dcraw, Cineform and video output.

version 0.5.0
-raw file meta data shown in file list.
-option to show first, middle and last thumbnail from the raw file before processing.
-clean up of UI.
-latest version of raw2dng included.

version 0.4.3
-New install with all needed files and some fixes. Hopefully the ffmpeg problem will be gone now.

version 0.4.2
-Fixed problem with path for Cineform tools. This folder could appear either under 'Cineform' or 'Gopro'. You can now also set custom path under 'folder settings' if you have it installed in a different folder.

version 0.4.1
-For the Cineform batch processing I'm now throwing up console window so the progress can be examined and aborted by closing the console window. This is temporary as I hope to find another way to deal with it.

version 0.4.0
-Batch processing for Gopro Cineform. You have to download and install Gopro Cineform studio + a small utility. Follow the instructions here: http://www.magiclantern.fm/forum/index.php?topic=5479.msg41378#msg41378
-For the Cineform batch processing, the top progressbar is not working (detailed progress for each clip). You have to wait and see...

version 0.3.3
-Possible to open a single dng folder
-Fixed bug when starting program and last folder used had been removed
-Increased responsiveness when previewing dcraw settings

version 0.3.2
-tried to get rid of some users program crash

version 0.3.1
-Added possibility to set custom folders to override default structure
-Initial attempt for 'watch folder'. When this is activated, new raw files copied to that folder will automatically start processing.

version 0.3.0
-Add date time prefix to raw file name
-UI much more responsive and cancel works almost all the time
-More options for managing files and processing
-Now possible to use custom dcraw converter settings
-UI to help create custom dcraw settings
-Use custom ffmpeg settings for video file
-Create video file from tiff sub folder that can be populated by your favorite raw converter (lightroom, ps)

version 0.2.1
-added DNxHD as an option for the proxy file

version 0.2.0
-using multiple instances of dcraw to increase speed of dng to tiff conversion. You can change no of instances to find optimal for your computer.


Known Issues:
- Does not work with file names containing spaces or other special characters

In version 0.6.1 there is no option for converting to Video all I can get it proxy files. I keep getting the error: No video sequence folder found... Sorry if I am doing something noob!

Hi I have been having some real issues getting RAW to work and only just succeeded by putting my FPS down to 25 from 30. Now I get continuous RAW recording. This in on a Canon 50D btw. So I see the 50D can only do around 70mb/s I guess this is the problem?

My benchmark ALWAYS crashes in movie mode so I had to take a photo:
https://skydrive.live.com/redir?resid=347C6A875030A01A!136&authkey=!ALOn3gOFMXestu0&v=3


Here is the one taken in playback mode:
https://skydrive.live.com/redir?resid=347C6A875030A01A!137&authkey=!AFCcdvuBvkWCa8U&v=3

But it playback it goes up to over 100mb/s?
I am confused.

On the 50D are we limited to 70mb/s? This is making sense now.
So I turned the FPS down to 25 FPS and it works! :-)
When it is on 30fps it tells me I need 70mb/s write speeds and I guess this is the max for the buss so it cannot do this continually!
Now I have to decide which card to return the one from the states or the one I just got today from Amazon.

It still seems a bit low on both the cards I wish someone would confirm with me this is the reason for my issues.

What mode did you do your benchmarks in?

"EOSHD
My Komputer Bay Benchmarks
« Reply #53 on: June 14, 2013, 07:01:50 PM »

Your 128GB results are invalid as you ran the benchmark in playback mode. Run it in movie mode with live view enabled to get an accurate impression of how it will perform during raw recording. You will find it is slow - around 70MB/s, pretty much all the 128GB KomputerBay cards are. The 64GB cards are fastest."



I'm just guessing here, but you said yourself that you are overwhelmed by the amount of options and I know I was at first, so I'd advise you hold off on returning until you are sure you haven't overlooked something. What resolution / ratio are you recording at? You need to go through the ML settings and switch off everything that you are unsure of and trawl through the site for the relevant info.

NOOOO!!!
I just got another card delivered and its the same results if not slightly better.
What do you mean play back mode?
I didnt press the play symbol underneath the live view screen before I ran the benchmark?

This is really frustrating me now. I have to send back the first card even though it seems it might not have been faulty in the end.
I have seen benchmarks for the 32gb cards go high.

What else could it be? I have deactivated everything I can in the ML settings. I turned off RAW photos in the Canon menu.

I am getting about 650 frames until the buffer maxes out. Surely there is more I can try? I bought this second card directly from amazon so I doubt its faulty.

WHat other settings do I need to tweak?

Ok so it looks like I have a dud card:
http://www.magiclantern.fm/forum/index.php?topic=5510.0

I thought so. The absolute maximum I have seen my card achieve is 70mb/s for a brief second.
Its definitely not up to scratch... So now I have to return it to USA :-(

I will test when  my new card arrives and then I will know for sure if it was the card.

You would have to check the 50D threads for specific info about camera and card speed, but the advertised 150 MBs is theoretical and dependent on the device it is used in. I don't think the 50D is anywhere near capable of that, so benchmark your card with your computer via USB 3 if you can.

There are certain camera settings that make the raw module more stable such as disabling raw photos and adjusting the display in the Canon menu. Also in the raw module of ML (on the builds I use) there is a 'small hacks' setting and 'card warm up'. There are probably more I have forgotten, but it's really a case of you trying them out for yourself and seeing what works for you.

Where are these module settings are they in the ML firmware or do I have to edit the files on the CF Card?

I do not have access to USB 3 on a computer at the moment. But I thought I had seen people post screen shots from their 50D card benchmark and it showed around 100mb/s. What sort of write speed should I expect? I have already ordered a new card and opened a case on ebay to return the current one.. 

Have you benchmarked your card and read up about optimizing your camera for raw?

Hey thanks for replying!
I only just realized there was a disk benchmark in ML and I tested yesterday it seemed to max our at around 60-70mb/s so I think I have been sold a dud card that is no 150mb/s..

What do you mean by optimizing my camera for raw please?

Ok so I did a completely fresh installation and now I get more frames recorded but it still turns off. I dont get it someone help pleeeaaaseee 

I only get a few seconds recording before the buffer maxes out and I get the message. "Recording has been automatically stoppped".
I have a Komputerbay card so why is it only allowing me roughly 45mb/s bitrates before it closes itself down?
I have made a post about it if anyone can please help me. maybe reply on that instead of here or PM me please.. Many thanks!

I solved the script dir missing issue just by creating the script directory in the cf card

Ok so it seems the buffer usage is maxing out. But I have a fast CF card?? It seems to max out at about 45mb/s??
I dont have a fast card reader to test if this card is the fault or not! Any other reason why the buffer would max out?

Sometimes it changes what it says in the raw menu settings after it stops recording. It says Expect 88 frames at 33-37mb/s now?

Hi I am completely overwhelmed by my new camera the 50D. I came from a gh2 and I still dont fully know how to use the Canon interface and now I am learning ML aswell. I have installed the module for raw and it changed the menu and gave me the option to shoot raw. BUT Shooting stops after 66 frames and when I go back to the raw settings in the menu it says. Expect around 66 frames at 20-22mb/s. I also get the error at start up "script dir missing"... I have  a Komputer bay x1000 card? What am I doing wrong? It does not appears to be filling its buffer fully?

I would really appreciate any help here to get me started so I can experiment with some raw video..
Many thanks!
Dom.