Magic Lantern Forum

Using Magic Lantern => Raw Video => Raw Video Postprocessing => Topic started by: marten on May 21, 2013, 03:32:46 PM

Title: RAWanizer - windows batch generation of video files from RAW
Post by: marten on May 21, 2013, 03:32:46 PM
To make a better workflow for myself I created this windows app. Thought I should share it in case anyone else find it useful.

It's just i quick dev. No extensive testing done. No guarantee of anything. Use at your own risk! Only works on windows and is using raw2dng, dcraw and ffmpeg.

My workflow
As of version 0.3.0 I have tried to get this app to help me with my whole workflow which centers around Lightroom as RAW converter. Here is how I do it:
-Copy raw files to folder on local computer (SSD disk will improve conversion speed alot)
-Open RAWanizer, select folder, choose video settings and press start. This will extract dng from raw file, create proxy tiff files and a proxy video file.
-For a fast preview of the sequence, I choose tiff size half and mp4 option. This will give me a preview that I can use to decide which files to do real conversions for.
-Once I know which files I want to do deal with I have two options:

---Go to Lightroom or other raw converter and do conversion there. Export files as tiff and put them in 'tiff' sub folder to the dng folder (in Lightroom there is a nice option to do this easy)
---Go back to RAWanizer and choose 'video' instead of 'proxy video', select a higher quality video codec and hit start. This will give me a video file to work in my NLE.
---If I want to go back and change some settings in Lightroom I can do that and reexport to the same folder as before. Then open RAW anizer and just hit start again and it will replace the previously created video file. This will automatically have the clip in your NLE  get updated.

---OR

---Instead of lightroom, in RAWanizer I hit custom button which brings up a dialog for making settings for dcraw conversion. Tweak the settings and hit save. This is now the settings use for conversions. If I'm satisfied with the quality I choose to use a high quality codec and hit start. Now I have a file ready for my NLE

Important The 'video' settings to the left of start button has these meanings:
-Proxy video: Extracts the dng from raw file. Then creates tiff files from dng and finally creates a video file from the tiffs.
-Video: Looks for tiff files in 'tiff' sub folder in the dng subfolder and creates video file from them. Use this option if you have developed the dng in other converter.
-No video: Only extracts the dng from raw file. No tiffs created and no video file created.
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fbitbucket.org%2Fbjurhulta%2Frawanizer-release%2Fdownloads%2FRAWanizer.0.3.0.JPG&hash=64d3dc79922796504e9bed164a6d170a)

Open the folder with raw files. Choose frame rate (for example 23.976) and size for proxy video. Click start and wait.

RAWanizer will create a sub folder for each raw file and put the dng files there. When proxy is created a sub folder in the dng folder will be created with tiffs. The final proxy video is created from the tiffs and put in the same folder as the original raw file. If there is a wav file with the same name as the raw file it will be included in the proxy video.

The proxy file generated can be either mp4 (5mbit) or DNxHD (185mbit). The mp4 file is created in the resolution of the tiff files.  Since DNxHD only supports two resolutions, the image is upscaled to 1920x1080 with black bars if not a perfect fit.

If people find it useful I might put some more time on it. What improvements would you like?

Download full install 0.6.0 (https://bitbucket.org/bjurhulta/rawanizer-release/downloads/RAWanizerSetup.0.6.0.exe)
Patch 0.6.1 (https://bitbucket.org/bjurhulta/rawanizer-release/downloads/RAWanizer.exe) Save .exe in previous installation folder.
If you have installed a previous version, when using full install, you have to use windows 'add and remove progam' to uninstall the previous version first. You may also be prompted to download and install .net 4.5 when you start the program for the first time.


version 0.6.1
-dng subfolder is named -dng instead of .dng so Resolve can recognize the files.

version 0.6.0
-fixed processing of multiple spanned files
-added option to save all dng files in same folder
-included the latest raw2dng

version 0.5.5
-added setting to delete dng files after video creation. For safety reasons this only works if original is a RAW file, not a Dng folder.
-added button to restore default presets
-some file handling bugfixes

version 0.5.4
-the settings are applied when processing starts and not when added to queue, this has confused some people so I hope this will help some, but now you can't get different settings for different files in the queue.

version 0.5.3
-bug fixes

version 0.5.2
-bug fixes
-use framrate from raw file when creating video

version 0.5.1
-automatic merging of split files (>4Gb) (there is a setting under file tab where you can choose to write to the original RAW file. This is faster, cleaner and the result is just one single RAW file. But if something fails along the way you probably end up with at corrupt RAW file, so use with caution, preferably a backup. If not checked it will create a new RAW file with prefix 'M-' and the originals will still be there, safer if you have no backup)
-some more options for dcraw conversions
-now possible to save more than one custom preset for dcraw, Cineform and video output.

version 0.5.0
-raw file meta data shown in file list.
-option to show first, middle and last thumbnail from the raw file before processing.
-clean up of UI.
-latest version of raw2dng included.

version 0.4.3
-New install with all needed files and some fixes. Hopefully the ffmpeg problem will be gone now.

version 0.4.2
-Fixed problem with path for Cineform tools. This folder could appear either under 'Cineform' or 'Gopro'. You can now also set custom path under 'folder settings' if you have it installed in a different folder.

version 0.4.1
-For the Cineform batch processing I'm now throwing up console window so the progress can be examined and aborted by closing the console window. This is temporary as I hope to find another way to deal with it.

version 0.4.0
-Batch processing for Gopro Cineform. You have to download and install Gopro Cineform studio + a small utility. Follow the instructions here: http://www.magiclantern.fm/forum/index.php?topic=5479.msg41378#msg41378
-For the Cineform batch processing, the top progressbar is not working (detailed progress for each clip). You have to wait and see...

version 0.3.3
-Possible to open a single dng folder
-Fixed bug when starting program and last folder used had been removed
-Increased responsiveness when previewing dcraw settings

version 0.3.2
-tried to get rid of some users program crash

version 0.3.1
-Added possibility to set custom folders to override default structure
-Initial attempt for 'watch folder'. When this is activated, new raw files copied to that folder will automatically start processing.

version 0.3.0
-Add date time prefix to raw file name
-UI much more responsive and cancel works almost all the time
-More options for managing files and processing
-Now possible to use custom dcraw converter settings
-UI to help create custom dcraw settings
-Use custom ffmpeg settings for video file
-Create video file from tiff sub folder that can be populated by your favorite raw converter (lightroom, ps)

version 0.2.1
-added DNxHD as an option for the proxy file

version 0.2.0
-using multiple instances of dcraw to increase speed of dng to tiff conversion. You can change no of instances to find optimal for your computer.


Known Issues:
- Does not work with file names containing spaces or other special characters
Title: Re: RAWanize - batch generation of proxy files from RAW
Post by: Stedda on May 21, 2013, 03:54:23 PM
Great work and thanks for sharing!
Title: Re: RAWanize - windows batch generation of proxy files from RAW
Post by: Jakobmen on May 21, 2013, 05:02:09 PM
wow thank you ) can we have it make DNxHD files =) ?
Title: Re: RAWanize - windows batch generation of proxy files from RAW
Post by: hjfilmspeed on May 21, 2013, 06:03:49 PM
Thank you soooo much!!!! Havent tried it yet but sounds awesome
Title: Re: RAWanize - windows batch generation of proxy files from RAW
Post by: Andy600 on May 21, 2013, 06:08:20 PM
Great work! it half works for me (which is still ok). I get as far as TIFF conversion but it doesn't create a proxy (Win7 64bit)
Title: Re: RAWanize - windows batch generation of proxy files from RAW
Post by: noisyboy on May 21, 2013, 06:36:45 PM
Coooooool :) Thanks!
Title: Re: RAWanize - windows batch generation of proxy files from RAW
Post by: marten on May 21, 2013, 06:41:38 PM
Great work! it half works for me (which is still ok). I get as far as TIFF conversion but it doesn't create a proxy (Win7 64bit)

Hmm. I run it on win7 64-bit myself. So can you see the created TIFF files in the tiff sub folder in the dng sub folder?
Title: Re: RAWanize - windows batch generation of proxy files from RAW
Post by: marten on May 21, 2013, 06:48:20 PM
Great work! it half works for me (which is still ok). I get as far as TIFF conversion but it doesn't create a proxy (Win7 64bit)

Did you rename the RAW file to something other then M000000x.RAW ? Looked at my code and could see this would break it. Sorry. Will try to fix it soon.
Title: Re: RAWanize - windows batch generation of proxy files from RAW
Post by: Andy600 on May 21, 2013, 06:50:47 PM
@marten - Yes, I can see the TIFFs. Everything seems to work apart from making the proxy. I haven't altered the raw name. BTW, are these uncompressed TIFFs, if yes, this is probably the fastest way to get files into Davinci Resolve  :)
Title: Re: RAWanize - windows batch generation of proxy files from RAW
Post by: marten on May 21, 2013, 07:19:17 PM
@marten - Yes, I can see the TIFFs. Everything seems to work apart from making the proxy. I haven't altered the raw name. BTW, are these uncompressed TIFFs, if yes, this is probably the fastest way to get files into Davinci Resolve  :)

Yes, they are uncompressed tiffs. BUT, the dng converter is not making good quality conversions. Haven't tested with so many different settings yet, but I would go with a real raw converter for the final footage. I see these more as proxies for viewing and cutting not to do grading from.

To bad it wasn't the naming of the file. Will see if I can find something else.
Title: Re: RAWanize - windows batch generation of proxy files from RAW
Post by: Andy600 on May 21, 2013, 07:23:41 PM
An error did come up when I first ran RAWanize but hasn't since. I'll reboot to see if I can cause it to happen again.
Title: Re: RAWanize - windows batch generation of proxy files from RAW
Post by: mjneubrander on May 21, 2013, 07:30:49 PM
I worked on a batch file. Similar thing but outputs prores4444. You could make a prores4444 or DNxHD file from your tiffs as an option aside from mp4 using ffmbc. It would make a great check-box option for those who feel like editing prores. I also found encoding a prores4444 file was not significantly more intensive than mp4.

I call ffmbc for prores4444 it using
ffmbc -threads 16 -r 23.976 -i 0%%05d.tiff -vcodec prores -pix_fmt yuv444p10 movie.mov
I have not tried DNxHD yet.

Are you using color correction in your dcraw call? If so what gain and brightness are you using?

Are you using the multithreaded dcraw? http://www.heliconsoft.com/heliconsoft-products/dcraw/

Does your program issue multiple decoding processes (raw2dng -> dcraw -> ffmpeg) at simultaneously, or does it process them sequentially? My batch file is limited to sequential and I never got the hang of programming :(.

FFMBC main site.
http://code.google.com/p/ffmbc/

The two key commands from the batch file I worked on
[spoiler]
/f "usebackq delims=|" %%f in (`dir /b "%CD%\*.dng"`) do dcraw -v -r 2 1 1.75 1 -H 2 -T -b 3.5 -4 %%f
ffmbc -threads 16 -r 23.976 -i 0%%05d.tiff -vcodec prores -pix_fmt yuv444p10 %~n1.mov
[/spoiler]
or see the thread
http://www.magiclantern.fm/forum/index.php?topic=5528.0
Title: Re: RAWanize - windows batch generation of proxy files from RAW
Post by: marten on May 21, 2013, 07:43:33 PM
I worked on a batch file. Similar thing but outputs prores4444. You could make a prores4444 or DNxHD file from your tiffs as an option aside from mp4 using ffmbc. It would make a great check-box option for those who feel like editing prores. I also found encoding a prores4444 file was not significantly more intensive than mp4.

I call ffmbc for prores4444 it using
ffmbc -threads 16 -r 23.976 -i 0%%05d.tiff -vcodec prores -pix_fmt yuv444p10 movie.mov
I have not tried DNxHD yet.

Are you using color correction in your dcraw call? If so what gain and brightness are you using?

Are you using the multithreaded dcraw? http://www.heliconsoft.com/heliconsoft-products/dcraw/

Does your program issue multiple decoding processes (raw2dng -> dcraw -> ffmpeg) at simultaneously, or does it process them sequentially? My batch file is limited to sequential and I never got the hang of programming :(.

FFMBC main site.
http://code.google.com/p/ffmbc/

The two key commands from the batch file I worked on
[spoiler]
/f "usebackq delims=|" %%f in (`dir /b "%CD%\*.dng"`) do dcraw -v -r 2 1 1.75 1 -H 2 -T -b 3.5 -4 %%f
ffmbc -threads 16 -r 23.976 -i 0%%05d.tiff -vcodec prores -pix_fmt yuv444p10 %~n1.mov
[/spoiler]
or see the thread
http://www.magiclantern.fm/forum/index.php?topic=5528.0

It was my plan to expand the available codecs once I got the conversion process stable. So they will be coming.

No, I'm not using multithreaded dcraw. I tried it, but it didn't give me much better results. However, I'm currently working on another solution to speed it up. Coming soon I hope.

Thanks for your tips and feed back. Hopefully most of them will be done soon. :)
Title: Re: RAWanizer - windows batch generation of proxy files from RAW
Post by: marten on May 21, 2013, 10:23:23 PM
New version uploaded.

Uses multiple instances of dcraw to increase speed. On my machine the total time improved approx 400%  8)

The downside of using multiple instances is the the progress bar will not report updates during this conversion :( But for me that is an easy choice.
Title: Re: RAWanize - windows batch generation of proxy files from RAW
Post by: marten on May 21, 2013, 10:24:27 PM
An error did come up when I first ran RAWanize but hasn't since. I'll reboot to see if I can cause it to happen again.

Can you try the new version and see if you still have the same problem. I have done some small fixes.
Title: Re: RAWanize - windows batch generation of proxy files from RAW
Post by: Andy600 on May 21, 2013, 10:29:34 PM
Can you try the new version and see if you still have the same problem. I have done some small fixes.

Yes but the link isn't working for me  ???

Update - The link works but you have to copy/paste it
Title: Re: RAWanizer - windows batch generation of proxy files from RAW
Post by: Andy600 on May 21, 2013, 10:55:45 PM
@marten - It's working great now!! 8) Many thanks for this excellent app
Title: Re: RAWanizer - windows batch generation of proxy files from RAW
Post by: marten on May 21, 2013, 11:42:49 PM
Added DNxHD as an option for the proxy file.

Download the patch from the original post.
Title: Re: RAWanize - windows batch generation of proxy files from RAW
Post by: marten on May 21, 2013, 11:46:08 PM
wow thank you ) can we have it make DNxHD files =) ?

Now you have it  :)
Title: Re: RAWanizer - windows batch generation of proxy files from RAW
Post by: tferradans on May 21, 2013, 11:51:04 PM
awesome work, @marten! thanks a lot!

I don't mean to be stupid, but is this thing working with 4GB+ clips already? :P
Title: Re: RAWanizer - windows batch generation of proxy files from RAW
Post by: marten on May 22, 2013, 12:08:55 AM
awesome work, @marten! thanks a lot!

I don't mean to be stupid, but is this thing working with 4GB+ clips already? :P

On some early test versions I tried it on a 5GB file and it worked fine. Haven't tested it on the latest versions though, but hope it's still working.
Title: Re: RAWanizer - windows batch generation of proxy files from RAW
Post by: Jakobmen on May 22, 2013, 12:31:17 AM
 ;D Thank you!
Title: Re: RAWanizer - windows batch generation of proxy files from RAW
Post by: 1% on May 22, 2013, 03:15:35 AM
You can update raw2dng binary in program files if necessary.
Title: Re: RAWanizer - windows batch generation of proxy files from RAW
Post by: JulianH on May 24, 2013, 12:21:34 AM
This is great! Seems to be the easiest way to preview the shots right now. Thanks for the app!
Title: Re: RAWanizer - windows batch generation of proxy files from RAW
Post by: marten on May 24, 2013, 05:49:54 PM
New version with quite a lot of new features.

Read the first post for download links.

The conversion from dng to tiff is hitting my disk quite hard. I had massive improvement when using an SSD. Don't know why dcraw is so hard on the disk, shouldn't be that much to move around.
Title: Re: RAWanizer - windows batch generation of proxy files from RAW
Post by: marten on May 24, 2013, 06:20:58 PM
Also added info on how I use RAWanizer in my workflow to the first post.
Title: Re: RAWanizer - windows batch generation of proxy files from RAW
Post by: Jakobmen on May 24, 2013, 11:58:57 PM
uhmm fresh installed but its not starting up in windows 7 64x

i dbl click and the task manager shows it but i dont see the GUI
Title: Re: RAWanizer - windows batch generation of proxy files from RAW
Post by: Andy600 on May 25, 2013, 12:02:54 AM
Thanks Marten :)

The V3 patch link isn't working for me. It's trying to link to another ML forum post or something?
Title: Re: RAWanizer - windows batch generation of proxy files from RAW
Post by: marten on May 25, 2013, 12:29:16 AM
uhmm fresh installed but its not starting up in windows 7 64x

i dbl click and the task manager shows it but i dont see the GUI

I did a test install on a win 7 64-bit machine before I uploaded it and it ran fine. Have you tried restatring the computer... I'm running it on several 64x machines. Did you uninstall the old version (if you had it) before installing the new version?
Title: Re: RAWanizer - windows batch generation of proxy files from RAW
Post by: marten on May 25, 2013, 12:30:31 AM
Thanks Marten :)

The V3 patch link isn't working for me. It's trying to link to another ML forum post or something?

There is no patch currently, you need to do the full install.
Title: Re: RAWanizer - windows batch generation of proxy files from RAW
Post by: Andy600 on May 25, 2013, 12:36:41 AM
Thanks Marten :)

I should have read the update properly  ::)
Title: Re: RAWanizer - windows batch generation of proxy files from RAW
Post by: 1% on May 25, 2013, 01:57:44 AM
Custom uprez like adobe ACR does to the tiffs. A way to do this with UFRAW and not lose quality... ie have 2k 16Bpc tiffs?
Title: Re: RAWanizer - windows batch generation of proxy files from RAW
Post by: pacman829 on May 25, 2013, 05:54:55 AM
uhmm fresh installed but its not starting up in windows 7 64x

i dbl click and the task manager shows it but i dont see the GUI


I actually had the same issue, so i went into the application folder and found the .exe and double clicked it directly (since i thought maybe the shortcut was just bad)

Turns out I need to update my version of the .net framework to version 4.5 in order to make it run ..  (got a pop up message as soon as i clicked on the file directly )
Title: Re: RAWanizer - windows batch generation of proxy files from RAW
Post by: Jakobmen on May 25, 2013, 05:57:28 AM

I actually had the same issue, so i went into the application folder and found the .exe and double clicked it directly (since i thought maybe the shortcut was just bad)

Turns out I need to update my version of the .net framework to version 4.5 in order to make it run ..  (got a pop up message as soon as i clicked on the file directly )

i tried that even uninstalling reinstalling .net framework
Title: Re: RAWanizer - windows batch generation of proxy files from RAW
Post by: pacman829 on May 25, 2013, 06:07:23 AM
Thats wierd bro, it's working perfect for me

Thanks a lot to the developer , by the way


I was actually thinking about writing some kind of raw2dng automated script as i cam upon this thread
Title: Re: RAWanizer - windows batch generation of proxy files from RAW
Post by: marten on May 25, 2013, 08:38:27 AM
i tried that even uninstalling reinstalling .net framework

Can you try this patch and see if it makes any difference Patch (https://bitbucket.org/bjurhulta/rawanizer-release/downloads/RAWanizer.exe)
Title: Re: RAWanizer - windows batch generation of proxy files from RAW
Post by: Levinson on May 25, 2013, 09:59:34 AM
Thank you Marten!

It works very well here :)
Title: Re: RAWanizer - windows batch generation of proxy files from RAW
Post by: Levinson on May 25, 2013, 10:03:14 AM
Marten - can I make a feature request?

Would it be possible to have the option to not generate the Tiff files, and allow only .dng generation and proxy video if needed?

Could we specifiy an output drive and folder?

Again, much appreciated :)

Title: Re: RAWanizer - windows batch generation of proxy files from RAW
Post by: marten on May 25, 2013, 11:08:41 AM
Custom uprez like adobe ACR does to the tiffs. A way to do this with UFRAW and not lose quality... ie have 2k 16Bpc tiffs?
[/quote

Can you explain a little bit more what you mean?
Title: Re: RAWanizer - windows batch generation of proxy files from RAW
Post by: marten on May 25, 2013, 11:16:12 AM
Marten - can I make a feature request?

Would it be possible to have the option to not generate the Tiff files, and allow only .dng generation and proxy video if needed?

Could we specifiy an ouput drive and folder?

Again, much appreciated :)

When dng are converted each file needs to be stored for the next step, video creation. So we cannot skip this step. What I could do is an option to delete the tiffs when video is created. Would that be helpful?

Regarding output folder, I'm working on it.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Levinson on May 25, 2013, 01:07:18 PM
Re: my Tiff question - of course!!! You are right, silly me. Don't bother with the tiffs deletion on my part.

Re: folders and drives question - that's great.

I have encountered an "unhandled exception error" while unpacking one of my raw from today. The error prompt gives the option to continue. If I click continue, the remaining .dng files are 0Kb in size. It always gets part way through the .raw file (same place each time) when the error appears. I cannot use your Rawanizer or Raw2dng program after that without 0Kb dngs being created, regardless of what .raw file I use. I must restart the PC for the apps to work again.

The error is quite lengthy. Is there a way to copy and paste what appears in the error dialogue? - if that is of any help to you.

Cheers

Lev

Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on May 25, 2013, 01:33:12 PM
I have encountered an "unhandled exception error" while unpacking one of my raw from today. The error prompt gives the option to continue. If I click continue, the remaining .dng files are 0Kb in size. It always gets part way through the .raw file (same place each time) when the error appears. I cannot use your Rawanizer or Raw2dng program after that without 0Kb dngs being created, regardless of what .raw file I use. I must restart the PC for the apps to work again.

The error is quite lengthy. Is there a way to copy and paste what appears in the error dialogue? - if that is of any help to you.

Do you get the same error if you only use raw2dng, not RAWanizer?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Levinson on May 25, 2013, 01:37:54 PM
yes, that's right. sorry, misread that. I didn't try using raw2dng immediately after a reboot. Raw2dng was only tried after your program reported the error.

however - maybe ignore that post as I've just copied all the files to another hard drive, and both converters are now working so far (but not yet complete). It appears it may have been that drive.

I'll let you know how far I get this time.

Cheers
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Levinson on May 25, 2013, 01:49:24 PM
No problems this time, it got through everything.

I'm a bit stumped, but glad it worked.

Sorry if that caused some worry.

Again, great program and thanks :)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: 1% on May 25, 2013, 05:08:48 PM
Quote
Can you explain a little bit more what you mean?

A few people are using adobe ACR and its 300DPI resize to uprez the DNG to TIFF when converting. Its annoying the way photoshop does it in batch.. it takes quite a while, it opens each file in photoshop first. Would be cool if this could be done without ACR via UFRAW. Also bit depth has to be set to 16 in ACR, dunno if ufraw is already doing this.

Doing resizing in after effects or some other editors causes quality loss because it assumes the DPI of video.


Tried the latest... a lot of options are there already.. I think the 16Bit one? The sliders are a little confusing though, no way to get back to the starting point and the changes don't apply real time. Also I hit develop and it doesn't do anything... if I make the custom string tho and re-do the tiffs it works.

Just hard to do brightness/noise/ca/contrast here because it doesn't update right away and no way to reset individual controls. Pro-Photo rgb is good.. I was surprised my colors went to normal with no shifts and just awb (which adds too much green vs too much magenta out of the camera). I guess the larger color space is better.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on May 25, 2013, 06:09:30 PM
Tried the latest... a lot of options are there already.. I think the 16Bit one? The sliders are a little confusing though, no way to get back to the starting point and the changes don't apply real time. Also I hit develop and it doesn't do anything... if I make the custom string tho and re-do the tiffs it works.

Just hard to do brightness/noise/ca/contrast here because it doesn't update right away and no way to reset individual controls. Pro-Photo rgb is good.. I was surprised my colors went to normal with no shifts and just awb (which adds too much green vs too much magenta out of the camera). I guess the larger color space is better.

Thanks for feedback. Since I use dcraw for converting dng to tiff I'm bound by its option regarding brightness etc. You are right about it not updating instantly, dcraw takes some time to develop and I have to wait for it. Try use the half option and it will work a lot faster. There is one thing I will try to do to update faster, but don't know if that will succeed.

To reset the slider to start position, just right click the slider. I know it's not intuitive, but I couldn't easily get a dblclick event from it, apperently it's not fired in windows. Maybe later.

The develop button does nothing if the auto develop checkbox is checked. This is an option for slow computer, maybe confusing...

Also I just noticed I slipped in some swedish on the save button. 'Spara' button is 'Save' and saves and closes the window to use the settings.

These settings are for dng to tiff conversion, so they only apply when you run that step.

I will look at your suggestions and see what I can do, thanks.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: 1% on May 25, 2013, 06:21:13 PM
Best program by far. Very easy to process like 20 raws at once. Video conversion speeds things up too, don't have to import into AE and render. I like the full size tiffs if I'm doing that though. Maybe process 1/2s and then re-do them for full size.

I have  a ~3.7ghz quad with 16gb so should be enough.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: pacman829 on May 25, 2013, 07:32:45 PM
I think I spoke too soon ...

Woke up today to shoot some test footage, and when i went to open up RAWanizer I got this error

(https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2Fi39.tinypic.com%2F9humn6.png&hash=4809059191fe9d04869330b3e556cbef)


Tried uninstalling, reinstalling, repairing, running as admin.... nothing seems to work .. :S

Specs :

AMD 4.0ghz FX 8530,12gb ram, win7_64x





EDIT: I got it working by moving the files into a new folder on my desktop ... for whatever reason it wasnt working from the program files (x86) folder ... :( ...  but atleast its working now
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: pacman829 on May 25, 2013, 08:20:05 PM
If it's not too much trouble I do have one request :

with the folder organization ; would it be possible to have the .raw files, tiff files, and dng, placed in one folder for each clip  ?

Instead of raw + dng[tiff] 

As an option, of course, so people can choose their preference
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on May 25, 2013, 10:35:26 PM
If it's not too much trouble I do have one request :

with the folder organization ; would it be possible to have the .raw files, tiff files, and dng, placed in one folder for each clip  ?

Instead of raw + dng[tiff] 

As an option, of course, so people can choose their preference

Do you mean that you don't want the tiffs to be in a subfolder to the dng. Currently it is creating a dng folder for each clip, but then the tiffs are stored in a sub folder to that. Could you give an example of the structure you would prefer?

Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: 1% on May 25, 2013, 11:18:19 PM
Current structure works for me.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on May 26, 2013, 02:01:06 AM
New version is up. See link in first post.

-Custom folders
-Folder watch
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on May 26, 2013, 02:04:44 AM
I think I spoke too soon ...

Woke up today to shoot some test footage, and when i went to open up RAWanizer I got this error

(https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2Fi39.tinypic.com%2F9humn6.png&hash=4809059191fe9d04869330b3e556cbef)

Tried uninstalling, reinstalling, repairing, running as admin.... nothing seems to work .. :S


With the new version you should get a message box with the error message instead of program crash. Could you try to run the 0.3.1 version and send me the error message you get? https://bitbucket.org/bjurhulta/rawanizer-release/downloads/RAWanizer.exe (https://bitbucket.org/bjurhulta/rawanizer-release/downloads/RAWanizer.exe)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: robrock_68 on May 26, 2013, 02:56:57 AM
I keep getting an "unhandled exception" error, which gives me the option to continue or quit. If I hit continue, nothing happens. if I hit quit, well,, you get the idea... It says "Length cannot be less than zero. Parameter name: Length
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: pacman829 on May 26, 2013, 06:17:22 AM
Well I'm just brainstorming really, 

As is, the thing works wonderfully , and I thank you for taking the time to make this.


What I was thinking about was something like


This is what it looks like now

<Folder with RAW>
-------- m0000000.RAW
-------- m0000000.proxy.mp4
--------<M0000000.dng>
---------------m0000000.dng
---------------<proxytiff>
---------------------m0000000.tiff

This is what I was thinking might be a bit more organized, since all the files would be side by side  (RAW,proxy, dng folder)


<Folder with RAW>
-------- <m0000000>
--------------m0000000.proxy.mp4
--------------m0000000.raw
--------------<m0000000.dng>
-----------------------m0000000.dng
---------------------<proxytiff>
---------------------------m0000000.tiff


Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on May 26, 2013, 08:25:48 AM
I keep getting an "unhandled exception" error, which gives me the option to continue or quit. If I hit continue, nothing happens. if I hit quit, well,, you get the idea... It says "Length cannot be less than zero. Parameter name: Length

Can you download the new version patch 0.3.2 from the first post and tell me if you still have same problem.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: 1% on May 26, 2013, 06:24:36 PM
I can't reprocess DNGs to video/tiff/etc once I delete the .raw file.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Apples on May 26, 2013, 09:11:44 PM
Hi, Im having a problem converting RAW files over 4Gig  the program starts then says Failed in the log window, under 4gig is fine. Is there a file size limit.

Win 7 64bit

Thanks for the program it works wonderfully except for file size limit, and if you built in a function to delete Tiff files after i would use it.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on May 26, 2013, 09:44:50 PM
I can't reprocess DNGs to video/tiff/etc once I delete the .raw file.

If you check the 'dng folder' checkbox you should be able to, that way you treat the dng as you starting point.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on May 26, 2013, 09:47:16 PM
Hi, Im having a problem converting RAW files over 4Gig  the program starts then says Failed in the log window, under 4gig is fine. Is there a file size limit.

Win 7 64bit

Thanks for the program it works wonderfully except for file size limit, and if you built in a function to delete Tiff files after i would use it.

Can you try to download the latest raw2dng.exe and replace the old in tools subfolder. Any difference?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: haavard on May 26, 2013, 09:56:11 PM
With the new version you should get a message box with the error message instead of program crash. Could you try to run the 0.3.1 version and send me the error message you get? https://bitbucket.org/bjurhulta/rawanizer-release/downloads/RAWanizer.exe (https://bitbucket.org/bjurhulta/rawanizer-release/downloads/RAWanizer.exe)

I got the same crash, it was due to the last open file had been moved since last use, so when Rawanizer could not find it on startup it crashes. Just delete the last open file from the user config file found in your appdata folder and you are good to go.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: 1% on May 26, 2013, 10:37:57 PM
I figured that would work but it does not. I select dng folder and select a folder with DNGs.. I see it in the bottom like "C:\Video\600D\M4" but nothing the box where the raws would go. Selecting the parent appears to work tho.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on May 26, 2013, 11:21:55 PM
I got the same crash, it was due to the last open file had been moved since last use, so when Rawanizer could not find it on startup it crashes. Just delete the last open file from the user config file found in your appdata folder and you are good to go.

Thanks, I will try to fix that.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on May 26, 2013, 11:31:57 PM
I figured that would work but it does not. I select dng folder and select a folder with DNGs.. I see it in the bottom like "C:\Video\600D\M4" but nothing the box where the raws would go. Selecting the parent appears to work tho.

Yes, you have to select the parent folder and check the folders you want to reprocess The list will never show individual dng or tiff files. Since this is a batch tool for me I wanted the workflow to be towards multiple folders instead of single. But I will see if I can accomodate both. Grey checkbox means it has detected existing files and they will not automatically be included in the process. Only solid check marks will be processed, so you have to manually check them if they are grey.

I am thinking of redoing the list with files/folders. Will see when I get time for that.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: 1% on May 27, 2013, 01:32:42 AM
If I select a folder of dngs it should take the folder. I had to select a folder with multiple dng folders.

I couldn't get the video button to work.. only the proxy button makes videos. Is that only for custom?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on May 27, 2013, 10:02:13 AM
Regarding the video option. I added this to the first post a couple of days ago:

The 'video' settings to the left of start button has these meanings:
-Proxy video: Extracts the dng from raw file. Then creates tiff files from dng and finally creates a video file from the tiffs.
-Video: Looks for tiff files in 'tiff' sub folder in the dng subfolder and creates video file from them. Use this option if you have developed the dng in other converter.
-No video: Only extracts the dng from raw file. No tiffs created and no video file created.

I do understand that the 'video' option might be confusing, but I haven't come up with a better way yet. It's purpose is tho batch process tiff folders that have been populated by external converters (I use Lightroom).

The 'proxy video' and 'video' both use the settings you select. The difference is where they try to find the source tiffs. For 'proxy video' it creates them from the dng, for 'video' it simply looks for a 'tiff' subfolder in the dng folder.

I will have a look at selecting just a single dng filder.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on May 27, 2013, 04:22:01 PM
New version is up. Check the first post for details.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: 1% on May 27, 2013, 06:29:41 PM
Ok, I get it... tiffs are in proxytiff so would have to rename the folder.

BTW did you update raw2dng to newest... as of 3.1 I still had to change it out... I'm also going to try different ffmpeg.. x64 with multithreading support.

http://ffmpeg.zeranoe.com/builds/ was winner.

I set MXF fps to 23.976 or 24 and it says no suitable target for 23.98, etc.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: IliasG on May 27, 2013, 08:31:49 PM
Marten, which Dcraw build do you use ?.

Did not try RAWanizer yet but I have to say that the faster Dcraw for my system (win vista32, C2D 3.0 Ghz) is https://sites.google.com/site/manuelllorens/

and it includes Lcms - libjpeg - jasper
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: 1% on May 27, 2013, 09:26:08 PM
That's a bit old... latest is like 9.17 there was a difference for EOSM/6D for photos... dng probably won't matter.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: hookah on May 27, 2013, 10:21:52 PM
would it be possible to use RAWanizer as frontend for DANewman´s RAW2GPCF cineform tool ?

http://www.magiclantern.fm/forum/index.php?topic=5479.msg41378#msg41378
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on May 27, 2013, 11:03:14 PM
Ok, I get it... tiffs are in proxytiff so would have to rename the folder.

BTW did you update raw2dng to newest... as of 3.1 I still had to change it out... I'm also going to try different ffmpeg.. x64 with multithreading support.

http://ffmpeg.zeranoe.com/builds/ was winner.

I set MXF fps to 23.976 or 24 and it says no suitable target for 23.98, etc.

Ok, either I'm not so good at explaining or I haven't made it logical... I work with two different tiff folders.

-Proxytiff folder is used for creating 'proxyvideo'. Proxy video for me is either a fast, low quality clip to preview the raw file (choose half size and mp4) OR it is a proxy to be used for editing (choose full size and higher quality codec) OR if I think the dcraw conversion is good enough I can use the 'proxy' for final editing. In neither of these cases do you need to bother about the 'tiff' folder.
-Tiff folders only purpose is if you use an external converter (ACR, Lightroom) and you want to batch video encode the output from the external converters.

So if you are happy with the conversion you get with the internal dng to tiff, only use proxytiff and choose quality you like.

In the full install for version 0.3.3 the lastest raw2dng is included (at least the one I could find, think it was may 24)

The ffmpeg I use may not be the latest, but it is multi threading at least for mp4. The higher quality codecs may not be. Have you tested the link you gave, is that mulitthreaded even for dnxhd and mxf?

I'm not surprised if you get problems with mxf framerates, I found the mxf support very confusing. I wanted it for Sony vegas support but it's not accepting it. For prores and mxf I'm using ffmbc, not ffmpeg.

I would be very happy if someone could provide me with some complete parameter settings for ffmpeg or ffmbc that are foolproof and working well that I could add as defaults. I'm personally hunting for XDCAM mxf that Sony vegas will accept to the timeline.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: IliasG on May 27, 2013, 11:14:30 PM
That's a bit old... latest is like 9.17 there was a difference for EOSM/6D for photos... dng probably won't matter.

But IT IS 9.17 release 1454 ... built on 27mar2013 .. although as you said it doen't matter for DNGs.

Did you try it for speed ??

Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: 1% on May 27, 2013, 11:17:25 PM
Quote
is that mulitthreaded even for dnxhd and mxf?


Not sure.. I'm never able to make an MXF.. didn't test DNXhd... what I do know is your FFmpeg = 25% cpu usage... that ffmpeg = 100% cpu usage and mp4 is done in a flash. Dunno what holds true for x32 version.

Will try DCraw next and see if it 4 cores DnxHD...
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on May 28, 2013, 10:11:43 AM
Did not try RAWanizer yet but I have to say that the faster Dcraw for my system (win vista32, C2D 3.0 Ghz) is https://sites.google.com/site/manuelllorens/

and it includes Lcms - libjpeg - jasper

I downloaded and tested the link. It gave only couple % speed increase. But it didn't give me a valid image when directed to the StandardOutput which I'm capturing. So as for now I will keep the existing build.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on May 28, 2013, 05:21:31 PM
would it be possible to use RAWanizer as frontend for DANewman´s RAW2GPCF cineform tool ?

http://www.magiclantern.fm/forum/index.php?topic=5479.msg41378#msg41378

With the new patch 0.4.0 (link in first post) you have it. Haven't got the top progress bar to work yet, they are not send out any breaks I can catch :(

You have to install the software according to the linked message
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: 1% on May 29, 2013, 01:58:10 AM
Won't find the file... its in :

C:\Program Files (x86)\CineForm\Tools

Code: [Select]
System.ComponentModel.Win32Exception (0x80004005): The system cannot find the file specified
   at System.Diagnostics.Process.StartWithCreateProcess(ProcessStartInfo startInfo)
   at RAWanizer.CommandTool.RunProcessAsync(String commandPath, String Parameters, String workingDirectory)
   at RAWanizer.ProcessItem.CineformRaw2Video()
   at RAWanizer.frmNewAsync.CineformRawToVideoNext()

Something I did?

Also not making any proxy videos right now:

C:\Program: No such file or directory
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: DANewman on May 29, 2013, 06:40:41 AM
With the new patch 0.4.0 (link in first post) you have it. Haven't got the top progress bar to work yet, they are not send out any breaks I can catch :(

You have to install the software according to the linked message

Add the '-v' switch to RAW2GPCF.exe, you should get more console output.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on May 29, 2013, 11:00:59 AM
Won't find the file... its in :

C:\Program Files (x86)\CineForm\Tools

Code: [Select]
System.ComponentModel.Win32Exception (0x80004005): The system cannot find the file specified
   at System.Diagnostics.Process.StartWithCreateProcess(ProcessStartInfo startInfo)
   at RAWanizer.CommandTool.RunProcessAsync(String commandPath, String Parameters, String workingDirectory)
   at RAWanizer.ProcessItem.CineformRaw2Video()
   at RAWanizer.frmNewAsync.CineformRawToVideoNext()

Something I did?

Also not making any proxy videos right now:

C:\Program: No such file or directory

Sorry, I looked at the path for 'tools' on my machine and it was under the 'GoPro' folder. Thought it would all be the same so hardcoded it, but it turns out some installations get a 'Cineform' folder instead. Now, with 0.4.2,  it will check for both and you can also set it manually . I'm also checking if the file actually exists before I try to start processing. It was stupid of me to hardcode it...
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Levinson on May 29, 2013, 01:18:07 PM
Hi Marten.

If Cineform output is selected, Rawanizer attempts to create a cineform video file even if "No Video" has been selected from the options at the bottom (even though all video options are greyed out). Is that expected behaviour?

Great program so far. Thank you for putting the time into it! Although it wasn't necessary, thank you also for adding the "delete proxy Tiff" option, probably as a result of my earlier question.

:)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: JulianH on May 30, 2013, 09:24:07 PM
Just did a clean install of RAWanizer with the updated .exe, but it failes at creating MP4 proxies:


Quote
21:19:51 Start creating proxy from M30-1809.RAW
21:19:51 Failed:
ffmpeg version N-35966-g1d0ae92, Copyright (c) 2000-2011 the FFmpeg developers
  built on Dec 19 2011 13:01:15 with gcc 4.6.2
  configuration: --enable-gpl --enable-version3 --disable-w32threads --enable-runtime-cpudetect --enable-avisynth --enable-bzlib --enable-frei0r --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libfreetype --enable-libgsm --enable-libmp3lame --enable-libopenjpeg --enable-librtmp --enable-libschroedinger --enable-libspeex --enable-libtheora --enable-libvo-aacenc --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libxavs --enable-libxvid --enable-zlib
  libavutil    51. 32. 0 / 51. 32. 0
  libavcodec   53. 46. 1 / 53. 46. 1
  libavformat  53. 27. 0 / 53. 27. 0
  libavdevice  53.  4. 0 / 53.  4. 0
  libavfilter   2. 53. 0 /  2. 53. 0
  libswscale    2.  1. 0 /  2.  1. 0
  libpostproc  51.  2. 0 / 51.  2. 0
Input #0, image2, from 'D:\Video\00000-RAW\50D-haven\M30-1809.dng\proxytiff\M%06d.tiff':
  Duration: 00:00:06.37, start: 0.000000, bitrate: N/A
    Stream #0:0: Video: tiff, rgba, 800x400, 24 fps, 24 tbr, 24 tbn, 24 tbc
C:\Program: No such file or directory
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: pacman829 on May 31, 2013, 01:04:18 AM
Just did a clean install of RAWanizer with the updated .exe, but it failes at creating MP4 proxies:

Updated and it doesnt want to make any kind of proxies (prores/mp4/dnxHD ) for me .. :S with the same error code as above
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: 1% on May 31, 2013, 01:06:50 AM
Cineform seems the way to go.. 800MB file vs 40GB of tiffs.

Wonder if he updated the exe to do the new de-banding thing from a1ex. Last night had no more issues with proxies using full install. I have to replace ffmpeg (its a year old, single core 32bit) and try again but stock worked.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on May 31, 2013, 12:30:00 PM
Just did a clean install of RAWanizer with the updated .exe, but it failes at creating MP4 proxies:

I can't reproduce your problem. Could you check if you have any tiff files in the folder specified in the error log? (The line starting with Input #0, image2, from ...)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on May 31, 2013, 12:30:51 PM
Updated and it doesnt want to make any kind of proxies (prores/mp4/dnxHD ) for me .. :S with the same error code as above

Could you also check if you have any tiff files in the folder specified in the error log? (The line starting with Input #0, image2, from ...)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on May 31, 2013, 01:09:45 PM
Another idea for the problem. Can you use the default custom setting for video (-r:v {InputVideoFps} -i "{InputVideoName}" -c:v libx264 -b:v 5000k "{OutputVideoName}.mp4")? Still the same error?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: korbendallas1976 on June 01, 2013, 09:43:04 AM
I have the same error as above if I use any of the non-custom video generating option (mp4, xdcam, dnxhd, prores).
Choosing the custom one is OK.

I guess the error on the last line of the log should give some info:
C:\Program: No such file or directory

Code: [Select]
09:29:03 Failed:
FFmbc version 0.7-rc8
Copyright (c) 2008-2013 Baptiste Coudurier and the FFmpeg developers
Input #0, image2, from 'F:\movie\_TMP\r2\M01-0740.dng\proxytiff\M%06d.tiff':
  Duration: 00:00:09.95, bitrate: N/A
    Stream #0.0(und): Video: tiff, rgb24, 1880x706p, 24.00 fps
C:\Program: No such file or directory

I hope it helps.
(I have Win7 64 bit, if it does matter)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: EOSHD on June 01, 2013, 03:39:06 PM
Some feedback from my test of RAWanizer and RAW2GPCF:

I can create CineForm AVI videos no problem, but Resolve needs MOV. At the command line with RAW2GPCF I can get MOV but not in RAWanizer when I change .avi to .mov in the CineForm parameters box - although RAW2GPCF runs it doesn't produce a file and the RAWanizer batch ends with 'aborted by user'. Any solution?

Rather than just a CineForm parameters text box can it be radio buttons in future for less advanced users?

CineForm Decoder and GoPro Studio give us two Tools directories so make sure RAW2GPCF is in the right one. With only CineForm Decoder installed and the RAW2GPCF.exe placed in the CineForm Tools directory, clips could not be produced. Does RAW2GPCF work with just the CineForm Decoder installed or does it require GoPro Studio?

I'm running Windows 7 in VMWare Fusion within OSX. Tried it in XP - doesn't work, and .NET 4.5 only runs in 7. Would be helpful if the app could be made to work in XP SP3 for those not running 7.

I cannot make a CineForm clip with the Video option selected, only Proxy. I get the TIFF error. This is confusing, can it be changed?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: kgv5 on June 01, 2013, 06:21:27 PM
I am getting such thing

18:11:41 Start extracting dng from M01-1220.RAW
18:12:29 Finished
18:12:29 Start converting tiff from M01-1220.RAW
18:12:44 Finished
18:12:44 Start creating proxy from M01-1220.RAW
18:12:45 Failed:
ffmpeg version N-35966-g1d0ae92, Copyright (c) 2000-2011 the FFmpeg developers

18:12:45 All items Finished


Tiff files are created but then application just turns off.
What could I do?

EDIT: I reinstalled the app, changed ffmpeg with the newest version but no success - still "failed" and no creating proxy movie
I use win7 64bit

EDIT2: newest version 0.3.3 and 0.4.2 patch doesn't work either...  :(
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on June 01, 2013, 11:37:02 PM
I think I found the problem with ffmpeg failing. In an effort to get mxf to work properly I always include an dummy wav file if original sound is missing. In the installer I forgot to include the dummy wav file... There is a link in first post. Put it in tools subfolder and try. Here is the link https://bitbucket.org/bjurhulta/rawanizer-release/downloads/dummy1s.wav (https://bitbucket.org/bjurhulta/rawanizer-release/downloads/dummy1s.wav)

I should do a new installer but have no time right now, sorry.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on June 02, 2013, 12:00:29 AM
Some feedback from my test of RAWanizer and RAW2GPCF:

I can create CineForm AVI videos no problem, but Resolve needs MOV. At the command line with RAW2GPCF I can get MOV but not in RAWanizer when I change .avi to .mov in the CineForm parameters box - although RAW2GPCF runs it doesn't produce a file and the RAWanizer batch ends with 'aborted by user'. Any solution?

Rather than just a CineForm parameters text box can it be radio buttons in future for less advanced users?

CineForm Decoder and GoPro Studio give us two Tools directories so make sure RAW2GPCF is in the right one. With only CineForm Decoder installed and the RAW2GPCF.exe placed in the CineForm Tools directory, clips could not be produced. Does RAW2GPCF work with just the CineForm Decoder installed or does it require GoPro Studio?

I'm running Windows 7 in VMWare Fusion within OSX. Tried it in XP - doesn't work, and .NET 4.5 only runs in 7. Would be helpful if the app could be made to work in XP SP3 for those not running 7.

I cannot make a CineForm clip with the Video option selected, only Proxy. I get the TIFF error. This is confusing, can it be changed?


I just tested to changed .avi to .mov and I get the file generated as it should. And it opens fine in Vegas, don't have Resolve. Did you keep the quotation marks around the filename ("{OutputVideoName}.mov")? They are needed if file path contains spaces. I cannot reproduce your problem right now.

There is no big reason for me to make a clickable interface to building the parameters, at least not now when I don't know which parameters are "universally" useful to all. Is there a parameter setting that everybody uses?

I do not have anything to do with the installation of cineform and the tool (I have not license to do it), so I cannot control where things end up. RAWanizer tries to guess where it is, but if that fails you can manually set the location of the cineform tool by clicking the 'folder settings' button.

I decided to use .net 4.5 so I could use the new threading options there. I currently do not have time to go over and rewrite the threading with other tools so for now it will require .net 4.5. Sorry.

I understand the confusing thing with cineform and  the video option. I will disable that option for cineform. As described in original post, that option is for making a videofile out of tiffs which has no meaning in cineform workflow. Cineform = Proxy video.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: kgv5 on June 02, 2013, 12:40:09 AM
I think I found the problem with ffmpeg failing. In an effort to get mxf to work properly I always include an dummy wav file if original sound is missing. In the installer I forgot to include the dummy wav file... There is a link in first post. Put it in tools subfolder and try. Here is the link https://bitbucket.org/bjurhulta/rawanizer-release/downloads/dummy1s.wav (https://bitbucket.org/bjurhulta/rawanizer-release/downloads/dummy1s.wav)

I should do a new installer but have no time right now, sorry.

Thank you for your response, unfortunatelly even with this wav file copied everywhere I get

00:34:43 Start extracting dng from M01-2242.RAW
00:35:04 Finished
00:35:04 Start converting tiff from M01-2242.RAW
00:35:23 Finished
00:35:23 Start creating proxy from M01-2242.RAW
00:35:23 Failed:
ffmpeg version N-35966-g1d0ae92, Copyright (c) 2000-2011 the FFmpeg developers
  built on Dec 19 2011 13:01:15 with gcc 4.6.2
  configuration: --enable-gpl --enable-version3 --disable-w32threads --enable-runtime-cpudetect --enable-avisynth --enable-bzlib --enable-frei0r --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libfreetype --enable-libgsm --enable-libmp3lame --enable-libopenjpeg --enable-librtmp --enable-libschroedinger --enable-libspeex --enable-libtheora --enable-libvo-aacenc --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libxavs --enable-libxvid --enable-zlib
  libavutil    51. 32. 0 / 51. 32. 0
  libavcodec   53. 46. 1 / 53. 46. 1
  libavformat  53. 27. 0 / 53. 27. 0
  libavdevice  53.  4. 0 / 53.  4. 0
  libavfilter   2. 53. 0 /  2. 53. 0
  libswscale    2.  1. 0 /  2.  1. 0
  libpostproc  51.  2. 0 / 51.  2. 0
Input #0, image2, from 'H:\RAWTEST\M01-2242.dng\proxytiff\M%06d.tiff':
  Duration: 00:00:15.33, start: 0.000000, bitrate: N/A
    Stream #0:0: Video: tiff, rgba, 832x312, 24 fps, 24 tbr, 24 tbn, 24 tbc
C:\Program: No such file or directory

00:35:23 All items Finished


Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: 1% on June 02, 2013, 01:12:10 AM
Yep, me too, not working. Seemed like it just was.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: EOSHD on June 02, 2013, 04:29:17 PM

I just tested to changed .avi to .mov and I get the file generated as it should. And it opens fine in Vegas, don't have Resolve. Did you keep the quotation marks around the filename ("{OutputVideoName}.mov")? They are needed if file path contains spaces. I cannot reproduce your problem right now.

There is no big reason for me to make a clickable interface to building the parameters, at least not now when I don't know which parameters are "universally" useful to all. Is there a parameter setting that everybody uses?

I do not have anything to do with the installation of cineform and the tool (I have not license to do it), so I cannot control where things end up. RAWanizer tries to guess where it is, but if that fails you can manually set the location of the cineform tool by clicking the 'folder settings' button.

I decided to use .net 4.5 so I could use the new threading options there. I currently do not have time to go over and rewrite the threading with other tools so for now it will require .net 4.5. Sorry.

I understand the confusing thing with cineform and  the video option. I will disable that option for cineform. As described in original post, that option is for making a videofile out of tiffs which has no meaning in cineform workflow. Cineform = Proxy video.

Fixed the MOV problem - my copy of Windows in VMWare didn't have Quicktime Player installed. CineForm needs that in order to do the Quicktime wrapper during transcode. So not a problem with RAWanizer :)

Great tool, looking forward to see how it develops!

BTW - maybe someone can answer this (I have already told David Newman) - on my Mac the CineForm RAW or 422 gives a flat LOG-like curve when you open the clip in Resolve, Premiere or Quicktime Player, but 444 gives punchier colour and contrast like a DNG in Adobe Camera Raw. Metadata issue?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on June 02, 2013, 08:27:10 PM
Yep, me too, not working. Seemed like it just was.

Ok. Yet another try to solve this. Link to full install in first post. I hope it was some missing quotation marks for the audio files. Didn't have spaces in my path to the audio files so mine never failed.

Please report back if this is solved, if you haven't given up on RAWanizer yet :) Sorry, but I have limited time for testing...
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: 3pointedit on June 03, 2013, 03:42:58 AM
Tool looks wonderful, is there any chance of creating the install as a portable app? As I don't have the admin rights
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: pacman829 on June 03, 2013, 08:39:39 AM
Tried the latest version , and everything seems to be working again for me

Thanks MARTEN !

Seems like things are going good

I agree that buttons should be implemented (or maybe sub-menus) once we get a v1.0 so that even the lesser tech savy can use this.

Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on June 03, 2013, 09:18:09 AM
Tool looks wonderful, is there any chance of creating the install as a portable app? As I don't have the admin rights

You can try to unzip this package https://bitbucket.org/bjurhulta/rawanizer-release/downloads/RAWanizer.0.4.3.zip (https://bitbucket.org/bjurhulta/rawanizer-release/downloads/RAWanizer.0.4.3.zip)
But .net 4.5 runtime needs to be installed on the computer for it to run.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: ted ramasola on June 03, 2013, 11:18:35 AM
Marten,

I installed this on my win 7 pc.

I choose a RAW file which is 5gig + joined via cmd prompt. This file can be extracted via raw2dng.

When I use RAWanizer v.0.4.3 I choose VIDEO and use Cineform.
After I press START the RAW2GPCF.exe  window pops up with a progress showing, then when it finish I get this
in RAWanizer:

04:13:02 Start Cineform converion from master.RAW
04:14:01 Failed:
Aborted by user
04:14:01 Aborted by user


In the folder that I choose there is NO files generated or extracted also.
Did I miss a procedure?

Ted

edited: to fix TYPO:
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on June 03, 2013, 11:51:47 AM
Marten,

I installed this on my win 7 pc.

I choose a RAW file which is 5gig + joined via cmd prompt. This file can be extracted via raw2dng.

When I use RAWanizer v.0.4.3 I choose VIDEO and use Cineform.
After I press START the RAW2GPCF.exe  window pops up with a progress showing, then when it finish I get this
in RAWanizer:

04:13:02 Start Cineform converion from master.RAW
04:14:01 Failed:
Aborted by user
04:14:01 Aborted by user


In the folder that I choose there is files generated or extracted also.
Did I miss a procedure?

Ted

So what you are saying is that the video file gets created as it should. The only thing is that you get a 'failed' message in the log?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: ted ramasola on June 03, 2013, 12:00:29 PM
sorry, when I edited my post I deleted the word NO.

I meant to say;

In the folder that I choose there is NO files generated or extracted also.
Did I miss a procedure?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on June 03, 2013, 01:29:52 PM
Strange. Is the video file created if you run the same raw file manually with a command prompt? Does it say 'done' as the last thing when you run it manually?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: pacman829 on June 03, 2013, 07:23:58 PM
sorry, when I edited my post I deleted the word NO.

I meant to say;

In the folder that I choose there is NO files generated or extracted also.
Did I miss a procedure?


I only got those issues with cineform when i changed the command line from -422 to -444 to see if it would generate a 4:4:4: file ... but it didnt .. lol


Anyhow, check to see what the command line says ,
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: EOSHD on June 04, 2013, 12:23:07 AM
I think that is because 444 needs Go Pro CF Studio Premium and it can't find it installed, only the free version - but it doesn't give an error, it just carries on and doesn't produce a file at the end.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: pacman829 on June 04, 2013, 05:21:14 AM
I think that is because 444 needs Go Pro CF Studio Premium and it can't find it installed, only the free version - but it doesn't give an error, it just carries on and doesn't produce a file at the end.

Exactly , I just thought i'd try it anyhow to see what would happen

Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on June 04, 2013, 08:49:55 AM
I think that is because 444 needs Go Pro CF Studio Premium and it can't find it installed, only the free version - but it doesn't give an error, it just carries on and doesn't produce a file at the end.

That is the behavior of the Cineform tool and nothing I can change. The message 'aborted by user' is mine and misleading, I have a hard time to distinguish between user closing window and program error. Will change the wording of it later.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: ebutka on June 04, 2013, 12:01:13 PM
Alright guys, I'll take any help - please!!

I've read this entire thread and can't get RAWanizer (V.0.4.3) to work.

I'm using a 5D MK3 @ 1920x1080. One file is 1.57GB the other is 3.99GB.

I downloaded  and installed QT7 and GoPro Cineform Studio.

I load the 2 RAW files in the window, click "no video" and click start.

Both files start and then instantly fail. Thats it, no other messages.

I try any combination of buttons and nothing works.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: ebutka on June 04, 2013, 12:03:19 PM
Oh and it makes a subfolder with a dummy1s file.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on June 04, 2013, 05:30:36 PM
For cineform to work you need to also need to install the utility tool described in this post: http://www.magiclantern.fm/forum/index.php?topic=5479.msg41378#msg41378 (http://www.magiclantern.fm/forum/index.php?topic=5479.msg41378#msg41378) (This link is in the first post)

Then the setting 'No video' means no video, so no video will be created. Only dng will be extracted. This is also explained in first post.

For Cineform to work, you need to choose 'proxy video'. This was stated a few posts back. Of course this all requires the Cineform tools have been properly installed as described in the link above otherwise it won't work.

Good luck.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: 1% on June 04, 2013, 05:55:42 PM
XDcam still fails. Other than that it looks to be working and with the multi core ffmpeg too.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on June 05, 2013, 01:52:49 PM
XDcam still fails. Other than that it looks to be working and with the multi core ffmpeg too.

I can only get it to work at 25 fps. If anyone has a good parameter setting for making XDCAM files with ffmbc, I will gladly incorporate it.

Also, do you have a link to the ffmpeg release you are referring to? I have tried a newer version but then I couldn't play the resulting video.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on June 05, 2013, 01:56:15 PM
New version is up. Link in first post.

-Meta data for raw file is shown.
-Optionally show first, middle and last thumbnail for raw file before processing.

I have made a lot of changes to the code an UI, therefore don't expect too much stability in this version ;)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: KahL on June 06, 2013, 01:08:37 AM
This is an INCREDIBLY useful software! Loving it so far and doing a test with today's footage :)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: platu on June 06, 2013, 01:25:20 AM
I agree... It makes for quite a streamlined workflow.  Thank you for doing this... much appreciated.  :)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: KahL on June 06, 2013, 03:05:25 PM
There are a few issues though.

I always tend to adjust the highlights, whites and color correct from Adobe Camera Raw before I want to create a usable video file. I started messing with the custom DNG option, which doesn't use the parameters from ACR, but instead it's own UI. However, the UI is extremely confusing. I would adjust the highlight recovery option and sometimes the highlights would dip down and other times the entire gamma of the image is affected. You cannot adjust the blacks specifically, only the gamma and then sometimes the slider (to the right) increases the exposure and other times (to the left) it decreases. Then other times, it does the opposite effect.

It's very confusing overall. Is there a way to use ONLY the ACR settings (which I setup in Bridge) and not the custom DNG "Build" UI settings? It's incredibly imprecise and I won't be able to use the DNG files the way they're meant to be (unless we're just doing this to batch convert solely).
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on June 06, 2013, 05:12:50 PM
I understand your frustration with the color corrections. From the beginning the conversion from dng to tiff was added to get a fast lower quality proxy file with preset setting that user could not change. Then I decided to make a GUI to the conversion settings. The problem is that I only reuse dcraw program to do the conversions so I have to use what parameters dcraw gives me to adjust. These settings are not compatible with ACR or any other software. So RAWanizer will never get the same functionality that ACR has. I will try got make it a little bit better soon, but there is not so much I can do without doing another raw converter which is not my intention.

In the first topic and a later post I tried to describe different workflow solutions based on different needs http://www.magiclantern.fm/forum/index.php?topic=5557.0 (http://www.magiclantern.fm/forum/index.php?topic=5557.0)http://www.magiclantern.fm/forum/index.php?topic=5557.msg41488#msg41488 (http://www.magiclantern.fm/forum/index.php?topic=5557.msg41488#msg41488)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: 1% on June 06, 2013, 05:14:05 PM
Lol, ACR causes expo shifts... but maybe dcraw too? I saw some when conerting.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: IliasG on June 06, 2013, 05:23:45 PM
Lol, ACR causes expo shifts... but maybe dcraw too? I saw some when conerting.

Dcraw does a kind of exposure correction by default, depending on the histogram (histogram stretching .?). You have to use -W to for a fixed White Point
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: KahL on June 06, 2013, 06:06:44 PM
So I seem to have created a proper CC cocktail that works [for now] for a DNxHD transcode. I'm sure I'll change it more as time goes by, but so far this matches my custom settings in ACR.

6/6/2013
-b 1.0 -o 1 -H 9 -6 -g 2.2 20.0

Is it also possible to have proxy jpeg alongside the option for proxy tiffs?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on June 07, 2013, 04:41:49 PM
New version 0.5.1 is up. Link in first post.

New version 0.5.1
-automatic merging of split files (>4Gb) (there is a setting under file tab where you can choose to write to the original RAW file. This is faster, cleaner and the result is just one single RAW file. But if something fails along the way you probably end up with at corrupt RAW file, so use with caution, preferably a backup. If not checked it will create a new RAW file with prefix 'M-' and the originals will still be there, safer if you have no backup)
-some more options for dcraw conversions
-now possible to save more than one custom preset for dcraw, Cineform and video output.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: godweeno on June 07, 2013, 05:04:37 PM
I just got a 50D.  This workflow looks good.  I'm going to give this a try tonight.  I'm looking to go from Rawanizer to LR to PP.

Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: 1% on June 07, 2013, 07:46:40 PM
I tested v5.. its looking much better.

Still has some bugs:

*After first encode, can no longer add to process queue... it just goes to town on all files.
*Sometimes saving settings doesn't work... ie pro-res reverts to ffmbc
*The audio file causes evil with dnxhd + media player classic, it only plays the "audio" back like there was no video, vlc and wmp ok.
*MXF is still not working, lol. F this codec anyway
*If that first encode errors out it doesn't redo it... just goes to town extracting the rest of the raw files
*frame rate should come from the clip... I don't want 25fps and I'm sure you don't want 24fps

So far DNXHD + pro-res are the most usable intermediate formats. I like the new thumbnail stuff too.

You also default for everyone as if they had 8 core intel... they may not... I have 4 core AMD... its annoying to hunt down all instances of 8 and change to 4 or in some cases its 2 threads per core and I can't remember... was this 8 or 16 threads before and did I save it.

Thats all I found so far in the limited time I have to process media right now.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on June 07, 2013, 08:48:44 PM
*After first encode, can no longer add to process queue... it just goes to town on all files.
*Sometimes saving settings doesn't work... ie pro-res reverts to ffmbc
*The audio file causes evil with dnxhd + media player classic, it only plays the "audio" back like there was no video, vlc and wmp ok.
*MXF is still not working, lol. F this codec anyway
*If that first encode errors out it doesn't redo it... just goes to town extracting the rest of the raw files
*frame rate should come from the clip... I don't want 25fps and I'm sure you don't want 24fps

So far DNXHD + pro-res are the most usable intermediate formats. I like the new thumbnail stuff too.

You also default for everyone as if they had 8 core intel... they may not... I have 4 core AMD... its annoying to hunt down all instances of 8 and change to 4 or in some cases its 2 threads per core and I can't remember... was this 8 or 16 threads before and did I save it.

0.5.2 is up where I tried to fix some of the bugs you found. Sorry for that. Framrate can now be used from camera.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: evanamorphic on June 08, 2013, 07:16:25 AM
I'm getting some very strange results with the 50D and the RAWanizer + CineForm combo. Going from DNG to CineForm RAW works just fine, not sure what's causing this.

(https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2Fi41.tinypic.com%2F8wytft.jpg&hash=d8b83ed81d9be6b9362dbc783dfee296)
(https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2Fi39.tinypic.com%2F2j32kw6.jpg&hash=81637fb974b1357521e4bd743d840eeb)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: nandoide on June 08, 2013, 10:55:20 AM
marten, a lot of thanks for this software!!!

I found several bugs related to refreshing parameters on last version 0.5.2: the changes of the settings don't reflect inmediately on processing. For example, if I change the video mode with the combo, and I have videos selected on Source panel, the program don't refresh the video settings and the conversion takes place with the old selected settings.

Sometimes the workaround is change settings prior to select the video.

The checks on File label exhibit the same behaviour.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on June 08, 2013, 11:06:00 AM
Actually, this is mostly by design if I understand your points correctly. At the moment you add something to the processing queue the current settings are read and stored for that item. If you change settings after that will not affect items already in queue. (this is how it's supposed to work at least)

I just uploaded 0.5.3 to make sure it works like this, at least for me now.

I know this is not obvious and I haven't spent any time on writing a manual...
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: nandoide on June 08, 2013, 11:52:24 AM
By design, humm.  Well, imho the expected behaviour, the natural one is that changes where reflected on queue.. and it will be more useful.

I download 0.5.3 and I lost all my settings   :( .  But i've only a few mods :-)  It will be good that the program serialize the settings to a file.


Thanks a lot!!!


Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: pixamant on June 08, 2013, 12:13:01 PM
Hi marten,
thank you for this amazing program
i use it since version 0.3 and is getting to be awesome!

I get an error when the video converter get footage which is 23.976 or 29.776 frames.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: 1% on June 08, 2013, 05:04:52 PM
For 50D: You can't use cineform.... it either does funky colors or stuff like this. Unusable directly... need to output to cineform from like AE.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Francis Frenkel on June 08, 2013, 07:12:17 PM
Hello,

I've tried to install last version but I have a message telling me to install Microsoft framework 4.5...

Is there a risk to have a incompatibility with one of my softwares installed or Hardware problem ?

Fran6
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: bzhwindtalker on June 08, 2013, 07:51:37 PM
Thanks for this soft, it really eases the workflow! It took me some time to figure how to get the proxi video thing working, but I succeded in the end.
However I noticed that despite the -W option being enabled in the dcraw panel, the video output has violent expo shifts.

Also, changing the parameters in the build custom dcraw panel (like brigthness or WB) does not apply changes to the picture, and ticking or not the auto preview does not change this.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on June 08, 2013, 10:06:30 PM
Hello,

I've tried to install last version but I have a message telling me to install Microsoft framework 4.5...

Is there a risk to have a incompatibility with one of my softwares installed or Hardware problem ?

Fran6

Installing .net framework 4.5 should be totally risk free. I have not heard of any compatibility issues with it, its a big Microsoft framework that should be stable.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on June 08, 2013, 10:09:12 PM
Thanks for this soft, it really eases the workflow! It took me some time to figure how to get the proxi video thing working, but I succeded in the end.
However I noticed that despite the -W option being enabled in the dcraw panel, the video output has violent expo shifts.

Also, changing the parameters in the build custom dcraw panel (like brigthness or WB) does not apply changes to the picture, and ticking or not the auto preview does not change this.

It seems like this is a behavior on some computers, I don't have it. If you disable the autopreview option and the press 'preview' button, does the image get updated then?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: advent2 on June 09, 2013, 10:35:44 AM
oop, all ok
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: ted ramasola on June 09, 2013, 10:58:21 AM
5.3 works great Marten. Good job on this software.

Just some questions/suggestions.

When joining spanned file, I noticed that it first generates a joined raw file before it extracts the DNG.

At default setting it joins this at source directory, in my case the attached CF card. It halts and issues a fail message, so in folder tab I indicate RAW target as the distination folder in my hard drive.

Now, it is successful in joining spanned files with the joined file generated in the HDD folder in my PC, however I also notice that ALL raw files are copied to my HDD aside from the extracted dngs, would it be ok if there is a feature that i can choose that only spanned files do this as I may not want to copy all my RAW files to HDD only dngs due to speed and hdd space issues?

Again thank you for this great piece of software that is making our work flow easy.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: JulianH on June 10, 2013, 02:06:01 AM
For 50D: You can't use cineform.... it either does funky colors or stuff like this. Unusable directly... need to output to cineform from like AE.
Cineform 444 works for me (installed the cineform studio premium trial). Made my last 2 video's this way...
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: bzhwindtalker on June 12, 2013, 05:03:38 PM
I made some tests with Rawnizer and a 50D, exporting to prores 444.
It worked nice enought but I had a lot of magenta...
Some people reported that the raw format changed in the latest builds, making it incompatible with older Raw2Dng builds.
Any input?
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Ffbcdn-sphotos-c-a.akamaihd.net%2Fhphotos-ak-frc1%2Fp160x160%2F995324_10151666222549617_721237343_n.jpg&hash=fc8ea8379dc9d1c62db41e1bc6ca85ee)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: artyg on June 12, 2013, 06:23:02 PM
I have same problem as above...

20:08:28 Start extracting dng from M0000000.RAW
20:08:30 Finished
20:08:30 Start converting tiff from M0000000.RAW
20:08:43 Finished
20:08:43 Start creating proxy from M0000000.RAW
20:08:43 Failed:
ffmpeg version N-35966-g1d0ae92, Copyright (c) 2000-2011 the FFmpeg developers
  built on Dec 19 2011 13:01:15 with gcc 4.6.2
  configuration: --enable-gpl --enable-version3 --disable-w32threads --enable-runtime-cpudetect --enable-avisynth --enable-bzlib --enable-frei0r --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libfreetype --enable-libgsm --enable-libmp3lame --enable-libopenjpeg --enable-librtmp --enable-libschroedinger --enable-libspeex --enable-libtheora --enable-libvo-aacenc --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libxavs --enable-libxvid --enable-zlib
  libavutil    51. 32. 0 / 51. 32. 0
  libavcodec   53. 46. 1 / 53. 46. 1
  libavformat  53. 27. 0 / 53. 27. 0
  libavdevice  53.  4. 0 / 53.  4. 0
  libavfilter   2. 53. 0 /  2. 53. 0
  libswscale    2.  1. 0 /  2.  1. 0
  libpostproc  51.  2. 0 / 51.  2. 0
Input #0, image2, from 'X:\RAW_Test\Source\Proxy_TIFF\M0000000.proxytiff\M%06d.tiff':
  Duration: 00:00:09.20, start: 0.000000, bitrate: N/A
    Stream #0:0: Video: tiff, rgba, 960x540, 24 fps, 24 tbr, 24 tbn, 24 tbc
X:\RAW_Test\Source\Video_Proxy\M0000000.proxy.mp4: No such file or directory

20:08:43 All items Finished

RAWanizer ver 0.5.3 Win 7 x64
no any kind of proxy =(
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: artyg on June 12, 2013, 07:03:09 PM
Yeee!!! It's Work! I don't now what I did, but...
This is my screens, maybe it halps anybody (sorry for my english, this is not my native language)

(https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2Fi5.pixs.ru%2Fthumbs%2F7%2F5%2F1%2FSnimok1PNG_9278058_8193751.jpg&hash=ccc244862f840a711d5a1be622ad7b6d) (http://pixs.ru/showimage/Snimok1PNG_9278058_8193751.png)(https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2Fi5.pixs.ru%2Fthumbs%2F7%2F7%2F3%2FSnimok2PNG_7493354_8193773.jpg&hash=7094841e001d30ccbd7488958c2678d4) (http://pixs.ru/showimage/Snimok2PNG_7493354_8193773.png)(https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2Fi5.pixs.ru%2Fthumbs%2F7%2F7%2F7%2FSnimok3PNG_7870027_8193777.jpg&hash=310e720e2295a6e54ec462e4b604db27) (http://pixs.ru/showimage/Snimok3PNG_7870027_8193777.png)(https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2Fi5.pixs.ru%2Fthumbs%2F7%2F8%2F0%2FSnimok4PNG_6177809_8193780.jpg&hash=ddd64f1d8470f450050087030b6dff01) (http://pixs.ru/showimage/Snimok4PNG_6177809_8193780.png)(https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2Fi5.pixs.ru%2Fthumbs%2F7%2F8%2F4%2FSnimok5PNG_2233745_8193784.jpg&hash=1926c1702935fb5792d5e75cc042f0d5) (http://pixs.ru/showimage/Snimok5PNG_2233745_8193784.png)

RAWanizer create M0000002.proxy.mov file near original RAW file
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on June 12, 2013, 10:16:21 PM
I made some tests with Rawnizer and a 50D, exporting to prores 444.
It worked nice enought but I had a lot of magenta...
Some people reported that the raw format changed in the latest builds, making it incompatible with older Raw2Dng builds.
Any input?
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Ffbcdn-sphotos-c-a.akamaihd.net%2Fhphotos-ak-frc1%2Fp160x160%2F995324_10151666222549617_721237343_n.jpg&hash=fc8ea8379dc9d1c62db41e1bc6ca85ee)

I didn't know that. You can always download your own raw2dng.exe and replace the existing. It's in c:\program files(x86)\rawanizer\tools. Please report back if it helps. I don't get any magenta with my 5D mkII, but I use June 4th build.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on June 12, 2013, 10:19:42 PM
Took a break from programming and went out in my garden with my 5D mkII. Processed with RAWanizer of course :)



Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: artyg on June 13, 2013, 10:13:23 AM
Took a break from programming and went out in my garden with my 5D mkII. Processed with RAWanizer of course :)

Niiice!!! What optic did you use there? One funny comment - I watched the video clip and I were singing birds outside the window ... I did not realize that they are singing outside my window, and not in the video! Very inspiring! Thank you;)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: dandeliondandy on June 13, 2013, 07:47:50 PM
I love the program as the proxy files can be extremely helpful for an editing workflow. However, about half the time I get this sort of message when trying to make the videos. If I'm converting two RAW files sometimes the first will get a working proxy video, the second will give this error. And repeated attempts don't change it. Is it the file or maybe a setting? Using 5.3

13:30:55 Start converting tiff from join.dng
13:35:17 Finished
13:35:17 Start creating proxy from join.dng
13:35:18 Failed:
ffmpeg version N-35966-g1d0ae92, Copyright (c) 2000-2011 the FFmpeg developers
  built on Dec 19 2011 13:01:15 with gcc 4.6.2
  configuration: --enable-gpl --enable-version3 --disable-w32threads --enable-runtime-cpudetect --enable-avisynth --enable-bzlib --enable-frei0r --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libfreetype --enable-libgsm --enable-libmp3lame --enable-libopenjpeg --enable-librtmp --enable-libschroedinger --enable-libspeex --enable-libtheora --enable-libvo-aacenc --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libxavs --enable-libxvid --enable-zlib
  libavutil    51. 32. 0 / 51. 32. 0
  libavcodec   53. 46. 1 / 53. 46. 1
  libavformat  53. 27. 0 / 53. 27. 0
  libavdevice  53.  4. 0 / 53.  4. 0
  libavfilter   2. 53. 0 /  2. 53. 0
  libswscale    2.  1. 0 /  2.  1. 0
  libpostproc  51.  2. 0 / 51.  2. 0
Input #0, image2, from 'G:\RAW video test\window\join.dng\proxytiff\M%06d.tiff':
  Duration: 00:02:24.41, start: 0.000000, bitrate: N/A
    Stream #0:0: Video: tiff, rgba, 940x353, 24 fps, 24 tbr, 24 tbn, 24 tbc
Input #1, wav, from 'C:\Program Files (x86)\RAWanizer\Tools\dummy1s.wav':
  Metadata:
    TCOD            : 0
    TCDO            : 9986848
  Duration: 00:00:00.99, bitrate: 706 kb/s
    Stream #1:0: Audio: pcm_s16le ([1][0][0][0] / 0x0001), 44100 Hz, 1 channels, s16, 705 kb/s
Incompatible pixel format 'rgba' for codec 'libx264', auto-selecting format 'yuv420p'
[buffer @ 03564FC0] w:940 h:353 pixfmt:rgba tb:1/1000000 sar:0/1 sws_param:
[buffersink @ 03565020] auto-inserting filter 'auto-inserted scale 0' between the filter 'src' and the filter 'out'
[scale @ 035650E0] w:940 h:353 fmt:rgba -> w:940 h:353 fmt:yuv420p flags:0x4
[libx264 @ 03589740] height not divisible by 2 (940x353)
Output #0, mp4, to 'G:\RAW video test\window\join.proxy.mp4':
    Stream #0:0: Video: h264, yuv420p, 940x353, q=-1--1, 5000 kb/s, 90k tbn, 24 tbc
    Stream #0:1: Audio: none, 44100 Hz, 1 channels, s16, 128 kb/s
Stream mapping:
  Stream #0:0 -> #0:0 (tiff -> libx264)
  Stream #1:0 -> #0:1 (pcm_s16le -> aac)
Error while opening encoder for output stream #0:0 - maybe incorrect parameters such as bit_rate, rate, width or height
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: bzhwindtalker on June 13, 2013, 09:13:07 PM
Hey, I did quite a lot of testing,
It seems that I can only outpout working h264, prores444 does not play either in premiere or vlc/media player, and DNxHD seem to outpout regular H264? However I noticed that checking the box "use ffmbc" makes thing work better for vidéo generation.
The H264 is nice as a proxy but it's not the best for editing... would it be possible to use RAWanizer to outpout folders containing TIFFs to be used as images sequences? I guess it's possible as it already does it for video proxy generation.
Adam
Title: Re: RAWanizer - windows batch generation of proxy files from RAW
Post by: random on June 14, 2013, 12:20:07 AM
Added DNxHD as an option for the proxy file.

Download the patch from the original post.

Is the DNxHD/185 a 8bit or a 10bit version?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: artyg on June 14, 2013, 07:15:25 AM
would it be possible to use RAWanizer to outpout folders containing TIFFs to be used as images sequences? I guess it's possible as it already does it for video proxy generation.
Adam

Yes, it's possible!

(https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2Fi5.pixs.ru%2Fthumbs%2F5%2F8%2F9%2FSnimok1PNG_9581582_8204589.jpg&hash=7a1045de39bd5c06482afd760080d1ac) (http://pixs.ru/showimage/Snimok1PNG_9581582_8204589.png) (https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2Fi.pixs.ru%2Fthumbs%2F5%2F9%2F7%2FSnimok2PNG_2694105_8204597.jpg&hash=b15fdef046f8312f5b06d34cd374dfd0) (http://pixs.ru/showimage/Snimok2PNG_2694105_8204597.png)

Tiff will be generated in this folder. But, how do you think to work with proxy tiff sequences? In Premiere, for example, when I import image sequence, I need to select each sequence and press "import as sequence" button. And this is for avery clip... Very painfully and inefficiency.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: bzhwindtalker on June 14, 2013, 10:36:11 AM
Yeah I agree with you, importing individual image sequences is a pain!But Rigth now I can't get anything else than H264 working for proxy video, and that's basicaly what we try to avoid shooting raw!

So leaving the video out field blank will cause the video proxy generation to fail so I will just have tiff sequences in individual folders? Nice, I will try that, thanks. BTW I changed the raw2dng to the latest one and I'm still getting pink tones from my 50D files, but raw2dng does it too :/
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: artyg on June 14, 2013, 10:59:30 AM
Yeah I agree with you, importing individual image sequences is a pain!But Rigth now I can't get anything else than H264 working for proxy video, and that's basicaly what we try to avoid shooting raw!

But I do not see any problems with this... We do proxies with which we work in NLE, then do XML and conform in Resolve. Where we can color correct and grade what we want. Or am I wrong? (Of course, it remains to solve the problem with the right conform XML in Resolve)

So leaving the video out field blank will cause the video proxy generation to fail so I will just have tiff sequences in individual folders? Nice, I will try that, thanks. BTW I changed the raw2dng to the latest one and I'm still getting pink tones from my 50D files, but raw2dng does it too :/

No, video proxy will generate near the original RAW and TIFF will generate whare you set. In RAWanizer video proxy generate from tiff proxy. And yes! I also have pink in overbright areas
(https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2Fi5.pixs.ru%2Fthumbs%2F1%2F7%2F9%2FSnimokPNG_9810339_8206179.jpg&hash=3267300719bc9c369ccddac9498d22e3) (http://pixs.ru/showimage/SnimokPNG_9810339_8206179.png)

In Resolve I fix this with HUE vs SAT but it's strange...
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: bzhwindtalker on June 14, 2013, 04:51:13 PM
I was more looking at a simpler workflow that could be used on simple projects, ouputing to a 10-12bit video file that could directly be imported into premiere and retain much of the info for simple CC, as I don't own resolve nor know how to use it :/

So far I have only been able to oupout H264 or prores 444 files that premiere won't open?? the later seem to be a good file for what I want to do but maybe my premiere setup is not good, I have been able to read the files with quicktime fine...

Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on June 14, 2013, 06:54:21 PM
I love the program as the proxy files can be extremely helpful for an editing workflow. However, about half the time I get this sort of message when trying to make the videos. If I'm converting two RAW files sometimes the first will get a working proxy video, the second will give this error. And repeated attempts don't change it. Is it the file or maybe a setting? Using 5.3


The ffmpeg libx264 can be picky about video resolutions. 940x353 sounds like it could be problematic. In the preset for mp4 I added a scale setting that has worked for me. Can you check that you have -vf "scale=1920:trunc(ow/a/2)*2" in the preset you are using. This scales up to 1920 and may cut some lines to make it work.

You can change the 1920 width to something you like better.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on June 14, 2013, 07:05:50 PM
Hey, I did quite a lot of testing,
It seems that I can only outpout working h264, prores444 does not play either in premiere or vlc/media player, and DNxHD seem to outpout regular H264? However I noticed that checking the box "use ffmbc" makes thing work better for vidéo generation.
The H264 is nice as a proxy but it's not the best for editing... would it be possible to use RAWanizer to outpout folders containing TIFFs to be used as images sequences? I guess it's possible as it already does it for video proxy generation.
Adam

The prores444 preset i found somewhere on the web. It doesn't play in my vlc, but my sony vegas nle opens the file fine.

The DNxHD does not output regular h264, at least not for me. I get a valid DNxHD that open up fine in sony vegas and also plays fine with vlc.

If you only want tiffs I can see two workarounds. Just let the tool make the proxy mp4 and then trash the mp4 file, the TIFFs will still be there. Or choose to make mp4 and also uncheck 'do all process steps before next item in queue', then it will first extract all dngs for the raws, then it will create all tiffs. It will also create all mp4 in the last step, but then you can just hit cancel and all tiffs should be there.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on June 14, 2013, 07:15:39 PM
I have uploaded a new version, see link in first post.

Now settings are applied when processing starts which I hope will help some people who experience that the settings "does not work" since they have changed settings after items has been added to the queue.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on June 14, 2013, 07:17:15 PM
Niiice!!! What optic did you use there? One funny comment - I watched the video clip and I were singing birds outside the window ... I did not realize that they are singing outside my window, and not in the video! Very inspiring! Thank you;)

Used a 300/2.8 for all the shots. Well, I think I even used a 2x extender on some.
Title: Re: RAWanizer - windows batch generation of proxy files from RAW
Post by: marten on June 14, 2013, 07:18:57 PM
Is the DNxHD/185 a 8bit or a 10bit version?

To tell you the truth, I don't know. If you look at the settings for the preset you see all parameters, I do not add to that.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on June 14, 2013, 07:21:45 PM
I was more looking at a simpler workflow that could be used on simple projects, ouputing to a 10-12bit video file that could directly be imported into premiere and retain much of the info for simple CC, as I don't own resolve nor know how to use it :/

So far I have only been able to oupout H264 or prores 444 files that premiere won't open?? the later seem to be a good file for what I want to do but maybe my premiere setup is not good, I have been able to read the files with quicktime fine...

I forgot, if you have problem with DNxHD, you may have to download the DNxHD codec from Avid website (free). I think ffmpeg is relying on that somehow. On one machine I had to do that to get it to work.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: bzhwindtalker on June 14, 2013, 08:32:33 PM
The prores444 preset i found somewhere on the web. It doesn't play in my vlc, but my sony vegas nle opens the file fine.

The DNxHD does not output regular h264, at least not for me. I get a valid DNxHD that open up fine in sony vegas and also plays fine with vlc.
I have no froking idea of what I did but now prores is working... just as I wanted it to! the only thing tat changed is the resolution, I was previousely shoting on a T2i at 1024px, those would not play when converted to prores, now it seems to be working with 50D files at almost 1600px, I don't see how this could have caused the issue.

 Anyways thanks for the soft man, it really eases the workflow for me!

Does it get simpler than this?

Camera > .RAW > RAWanizer> Prores 444 > premiere > H264> vimeo

I did not test this for data loss over 16bit tiff but that's something I will do!
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: dandeliondandy on June 14, 2013, 08:53:27 PM
Any idea why I'm getting my error?

Thanks!
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on June 14, 2013, 11:21:57 PM
Any idea why I'm getting my error?

Thanks!

I did give a suggestion to look at in a post http://www.magiclantern.fm/forum/index.php?topic=5557.msg50958#msg50958 (http://www.magiclantern.fm/forum/index.php?topic=5557.msg50958#msg50958). I do believe ffmpeg has problem with your resolution.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on June 14, 2013, 11:25:13 PM
I did not test this for data loss over 16bit tiff but that's something I will do!

If you set dcraw settings to 16-bit the tiff files will be 16-bit for sure. But I don't know for sure if ffmeg/ffmbc handles them correctly, but I hope so.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: mkrjf on June 15, 2013, 01:40:01 AM
Anybody working or interested in working on Mac osx equivalent?!
Even if it is a CPU hog getting prores444 from Mac workflow would be perfect
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: KahL on June 15, 2013, 02:03:30 AM
Sooooo I accidentally deleted the DNxHD option and now I cannot get it back. Is there any way of retrieving it (ver 0.5.4)? :-(
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on June 15, 2013, 09:25:57 AM
Sooooo I accidentally deleted the DNxHD option and now I cannot get it back. Is there any way of retrieving it (ver 0.5.4)? :-(

You can delete the user.config files found in C:\Users\YourUserName\AppData\Local\RAWanizer folder. That should bring back all defaults, but you'll loose all your other settings.

Or you can take this string and paste it to a new setting:
-threads 8 -r {InputVideoFps} -i "{InputVideoName}" -i "{InputAudioName}" -vcodec dnxhd -b 185M {ScaleTo1920x1080} -r {InputVideoFps} {Parameters} "{OutputVideoName}.mov"
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: bzhwindtalker on June 15, 2013, 12:55:34 PM
Would it be possible to add a checkbox for deleting DNG after proxy creation? Sorry to just ask and expect  :)
Btw I converted 32GB of footage without issue on my laptop. It just stopped on the few last clips when my HDD was full haha
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on June 15, 2013, 05:14:25 PM
Would it be possible to add a checkbox for deleting DNG after proxy creation? Sorry to just ask and expect  :)
Btw I converted 32GB of footage without issue on my laptop. It just stopped on the few last clips when my HDD was full haha

Added in new version 0.5.5 (link in first post)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on June 15, 2013, 05:15:20 PM
Sooooo I accidentally deleted the DNxHD option and now I cannot get it back. Is there any way of retrieving it (ver 0.5.4)? :-(

In version 0.5.5 there is a button on the file settings tab to restore default presets.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: bzhwindtalker on June 15, 2013, 05:47:01 PM
Added in new version 0.5.5 (link in first post)

Tanks ! You rock!
Now I just need to get rid of the pink tone (issue not related to RAWanizer)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: KahL on June 17, 2013, 08:02:51 PM
I'm getting the same error as everyone else beforehand.

13:54:30 Start converting tiff from Cntrl Park North.001.dng
13:57:32 Finished
13:57:32 Start creating proxy from Cntrl Park North.001.dng
13:57:32 Failed:
ffmpeg version N-35966-g1d0ae92, Copyright (c) 2000-2011 the FFmpeg developers
  built on Dec 19 2011 13:01:15 with gcc 4.6.2
  configuration: --enable-gpl --enable-version3 --disable-w32threads --enable-runtime-cpudetect --enable-avisynth --enable-bzlib --enable-frei0r --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libfreetype --enable-libgsm --enable-libmp3lame --enable-libopenjpeg --enable-librtmp --enable-libschroedinger --enable-libspeex --enable-libtheora --enable-libvo-aacenc --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libxavs --enable-libxvid --enable-zlib
  libavutil    51. 32. 0 / 51. 32. 0
  libavcodec   53. 46. 1 / 53. 46. 1
  libavformat  53. 27. 0 / 53. 27. 0
  libavdevice  53.  4. 0 / 53.  4. 0
  libavfilter   2. 53. 0 /  2. 53. 0
  libswscale    2.  1. 0 /  2.  1. 0
  libpostproc  51.  2. 0 / 51.  2. 0
R:\Central Park North 110st\Cntrl Park North.001.dng\proxytiff\Cntrl Park North.001-%06d.tiff: No such file or directory

13:57:32 All items Finished


What's happening here? How do I prevent this?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on June 17, 2013, 10:27:02 PM
I'm getting the same error as everyone else beforehand.

13:54:30 Start converting tiff from Cntrl Park North.001.dng
13:57:32 Finished
13:57:32 Start creating proxy from Cntrl Park North.001.dng
13:57:32 Failed:
ffmpeg version N-35966-g1d0ae92, Copyright (c) 2000-2011 the FFmpeg developers
  built on Dec 19 2011 13:01:15 with gcc 4.6.2
  configuration: --enable-gpl --enable-version3 --disable-w32threads --enable-runtime-cpudetect --enable-avisynth --enable-bzlib --enable-frei0r --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libfreetype --enable-libgsm --enable-libmp3lame --enable-libopenjpeg --enable-librtmp --enable-libschroedinger --enable-libspeex --enable-libtheora --enable-libvo-aacenc --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libxavs --enable-libxvid --enable-zlib
  libavutil    51. 32. 0 / 51. 32. 0
  libavcodec   53. 46. 1 / 53. 46. 1
  libavformat  53. 27. 0 / 53. 27. 0
  libavdevice  53.  4. 0 / 53.  4. 0
  libavfilter   2. 53. 0 /  2. 53. 0
  libswscale    2.  1. 0 /  2.  1. 0
  libpostproc  51.  2. 0 / 51.  2. 0
R:\Central Park North 110st\Cntrl Park North.001.dng\proxytiff\Cntrl Park North.001-%06d.tiff: No such file or directory

13:57:32 All items Finished


What's happening here? How do I prevent this?

As it states in the known issues in original post (easy to miss, I understand): Does not work with spaces in the file names. I think this is your problem.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: dandeliondandy on June 18, 2013, 03:24:36 AM
The ffmpeg libx264 can be picky about video resolutions. 940x353 sounds like it could be problematic. In the preset for mp4 I added a scale setting that has worked for me. Can you check that you have -vf "scale=1920:trunc(ow/a/2)*2" in the preset you are using. This scales up to 1920 and may cut some lines to make it work.

You can change the 1920 width to something you like better.

Sorry, didn't see this! Thanks. I didn't have anything like that in my preset so I added it as the bottom line under the other settings, and I'll give it a test soon to see if that helps anything.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: KahL on June 18, 2013, 04:58:20 AM
As it states in the known issues in original post (easy to miss, I understand): Does not work with spaces in the file names. I think this is your problem.

Ooooohh, I see. GOTCHA, and thanks, man. Pardon my ignorance on that O_o
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: creese13 on June 18, 2013, 07:43:30 AM
Nice App Marten. Works Seamless with the raw files right from the camera.  When I try to use "Make video from output of external dng converter", it gives error msg.  I have no spaces in the file name and created sub "tiff" folder within the dng folder.  Any Clue what I'm doing wrong? I use the same file structure the app creates when converting the org raw.  Funny thing is if I delete the video created from the raw process, select "dng folders" option at the top and change the "proxytiff" folder to just 'tiff" it recreates the video with no problem, but with outside dng file folders not created by this app it doesn't like for some reason.  Hope that makes sense. 

01:25:34 Start creating video from DNG002.dng
01:25:34 Failed:
ffmpeg version N-35966-g1d0ae92, Copyright (c) 2000-2011 the FFmpeg developers
  built on Dec 19 2011 13:01:15 with gcc 4.6.2
  configuration: --enable-gpl --enable-version3 --disable-w32threads --enable-runtime-cpudetect --enable-avisynth --enable-bzlib --enable-frei0r --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libfreetype --enable-libgsm --enable-libmp3lame --enable-libopenjpeg --enable-librtmp --enable-libschroedinger --enable-libspeex --enable-libtheora --enable-libvo-aacenc --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libxavs --enable-libxvid --enable-zlib
  libavutil    51. 32. 0 / 51. 32. 0
  libavcodec   53. 46. 1 / 53. 46. 1
  libavformat  53. 27. 0 / 53. 27. 0
  libavdevice  53.  4. 0 / 53.  4. 0
  libavfilter   2. 53. 0 /  2. 53. 0
  libswscale    2.  1. 0 /  2.  1. 0
  libpostproc  51.  2. 0 / 51.  2. 0
C:\Users\Reese\Desktop\test\DNG002.dng\tiff\DNG002-%06d.tiff: No such file or directory

01:25:34 All items Finished
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: oddname on June 18, 2013, 10:48:14 AM
What am I doing wrong if I try the cineform export-option and get a really noisy image that even is worse than the in-camere h264?  Looks like really high iso noise, but its not
Doesnt look like raw to me at all. :(

Other modes work fine.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on June 18, 2013, 04:19:09 PM
What am I doing wrong if I try the cineform export-option and get a really noisy image that even is worse than the in-camere h264?  Looks like really high iso noise, but its not
Doesnt look like raw to me at all. :(

Other modes work fine.

For cineform the all conversion is handled by the cineform tool. Try asking you question here http://www.magiclantern.fm/forum/index.php?topic=5479.200 (http://www.magiclantern.fm/forum/index.php?topic=5479.200)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on June 18, 2013, 04:24:11 PM
Nice App Marten. Works Seamless with the raw files right from the camera.  When I try to use "Make video from output of external dng converter", it gives error msg.  I have no spaces in the file name and created sub "tiff" folder within the dng folder.  Any Clue what I'm doing wrong? I use the same file structure the app creates when converting the org raw.  Funny thing is if I delete the video created from the raw process, select "dng folders" option at the top and change the "proxytiff" folder to just 'tiff" it recreates the video with no problem, but with outside dng file folders not created by this app it doesn't like for some reason.  Hope that makes sense. 

01:25:34 Start creating video from DNG002.dng
01:25:34 Failed:
ffmpeg version N-35966-g1d0ae92, Copyright (c) 2000-2011 the FFmpeg developers
  built on Dec 19 2011 13:01:15 with gcc 4.6.2
  configuration: --enable-gpl --enable-version3 --disable-w32threads --enable-runtime-cpudetect --enable-avisynth --enable-bzlib --enable-frei0r --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libfreetype --enable-libgsm --enable-libmp3lame --enable-libopenjpeg --enable-librtmp --enable-libschroedinger --enable-libspeex --enable-libtheora --enable-libvo-aacenc --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libxavs --enable-libxvid --enable-zlib
  libavutil    51. 32. 0 / 51. 32. 0
  libavcodec   53. 46. 1 / 53. 46. 1
  libavformat  53. 27. 0 / 53. 27. 0
  libavdevice  53.  4. 0 / 53.  4. 0
  libavfilter   2. 53. 0 /  2. 53. 0
  libswscale    2.  1. 0 /  2.  1. 0
  libpostproc  51.  2. 0 / 51.  2. 0
C:\Users\Reese\Desktop\test\DNG002.dng\tiff\DNG002-%06d.tiff: No such file or directory

01:25:34 All items Finished

According to the log, ffmpeg can't find any files matching the path you see at the bottom. Can you verify that you have files matching that pattern. The file name of the first file should be DNG002-000000.tiff, second DNG002-000001.tiff

Which version of RAWanizer are you running?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: creese13 on June 18, 2013, 05:55:11 PM
According to the log, ffmpeg can't find any files matching the path you see at the bottom. Can you verify that you have files matching that pattern. The file name of the first file should be DNG002-000000.tiff, second DNG002-000001.tiff

Which version of RAWanizer are you running?

Thanks Marten for the reply.  I'm using the latest version and I see what's happening.  The org program I used created the DNG file names with an underscore and your program sees file names with dash.  So the org file name was DNG002_000000.tiff, I changed the file name to  DNG002-000000.tiff and it worked perfect.  Thanks hope this helps someone else.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: ted ramasola on June 23, 2013, 09:04:51 AM
Marten,

Using 5.5 I notice a problem with spanned shots.

1. scenario one, running rawanizer with source from CF card.
If I have a spanned file on the CF card it will fail in merge. Non spanned clips are ok, they will be extracted to a folder on my computer and the RAW clips Moved from CF to Hard disk. The spanned file will not be merged and extracted only the *.RAW file will be moved to hard disk but the *.R00/*.R01/etc. will remain in CF card.

2.scenario two, running rawanizer with source from folder in hard drive.
If i have 2 or more spanned clips in the que. Only one spanned clip will be successfully merged and extracted.
I delete the finished raw clips and leaving the unprocessed spanned clips, start rawanizer again and in second run its successful.

Is there a setting I am missing or something I am doing wrong?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: grooveminister on June 23, 2013, 11:27:21 AM
Fantastic tool!
0.4.3 is working fine here, but I can´t install 0.5.0 because I get:

"1152: Error extracting to the temporary location"

This is on Win7-64bit - I even tried to run the installer as admin...

Best wishes,
Andreas
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Levinson on June 28, 2013, 12:13:58 AM

Excellent program Marten, thanks again.

My only issue so far is the same as Ted's regarding the file spanning

Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: noisyboy on June 28, 2013, 03:46:41 AM
Hey Marten!

I hear that with RawMagic on Mac OS, you can select which camera you shot on and it will write the correct camera name into the metadata of the DNG's so you can use all the camera calibration options within ACR/Lightroom. Is that something that might find it's way into your ass kicking Rawanizer?

If I have this wrong then appologies. I only assume that this data is supposed to be written after and not during recording. I'm using a 6D and don't get any of those options of course this also means I can't use the custom profiles from people like VisionColor etc either.

Cheers bud! Great work  8)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on June 28, 2013, 11:58:11 AM
Hey Marten!

I hear that with RawMagic on Mac OS, you can select which camera you shot on and it will write the correct camera name into the metadata of the DNG's so you can use all the camera calibration options within ACR/Lightroom. Is that something that might find it's way into your ass kicking Rawanizer?

If I have this wrong then appologies. I only assume that this data is supposed to be written after and not during recording. I'm using a 6D and don't get any of those options of course this also means I can't use the custom profiles from people like VisionColor etc either.

Cheers bud! Great work  8)

RAWanizer is currently just a batch tool using other command line tools. So if those tools do not write metadata RAWanizer will not. Currently I have no plans to make this something else than just a batch tool.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on June 28, 2013, 11:59:44 AM
Marten,

Using 5.5 I notice a problem with spanned shots.

1. scenario one, running rawanizer with source from CF card.
If I have a spanned file on the CF card it will fail in merge. Non spanned clips are ok, they will be extracted to a folder on my computer and the RAW clips Moved from CF to Hard disk. The spanned file will not be merged and extracted only the *.RAW file will be moved to hard disk but the *.R00/*.R01/etc. will remain in CF card.

2.scenario two, running rawanizer with source from folder in hard drive.
If i have 2 or more spanned clips in the que. Only one spanned clip will be successfully merged and extracted.
I delete the finished raw clips and leaving the unprocessed spanned clips, start rawanizer again and in second run its successful.

Is there a setting I am missing or something I am doing wrong?

Ok. I will have a look at it. My job is currently taking all my time so I have little time left for RAWanizer  :(
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: AdamTheBoy on July 05, 2013, 07:33:07 AM
Following your workflow has been awesome, Rawanizer is really awesome and I hope you are able to just keep improving it.  Thanks so much!
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: sarotaz on July 05, 2013, 08:45:18 AM
Fantastic utility. It speeds up my workflow. Short questions:

1) my 60D is affected by bad pixel. Can i overwrite raw2dng.exe, located in tools folder, with last version released from Marekk with badpixel_opcode optimization?
2) Does tiff contain metadata from camera raw?
3) is there a way to reconvert dng file to 16 or 10 bit (including metadata) for work with resolve?

Thanks in advance.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: sarotaz on July 05, 2013, 08:50:24 AM
Sorry fot double post -.-
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: ted ramasola on July 06, 2013, 06:52:27 AM
Fantastic utility. It speeds up my workflow. Short questions:

1) my 60D is affected by bad pixel. Can i overwrite raw2dng.exe, located in tools folder, with last version released from Marekk with badpixel_opcode optimization?
2) Does tiff contain metadata from camera raw?
3) is there a way to reconvert dng file to 16 or 10 bit (including metadata) for work with resolve?

Thanks in advance.

1. I tried it and its ok.
2. not sure about this but when I open the dngs in acr it does know my camera model.
3. for rawanizer, not yet. chmee's raw2cdng can do that now.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: eyeland on July 07, 2013, 07:35:46 AM
Hey Marten!
I hear that with RawMagic on Mac OS, you can select which camera you shot on and it will write the correct camera name into the metadata of the DNG's so you can use all the camera calibration options within ACR/Lightroom. Is that something that might find it's way into your ass kicking Rawanizer?
+1
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: gentlemanbroncos on July 07, 2013, 10:37:30 AM
Not sure if this is the place to post this, but I'm having trouble extracting dng files from my raw files larger than 4 gigs. Any help on this subject would be greatly appreciated. Thanks.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: bluewater on July 10, 2013, 08:04:08 PM
Marten,

I want to convert RAW->DNG (via RAWanizer)
                  DNG->TIF (including color editing)  via Lightroom
                 
Then I "REally want to convert this "TIF" (not TIFF ) into MOV file.
                 
However, all I can do is just press start button and see "error message".


What's the problem?


 What I did was...
 1. changing file names from .TIF to .TIFF
 2. Making tiff subfolder in DNG folder RAWanizer made when I convert RAW to DNG.
 3. put .TIFF files into the tiff folder I made above.
 4. pressing "start" button in RAWanizer clicking "RAW files" "DNG folders" "Watch folder" "Auto TS"


 I tried ver. 0.3.3, 0.4.2, 0.5, 0.55. but the results are the same.


Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: ToniX on July 12, 2013, 09:49:54 PM
I tried to install several times Rawanizer, wishing to test the suggested workflow (also installed Lightworks)but regardless the version I always ger error message:not a valid win 32 app.   I run win xp :-\ 
Any idea? needs xp64 or newer OS to run?

Thanks
Title: Compatibility with Resolve lite
Post by: ted ramasola on July 15, 2013, 09:35:21 AM
Marten,

Since Black Magic Resolve now supports DNGs from ML raw, I tested the extracts from Jul 2 build of raw2dng.exe and found out that the DNGs using drag n drop can now indeed be opened by resolve, however, the ones extracted from Rawanizer CAN'T be opened.

Can you make modifications to include the compatibility of the extracted files to be opened in resolve?

Thanks Ted
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: bzhwindtalker on July 17, 2013, 10:15:50 PM
I'm still using a direct export to prores 444, and I found that setting quality to 3 under build custom dcraw helped a LOT with moiré and quality, and I did not notice a performance drop. I like this workflow, it's so simple, thanks again.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: peewee69 on July 18, 2013, 12:48:48 PM
Hey .. Impressive tool and very useful .. good work ! Thanks ..
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: tonkabike on July 19, 2013, 09:06:23 PM
How do you get rawanizer to process dng from several clips to one subfolder so that you can set up a directory to the media pool in resolve so you dont have to choose folders for your clips one by one.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on July 23, 2013, 11:26:48 AM
Marten,

Using 5.5 I notice a problem with spanned shots.

1. scenario one, running rawanizer with source from CF card.
If I have a spanned file on the CF card it will fail in merge. Non spanned clips are ok, they will be extracted to a folder on my computer and the RAW clips Moved from CF to Hard disk. The spanned file will not be merged and extracted only the *.RAW file will be moved to hard disk but the *.R00/*.R01/etc. will remain in CF card.

2.scenario two, running rawanizer with source from folder in hard drive.
If i have 2 or more spanned clips in the que. Only one spanned clip will be successfully merged and extracted.
I delete the finished raw clips and leaving the unprocessed spanned clips, start rawanizer again and in second run its successful.

With the 0.6.0 version I hope I fixed scenario two.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on July 23, 2013, 11:43:06 AM
I tried to install several times Rawanizer, wishing to test the suggested workflow (also installed Lightworks)but regardless the version I always ger error message:not a valid win 32 app.   I run win xp :-\ 
Any idea? needs xp64 or newer OS to run?

Thanks

RAWanizer requires .NET 4.5 which doesn't work on xp.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on July 23, 2013, 11:44:44 AM
Marten,

I want to convert RAW->DNG (via RAWanizer)
                  DNG->TIF (including color editing)  via Lightroom
                 
Then I "REally want to convert this "TIF" (not TIFF ) into MOV file.
                 
However, all I can do is just press start button and see "error message".


What's the problem?


 What I did was...
 1. changing file names from .TIF to .TIFF
 2. Making tiff subfolder in DNG folder RAWanizer made when I convert RAW to DNG.
 3. put .TIFF files into the tiff folder I made above.
 4. pressing "start" button in RAWanizer clicking "RAW files" "DNG folders" "Watch folder" "Auto TS"


 I tried ver. 0.3.3, 0.4.2, 0.5, 0.55. but the results are the same.

On the processing tab, did you check 'make video from output of external converter'?
Title: Re: Compatibility with Resolve lite
Post by: marten on July 23, 2013, 11:46:41 AM
Marten,

Since Black Magic Resolve now supports DNGs from ML raw, I tested the extracts from Jul 2 build of raw2dng.exe and found out that the DNGs using drag n drop can now indeed be opened by resolve, however, the ones extracted from Rawanizer CAN'T be opened.

Can you make modifications to include the compatibility of the extracted files to be opened in resolve?

Thanks Ted
I have included the latest raw2dng in 0.6.0 which should work. I don't have a computer with good enough graphics card so I can't test this in Resolve though :(
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on July 23, 2013, 11:49:04 AM
How do you get rawanizer to process dng from several clips to one subfolder so that you can set up a directory to the media pool in resolve so you dont have to choose folders for your clips one by one.

I have made an option on the file tab to put all dng in same folder. But I can't test if it's behaving correctly because I don't have a computer with good enough graphics card to run Resolve :(
Title: Re: Compatibility with Resolve lite
Post by: ted ramasola on July 25, 2013, 07:24:39 AM
I have included the latest raw2dng in 0.6.0 which should work. I don't have a computer with good enough graphics card so I can't test this in Resolve though :(

Thank you for the updates Marten,

Will test it asap.
Title: Re: Compatibility with Resolve lite
Post by: ted ramasola on July 25, 2013, 09:39:21 AM
I have included the latest raw2dng in 0.6.0 which should work. I don't have a computer with good enough graphics card so I can't test this in Resolve though :(

just tested 0.6.0 and dngs still cannot be opend with RESOLVE.
Title: Re: Compatibility with Resolve lite
Post by: marten on July 25, 2013, 09:53:38 AM
just tested 0.6.0 and dngs still cannot be opend with RESOLVE.

Ok. I have been on vacation for some weeks and have not really followed the progress of ML lately. So what is required to do with the RAW file to get it to open in resolve? I just assumed that using the latest raw2dng would be enough. Downloaded from link in this post http://www.magiclantern.fm/forum/index.php?topic=5404.0 (http://www.magiclantern.fm/forum/index.php?topic=5404.0)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Dimitri de la monte on July 25, 2013, 11:54:21 AM
Resolve can only open Cinema DNG files. So it only works with the "raw2cdng.exe" ;-) I hope you can implement it to rawanizer :-)

You can download it here: http://www.phreekz.de/wordpress/2013/06/magiclantern-raw2cdng-cinema-dng/

and this ist the ML tread: http://www.magiclantern.fm/forum/index.php?topic=5618.0
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: ted ramasola on July 25, 2013, 07:16:19 PM
Resolve can only open Cinema DNG files. So it only works with the "raw2cdng.exe" ;-) I hope you can implement it to rawanizer :-)

You can download it here: http://www.phreekz.de/wordpress/2013/06/magiclantern-raw2cdng-cinema-dng/

and this ist the ML tread: http://www.magiclantern.fm/forum/index.php?topic=5618.0

resolve already opens DNGs from magic lantern Raw video. No need to use CDNGs.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: chmee on July 25, 2013, 07:40:39 PM
[resolve] since 9.1.5. just to be clear on that ;)
Title: Re: Compatibility with Resolve lite
Post by: ted ramasola on July 25, 2013, 08:10:52 PM
Ok. I have been on vacation for some weeks and have not really followed the progress of ML lately. So what is required to do with the RAW file to get it to open in resolve? I just assumed that using the latest raw2dng would be enough. Downloaded from link in this post http://www.magiclantern.fm/forum/index.php?topic=5404.0 (http://www.magiclantern.fm/forum/index.php?topic=5404.0)

Marten,

I did some tests with your new build.

I found out why your files can't be seen by resolve, its the way your FOLDERS are named. For example:

M25-1248.dng

I renamed them to say, folder1 or footage and now Resolve can see it.

The extracted dng frames inside the folders OPEN with resolve no problems.

if you can find a way to name it intuitively without the dot (.dng) it would work.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: ted ramasola on July 25, 2013, 09:19:22 PM
With the 0.6.0 version I hope I fixed scenario two.

scenario #2 is now fixed!

for scenario #1 I think the way your program works now is that it merges spanned files IN THE SOURCE. This is not good since usually the source will be full and thus give you fail result, also it it slow.

I think you should program it to do the merging process in the destination folder.

Also its not so clear, but is there an option that the sources will be left or just copied and not moved? For safety reason.
I think you have that but I guess the option words are not clear to me , sorry.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Supermac on July 27, 2013, 04:06:46 AM
Hi, I just installed the new version. It still had files loaded up on the screen that I converted from the previous install. I clicked delete files from disk to remove them from the window and I just realised that it may have actually removed the files from my hard disk, is this right? I can still see the spanned files but not the original raw file.

Thanks
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: lilpillz on July 27, 2013, 05:46:25 AM
Once I've converted my raw files to dngs
And have gone in edited the dngs in ACR
How do I get RAWanizer to make that into a .mov?

I must be using the wrong settings because I only end up creating tiffs and a proxy mov from dngs
These both do not have the edits that have occurred in ACR- it is just the original look of the dngs pre edit

Have I selected the wrong folders or not clicked the right buttons- please help
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: bzhwindtalker on July 27, 2013, 10:43:54 PM
Helo guys! when using rawanizer I noticed that there is some sort of auto exposure thing going on with the prores proxies, I can't use them because they flicker... any ideas? my footage are fine (tested on a diferent workflow)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: eyeland on July 28, 2013, 01:42:41 PM
Perhaps I missed something obvious, but I am experiencing an issue, where my DNGs seemingly come out with lossy compression even though I choose "lossless".
Jut ran a 132GB batch over night and most of the DNG's came out around 800-900kb and not the ~2.5mb that I'd expect, resulting in an output of ~33GB  any thoughts?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: pinger007 on July 30, 2013, 04:38:48 AM
Can't wait to test V0.6.0!!!  I've been using 0.5.5 for over a month and it's been great!  Definitely the best workflow around (edit proxies quickly, then replace with DNG sequences for final grade and output).  Keep up the good work.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Francis Frenkel on July 30, 2013, 09:09:13 AM
Hello

Impossible to open the application...
I get this error message after installation, when I double clic in the icon :

Error CLR : 8000-4005
The application will close


Could you help me ?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on July 30, 2013, 10:24:55 AM
Hello

Impossible to open the application...
I get this error message after installation, when I double clic in the icon :

Error CLR : 8000-4005
The application will close


Could you help me ?

Are yuu running windows xp? (RAWanizer cannot run on XP) If you run win 7 or later, try reinstalling .net framwork ver 4.5 from microsoft.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on July 30, 2013, 10:27:03 AM
Perhaps I missed something obvious, but I am experiencing an issue, where my DNGs seemingly come out with lossy compression even though I choose "lossless".
Jut ran a 132GB batch over night and most of the DNG's came out around 800-900kb and not the ~2.5mb that I'd expect, resulting in an output of ~33GB  any thoughts?

RAWanizer do not compress anything and there is no option to choose 'lossless'. Are you using BATCHelor? Then you are in the wrong thread asking the question.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on July 30, 2013, 10:29:31 AM
Helo guys! when using rawanizer I noticed that there is some sort of auto exposure thing going on with the prores proxies, I can't use them because they flicker... any ideas? my footage are fine (tested on a diferent workflow)

The only thing that can affect this is your settings for dcraw. Use the default or remove the entire string with develop settings and see if you still have flicker.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on July 30, 2013, 10:36:40 AM
Hi, I just installed the new version. It still had files loaded up on the screen that I converted from the previous install. I clicked delete files from disk to remove them from the window and I just realised that it may have actually removed the files from my hard disk, is this right? I can still see the spanned files but not the original raw file.

Thanks

'Delete files from disk' does what it says, deletes the files from disk. It also asks for confirmation if you are sure you want to permanently delete the files. So don't use it if you don't want to delete the files from disk.

There might be a bug when the files are spanned though.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on July 30, 2013, 10:42:49 AM
Once I've converted my raw files to dngs
And have gone in edited the dngs in ACR
How do I get RAWanizer to make that into a .mov?

I must be using the wrong settings because I only end up creating tiffs and a proxy mov from dngs
These both do not have the edits that have occurred in ACR- it is just the original look of the dngs pre edit

Have I selected the wrong folders or not clicked the right buttons- please help

Please read the original post, but notice that the name of processing options have changed. To extract the dng to use in ACR, select 'only extract dng from raw'. Then when you have exported the tiffs from ACR into the 'tiff' subfolder, use the processing option 'make video from output of external dng converter' to make the video file.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on July 30, 2013, 10:44:20 AM
Can't wait to test V0.6.0!!!  I've been using 0.5.5 for over a month and it's been great!  Definitely the best workflow around (edit proxies quickly, then replace with DNG sequences for final grade and output).  Keep up the good work.
Thanks, glad it's useful for someone :)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: kgv5 on July 30, 2013, 06:11:15 PM
Can't wait to test V0.6.0!!!  I've been using 0.5.5 for over a month and it's been great!  Definitely the best workflow around (edit proxies quickly, then replace with DNG sequences for final grade and output).  Keep up the good work.

Is there any way to replace proxies faster than clicking one by one like i do it?
I do it like this:
rawanizer - i make mp4 proxies
import proxies to premiere
edit
i select all clips and make replacement with AE composition
in AE i am right clicking on every clip and just replacing them with original DNGs (and making ACR grading)
i am adding some additional color grading with MB looks
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Francis Frenkel on July 30, 2013, 10:12:28 PM
Are yuo running windows xp? (RAWanizer cannot run on XP) If you run win 7 or later, try reinstalling .net framwork ver 4.5 from microsoft.

I did it again (re-installation of framework 4.5 for windows 7 SP1 64bits but it doesn't work anyway...).

Still the same error message.

NO chance to use your famous application ?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: ted ramasola on August 01, 2013, 05:39:41 AM
Hi Marten,

Hope you can fix the folder naming for the output files so resolve can see them.
We are finishing a FREE guide to using the ML raw video http://www.dvxuser.com/guides/ml_raw_guide_5DIII_full.pdf

Its still not finished and in the post processing part for windows, I'm recommending RAWanizer as one of the apps to use for merging split files and dng extraction.
Its just that, for this version, I had to place in the cons list that the folder names has to be manually changed for it to be seen in resolve.


Thanks in advance,
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on August 01, 2013, 09:44:57 AM
Hi Marten,

Hope you can fix the folder naming for the output files so resolve can see them.
We are finishing a FREE guide to using the ML raw video http://www.dvxuser.com/guides/ml_raw_guide_5DIII_full.pdf

Its still not finished and in the post processing part for windows, I'm recommending RAWanizer as one of the apps to use for merging split files and dng extraction.
Its just that, for this version, I had to place in the cons list that the folder names has to be manually changed for it to be seen in resolve.


Thanks in advance,

Uploaded ver 0.6.1. Should name -dng instead of .dng
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: ted ramasola on August 01, 2013, 10:32:25 AM
Marten,

Just tested  ver. 0.6.1

Bravo! Thank you for fixing that. Now resolve can see the folders!




Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on August 01, 2013, 11:16:04 AM
Marten,

Just tested  ver. 0.6.1

Bravo! Thank you for fixing that. Now resolve can see the folders!

You can also choose to put all dngs in the same target folder, that way you don't have to change folders in resolve to see all clips.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: ted ramasola on August 01, 2013, 06:18:19 PM
You can also choose to put all dngs in the same target folder, that way you don't have to change folders in resolve to see all clips.

all is good now because even dragging the folders themselves into the media bin is now possible.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: fafalone on August 06, 2013, 07:03:00 AM
There's a bug from 0.6.0 on that prevents saving Cineform proxy files to a different folder. It gives an error saying "Do you have Cineform Studio installed?". If no path for proxy files is chosen they do process.

See http://www.magiclantern.fm/forum/index.php?topic=5479.msg62501#msg62501
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Disease on August 06, 2013, 07:09:02 PM
To make a better workflow for myself I created this windows app. Thought I should share it in case anyone else find it useful.

It's just i quick dev. No extensive testing done. No guarantee of anything. Use at your own risk! Only works on windows and is using raw2dng, dcraw and ffmpeg.

My workflow
As of version 0.3.0 I have tried to get this app to help me with my whole workflow which centers around Lightroom as RAW converter. Here is how I do it:
-Copy raw files to folder on local computer (SSD disk will improve conversion speed alot)
-Open RAWanizer, select folder, choose video settings and press start. This will extract dng from raw file, create proxy tiff files and a proxy video file.
-For a fast preview of the sequence, I choose tiff size half and mp4 option. This will give me a preview that I can use to decide which files to do real conversions for.
-Once I know which files I want to do deal with I have two options:

---Go to Lightroom or other raw converter and do conversion there. Export files as tiff and put them in 'tiff' sub folder to the dng folder (in Lightroom there is a nice option to do this easy)
---Go back to RAWanizer and choose 'video' instead of 'proxy video', select a higher quality video codec and hit start. This will give me a video file to work in my NLE.
---If I want to go back and change some settings in Lightroom I can do that and reexport to the same folder as before. Then open RAW anizer and just hit start again and it will replace the previously created video file. This will automatically have the clip in your NLE  get updated.

---OR

---Instead of lightroom, in RAWanizer I hit custom button which brings up a dialog for making settings for dcraw conversion. Tweak the settings and hit save. This is now the settings use for conversions. If I'm satisfied with the quality I choose to use a high quality codec and hit start. Now I have a file ready for my NLE

Important The 'video' settings to the left of start button has these meanings:
-Proxy video: Extracts the dng from raw file. Then creates tiff files from dng and finally creates a video file from the tiffs.
-Video: Looks for tiff files in 'tiff' sub folder in the dng subfolder and creates video file from them. Use this option if you have developed the dng in other converter.
-No video: Only extracts the dng from raw file. No tiffs created and no video file created.
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fbitbucket.org%2Fbjurhulta%2Frawanizer-release%2Fdownloads%2FRAWanizer.0.3.0.JPG&hash=64d3dc79922796504e9bed164a6d170a)

Open the folder with raw files. Choose frame rate (for example 23.976) and size for proxy video. Click start and wait.

RAWanizer will create a sub folder for each raw file and put the dng files there. When proxy is created a sub folder in the dng folder will be created with tiffs. The final proxy video is created from the tiffs and put in the same folder as the original raw file. If there is a wav file with the same name as the raw file it will be included in the proxy video.

The proxy file generated can be either mp4 (5mbit) or DNxHD (185mbit). The mp4 file is created in the resolution of the tiff files.  Since DNxHD only supports two resolutions, the image is upscaled to 1920x1080 with black bars if not a perfect fit.

If people find it useful I might put some more time on it. What improvements would you like?

Download full install 0.6.0 (https://bitbucket.org/bjurhulta/rawanizer-release/downloads/RAWanizerSetup.0.6.0.exe)
Patch 0.6.1 (https://bitbucket.org/bjurhulta/rawanizer-release/downloads/RAWanizer.exe) Save .exe in previous installation folder.
If you have installed a previous version, when using full install, you have to use windows 'add and remove progam' to uninstall the previous version first. You may also be prompted to download and install .net 4.5 when you start the program for the first time.


version 0.6.1
-dng subfolder is named -dng instead of .dng so Resolve can recognize the files.

version 0.6.0
-fixed processing of multiple spanned files
-added option to save all dng files in same folder
-included the latest raw2dng

version 0.5.5
-added setting to delete dng files after video creation. For safety reasons this only works if original is a RAW file, not a Dng folder.
-added button to restore default presets
-some file handling bugfixes

version 0.5.4
-the settings are applied when processing starts and not when added to queue, this has confused some people so I hope this will help some, but now you can't get different settings for different files in the queue.

version 0.5.3
-bug fixes

version 0.5.2
-bug fixes
-use framrate from raw file when creating video

version 0.5.1
-automatic merging of split files (>4Gb) (there is a setting under file tab where you can choose to write to the original RAW file. This is faster, cleaner and the result is just one single RAW file. But if something fails along the way you probably end up with at corrupt RAW file, so use with caution, preferably a backup. If not checked it will create a new RAW file with prefix 'M-' and the originals will still be there, safer if you have no backup)
-some more options for dcraw conversions
-now possible to save more than one custom preset for dcraw, Cineform and video output.

version 0.5.0
-raw file meta data shown in file list.
-option to show first, middle and last thumbnail from the raw file before processing.
-clean up of UI.
-latest version of raw2dng included.

version 0.4.3
-New install with all needed files and some fixes. Hopefully the ffmpeg problem will be gone now.

version 0.4.2
-Fixed problem with path for Cineform tools. This folder could appear either under 'Cineform' or 'Gopro'. You can now also set custom path under 'folder settings' if you have it installed in a different folder.

version 0.4.1
-For the Cineform batch processing I'm now throwing up console window so the progress can be examined and aborted by closing the console window. This is temporary as I hope to find another way to deal with it.

version 0.4.0
-Batch processing for Gopro Cineform. You have to download and install Gopro Cineform studio + a small utility. Follow the instructions here: http://www.magiclantern.fm/forum/index.php?topic=5479.msg41378#msg41378
-For the Cineform batch processing, the top progressbar is not working (detailed progress for each clip). You have to wait and see...

version 0.3.3
-Possible to open a single dng folder
-Fixed bug when starting program and last folder used had been removed
-Increased responsiveness when previewing dcraw settings

version 0.3.2
-tried to get rid of some users program crash

version 0.3.1
-Added possibility to set custom folders to override default structure
-Initial attempt for 'watch folder'. When this is activated, new raw files copied to that folder will automatically start processing.

version 0.3.0
-Add date time prefix to raw file name
-UI much more responsive and cancel works almost all the time
-More options for managing files and processing
-Now possible to use custom dcraw converter settings
-UI to help create custom dcraw settings
-Use custom ffmpeg settings for video file
-Create video file from tiff sub folder that can be populated by your favorite raw converter (lightroom, ps)

version 0.2.1
-added DNxHD as an option for the proxy file

version 0.2.0
-using multiple instances of dcraw to increase speed of dng to tiff conversion. You can change no of instances to find optimal for your computer.


Known Issues:
- Does not work with file names containing spaces or other special characters

In version 0.6.1 there is no option for converting to Video all I can get it proxy files. I keep getting the error: No video sequence folder found... Sorry if I am doing something noob!
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Disease on August 06, 2013, 08:01:11 PM
Looks like 0.3.0 made a lot more sense!
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on August 07, 2013, 10:01:01 AM
In version 0.6.1 there is no option for converting to Video all I can get it proxy files. I keep getting the error: No video sequence folder found... Sorry if I am doing something noob!

You are free to choose the quality of the proxy files. So it's up to you if you want to consider them proxies or final video. The file name will always contain .proxy though.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Disease on August 07, 2013, 03:29:17 PM
You are free to choose the quality of the proxy files. So it's up to you if you want to consider them proxies or final video. The file name will always contain .proxy though.

Ah ok.. strange tho as when i try to open them it just says there is no video or audio present. I will try again. I was not aware that the word proxy would always be there.

Thanks for the reply I am kinda loosing hair over getting these raw files into a video format! ;-)

Thanks for the awesome software once I get my head around this and can generate a ProRes444 or equivelant file that will work in Premiere I will be soo happy!
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: n0M3n on August 08, 2013, 03:13:40 AM
I'm making a weird videoclip using your tool. This is really helpful. I hope you keep on developing it.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: marten on August 08, 2013, 10:28:21 AM
Ah ok.. strange tho as when i try to open them it just says there is no video or audio present. I will try again. I was not aware that the word proxy would always be there.

Thanks for the reply I am kinda loosing hair over getting these raw files into a video format! ;-)

Thanks for the awesome software once I get my head around this and can generate a ProRes444 or equivelant file that will work in Premiere I will be soo happy!

They shouldn't be empty. Have you tried the simple mp4 preset? Is that empty as well?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: dude on August 08, 2013, 12:28:39 PM
I had to transform some files from raw to dng,
2 were over 4gb. Raw2dng made black or fucked up pictures out of them rawanizer made the job pretty well.

beside,
when i open the dngs via Bridge, the pink colour-cast is gone and they  look pretty cool in acr, like it put some grading over it..
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Disease on August 10, 2013, 11:18:58 AM
I am afraid I just cannot get this to work.
When I try to create a Prores file it jusst fails..
10:01:26 Start extracting dng from M06-1213.RAW
10:02:15 Finished
10:02:15 Start converting tiff from M06-1213.RAW
10:04:39 Finished
10:04:39 Start creating proxy from M06-1213.RAW
10:04:39 Failed:
FFmbc version 0.7-rc8

10:04:39 All items Finished

I am pretty sure I was making some video files from this earlier but they just wouldnt open in anything. Now I cannot make any video file. Whats ffmbc? DO I need a newer versionof that?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: kgv5 on August 13, 2013, 09:09:14 PM
marten, is it possible to make your app works with mlv2dng? Your rawanizer is a great tool for me but now we have to switch to mlv, it would be great to have this option with some new release. Thanks for your great work :)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Kuky on August 15, 2013, 06:13:37 PM
When trying to convert spanned raw files to video this error keeps poping out: "No video sequence folder found"
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: wbs21 on August 17, 2013, 01:18:47 PM
can i use it convert bmcc dng to proress444?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Canon eos m on August 17, 2013, 05:14:46 PM
Hi I get the following error:

"RAWanizer ver 0.6.1
Unhandled exception has occurred in your application. I you click Continue, the application will ignore this error and attempt to continue. If you click Quit, the application will close immediately.

Arithmetic operation resulted in an overflow."


See the end of this message for details on invoking
just-in-time (JIT) debugging instead of this dialog box.

************** Exception Text **************
System.OverflowException: Arithmetic operation resulted in an overflow.
   at RAWanizer.RawUtility.MakeRawFile(FileInfo fi, String targetFileName, RawMetaData metaData, Int32[] frames, List`1 SplitFiles)
   at RAWanizer.ProcessItem.MakeThumbImages(RawMetaData metaData)
   at RAWanizer.frmThumb.DoCreateVideoThumbs(DiskItem diskItem)
   at System.Threading.Tasks.Task`1.InnerInvoke()
   at System.Threading.Tasks.Task.Execute()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at RAWanizer.frmThumb.<CreateVideoThumbs>d__13.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.CompilerServices.AsyncMethodBuilderCore.<ThrowAsync>b__0(Object state)


************** Loaded Assemblies **************
mscorlib
    Assembly Version: 4.0.0.0
    Win32 Version: 4.0.30319.18051 built by: FX45RTMGDR
    CodeBase: file:///C:/Windows/Microsoft.NET/Framework64/v4.0.30319/mscorlib.dll
----------------------------------------
RAWanizer
    Assembly Version: 0.6.1.0
    Win32 Version: 0.6.1
    CodeBase: file:///C:/Users/USer/Desktop/5DMark3%20August%206%202103%20build/RAWanizersetup%200.6.0%20August%2017%202013%20download/RAWanizer.exe
----------------------------------------
System.Windows.Forms
    Assembly Version: 4.0.0.0
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: DjJuvan on August 17, 2013, 06:39:54 PM
I have problem with extracting bigger than 4 GB raw files... it doesn't make any dngs o_0 I don't know what to set, to make it work.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: ubejavshiy on August 19, 2013, 02:18:32 PM
Hello, please forgive me for my English.

I have a problem when installing the application an error.
(https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2Fubejavshiy.com%2Fraw.png&hash=bba62de961bb13894dd8688806345056)
I reinstalled the app, but it has not worked.

I have Windows 8 .NET Framework 4.5

I hope for your help and thank you for your work.

--------------------

from Russia with love.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Francis Frenkel on August 19, 2013, 04:42:36 PM
Hello from France,

Same problem, same situation :

Windows 7 64 bits
NET Framework 4.5

I already explain my problem but no respons...

I re-install NET Framework 4.5 = but does not work anyway...

It's a real shame... It would be so usefull...( I'm pro).
Please, help me.

Francis

Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: ubejavshiy on August 19, 2013, 04:56:23 PM
Hi, I found a solution

It is a problem with 64 bit.

You need move your app's files  from "Program Files (x86)" to "Program Files" after installation or install it in this folder.

Windows 8 (64 bit) - it's work!
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Francis Frenkel on August 19, 2013, 05:21:03 PM

Quote
You need move your app's files  from "Program Files (x86)" to "Program Files" after installation or install it in this folder.

It does not work for me :
I install the program, but without lauching the applictaion (cause it doesnt work)
Then, I copy the RAWanizer folder in "Program files"
Then try to open by double clic in application icon, but same error message : "Error CLR 80004005 program will end now"

I do something wrong ?

Francis


Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Francis Frenkel on August 20, 2013, 12:15:15 AM
Nobody to help me ?

I also tried to modify the compatibility in properties of the .exe file
I also tried to open with admin...

What is wronG ?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: ubejavshiy on August 20, 2013, 09:21:52 AM
Hi,
the method described above will work for me.

Try to completely uninstall a program, set unchanged, replace the file and then copy the folder with the application of the "Program Files x86" in the folder "Program Files" on system disk.

I have thought of this method by accident and I don't think that's the only right decision.

Good luck, and sorry my english.

Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Francis Frenkel on August 21, 2013, 09:48:36 AM
Hi, the method described above will work for me.
Try to completely uninstall a program, set unchanged, replace the file and then copy the folder with the application of the "Program Files x86" in the folder "Program Files" on system disk.
I have thought of this method by accident and I don't think that's the only right decision.
Good luck, and sorry my english.

I did it but it doesnt work, thany you anyway...

Francis
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Francis Frenkel on August 22, 2013, 01:27:23 PM
Am I the only one on earth can not install this application?

Fran6
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: maxotics on August 24, 2013, 12:31:49 AM
Hi, dcraw may need updating in RAWanizer.  It is currently version 9.16.  I couldn't understand why the RAWanizer TIFFs seemed to have more red-dot noise (EOS-M) than Adobe conversions (at least for me).  I found the new dcraw and tried it and it seems there is less saturation and dots in the new one.  I replaced the version of dcraw in my RAWanizer program path and it seems to work fine (now it's not!, changed back, now it's working again????). However, I'm in deep waters for me on this stuff.  Hopefully someone can confirm/refute this.

Also, any help in optimizing dcraw for EOS-M and 50D files would be greatly appreciated.  Profiles? Thanks!

http://lightzoneproject.org/content/dcraw-917-released (http://lightzoneproject.org/content/dcraw-917-released)

Here is output, using "-w -6 -T" from dcraw version 9.16

(https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2Fmaxotics.com%2Fphotos%2Ftestv916.jpg&hash=5fa3e3f63d8611ab32019d3d6f57e218)

Here for 9.17

(https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2Fmaxotics.com%2Fphotos%2Ftestv917.jpg&hash=416dd8f2222d5ed7cf0ab83f403ac805)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: gtsofilms on August 24, 2013, 08:37:21 PM
Hey everyone, I have the same error as Kuky posted before:

When trying to convert spanned raw files to video this error keeps poping out: "No video sequence folder found"

Anyone know what's happening here? I'm able to use Cineform to create a proxy file but it doesn't work with dcraw
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: maxotics on August 24, 2013, 10:34:12 PM
I had that error and it fixed when I copied back the 9.16 dcraw (see above).  Dcraw will apparently only work with file in the same folder (a pain), I wonder if windows locks it up if RAWanizer copies it too many times to the files to process folder (and deletes it I assume).  Check your path C:\Program Files (x86)\RAWanizer\Tools  Make sure all the programs are in there. dcraw. ffmpeg, etc.  Maybe copy a new one in there.  Anyway, beats me.  If RAWanizer source is available I could look at it.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: gtsofilms on August 24, 2013, 11:19:16 PM
Hmm thanks for the input. I tried replacing dcraw 9.16 as you mentioned but I still get the same error, do the dngs and tiffs have to be in the same folder not subfolder? What video sequence is it referring to? the tiff files?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: maxotics on August 24, 2013, 11:48:24 PM
It's referring to making the TIFFs I believe, since when I got the error they weren't made, put into the proxytiffs folder.  Since there are no tiffs, there's nothing, "video sequence" for ffmpeg to do in making the proxy video.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: gtsofilms on August 25, 2013, 09:34:27 AM
I've tested it with Cineform proxies and those work fine, I can't use the regular dcraw for proxies though.  This is the error I get:

Does this make sense to anyone? I actually just got it to work my unclicking the use ffmbc.  Including in case this is helpful for development. Thanks!

FFmbc version 0.7-rc8
Copyright (c) 2008-2013 Baptiste Coudurier and the FFmpeg developers
Input #0, image2, from 'Z:\WD 1TB\ML RAW\TEST 8-24 Bedroom\M23-0055-dng\proxytiff\M23-0055-%06d.tiff':
  Duration: 00:00:05.29, bitrate: N/A
    Stream #0.0(und): Video: tiff, rgb24, 1856x1044p, 23.98 fps
Input #1, wav, from 'C:\Program Files (x86)\RAWanizer\Tools\dummy1s.wav':
  Duration: 00:00:00.99, bitrate: 706 kb/s
    Stream #1.0(und): Audio: pcm_s16le, 44100 Hz, 1 channels, s16, 705 kb/s
Unrecognized option 'n'
C:\Program Files (x86)\RAWanizer\Tools\ffmbc.exe: failed to set value 'Z:\WD 1TB\ML RAW\TEST 8-24 Bedroom\M23-0055.proxy.mov' for option 'n'

03:29:18 All items Finished
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: maxotics on August 25, 2013, 01:42:58 PM
@gtsofilms

I'll have to do until an expert comes around ;)  RAWanizer is only a GUI (graphical user interface) to command line programs; that is, programs that run in a command line by sending them parameters.  For example, if you load a command prompt and put a myshoot.RAW file and raw2dng.exe into the same folder and type "raw2dng.exe myshootRAW" raw2dng.exe will extract/create a series of DNG files that are frames in your video.   Then, if you put dcraw.exe in that folder with the dngs and type dcraw.exe -w -6 -T myshoot0001.dng it will create myshoot0001.tiff  The "-w -6 -T" tells dcraw to create a TIFF at 16bits using the camera white balance recorded in the DNG file.  There are MANY other ways (parameters/arguments) of telling dcraw how to create your TIFFs.  ffmpeg.exe is another command line program that creates movie files.  It is usually used to convert one format to another.  It is a very complex piece of software. 

Knowing this, you can see that the problem would either be 1.) RAWanizer is not/cannot call one of the programs.  or  2.) it is calling them with the wrong parameters.  I believe it is one.  Because dcraw does not have a parameter to set where the output file goes, it is has be copied into the source file folder.  I believe this is creating problems.  I don't believe this problem can be solved until the maker of RAWanizer looks into it.  For now, you can mimic what RAWanizer does by:

1. Copy RAW file into folder
2. Copy RAW2dng into folder
3. Drag RAW file onto raw2dng (same as raw2dng myShoot.RAW in command line)
4. Copy extracted DNG files to their own folder, say /dng
5. Copy dcraw.exe to dng
6. Type  someting like dcraw -w -T DSC00001.DNG DSC00002.DNG DSC00003.DNG (all the other file names separated by spaces)
7. Copy ffmpeg into folder
9. run ffmpeg on TIFFs (parameters to long to go into now).

The above process is what RAWanizer automates for you.  It also has come canned settings to start you out, and you can create/modify your own.  It's very good software.  Unfortunately, unless this bug happens to the developer it's difficult for him/her to troubleshoot.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: gtsofilms on August 25, 2013, 06:51:05 PM
Thanks maxotics! That explanation was very helpful. It seems I've been able to get it to work consistently now as long as I'm not checking the ffmbc box.  I think I read that both ffmpeg and ffmbc do similar things in terms of transcoding video files, but do you know if one is better than the other?

thanks so much again for sharing your knowledge  :)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: maxotics on August 25, 2013, 07:18:59 PM
@gtsofilms.  My head is swimming with all this stuff.  I tried to ignore that ffmbc box but you thanked me so felt compelled to go read up on it ;)  Looks like it's a port of ffmpeg that is geared towards high-end video CODECs.  That's cool!  I've been having trouble getting ffmpeg to give me the quality I want so good chance ffmbc can help me here.  Here's the link to it:

https://code.google.com/p/ffmbc/

I want to compress in a format that is almost/same quality as TIFFs. 

I've also finished a VBscript that does what RAWanizer does.  As soon as I feel it's somewhat trustworthy I'll release it to the wild so we have an alternative to RAWanizer.  (Though I LOVE RAWanizer, don't get me wrong!)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Francis Frenkel on August 25, 2013, 07:40:16 PM
Yesss Maxotic !

Cause I dont know why I just can't install Rawanizer on my bloody computer....

I hope your "alternative" will "accept" to work on my bloody computer...

(Though I would LOVE RAWanizer, if I could just install it....don't get me wrong!)

Francis
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: maxotics on August 25, 2013, 09:30:13 PM
@Francis  I have a couple of moment to think about your problem.

1. Is program in the C:\Program Files (x86)\RAWanizer
directory (that is x86 emulation)

2.  It seems to use .NET 4.0.  Do you have that installed (in addition to 4.5? )

I'm wondering if you're trying to run it under 64bit mode and it's not working

Do you program?  I can send script when not fully done if I know it might be useful to you.

Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Francis Frenkel on August 29, 2013, 11:01:17 AM
Maxotics :

Quote
1. Is program in the C:\Program Files (x86)\RAWanizer
directory (that is x86 emulation)
yes, installation put the folders in C:\Program Files (x86)\RAWanizer

But when I try to open i got this message : "error 80004005 program will termated"
Quote
2.  It seems to use .NET 4.0.  Do you have that installed (in addition to 4.5? )

Yes, .Net 4.5.

Quote
I'm wondering if you're trying to run it under 64bit mode and it's not working

Yes I got Windows 64 bits.

Thank you so much for helping me !

Francis
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: maxotics on August 29, 2013, 09:14:15 PM
Hi Francis.  Uninstall the app and make sure when you re-run it you do it as an "administrator" of the computer.  You must have those privileges. 
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Francis Frenkel on September 01, 2013, 02:39:30 PM
Done before you ask me...
No, it's not a solution.

Francis
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: maxotics on September 01, 2013, 02:56:01 PM
@Francis.  How badly do you want RAWanizer to run?  Can I send you email at your company address?  Maybe I can compile a small do-nothing .NET app for you and see if that works (isolate the problem).  Not sure you answered one of the questions, which versions of .NET do you have installed?  I know you have 4.5, but not sure on any of the other version. You should be able to see them under install/remove programs.

Also, don't know if you know, but I've created scripts you could use.  Though for a lot of stuff I prefer RAWanizer.  I think you should get that figured out. 

http://www.magiclantern.fm/forum/index.php?topic=7908.0
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Francis Frenkel on September 01, 2013, 04:43:57 PM
thank you so much for the interest you bring to my problem!
Quote
I know you have 4.5, but not sure on any of the other version. You should be able to see them under install/remove programs.
I got CCcleaner and I checked, but I only have  .Net 4.5 for weeks now, and not other (old) version running...

You can send me mail on my company address :
francis.frenkel@lucide-prod.com

Quote
Also, don't know if you know, but I've created scripts you could use.  Though for a lot of stuff I prefer RAWanizer.  I think you should get that figured out. 
Yes, I had seen this page and I can not wait to try these scripts!

Thanks again.

Francis
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: chmee on September 03, 2013, 12:30:54 AM
just to be clear - .net4.5 is not an update from .net4.0 or 3.5 - if a software is coded with .net2.0, you'll need .net2.0.
all .net-versions can coexist. if you have been asked, if .net4.0 is installed, "yes, 4.5" is the wrong answer.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: maxotics on September 03, 2013, 05:03:38 AM
Looks like it was built using 4.5.  So don't believe Francis needs earlier versions of .NET

Code: [Select]
.custom instance void [mscorlib]System.Runtime.Versioning.TargetFrameworkAttribute::.ctor(string) = ( 01 00 1A 2E 4E 45 54 46 72 61 6D 65 77 6F 72 6B   // ....NETFramework
                                                                                                        2C 56 65 72 73 69 6F 6E 3D 76 34 2E 35 01 00 54   // ,Version=v4.5..T
                                                                                                        0E 14 46 72 61 6D 65 77 6F 72 6B 44 69 73 70 6C   // ..FrameworkDispl
                                                                                                        61 79 4E 61 6D 65 12 2E 4E 45 54 20 46 72 61 6D   // ayName..NET Fram
                                                                                                        65 77 6F 72 6B 20 34 2E 35 )                      // ework 4.5

Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Francis Frenkel on September 05, 2013, 11:06:31 AM
I just dont understand ...

I've installed Microsoft.net framework 4.5  since the first installation I got an error message asking me to install Microsoft framework 4.5!

OK , then, wich one do I have to install ?

Fran6
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Kharak on September 06, 2013, 09:31:01 AM
Greetings from the shadows.

Thank You for this wonderful Program Marten. It really makes life so much easier.

@Francis Frenkel. I had the exact same error as you and was getting as frustrated as you. I read this thread over and over to see if I could find any solution and could not.

Now Rawanizer works and the only thing I've done in the last few days is updating Windows! I had 11 or so new updates available for windows. So you might wanna start there.

I wish you good look.


Question: In Rawanizer, there is a quality switch when you look at preview frame (when you right click a RAW file and select dcraw or somethin'). I can't tell any difference from when the switch is all the way to the left or the right. But as I see Brightness, gamma etc.. all increase when pushing it to the right, am I right to assume that pushing that switch to the Right is highest quality?

With regards.

The quality whore :)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: maxotics on September 06, 2013, 12:53:53 PM
I just dont understand ...

I've installed Microsoft.net framework 4.5  since the first installation I got an error message asking me to install Microsoft framework 4.5!

OK , then, wich one do I have to install ?

Fran6

Hi, I think Chmee sas suggesting you needed an earlier version of .NET, maybe 2.0, which was a possibliity.  I was just saying that you should be good with 4.5 since that was its target development library---just developer stuff.  Anyway, I hope with a new service pack your problem does go away.  The other stuff I can think to try, I now realize, would take us hours and hours with uncertain results.  Might be cheaper to just buy an old laptop ;)  Anyway, hoping for the best.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: RenatoPhoto on September 08, 2013, 10:03:09 PM
I am testing this application and so far with the proxy stuff I have the following results.

At first I could not generate any proxy video. The issue was that my computer displays the video framerate as 29,97 and the ffmpeg convertor wanted with a decimal point.  The problem was solved by entering the fps in the Video tab with a period.  In my case 29.97.

By setting fps manually with period (.) rather than coma (,) I can make:

mp4 5 mbit proxy
DNxHD 185mbit proxy
444 prores proxy

Also I installed the Cineform Studio and the RAW2GPCF.exe file.
So far I can produce the .avi file (standard setting under Cineform Tab) rather quickly!

I have also used the latest raw2dng.exe file.

I will be using this application to process many videos and will report issues if any.

Great job: Marten and others who have contributed to this nifty program!  8)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: 1% on September 12, 2013, 04:47:43 AM
Would be really cool to support raw therapee... it has IGV and amaze debayer that really makes a difference.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Audionut on September 12, 2013, 04:57:10 AM
It's highlight recovery is on par with Adobe also.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: feureau on September 12, 2013, 11:01:27 AM
And most importantly, MLV support.


... just sayin...
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: RenatoPhoto on September 12, 2013, 02:38:38 PM
Had a chance to make many proxy videos and compare them to my usual method (that I use) of ACR convert to tiff and make video with Vegas 12.

The quality of the proxy videos is not up to the ACR 8.2 RC process since the method used for optimizing the tiffs is not very powerflul,  I am referring to the dcraw build option which can adjust the tiff but I can never get it right.  This interface of dcraw is not good enough for the quality of raw video, it would be very useful to find a more powerful converter.  I wonder if the Adobe dng to tiff converter provides an interface for adjusting the tiffs, and if this interface could be incorporated much like the dcraw.

The Cineform option is good but again does not have any quality adjustment options, unless there are some copy paste codes that can be added to the Cineform parameters.

So far I will use this software for an quick and dirty automated method for making nice proxy preview videos.  The higher quality option will be used for final processing.

Thanks again and hope that the development of this great software can continue to improve.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Steve Kahn on September 17, 2013, 10:14:19 PM
Would it be possible to include a sequential renaming feature to aid in post production?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: maxotics on September 17, 2013, 11:26:45 PM
Hi RanatoPhoto, I've been experimenting with ffmpeg to get closest quality to TIFFs.  So a couple of suggestions/ideas

ufRAW seems to have a lot more control over the DNG to TIFF conversion process.  It can be run in batch too.  Have you tried that?

These ffmpeg commands in RAWanizer might give better quality.  I've tried to configure RAWanizer but came up with problems difficult to diagnose.  This site gave me a lot of ideas.

https://trac.ffmpeg.org/wiki/vfxEncodingGuide

For example

These arguments for h.264.  Sorry, haven't had chance to look up what this does! :)

-g 1 -tune stillimage -crf 9 -bf 0

The most important might be:

-pix_fmt yuvj422p which I think give 4:2:2 color depth like Cineform  Hopefully someone reading this can verify/elaborate.

This was a good ProRes string

-c:v prores_ks -profile:v 3 -qscale:v 1 -vendor ap10 -pix_fmt yuv422p10le -r 24 output.mov

I've also been using this to sharpen the TIFFs before conversion

-vf unsharp=5:5:1.5:5:5:1.5

Anyway, I believe RAWanizer can be configured to provide near/complete TIFF quality video clips and one could delete the DNGs and TIFFs.  In any case, I will accept slight IQ loss for ease of storage use, etc.

Hope you keep on this quest!  I'm currently scraping my knuckles bloody on the hot/pink pixel issues.







Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: RenatoPhoto on September 18, 2013, 03:08:05 AM
Thanks Maxotics will have to try those codes.. and thanks for the link. 
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: asparaco on September 27, 2013, 04:19:19 PM
Love the app but when attempting to get a proxy file rendered I am getting this error message

09:11:10 Start extracting dng from M26-0829.RAW
09:11:39 Finished
09:11:39 Start converting tiff from M26-0829.RAW
09:11:57 Finished
09:11:57 Start creating proxy from M26-0829.RAW
09:11:59 Failed:
FFmbc version 0.7-rc8
Copyright (c) 2008-2013 Baptiste Coudurier and the FFmpeg developers
Unrecognized option 'r:v'
C:\Program Files (x86)\RAWanizer\Tools\ffmbc.exe: failed to set value '23.976' for option 'r:v'


How can I fix this?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: RenatoPhoto on September 27, 2013, 04:50:45 PM
1. dont use ffmc for mp4 5mbit proxy. 
2. If you use ffmbc then select the ProRes 444 option under Video.
That is as much as I know.

From here:
https://trac.ffmpeg.org/wiki/vfxEncodingGuide

Under Output:
FFmpeg will take an image sequence on the input and will then output a movie clip file (usually in a .mov or .avi container). The VFX/film industry would mostly use the .mov container, especially for client deliveries, because it is the most commonly used format in the industry. Making these clips is pretty straightforward, but we'll look at the options that are of interest to this specific industry the most.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: maxotics on September 27, 2013, 06:02:07 PM
Also, it seems that ffmbc isn't being developed currently, or there is a lull.  ffmpeg always seems to be in development and there are both 32bit and 64bit binaries around the web.  You should be able to drop those into the \tools folder of RAWanizer.  RenatoPhoto, have you learned anything more about the color spaces the 420p, 422p thing?  I've been full-on with with focus pixels and de-bayering stuff
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: asparaco on September 27, 2013, 07:32:06 PM
Thanks  ;)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: RenatoPhoto on September 27, 2013, 09:35:07 PM
have you learned anything more about the color spaces the 420p, 422p thing?  I've been full-on with with focus pixels and de-bayering stuff
Have not played with that stuff yet.  Thanks
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Malex on September 28, 2013, 11:53:43 AM
Hi, I have a interface request... I know that rawanizer is a beta software, just like the shooting raw with our canons, but I don't know if some people said this before but rawanizer user interface is hard to understand, I feel I have to be a developper to know what I'm doing.
Either my install of the 0.6.0 is wrong, either I suck and I don't know how to export what I want.

I don't know how to simply export .dng like with the older versions, and when I finally get it to make DNG, it also create .tiff files which I don't need. How to not make tiff files ?
I can't make video either, from dng or tiff or raw, I'm getting fustrated trying (so maybe there is something wrong with my installation).

How about making :
                - a "Wizard tab" with some check box :
                                  ☑ DNG
                                      [..................] Destination folder

                                  ☐ Tiff         
                                                ☐Full       ☑Half
                                      [..................] Destination folder

                                  ☑ Video :
                                                ☐ mp4:               choose bantwith [.....mbit]
                                                ☑ ProRes             ☑[4.2.0]      ☐[4.2.2]      ☐[4.4.4]
                                                ☐ DNxHD            choose bantwith [.....mbit]
                                                ☐ XDCAM mxf
                                      [..................] Destination folder


                - an "Advanced tab" with all the other stuff for pro.

                - a settings tab that would switch stuff for both wizard and advanced tab.

I know devs are doing this on their free time (by the way where is the donate button), and it's still a beta, but as a user I felt like giving my user experience in here since it's also why the forum is for.

How does that interface sound like (looks like) ?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: maxotics on September 28, 2013, 04:08:33 PM
@Malex.  You're having difficulty because you don't know where you are where you need to go :)

Every night I almost cry because everything about RAW video takes so dang long.  I think that true, even for the experts.  So you want to take a day or two and just read through the forum (yes, it isn't well organized) and try to learn about the whole technology process.  If you stick with it, you will look at your post and laugh.  RAWanizer is about the easiest most powerful post-processing tool here!  (In any case, the dev is not around).

Let me try to get you oriented for starters. 

When you shoot RAW your camera is writing to a file the values from it's sensor.  The first line of the sensor is Red,Green,Red,Green to the end.  The 2nd line, even lines, are Green,Blue,Green,Blue, to the end.  People normally think of the data in 4 pixel blocks that go, from top to bottom, Red, Green, Green, Blue, or RGGB.  Getting confused?  We've barely started!

So 3rd party software won't open the RAW file.  So you need to save it in an industry standard RAW format, DNG.  Even DNG, isn't useable until it is de-bayered, that is, the dots given full-color values...

Go read everything you can.  Feel free to PM me with questions, once you've done that.

Welcome!

Max

Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Malex on September 28, 2013, 06:37:16 PM
@Maxotics , thanx for the reply, but I know enough already about the RAW process and DNG debayer and stuff, I have been reading post here about RAW since it's possible and I used to convert the RAW files of my 6D with RAWanizer, now I sold it and got myself a 5D3 so I got the lastest version of RAWanizer.

RAWanizer is about the easiest most powerful post-processing tool here!

The most powerful for sure, but easiest I'm not so sure... I'm just saying it's easy to get confused, I know it's a powerfull soft, but you have to admit that the UI is not user friendly. Before with RAWanizer 0.30 it was like RAWmagic, you just put RAW and you get DNG easy, now I have difficulty just do to that :(
I get DNG+Tiff (I don't know how to not get tiff), or I get merged RAW files without DNG, and I tried to get videos but I couldn't, am I an idiot ?

It's still a beta so I know it's normal, I was just giving my 2 cents about how to make the UI simpler, feel free to tell me if what I proposed is bad, I just felt I could share my experience as a end user.

Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: maxotics on September 28, 2013, 08:25:26 PM
The most powerful for sure, but easiest I'm not so sure... I'm just saying it's easy to get confused, I know it's a powerfull soft, but you have to admit that the UI is not user friendly.

Except for reading the RAW footers and populating the listbox with that information, the only thing that RAWanizer does is call command line software (raw2dng, dcraw and ffmpeg) with arguments you chose in the interface.   Since the dev is gone, i can't help with RAWanizer because I don't have the source.  But I can help you get to where you want to go, I hope.

Before with RAWanizer 0.30 it was like RAWmagic, you just put RAW and you get DNG easy, now I have difficulty just do to that :(

That's the simplest part of the process.  Just copy raw2dng from the RAWanizer /tools path, or download it from the internet.  Then just drag your RAW file onto it and it will extract out each RAW frame as a DNG file.  I know that sounds cumbersome, but one you get the hang of it very quick.

If you video post processing will work with DNGs, you're set.  If you want cDNG, get the raw2cdng.exe file and use that.

I get DNG+Tiff (I don't know how to not get tiff), or I get merged RAW files without DNG, and I tried to get videos but I couldn't, am I an idiot ?

I'm the first idiot on this forum.  Get in line ;)  As you know, DNG files are only the red, green, blue values from the pixels.  They need to be debayered if you're going make a video file.  RAWanizer makes TIFFs to send to ffmpeg.  Again, if you only want to use DNGs or cDNGs and post-process in other software, stop right here.

To create TIFFs, that's what dcraw does.  Unfortunately, dcraw doesn't take command line arguments for multiple files and output paths.  This is where RAWanizer begins to shine.  However, you can run a batch file in your directory like this.  In notepad, you'd save a file called, say, processraw.bat and put this line in it.

Code: [Select]
FOR %f in (*.dng) DO dcraw -T -w %f

I've read this fifty times and am still digesting it.  I recommend reading it.
http://www.guillermoluijk.com/tutorial/dcraw/index_en.htm (http://www.guillermoluijk.com/tutorial/dcraw/index_en.htm)

It's still a beta so I know it's normal, I was just giving my 2 cents about how to make the UI simpler, feel free to tell me if what I proposed is bad, I just felt I could share my experience as a end user.

Naturally I want you to share your experiences.  But such questions can illicit annoyed responses (because if you read through the thread you'll see the dev has not been around to answer many questions), it's a shortcoming of this forum.  Just wanted to spare you that :)

Hope this gets you back on track! 
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Malex on September 28, 2013, 09:09:01 PM
Naturally I want you to share your experiences.  But such questions can illicit annoyed responses (because if you read through the thread you'll see the dev has not been around to answer many questions), it's a shortcoming of this forum.  Just wanted to spare you that :)
Hope this gets you back on track! 
Well I appreciate you help, thank you for taking the time :) I'll see if I use RAWmagic or RAW2DNG on pc.
Title: 0.6.0 makes me comfortable but...
Post by: mrimoi on October 01, 2013, 04:12:57 PM
I usually use dual iso RAW..

0.6.0 compose directly dual iso dng file,

 but it's quality is not good.

dual mode lines are alive on the footages.

please correct that error..
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: lilpillz on October 03, 2013, 11:20:54 PM
How do you batch create TIFF's from your edited version of DNGs. Do I need to go into PS and select all the DNGs and use CR or is there an easier way?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: iunknown on October 15, 2013, 07:32:31 PM
Hi, I found a solution

It is a problem with 64 bit.

You need move your app's files  from "Program Files (x86)" to "Program Files" after installation or install it in this folder.

Windows 8 (64 bit) - it's work!

Thanks! This worked!
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Kharak on October 15, 2013, 09:02:30 PM
ACR interprets my 5D MK II footage as Canikon.

I believe this is a problem with raw2dng, something to do with EXIF data or something like that (I'm not so keen on all the technical stuff behind DNG's). I always use RAWanizer, is there a way that I can install a new version of raw2dng and somehow make that work with RAWanizer?

And am I right to assume that this has something to do with raw2dng?

I need ACR to interpret the footage as 5D MK II, because I am using Vision Log and it needs to interpret the right camera for it to work properly.

Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: feureau on October 19, 2013, 11:29:08 PM
Been using rawanizer for quite a while now. Thanks for this tool :D

Will it be updated to work with .mlv btw?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Kharak on October 20, 2013, 02:16:58 AM
Just wanna add, that I found a way to make RAWanizer include camera profile information. EDIT: The raw2dng is for 5DMKII only

raw2dng: https://www.dropbox.com/s/29qkvnf3pa1c6b7/raw2dng.exe

I overwrited the raw2dng.exe file in RAWanizer tools folder with an older raw2dng (says Last Modified 15. July) which includes camera profile, this alone did not work for me (maybe you will have better luck), but then I also copied the raw2dng in to a folder that had RAW files in it, started converting a RAW file with raw2dng - aborted (ctrl+a - ctrl+c) - Started converting that same file with RAWanizer and now RAWanizer includes Camera profile information on all other RAW files and folders, so you can choose correct Vision Log, faithful, adobe standard etc. :) Hope this will work for others.

--------------------------------------------------------------------------

Today RAWanizer did the same crash as ubejavshiy reported 2 pages back or so and I had a while ago too. I couldn't use RAWanizer for quite some time until one day it just worked. But I believe I found the cause of the error and how to get around it.

(https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2Fubejavshiy.com%2Fraw.png&hash=bba62de961bb13894dd8688806345056)

So RAWanizer spit this message in my face today and I was like "PLEASE nooo!!".

 I had chosen a folder that had some RAW files in it and then the program crashed and when opened again I got the message above. So after re-installing, CCleaning, Moving, adding, compatibility, admin rights, you name it and nothing worked. I was pulling the last few hairs out of my head and I pulled the Hard Drive out which RAWanizer accessed last. (Even though I deleted RAWanizer in Control Panel, it still seems to remember its last location)

I Opened RAWanizer and it worked. Then I tried accessing the same folder again and the error report came up again, instead of choosing Exit, I choose continue and chose another folder containing some other RAW files and those files worked with RAWanizer. So I looked in to the folder in which RAWanizer crashed in. Found a RAW file which was 1 or 0 kb, not sure right now. Deleted it and tried accessing the folder again via RAWanizer and voila!! It worked.

So if anyone else got this problem, try this solution :)

Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: feureau on October 21, 2013, 07:40:51 PM
Just wanna add, that I found a way to make RAWanizer include camera profile information.

I overwrited the raw2dng.exe file in RAWanizer tools folder with an older raw2dng (says Last Modified 15. July) which includes camera profile, this alone did not work for me (maybe you will have better luck), but then I also copied the raw2dng in to a folder that had RAW files in it, started converting a RAW file with raw2dng - aborted (ctrl+a - ctrl+c) - Started converting that same file with RAWanizer and now RAWanizer includes Camera profile information on all other RAW files and folders, so you can choose correct Vision Log, faithful, adobe standard etc. :) Hope this will work for others.

I believe I found that RAW2DNG file in BATCHelor 3.0 Alpha 3.

I tried using the one from batchelor but my dngs are still plain. No camera profile info.

Can you upload the raw2dng you're using please? :3

thanks
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Kharak on October 21, 2013, 10:23:42 PM
I tried using the one from batchelor but my dngs are still plain. No camera profile info.

Can you upload the raw2dng you're using please? :3

thanks

I'm not so good at this dropbox thing.

Tell me if this link works: https://www.dropbox.com/s/29qkvnf3pa1c6b7/raw2dng.exe

Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: dude on October 24, 2013, 03:59:25 PM
yes it works, but is for MK II.

One question- if i run rawanizer and export to cineform and open in premiere, i have no real acces to the debayer, like i have it in acr, right?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Kharak on October 27, 2013, 08:19:38 AM
yes it works, but is for MK II.

One question- if i run rawanizer and export to cineform and open in premiere, i have no real acces to the debayer, like i have it in acr, right?

OKey, then the 5DII is hardcoded in to that raw2dng. I will edit the post above.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Borzacch on October 31, 2013, 11:47:11 AM
Thank you a lot!! I'm cooking RAW's on six PCs via 1Gbit LAN. All PCs in farm are connected to one mediaserver (Synology DS1511+) That schemme is damn good. Thank you from Russia again!!!

Please, give me info where to donate.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Kharak on November 02, 2013, 09:28:39 AM
Newest version of raw2dng for 5D2.

With Median Algorithm. (if this is better or not, is up to you to decide)

5d2_raw2dng.zip (https://dl.dropboxusercontent.com/u/13314708/5d2_raw2dng.zip)

For Windows and Mac

Thanks to a.d.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: lmackreath on November 13, 2013, 10:33:50 AM
Still cannot get this to work

"no video sequence folder found"

I have a folder full of dngs and I want them to convert to pro res...anything obvious i need to check?


09:20:55 Start converting tiff from Shot 1
09:20:55 Finished
09:20:55 Start creating proxy from Shot 1
09:20:55 Failed:
No video sequence folder found
09:20:55 All items Finished
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Steve Kahn on November 13, 2013, 10:08:34 PM
Just wanna add, that I found a way to make RAWanizer include camera profile information. EDIT: The raw2dng is for 5DMKII only

raw2dng: https://www.dropbox.com/s/29qkvnf3pa1c6b7/raw2dng.exe

I overwrited the raw2dng.exe file in RAWanizer tools folder with an older raw2dng (says Last Modified 15. July) which includes camera profile, this alone did not work for me (maybe you will have better luck), but then I also copied the raw2dng in to a folder that had RAW files in it, started converting a RAW file with raw2dng - aborted (ctrl+a - ctrl+c) - Started converting that same file with RAWanizer and now RAWanizer includes Camera profile information on all other RAW files and folders, so you can choose correct Vision Log, faithful, adobe standard etc. :) Hope this will work for others.

--------------------------------------------------------------------------

Today RAWanizer did the same crash as ubejavshiy reported 2 pages back or so and I had a while ago too. I couldn't use RAWanizer for quite some time until one day it just worked. But I believe I found the cause of the error and how to get around it.

(https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2Fubejavshiy.com%2Fraw.png&hash=bba62de961bb13894dd8688806345056)

So RAWanizer spit this message in my face today and I was like "PLEASE nooo!!".

 I had chosen a folder that had some RAW files in it and then the program crashed and when opened again I got the message above. So after re-installing, CCleaning, Moving, adding, compatibility, admin rights, you name it and nothing worked. I was pulling the last few hairs out of my head and I pulled the Hard Drive out which RAWanizer accessed last. (Even though I deleted RAWanizer in Control Panel, it still seems to remember its last location)

I Opened RAWanizer and it worked. Then I tried accessing the same folder again and the error report came up again, instead of choosing Exit, I choose continue and chose another folder containing some other RAW files and those files worked with RAWanizer. So I looked in to the folder in which RAWanizer crashed in. Found a RAW file which was 1 or 0 kb, not sure right now. Deleted it and tried accessing the folder again via RAWanizer and voila!! It worked.

So if anyone else got this problem, try this solution :)

Yep.  This worked for me as well.  Same issue.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: gary2013 on November 14, 2013, 03:42:24 AM

... I'm the first idiot on this forum.  Get in line ;) ...
u r def not an idiot.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Kharak on November 15, 2013, 11:51:00 AM
Yep.  This worked for me as well.  Same issue.

Great!! been wondering if I was the only one

Happy to have helped :)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: diogo.fagundes on November 25, 2013, 05:22:46 PM
To make a better workflow for myself I created this windows app. Thought I should share it in case anyone else find it useful.

It's just i quick dev. No extensive testing done. No guarantee of anything. Use at your own risk! Only works on windows and is using raw2dng, dcraw and ffmpeg.

My workflow
As of version 0.3.0 I have tried to get this app to help me with my whole workflow which centers around Lightroom as RAW converter. Here is how I do it:
-Copy raw files to folder on local computer (SSD disk will improve conversion speed alot)
-Open RAWanizer, select folder, choose video settings and press start. This will extract dng from raw file, create proxy tiff files and a proxy video file.
-For a fast preview of the sequence, I choose tiff size half and mp4 option. This will give me a preview that I can use to decide which files to do real conversions for.
-Once I know which files I want to do deal with I have two options:

---Go to Lightroom or other raw converter and do conversion there. Export files as tiff and put them in 'tiff' sub folder to the dng folder (in Lightroom there is a nice option to do this easy)
---Go back to RAWanizer and choose 'video' instead of 'proxy video', select a higher quality video codec and hit start. This will give me a video file to work in my NLE.
---If I want to go back and change some settings in Lightroom I can do that and reexport to the same folder as before. Then open RAW anizer and just hit start again and it will replace the previously created video file. This will automatically have the clip in your NLE  get updated.

---OR

---Instead of lightroom, in RAWanizer I hit custom button which brings up a dialog for making settings for dcraw conversion. Tweak the settings and hit save. This is now the settings use for conversions. If I'm satisfied with the quality I choose to use a high quality codec and hit start. Now I have a file ready for my NLE

Important The 'video' settings to the left of start button has these meanings:
-Proxy video: Extracts the dng from raw file. Then creates tiff files from dng and finally creates a video file from the tiffs.
-Video: Looks for tiff files in 'tiff' sub folder in the dng subfolder and creates video file from them. Use this option if you have developed the dng in other converter.
-No video: Only extracts the dng from raw file. No tiffs created and no video file created.
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fbitbucket.org%2Fbjurhulta%2Frawanizer-release%2Fdownloads%2FRAWanizer.0.3.0.JPG&hash=64d3dc79922796504e9bed164a6d170a)

Open the folder with raw files. Choose frame rate (for example 23.976) and size for proxy video. Click start and wait.

RAWanizer will create a sub folder for each raw file and put the dng files there. When proxy is created a sub folder in the dng folder will be created with tiffs. The final proxy video is created from the tiffs and put in the same folder as the original raw file. If there is a wav file with the same name as the raw file it will be included in the proxy video.

The proxy file generated can be either mp4 (5mbit) or DNxHD (185mbit). The mp4 file is created in the resolution of the tiff files.  Since DNxHD only supports two resolutions, the image is upscaled to 1920x1080 with black bars if not a perfect fit.

If people find it useful I might put some more time on it. What improvements would you like?

Download full install 0.6.0 (https://bitbucket.org/bjurhulta/rawanizer-release/downloads/RAWanizerSetup.0.6.0.exe)
Patch 0.6.1 (https://bitbucket.org/bjurhulta/rawanizer-release/downloads/RAWanizer.exe) Save .exe in previous installation folder.
If you have installed a previous version, when using full install, you have to use windows 'add and remove progam' to uninstall the previous version first. You may also be prompted to download and install .net 4.5 when you start the program for the first time.


version 0.6.1
-dng subfolder is named -dng instead of .dng so Resolve can recognize the files.

version 0.6.0
-fixed processing of multiple spanned files
-added option to save all dng files in same folder
-included the latest raw2dng

version 0.5.5
-added setting to delete dng files after video creation. For safety reasons this only works if original is a RAW file, not a Dng folder.
-added button to restore default presets
-some file handling bugfixes

version 0.5.4
-the settings are applied when processing starts and not when added to queue, this has confused some people so I hope this will help some, but now you can't get different settings for different files in the queue.

version 0.5.3
-bug fixes

version 0.5.2
-bug fixes
-use framrate from raw file when creating video

version 0.5.1
-automatic merging of split files (>4Gb) (there is a setting under file tab where you can choose to write to the original RAW file. This is faster, cleaner and the result is just one single RAW file. But if something fails along the way you probably end up with at corrupt RAW file, so use with caution, preferably a backup. If not checked it will create a new RAW file with prefix 'M-' and the originals will still be there, safer if you have no backup)
-some more options for dcraw conversions
-now possible to save more than one custom preset for dcraw, Cineform and video output.

version 0.5.0
-raw file meta data shown in file list.
-option to show first, middle and last thumbnail from the raw file before processing.
-clean up of UI.
-latest version of raw2dng included.

version 0.4.3
-New install with all needed files and some fixes. Hopefully the ffmpeg problem will be gone now.

version 0.4.2
-Fixed problem with path for Cineform tools. This folder could appear either under 'Cineform' or 'Gopro'. You can now also set custom path under 'folder settings' if you have it installed in a different folder.

version 0.4.1
-For the Cineform batch processing I'm now throwing up console window so the progress can be examined and aborted by closing the console window. This is temporary as I hope to find another way to deal with it.

version 0.4.0
-Batch processing for Gopro Cineform. You have to download and install Gopro Cineform studio + a small utility. Follow the instructions here: http://www.magiclantern.fm/forum/index.php?topic=5479.msg41378#msg41378
-For the Cineform batch processing, the top progressbar is not working (detailed progress for each clip). You have to wait and see...

version 0.3.3
-Possible to open a single dng folder
-Fixed bug when starting program and last folder used had been removed
-Increased responsiveness when previewing dcraw settings

version 0.3.2
-tried to get rid of some users program crash

version 0.3.1
-Added possibility to set custom folders to override default structure
-Initial attempt for 'watch folder'. When this is activated, new raw files copied to that folder will automatically start processing.

version 0.3.0
-Add date time prefix to raw file name
-UI much more responsive and cancel works almost all the time
-More options for managing files and processing
-Now possible to use custom dcraw converter settings
-UI to help create custom dcraw settings
-Use custom ffmpeg settings for video file
-Create video file from tiff sub folder that can be populated by your favorite raw converter (lightroom, ps)

version 0.2.1
-added DNxHD as an option for the proxy file

version 0.2.0
-using multiple instances of dcraw to increase speed of dng to tiff conversion. You can change no of instances to find optimal for your computer.


Known Issues:
- Does not work with file names containing spaces or other special characters

Is there any version for Mac, of this program? ... If don't, please, create one, because this program seems to be perfect to improve the workflow.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Luiz Roberto dos Santos on November 26, 2013, 12:20:00 AM
Some ideas ... wish I could help [possibly] implement them, but my programming knowledge is almost nil.  :-\

1. What demosaincing algorithm uses the RAWanizer? "Fast"? How about implementing algorithms of high complexity, such as the AHD or AMaZe?

2 . It is possible to process the raw files with DCP tone curve applied? This way could be used to transform output files in logarithmic space, preserving every detail.

3 . Same for lens profiles ".lcp"? "Dark frame", or "flat field"?

4 . A possible integration with lib. the AviSynth or VapourSynth? If possible, it might be possible to run [later converting] a script ".avs" for use of advanced plugins.

5 . As already mentioned, support for . MLV and dual- iso. Maybe that last one of the most important implementations for now.


Like I said, I would love to help, but I'm not a developer and I'm just throwing ideas in the air. I hope some of them it is possible to implement!

Hug guys!
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: maxotics on December 04, 2013, 03:21:53 PM
I've sent multiple e-mails to Mårten Dalfors, who seems to be the dev behind RAWanizer.  I asked if he might continue dev or release it as open-source.  I explained that it would be best if FocusPixelFixer, and other new apps, were called from RAWanizer.  I haven't received any response.  It appears that he's Swedish.  I wonder if ML drove him insane ;) 

Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: jonnyginese on December 07, 2013, 08:34:06 PM
I like this a lot. Is it possible to use Adobe Camera Raw editor instead of the DCRaw editor?  for some reason the dcraw app is sluggish and I can't get the same look that I'm used to compared to the Adobe one.

Also, is there a way to change the settings on Cineform before rendering?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: jonnyginese on December 08, 2013, 06:19:20 PM
Does anyone know how to make this render put to cineform Raw instead of 422 or 444 and also set the color space to what was show in camera(is sRGB)? Also, once rendered, is there a specific plugin in available or in premiere that will give a similar editing tool set as the adobe raw editor?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: maxotics on December 08, 2013, 06:38:20 PM
Here's an effort to create a tool that creates Cineform RAW

http://www.primehd.net/news/raw-2-cf-raw/

I want to point out, again, that RAWanizer is only a GUI to command line apps.  You can use raw2gpcf with some switches that create Cineform 422.  However, I think the de-bayering is a little weak. 

Resolve has come a long way; the Free/Lite version is all you need. You can easily import DNGs and create almost any output, which you can use in any editor.  I recommend that you spend your time with Resolve, which wasn't really a solution a few months ago, but now is.

D.L. Watson did a very nice tutorial recently. 


You probably don't want to pick the BMRaw camera setting that he does in the video.  There are other tutorials I would find and watch. 

Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: jonnyginese on December 08, 2013, 07:37:59 PM
From what this post says.
http://www.magiclantern.fm/forum/index.php?topic=5479.55;wap2

It looks like the default conversion for cineform is Cineform RAW if you have no switches activated. Is there anyway to verify what format the file is after its rendered?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: maxotics on December 08, 2013, 11:54:31 PM
That's interesting jonnyginese, didn't notice that before!  My guess is if the output doesn't play in Windows media player it's RAW ;)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Andy600 on December 09, 2013, 12:40:04 AM
Media Info should give detailed info on file formats, codecs, bitrates etc http://sourceforge.net/projects/mediainfo/

another 'essential' app is http://www.digitalrebellion.com/posthaste/ (thanks to D.L. Watson for the heads up). Save's a ton of time creating project directory structures, folders etc
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: jonnyginese on December 10, 2013, 02:37:39 PM
how do i set an output folder that i want all my processed Cineform files to go?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: maverick891 on December 16, 2013, 08:24:22 AM
I have used this software on two diff machines successfully. Installed in on my brand new pc and it is failing to convert .raw to dng files. The raw2dng executable works but i would rather use a gui for large number of files. It just says failed no error description or number. Any idea how to fix this?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: feureau on January 07, 2014, 07:13:10 PM
Btw, has anyone run the rawanizer into a virus scanner?

Bitdefender just quarantined every rawanizer.exe I got for Gen:Variant.Kazy.298552

A quick google says this is a trojan. Just want to put this out there in case.

EDIT: Yup. I tried downloading a fresh copy of rawanizer (0.6.1) and Bitdefender:

a. caught the link and blocked me. I downloaded it anyway, and it

b. immediately quarantined the copy.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Luiz Roberto dos Santos on January 08, 2014, 01:23:50 PM
Btw, has anyone run the rawanizer into a virus scanner?

Bitdefender just quarantined every rawanizer.exe I got for Gen:Variant.Kazy.298552

A quick google says this is a trojan. Just want to put this out there in case.

EDIT: Yup. I tried downloading a fresh copy of rawanizer (0.6.1) and Bitdefender:

a. caught the link and blocked me. I downloaded it anyway, and it

b. immediately quarantined the copy.

This is not virus. Just stop bitdefender and download it, or set exeption for this software in bitdefender gui.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Kharak on January 08, 2014, 01:29:28 PM
Btw, has anyone run the rawanizer into a virus scanner?

Bitdefender just quarantined every rawanizer.exe I got for Gen:Variant.Kazy.298552

A quick google says this is a trojan. Just want to put this out there in case.

EDIT: Yup. I tried downloading a fresh copy of rawanizer (0.6.1) and Bitdefender:

a. caught the link and blocked me. I downloaded it anyway, and it

b. immediately quarantined the copy.

Have not experienced any virus warnings.

But I guess your Trojan warning has something to do with .net 4.5
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: drmoreau on January 08, 2014, 10:17:44 PM
I don't get it. I show it where my RAW files are hit start and it looks like it's doing something but nothing happens. The files are still just sitting there, no DNG files, no TIFF files, no video. What gives?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Kharak on January 09, 2014, 12:52:32 PM
I don't get it. I show it where my RAW files are hit start and it looks like it's doing something but nothing happens. The files are still just sitting there, no DNG files, no TIFF files, no video. What gives?

Did you queue the files?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: feureau on January 09, 2014, 08:15:45 PM
This is not virus. Just stop bitdefender and download it, or set exeption for this software in bitdefender gui.

It is indeed not a virus, but is actually a malware: http://www.f-secure.com/v-descs/rogue_w32_systemtool.shtml

an alias to  Rogue:W32/SystemTool

It is generally considered to be not in good form to set exception for malwares. I don't know what triggers this one, but I've definitely seen that install screen before, and wondered where it came from. RAWanizer is not open source, detected for malware, and the author has since disappeared.

Use with caution. You've been warned.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Kharak on January 11, 2014, 06:27:04 PM
It is indeed not a virus, but is actually a malware: http://www.f-secure.com/v-descs/rogue_w32_systemtool.shtml

an alias to  Rogue:W32/SystemTool

It is generally considered to be not in good form to set exception for malwares. I don't know what triggers this one, but I've definitely seen that install screen before, and wondered where it came from. RAWanizer is not open source, detected for malware, and the author has since disappeared.

Use with caution. You've been warned.


Well then the question goes to all RAWanizer users. Has anyone here experienced their computer getting "sick" lately?

I must admit that I do find it weird how the developer just disappeared without a word.

And my computer has had random freezes and crashes lately, but it is old and I do think that might be the cause, but if anyone else here is experiencing the same thing as I, then perhaps this tool is infected..

But why create such and awesome tool and then put a Malware in it ?

Windows Defender does not find anything, neither does Avast. I will be installing Windows Security Essentials now, friend of mine says its the single best anti virus there is. He works with computers for a living.

If it does not classify it as malware, then I feel safe.

EDIT: Security Essentials did not find anything.

Guess you've been visiting some shady website, Feureau ;)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: RenatoPhoto on January 11, 2014, 09:28:04 PM
I use it and dont have any problems!
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: 1% on January 11, 2014, 10:37:25 PM
Quote
If it does not classify it as malware, then I feel safe.

I use ESET and it has never tried to connect out or in. Nor has it run on startup or spawned any EXEs
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: machinez on January 13, 2014, 07:17:19 AM
Adaware scanned file as having "Trojan.GenericKD.1419367"

Googling found this link:
https://www.virustotal.com/en/file/2a3edecc42751d7ca867157057f7580465ea1420f5650b3c0184411e8c9b759b/analysis/

Great tool. Quarantined for the moment, until I can figure out whats it's doing outside of converting raw footage.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Kharak on January 14, 2014, 03:04:16 PM
Adaware scanned file as having "Trojan.GenericKD.1419367"

Googling found this link:
https://www.virustotal.com/en/file/2a3edecc42751d7ca867157057f7580465ea1420f5650b3c0184411e8c9b759b/analysis/

Great tool. Quarantined for the moment, until I can figure out whats it's doing outside of converting raw footage.

Let us know if you find something
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: mmarko on January 21, 2014, 02:33:48 PM
Why is this happening, am I doing something wrong? I have opened alot of files, but still there are some that i couldnt open. Shot on mk3. Tried on RawMagic too on Mac, not working :o on 6d i didnt have those problems. files have enough GB's, tried on raw2dng too, kicking out from program.

(https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2Fimagizer.imageshack.us%2Fv2%2F800x600q90%2F836%2Fykko.jpg&hash=5a308231d332c4b4c8ddd17a43df6d93) (https://imageshack.com/i/n8ykkoj)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Kharak on January 21, 2014, 04:14:29 PM
Try newest version, 0.6.1
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: mmarko on January 24, 2014, 11:03:01 AM
Not working on that version too. Is there someone here who I can send one small file, just to try, please?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: mmarko on January 24, 2014, 04:11:05 PM
Tried with Ginger HDR in AE on PC. This is what happened:

ASSERT FAILED: currSize> 0
Line: 17
File: src/CommonLib/src/BinaryFile.cpp
Func: BinaryFileRead::ReadFile

Error logged to file:
C:/Users/lee/Documents/19lights/Ginger-HDR-Proxy-log.txt
please send the error...
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: kaco on January 25, 2014, 12:06:35 PM
Hi, I am using RAWanizer 0.6.1 under Windows 8.1 64bit

When having raws with more than 1:25 (one minute and 25 secs, which is approx 2040 dngs), the half resolution proxy is generated correctly. But when I try to swich the proxy to full resolution and DNxHD 185, the video will be generated at the maximum time approx 1:25 (with no error message). Same problem when trying to use TIFFs exported from Lightroom. I have more than 6000 tiffs in the folder, but the maximum lenght of the DNxHD video is 1:25 :-/
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: kaco on January 25, 2014, 01:16:25 PM
Hi, I am using RAWanizer 0.6.1 under Windows 8.1 64bit

When having raws with more than 1:25 (one minute and 25 secs, which is approx 2040 dngs), the half resolution proxy is generated correctly. But when I try to swich the proxy to full resolution and DNxHD 185, the video will be generated at the maximum time approx 1:25 (with no error message). Same problem when trying to use TIFFs exported from Lightroom. I have more than 6000 tiffs in the folder, but the maximum lenght of the DNxHD video is 1:25 :-/

I tried to switch from DNxHD to prores444 and now it seems to work fine (i can export videos longer than 5 minutes without any problem).
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Kharak on January 25, 2014, 09:06:37 PM
Not working on that version too. Is there someone here who I can send one small file, just to try, please?

do you have .net 4.5 installed?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: mmarko on January 27, 2014, 02:05:24 AM
Yes. I have reinstalled computer yesterday (not cause of this) and I got new problem with Rawanizer, it won't start.
(https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2Fimagizer.imageshack.us%2Fv2%2F800x600q90%2F22%2Fepd9.jpg&hash=5dc021b6c804756bbbed5551261ee876) (https://imageshack.com/i/0mepd9j)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Kharak on January 27, 2014, 10:49:31 PM
Yes. I have reinstalled computer yesterday (not cause of this) and I got new problem with Rawanizer, it won't start.
(https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2Fimagizer.imageshack.us%2Fv2%2F800x600q90%2F22%2Fepd9.jpg&hash=5dc021b6c804756bbbed5551261ee876) (https://imageshack.com/i/0mepd9j)

Just wanna add, that I found a way to make RAWanizer include camera profile information. EDIT: The raw2dng is for 5DMKII only

raw2dng: https://www.dropbox.com/s/29qkvnf3pa1c6b7/raw2dng.exe

I overwrited the raw2dng.exe file in RAWanizer tools folder with an older raw2dng (says Last Modified 15. July) which includes camera profile, this alone did not work for me (maybe you will have better luck), but then I also copied the raw2dng in to a folder that had RAW files in it, started converting a RAW file with raw2dng - aborted (ctrl+a - ctrl+c) - Started converting that same file with RAWanizer and now RAWanizer includes Camera profile information on all other RAW files and folders, so you can choose correct Vision Log, faithful, adobe standard etc. :) Hope this will work for others.

--------------------------------------------------------------------------

Today RAWanizer did the same crash as ubejavshiy reported 2 pages back or so and I had a while ago too. I couldn't use RAWanizer for quite some time until one day it just worked. But I believe I found the cause of the error and how to get around it.

(https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2Fubejavshiy.com%2Fraw.png&hash=bba62de961bb13894dd8688806345056)

So RAWanizer spit this message in my face today and I was like "PLEASE nooo!!".

 I had chosen a folder that had some RAW files in it and then the program crashed and when opened again I got the message above. So after re-installing, CCleaning, Moving, adding, compatibility, admin rights, you name it and nothing worked. I was pulling the last few hairs out of my head and I pulled the Hard Drive out which RAWanizer accessed last. (Even though I deleted RAWanizer in Control Panel, it still seems to remember its last location)

I Opened RAWanizer and it worked. Then I tried accessing the same folder again and the error report came up again, instead of choosing Exit, I choose continue and chose another folder containing some other RAW files and those files worked with RAWanizer. So I looked in to the folder in which RAWanizer crashed in. Found a RAW file which was 1 or 0 kb, not sure right now. Deleted it and tried accessing the folder again via RAWanizer and voila!! It worked.

So if anyone else got this problem, try this solution :)

From 2 pages back
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Canon eos m on February 02, 2014, 02:26:20 PM
I am getting the exact same error. Been trying to sort this out since the last 2 hours (install, uninstall, etc.). Nothing works. The error keeps coming back.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Kharak on February 04, 2014, 06:16:01 AM
I am getting the exact same error. Been trying to sort this out since the last 2 hours (install, uninstall, etc.). Nothing works. The error keeps coming back.

did you read the post?

Check your folder that contains the RAW that you worked on the last time. See if you can find a raw file that is 0 or 1 kb or close to that, basically a useless raw file. Then delete it.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: pascal on March 08, 2014, 07:34:19 PM
Very much thanks to the author of this tool. Where many other tools have failed this one does exactly what is needed to process ML RAW files. It batch-converts RAW files conviniently to DNG sequences without any unnecessary overhead.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: edge11 on March 19, 2014, 01:12:09 AM
is there any way to set up chroma soothing ala  raw2dng cs2x2?
thanks guys.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: sqd on March 24, 2014, 10:37:39 AM
I'm just wondering (and it's probably because I'm dumb :p), but.. I have GoPro Studio Premium installed, and I change the output parameters in Rawanizer from -422 to -raw, but the file it produces is still smaller than from what I get with 444.. is that correct?

Also, does anyone know of the quality comparison between Raw converted to Cineform 444  vs. the standard Canon .mov files?
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: guentergunter on March 25, 2014, 09:45:21 PM
Hello marten,
since a few days now there's a discussion about the future resolutions available for the 5D2 (and maybe other cameras).

It started with a1ex:

The horizontal resolution is restricted to multiples of 8 bytes and 16 pixels according to latest findings. This restriction is valid at least for 5D3 and 6D (didn't do much testing on other cameras), but I'd like to keep the code portable without camera-specific exceptions.

So, before including this change in nightly builds, I'd like to ask you which is better: 1888 with 8 pixels of black border that you will have to crop, or 1856 without any border pixels? Between these 2 values, there are no valid resolutions that respect the alignment restrictions.

This change was discussed here:

http://www.magiclantern.fm/forum/index.php?topic=3904.msg106087#msg106087
https://bitbucket.org/hudson/magic-lantern/pull-request/438/raw-recording-force-line-size-to-be/diff


In my opinion, it would be no problem to simply discard black borders from an image while converting to dng:


...and it's also no coding effort to discard pixels while converting to dng. The user wouldn't even realize it!
This way, no one has to crop anything actively in post! It's simply done in background in the ever necessary converting (to dng) step.

I'm no programmer (just some very basic skills).
Thus it would be really great, if you could just leave a little comment about it as a programmer to help us sort things out for the 5D2 (and other cameras with the same problem):

Specific 5D2 threat (http://www.magiclantern.fm/forum/index.php?topic=5533.new#new)

Thank you very much!
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Kharak on April 03, 2014, 01:27:37 AM
@Guenter.

Sorry to say, but Marten has not been around for several months. He disappeared without a word, Hope he's okey.

Rawanizer is the greatest raw_rec post processor in my opinion. Looks like it won't ever go past 0.6.1.

Edit: but RAWanizer only needs the raw2dng to crop those 8 pixels. You can change what raw2dng Rawanizer uses.. So if someone else programs a raw2dng to crop 8 pixels, then RAWanizer will do so too.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Nautilus on April 10, 2014, 06:30:07 PM
I extracted DNGs from raw file using raw2dngcs2x2.exe (to remove pink dots) and then trying to make ProRes 444 video file from them using RAWanizer. But i keep getting this error: "No video sequence folder found"
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: ratheesh on May 14, 2014, 05:49:22 PM
Which is better RAWANIZER or MLV converter? It would be better to have mlv file conversion within RAWanizer
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: rking on July 10, 2014, 07:58:38 PM
Anyway to have folders for the dngs to not have .dng at the end?  Makes them unreadable by Davinci Resolve. 
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Kharak on July 11, 2014, 01:25:29 AM
The developer has been gone for almost a year now.

I don't think any more changes will be made to this program.

I enjoy this program the most for raw_rec though.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: pakal on August 04, 2014, 10:40:10 PM
Hi everyone,

I've been trying to use this software to convert dng sequences (extracted from mlv with mlv converter ) to mov.
But I get this error :

21:34:23 Start creating video from MLV_WHARF_A002_201645_C00001-dng
21:34:23 Failed:
No video sequence folder found
21:34:23 All items Finished

I've seen someone had the same issue. I guess it's just a naming convention the program doesn't recognize.
Can someone post the way the folders are named and the files inside please?

Would be a big help to batch convert all these folders!

Thanks
Pascal
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: DolphinCreative on October 06, 2014, 10:19:52 AM
This is a great tool.

Thank you so much. :)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Alex Stroud on October 16, 2014, 06:36:45 PM
Hi. I'm a little confused. I'm making the transition to a cineform workflow. I work on a 2014 Mac Pro, so I have paid for a copy of windows and VMware, and have installed RAW2GPCF and rawanizer on the windows side.

Where does Cineform Studio fit in? I've paid for it but I haven't got the activation code yet so I don't think I'm tied into what system I put it on. Does it need to be on the windows or mac side? AFAIK you need Studio Premium to get rawanizer to export Cineform raw (I assume it's giving you the licenses to encode to Cineform, which makes me think that it should be on the windows side), but I'd ideally want it on the Mac side because I have an apple laptop that could be used for another guy to remote grade during editing with the active meta data.

Anyway, I'm generally just a little confused with where Cineform Studio needs to be.

Cheers guys
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: glubber on October 16, 2014, 10:28:34 PM
Looks like the raw2cineform converter is only available in Windows:
 http://www.magiclantern.fm/forum/index.php?topic=5479.msg40941.msg#40941  (http://www.magiclantern.fm/forum/index.php?topic=5479.msg40941.msg#40941)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: eld3rs on December 09, 2014, 01:58:04 PM
I have just shot my first video in RAW format on the BMCC. I got .DNG files off the camera and since i had to return the hired camera. Now i want to preview the files in my regular media player instead of inside the NLE because its faster. I've tried using rawanizer to produce the proxies but it creates tiffs as well but all i want is the proxy video at any quality (even the lowest just for previewing). Is there a converter or any other way i can get a proxy from dng. I understand i can do it in After effects, even premiere but those eat up my memory and time,,, i want something lite like Rawanizer.

Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: dmilligan on December 09, 2014, 02:00:00 PM
MLRawViewer (http://www.magiclantern.fm/forum/index.php?topic=9560.0)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: eld3rs on December 09, 2014, 03:47:18 PM
MLRawViewer (http://www.magiclantern.fm/forum/index.php?topic=9560.0)

thanks dmiligan,, MLRawViewer seems to be working well, i just have two more issues.

1. The video is playing but it is duotoned and not in full color

2. I cant get to export, how does i followed this order from the control list
W - File dialog to choose the export directory
D - Choose export type, MOV or DNG
E - Add marked range to the export queue. Will use the source name with ".MOV" or "_DNG" appended.
C - Export all files in the current directory using the current settings
Y - Start processing, or pause processing of the export queue

but there's no progress after pressing the E key.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Kharak on December 09, 2014, 04:17:22 PM
this thread is for RAWanizer related topics.

please write in the appropriate thread
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: eld3rs on December 09, 2014, 06:01:10 PM
got it.. thanks
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: LarryB on December 31, 2014, 10:28:12 PM
Hey guys,

Was wondering, will RAWanizer support MLV and merge audio in a nearly future?
I'll soon start to shoot for a documentary and looking forward to transcode MLV to GPCF Raw. The 10:1 compression while retaining raw capabilities could be so much valuable.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: dmilligan on January 01, 2015, 01:39:20 AM
This app appears to be no longer supported. The author has been silent for more than a year. I would suggest using one of the various other converters that do support MLV:
http://www.magiclantern.fm/forum/index.php?topic=9560.0
http://www.magiclantern.fm/forum/index.php?topic=5618.0
http://www.magiclantern.fm/forum/index.php?topic=13152.0


The developer has been gone for almost a year now.
Sorry to say, but Marten has not been around for several months. He disappeared without a word, Hope he's okey.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Scheme2Cream on January 21, 2015, 06:31:07 PM
marten, thank you so much you're a saint!
this program works, I don't know how but it just does.

thank you thank you! you've saved my assignment keep up the great work man!
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Kromofone on April 06, 2015, 09:07:01 PM
Hey, I know I'm late but did anyone have this problem? I can't get rid of it and can't even open Rawanizer anymore :(

(https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2Fi.imgur.com%2FDxCAYfN.png&hash=6ad291ed5cf209ffad861a4f2ede18e4)
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: heavygrafix on April 07, 2015, 06:14:08 PM
Quote
Hey, I know I'm late but did anyone have this problem? I can't get rid of it and can't even open Rawanizer anymore :(


same here :/
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Kharak on April 07, 2015, 06:39:55 PM
Look if there is a raw file with the size of either 0 or 1 kb in your folder you are trying to convert.

If so Delete it or if you feel its important move it out of the folder.

Not sure if this is the same problem you are having, but Rawanizer has issues with 0 and 1 kb files.

Other than that.. Why not try one of the not 2 year old converters? like MLrawviewer, Raw2cdng, mlvfs etc.. ? So many other new ones on this site that work better.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Bobandy on July 01, 2015, 06:31:38 PM
Hey guys, I am currently trying to create an mp4 file from a dng file that I converted from RAW using an external converter (MLRawViewer). I keep running into the same problem, however, when it attempts to create a proxy or video. The program says that it cannot find the video sequence folder. I am running it on Windows 7 (64 bit). I realize its an old app but its one of the only and simplest ones i've found yet to go from .dng to .mp4. Any help would be greatly appreciated. Thanks!
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: lxddsdzh on September 10, 2015, 01:14:33 PM
I don't you what
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: lxddsdzh on September 10, 2015, 01:16:54 PM
可以给我发一份么 ...      不知道把中文翻译过去你能不能看懂
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: Odin on January 01, 2016, 03:10:55 AM
Proxy isn't created when I use this option...How to solve?
I use ML lantern the latest build downloaded from the official website.
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: ziomalnb on February 26, 2016, 06:40:03 PM
Hello Guys,
I have a problem with rawanizer. It converts a raw file to dng files, then it makes tiff files, but It doesn't create a proxy file. I don't know why. Any ideas? I am using windows 10 64bit
Title: Re: RAWanizer - windows batch generation of video files from RAW
Post by: caculo on May 27, 2016, 08:57:22 PM
Thank you!!!!
Here´s something I did with it: