Magic Lantern Forum

Using Magic Lantern => Raw Video => Raw Video Postprocessing => Topic started by: fatpig on May 24, 2013, 03:43:29 PM

Title: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: fatpig on May 24, 2013, 03:43:29 PM
BATCHelor 3.0 Alpha 3

(http://www.fatpigtures.com/software/images/batchelor3.jpg)

Download: http://www.fatpigtures.com/software (http://www.fatpigtures.com/software)

Changelog:

v3.0 Alpha 3

- implemented pause option

v3.0 Alpha 2

- critical bugfix for compression feature

v3.0 Alpha
- added preview function for .RAW
- added project management
- cleanup
- added button icons
- increased reliability
- warnings for known issues with path length

ToDo:
- File Spanning Support
- Raw2Dng conversion success check routine


My goal is to make this the only software you need on set to save your files off your CF cards.
You select your source (CF Reader) and destination directory, Batchelor creates a folder structure for each card, and each file.
The idea is, you leave BATCHelor running on your notebook (hibernate, if neccessary) and each time you have a new card, just press "GO!". :)

with thumbnails and optional lossy/lossless DNG compression
TIP: try lossy! It's a great difference in size (sometimes reduction to 30%) but looks the same!
(after successfully copying your files, because we know you need your CF card back ;) )
you can name your files and number the cards.

for info on RAW2GPCF (Cineform) installation, please refer to http://www.magiclantern.fm/forum/index.php?topic=5479.0

Any Questions will be answered here.

Bug Reports:
Please contact me via PM, providing a sample of affected files. This is the only way to fix some problems.

*Remember this is a Beta! Please post suggestions and problems here. Old version can be found under the same link.* :D
Title: Re: RAW2DNG GUI with Thumbnails and Folder Management
Post by: saint33d on May 24, 2013, 05:14:12 PM
Hey buddy, made an account to say thanks. This is exactly what i needed, couldn't seem to make thumbnails work though.
Title: Re: RAW2DNG GUI with Thumbnails and Folder Management
Post by: fatpig on May 24, 2013, 05:36:26 PM
Hi, I appreciate it. :)

For thumbnails (in this version, that is) do the following:
1. install imagemagick.
2. go to your program files/imagemagick and copy the complete folder to Batchelors folder.
so you got
batchelor/imagemagick/imagemagick.exe

hope it works for you. I can implement another method maybe in the future.


DCRaw is now our preview tool. No action on your side required. :)
Title: Re: RAW2DNG GUI with Thumbnails and Folder Management
Post by: saint33d on May 25, 2013, 06:27:39 AM
I got it working thanks, is there anyway of getting the thumbnail before the conversion ?
Title: Re: RAW2DNG GUI with Thumbnails and Folder Management
Post by: fatpig on May 25, 2013, 09:27:56 AM
I could try to implement a function like this, but why?
Title: Re: RAW2DNG GUI with Thumbnails and Folder Management
Post by: saint33d on May 25, 2013, 09:44:44 AM
Well it would be nice to see which clip youre converting before you do it. If its too hard it doesn't really matter this is what ill be using for my conversions.
Title: Re: RAW2DNG GUI with Thumbnails and Folder Management
Post by: Levinson on May 25, 2013, 09:58:23 AM
Quote from: saint33d on May 24, 2013, 05:14:12 PM
Hey buddy, made an account to say thanks.

Have just done the same. Thank you Fatpig :) 

Will test and let you know how it goes.
Title: Re: RAW2DNG GUI with Thumbnails and Folder Management
Post by: 3pointedit on May 25, 2013, 11:47:50 AM
fatpig, this looks really cool. Is it portable or do i have to install this and imagemagick? Would like to distribute it around some work PCs so they can chug away in downtime( no admin rights for install).
Title: Re: RAW2DNG GUI with Thumbnails and Folder Management
Post by: fatpig on May 25, 2013, 11:54:27 AM
Hey, my app is portable, unfortunately Imagemagick is not...
If you can recommend another free (commandline usable, which is most of them)  - utility which reads DNGs, I would be happy to change that.

@saint33d:
how would that look? are you thinking of a kind of internal file browser?
or just the folder structure built up before the actual conversion, already with the folder.jpgs created?
Title: Re: RAW2DNG GUI with Thumbnails and Folder Management
Post by: 3pointedit on May 25, 2013, 02:57:18 PM
Oh cool, well RawTherapee comes portable with a command line entry. I have opened 5DmkIII DNG files with it. I guess other size frames will work too?
Title: Re: RAW2DNG GUI with Thumbnails and Folder Management
Post by: pacman829 on May 25, 2013, 07:42:19 PM
any way to set this to run in the windows background ..

When i set it to convert it always pops up in front of other windows when it starts a new file
Title: Re: RAW2DNG GUI with Thumbnails and Folder Management
Post by: mjneubrander on May 25, 2013, 08:58:35 PM
DCRaw is small portable and reads the DNG files nicely
Title: Re: RAW2DNG GUI with Thumbnails and Folder Management
Post by: fatpig on May 26, 2013, 12:45:05 AM
I will look at the options for DCraw and RawTherapee.
I can also add a checkbox for hiding the conversion progress.

EDIT: DCRaw seems like a lot better of an option :)
Title: Re: RAW2DNG GUI with Thumbnails and Folder Management
Post by: fatpig on May 26, 2013, 12:58:19 PM
Hello guys, I'm at home right now, I tried to implement DCraw and the hide feature, but i dont have a .RAW file here for testing right now.
If anyone would upload a small .RAW file for me to work with I would appreciate it.

Thanks
Title: Re: RAW2DNG GUI with Thumbnails and Folder Management
Post by: saint33d on May 27, 2013, 06:26:24 AM
Try these from Neumann films
http://neumannfilms.mediafire.com/download/f10bftidtzk4ndn/5D3_Raw.zip (http://neumannfilms.mediafire.com/download/f10bftidtzk4ndn/5D3_Raw.zip)
Title: Re: RAW2DNG GUI with Thumbnails and Folder Management
Post by: fatpig on May 27, 2013, 05:29:56 PM
thanks, but obviously noone uploads unconverted .RAW files. all are DNG. I need the source to test the conversion process.. :)
Title: Re: RAW2DNG GUI with Thumbnails and Folder Management
Post by: renevg on May 28, 2013, 10:06:39 AM
Hi,
looks like good idea, but I can't seem to get raw2dng_batchelor working. I didn't install imagemagick. Do I have to?
I put RAw2dng in same folder as batchelor, created a folder with raw files and pulled that into the top box. it started creating folders but with nothing in it.
Title: Re: RAW2DNG GUI with Thumbnails and Folder Management
Post by: Northernlight on May 28, 2013, 11:41:45 AM
Quote from: fatpig on May 24, 2013, 05:36:26 PM
Hi, I appreciate it. :)

For thumbnails (in this version, that is) do the following:
1. install imagemagick.
2. go to your program files/imagemagick and copy the complete folder to Batchelors folder.
so you got batchelor/imagemagick/imagemagick.exe

hope it works for you. I can implement another method maybe in the future.

Hi, can not get imagemagick "installed", can not find any imagemagick.exe file, and I do not have any Visual IDE studio installed (as described on imagemagick site).. How do I proceed? Extracting imagemagick zip file into your folder does not help..
Title: Re: RAW2DNG GUI with Thumbnails and Folder Management
Post by: fatpig on May 28, 2013, 07:56:02 PM
@renevg:
tried running it as admin?
tried putting your files somewhere simple? (like C:\test\)

@Northernlight:
The installer for imagemagick is not exactly my area.. if you have it installed there will be a shortcut to the imagemagick.exe inside your start menu folder.

I think soon we will not need Imagemagick anymore. :)
DCRaw implementation was successful, wait some days. :)
Title: Re: RAW2DNG GUI with Thumbnails and Folder Management
Post by: 3pointedit on May 29, 2013, 06:06:36 AM
Oh, I don't have access to Admin rights on the PCs I can use (no imagemagick for me). Will DCraw be a portable component in your app?
Title: Re: RAW2DNG GUI with Thumbnails and Folder Management
Post by: renevg on May 29, 2013, 07:11:27 AM
Quote from: fatpig on May 28, 2013, 07:56:02 PM
@renevg:
tried running it as admin?
tried putting your files somewhere simple? (like C:\test\)
:) Well that did the trick. Didn't need running as admin, but putting files somewhere simple. Had spaces in foldernames and now I don't anymore. Great. Your tool can save a lot of time and boring actions. Now we can do what we want to do...filming and actual editing. Thanks.

Quote from: Northernlight on May 28, 2013, 11:41:45 AM
Hi, can not get imagemagick "installed", can not find any imagemagick.exe file, and I do not have any Visual IDE studio installed (as described on imagemagick site).. How do I proceed? Extracting imagemagick zip file into your folder does not help..
btw I had this same problem. Installing imagemagick one needs to be programmer  :( .  even though they speek of an windows install version that should do the trick, it doesn't. to bad.
Title: Re: RAW2DNG GUI with Thumbnails and Folder Management
Post by: fatpig on May 29, 2013, 11:55:45 PM
Hello guys, DCRaw will be included and portable.
It does not output jpg, so I am currently working a little longer on that.
We should see a release in the next week or so.
Until then I believe you have to be admin to install imagemagick..
Title: Re: RAW2DNG GUI with Thumbnails and Folder Management
Post by: fatpig on May 30, 2013, 12:37:03 AM
Surprise!

I had an idea and now it seems to be working. v1.2 out NOW! :)
As always, download from my website:
http://fatpigtures.com/software/ (http://fatpigtures.com/software/)

Let me know how it works for you.
Title: Re: [RAW2DNG] BATCHelor 1.2 (GUI with Thumbnails and Folder Management)
Post by: 3pointedit on May 30, 2013, 03:34:25 PM
Thank you fatpig that is great work. So happy to have a portable solution.
Title: Re: [RAW2DNG] BATCHelor 1.2 (GUI with Thumbnails and Folder Management)
Post by: bumkicho on May 30, 2013, 05:20:14 PM
So, it basically creates dng folders, uses raw2dng to extract dngs from raw, and uses dcraw to create thumbnails? Great work!
Title: Re: [RAW2DNG] BATCHelor 1.2 (GUI with Thumbnails and Folder Management)
Post by: 3pointedit on May 31, 2013, 02:33:18 AM
Hey it works great but I notice some mosaic artifacts, around high contrast edges. Is that normal?
Title: Re: [RAW2DNG] BATCHelor 1.2 (GUI with Thumbnails and Folder Management)
Post by: fatpig on May 31, 2013, 09:47:26 AM
...and uses cjpeg to make jpgs from the ppm files DCraw puts out. :)
- but other than that.. that is how it works. Happy you find it useful! :)

@3pointedit: you talk about the thumbnail?
I used the highlight recovery option in DCraw- this may be the cause.
Otherwise we look at blown out hightlights i suppose.
Title: Re: [RAW2DNG] BATCHelor 1.2 (GUI with Thumbnails and Folder Management)
Post by: bumkicho on May 31, 2013, 11:25:24 PM
Is there an option I can set to automatically create folder jpg instead of having to be prompted for every raw file?
Title: Re: [RAW2DNG] BATCHelor 1.2 (GUI with Thumbnails and Folder Management)
Post by: leefie on June 01, 2013, 02:18:51 AM
Yeah, or choose to disable the jpg completely.
Awesome tool so far! saved me hours of processing.
Have loaded the results yet but everything looks good :-)
Title: Re: [RAW2DNG] BATCHelor 1.2 (GUI with Thumbnails and Folder Management)
Post by: fatpig on June 01, 2013, 04:57:57 AM
Hello,

I made a small mistake in the 1.2 version, please download again, the prompt is now removed.
It is called version 1.2a - and it is right here as always:

http://www.fatpigtures.com/software
Title: Re: [RAW2DNG] BATCHelor 1.2 (GUI with Thumbnails and Folder Management)
Post by: ted ramasola on June 01, 2013, 10:29:37 AM
This app has great potential! Thanks fatpig!

A couple of queries;

Does this work with spanned files of more than 4gig?

Is this compatible with the latest nightly compile for the 5dmkII dated may 31?
Title: Re: [RAW2DNG] BATCHelor 1.2 (GUI with Thumbnails and Folder Management)
Post by: fatpig on June 01, 2013, 11:15:22 AM
Just use the newest Raw2Dng.exe you can find, it worked for me at least. :)

I am currently thinking about making this something of an app you use on your notebook on set, so it copies, and optionally compresses your DNGs aswell.
What are some of the compression options out there?
I was thinking of some tests with Adobes DNG Converter. Ideally we could use some freeware for this aswell like 7-zip.
Other ideas?

7-zip gives about 50% on ultra and 80% on fastest compression setting.
I will also look at the lossy compression from Adobe.

EDIT: lossy compression is great, you seem to lose no detail, but filesize is greatly decreased. My first test gave a reduction to about 34% file size while remaining directly usable. this is great!
Title: Re: [RAW2DNG] BATCHelor 1.2 (GUI with Thumbnails and Folder Management)
Post by: ted ramasola on June 01, 2013, 11:25:34 AM
Thank you for your reply,

is imagemagick install optional? in case I don't need the thumbnails?
Title: Re: [RAW2DNG] BATCHelor 1.2 (GUI with Thumbnails and Folder Management)
Post by: fatpig on June 01, 2013, 11:30:02 AM
You don't need Imagemagick anymore. My app just works out of the download now.  :)
Title: Re: [RAW2DNG] BATCHelor 1.2 (GUI with Thumbnails and Folder Management)
Post by: IliasG on June 01, 2013, 03:36:19 PM
Quote from: fatpig on June 01, 2013, 11:15:22 AM
Just use the newest Raw2Dng.exe you can find, it worked for me at least. :)

I am currently thinking about making this something of an app you use on your notebook on set, so it copies, and optionally compresses your DNGs aswell.
What are some of the compression options out there?
I was thinking of some tests with Adobes DNG Converter. Ideally we could use some freeware for this aswell like 7-zip.
Other ideas?

7-zip gives about 50% on ultra and 80% on fastest compression setting.
I will also look at the lossy compression from Adobe.

EDIT: lossy compression is great, you seem to lose no detail, but filesize is greatly decreased. My first test gave a reduction to about 34% file size while remaining directly usable. this is great!

Adobe DNG converter is freeware and at lossless compression it gives a file size at around 60-70% with the added benefit of embedded midsize jpeg preview which then you can extract with Dcraw -e ..

Lossy compressed DNGs have limited support at the moment and give a RGB 8 bit-log file which possibly has problems with heavy grading. Some tests to show it's robustness (heavy grading, green screen) are needed before adoption ..
Title: Re: [RAW2DNG] BATCHelor 1.2 (GUI with Thumbnails and Folder Management)
Post by: leefie on June 01, 2013, 06:06:16 PM
I have one other suggestion:
Start the folder names at 0 instead of 1 so that they match the original files :-)
Will help with workflow, archiving, etc
Title: Re: [RAW2DNG] BATCHelor 1.2 (GUI with Thumbnails and Folder Management)
Post by: fatpig on June 01, 2013, 09:36:17 PM
@IliasG:
If I am not mistaken, Aftereffects is the only software capable of processing the Canon DNGs at the moment anyway-
and Aftereffects also supports the lossy DNGs as far as I know.

I think an option for lossless and lossy compression would be a good Idea in BATCHelor.

As for the file naming, I dont really see the benefit of this, as you delete your .RAW files after conversion, don't you? Why would the DNGs start at 0 then?
Title: Re: [RAW2DNG] BATCHelor 1.2 (GUI with Thumbnails and Folder Management)
Post by: tin2tin on June 02, 2013, 02:00:52 PM
Is it possible to somehow see and/or edit the dcraw settings you are you're using?
Title: Re: [RAW2DNG] BATCHelor 1.2 (GUI with Thumbnails and Folder Management)
Post by: fatpig on June 02, 2013, 02:47:14 PM
currently it is not possible.
It is harcoded.
What would you like to change?
Title: Re: [RAW2DNG] BATCHelor 1.2 (GUI with Thumbnails and Folder Management)
Post by: tin2tin on June 02, 2013, 03:18:03 PM
I'm messing around with dcraw but only get dark and pink frames out.
Title: Re: [RAW2DNG] BATCHelor 1.2 (GUI with Thumbnails and Folder Management)
Post by: fatpig on June 02, 2013, 03:38:37 PM
I am using the 
Quote-w -H 2
parameters only.
Title: Re: [RAW2DNG] BATCHelor 1.2 (GUI with Thumbnails and Folder Management)
Post by: IliasG on June 02, 2013, 09:48:45 PM
Quote from: fatpig on June 01, 2013, 09:36:17 PM
@IliasG:
If I am not mistaken, Aftereffects is the only software capable of processing the Canon DNGs at the moment anyway-
and Aftereffects also supports the lossy DNGs as far as I know.

I think an option for lossless and lossy compression would be a good Idea in BATCHelor.

..

I think you are correct on this. And more support is coming by third parties ..

I just insist that lossy DNG needs a robustness test before accepted as a useful option.
Title: Re: [RAW2DNG] BATCHelor 1.2 (GUI with Thumbnails and Folder Management)
Post by: fatpig on June 04, 2013, 06:18:45 PM
I will make both options available, I redesigned the interface and will try to make it a one-stop on-set solution for storing our RAW files.
Title: Re: [RAW2DNG] BATCHelor 1.2 (GUI with Thumbnails and Folder Management)
Post by: hjfilmspeed on June 05, 2013, 06:22:37 PM
Is it possible to combined your batch with raw to cineform converter too? or cinema dng? I love your program. its simple and quick and super reliable. I converted and afternoons worth of raw without a single issue but id love to have the option to batch to cinform or cinema dng. I have no clue how to do the command line thing. Do think it is possible?
Title: Re: [RAW2DNG] BATCHelor 1.2 (GUI with Thumbnails and Folder Management)
Post by: fatpig on June 05, 2013, 08:12:00 PM
Hello hjfilmspeed,

I am certainly willing to include these exciting methods once they are workable.
For now, they don't work on either of my machines.
I have posted in the RAW2GPCF thread already.

For now, I implemented some new stuff in my new Beta in Post 1. Check it out! ;)
Title: Re: [RAW2DNG] BATCHelor 2.0 Beta (Complete ON-SET Data Solution!)
Post by: hjfilmspeed on June 05, 2013, 10:54:01 PM
Awesome! I have no clue how you programmers do it. Excellent job and thank you so much! 1.0 was a machine! Havent had any issues yet! Great work!!!
Title: Re: [RAW2DNG] BATCHelor 2.0 Beta (Complete ON-SET Data Solution!)
Post by: fatpig on June 05, 2013, 11:45:39 PM
let me know how the beta works for you, should you come to use it :)
Title: Re: [RAW2DNG] BATCHelor 2.0 Beta (Complete ON-SET Data Solution!) *Compressed DNG*
Post by: ted ramasola on June 06, 2013, 12:30:22 PM
I was able to run it 1 time, I saw a cmd prmt window running raw2dng and files were generated in folders in the specified dir. then when I tried for a second batch it just generated a folder and I can see a cmdprmt screen flash for a millisecond but nothing is generated.

Does it work if I manually deleted first a file in the cf card via explorer before I run bachelor? because that's what I did different from the 1st time.
Title: Re: [RAW2DNG] BATCHelor 2.0 Beta (Complete ON-SET Data Solution!) *Compressed DNG*
Post by: fatpig on June 06, 2013, 01:49:19 PM
manually deleting files should not be a problem while batchelor is not running.

try to reproduce the error-
on your system, just let batchelor process the same folder twice in a row.
if everything works correctly you will get 2 folders, one with number 1, one with number 2.

let me know how it works, also try to run as admin and use short paths like C:\test to narrow down the problem.
Title: Re: [RAW2DNG] BATCHelor 2.0 Beta (Complete ON-SET Data Solution!) *Compressed DNG*
Post by: ted ramasola on June 06, 2013, 01:57:00 PM
Quote from: fatpig on June 06, 2013, 01:49:19 PM
manually deleting files should not be a problem while batchelor is not running.

try to reproduce the error-
on your system, just let batchelor process the same folder twice in a row.
if everything works correctly you will get 2 folders, one with number 1, one with number 2.

let me know how it works, also try to run as admin and use short paths like C:\test to narrow down the problem.

I've done it several times. Yes, I got several folders numbered incrementally but nothing is inside. I tried files that were transfered to the HDD. still no go. I can extract using the drag over raw2dng method.

The folder structure i use is also simple, just a folder after drive letter.

Also ran the program as admin.
Title: Re: [RAW2DNG] BATCHelor 2.0 Beta (Complete ON-SET Data Solution!) *Compressed DNG*
Post by: fatpig on June 06, 2013, 02:22:20 PM
I am trying to reproduce the problem, but until now, no luck.

just to confirm, this works for me:
What I mean is, choose your .RAW folder, click nothing else, press GO.
It works, done.
Then, press GO again.

Then there is no output in the new, second DNG folder?
Title: Re: [RAW2DNG] BATCHelor 2.0 Beta (Complete ON-SET Data Solution!) *Compressed DNG*
Post by: ted ramasola on June 06, 2013, 02:25:10 PM
Quote from: fatpig on June 06, 2013, 02:22:20 PM
I am trying to reproduce the problem, but until now, no luck.

just to confirm, this works for me:
What I mean is, choose your .RAW folder, click nothing else, press GO.
It works, done.
Then, press GO again.

Then there is no output in the new, second DNG folder?

yes. no extracted contents in all folders created. In the 1st time I ran Batchelor, I knew it was working because I see the cmd prompt window with the progress running.

I'll go step by step.

-run batchelor 2.0 as administrator. --- app opens
-click source button---window opens, I select CF card-go to DCIM folder--select subfolder with the raw files
-click on destination--picked a folder in drive ( f:\footage\).
-click GO
-in footage folder DNG1 is created with folder named 1_001  -its empty
-Status in batchelor app says DONE
-click GO again
-in footage folder DNG2 is created with folder named 2_002  -its empty
-Status in batchelor app says Done

complete text in status box for entire process is:

Ready.
processing M06-0438.RAW...
Generating Thumbnail 001... Done.
processing M06-0438.RAW...
Generating Thumbnail 002... Done.
Title: Re: [RAW2DNG] BATCHelor 2.0 Beta (Complete ON-SET Data Solution!) *Compressed DNG*
Post by: fatpig on June 06, 2013, 02:35:38 PM
Read your PM. ;)
Title: Re: [RAW2DNG] BATCHelor 2.0 Beta (Complete ON-SET Data Solution!) *Compressed DNG*
Post by: ted ramasola on June 08, 2013, 11:02:47 PM
Just want to post for others following this that Fatpig has pmed me some assistance and have gotten this to work on my system. Currently it can't handle files bigger than 4gig.

Hopefully this useful software will be able to automatically join spanned files from the mkII.

Keep up the great work! :)
Title: Re: [RAW2DNG] BATCHelor 2.0 Beta (Complete ON-SET Data Solution!) *Compressed DNG*
Post by: qsara on June 09, 2013, 08:39:07 PM
just for this operations I've ordered 2nd ssd for my laptop, I'll try to use it wisely but I'm not sure how long it lasts..

as far I know, my old SSD (which I've bought 3 months ago, Intel 520 series 60GB encrypted) has 35TB data limit, I'm seeking for more data transfer capacity model, do you have any ideas?

(I really don't like to wait to see the results using a HDD)
Title: Re: [RAW2DNG] BATCHelor 2.0 Beta (Complete ON-SET Data Solution!) *Compressed DNG*
Post by: amsh89es335 on June 10, 2013, 07:40:06 AM
worked fine few times then I just keep getting an error. "Line 2215" Error: Subscript used with non-Array variable.
Title: Re: [RAW2DNG] BATCHelor 2.0 Beta (Complete ON-SET Data Solution!) *Compressed DNG*
Post by: guentergunter on June 11, 2013, 01:42:31 PM
This On-Set solution is what's definitely needed to bring the RAW out in the fields.
Especially the "just GO"-solution from card to HDD together with thumbnails for a quick check for corrupt files is like a dream.

Hopefully the MLTools will go that way, too ;-)
Title: Re: [RAW2DNG] BATCHelor 2.0 Beta (Complete ON-SET Data Solution!) *Compressed DNG*
Post by: Viente on June 12, 2013, 12:44:09 AM
Would be nice to have an option to uncheck thumbnail creation. Thanks :)
Title: Re: [RAW2DNG] BATCHelor 2.0 Beta (Complete ON-SET Data Solution!) *Compressed DNG*
Post by: Shield on June 14, 2013, 05:30:46 PM
Any chance we can have it use the raw name for the folder?
I.E. "M14-0149.RAW" becomes a M14-0149 folder.  This way later on if there's confusion I can just manually extract the raw in question.

Thanks,
Shawn
Title: Re: [RAW2DNG] BATCHelor 2.0 Beta (Complete ON-SET Data Solution!) *Compressed DNG*
Post by: fatpig on June 16, 2013, 10:08:06 PM
Hi Guys, I just finished a Week of shooting with our beloved 5DII RAW and worked on the automatic copying and joining of files.

I am currently thinking about iplementing copy/join only option because once you extracted your DNGs from .RAWs, there is no way to get cinemaDNG out of those, is there?

What are some of your thoughts on what BATCHelor should do on set exactly?
looking to keep your .RAWs?

My experience on set was not to process the .RAW Files because cards filled up as fast as I could copy the .RAWs, so no HDD speed for processing left..

@Shield: I am changing the enumeration to the origin file name
(which seems to have changed from 00001, 0002, etc. to current time like 1149, 1150, 1200,...)
- so your set assistant can keep track of file names for syncing audio.

@Viente: Why?

@guentergunter: Is there another tool that already does this?

@amsh89es335:
try to find out if some funky folder path is the problem, delete config.ini and set your source/destination again.

@qsara:
this is really a problem on set. unless you have a server with RAID, I see no option other than usb 3.0 / Firewire and ssd.
Title: Re: [RAW2DNG] BATCHelor 2.0 Beta (Complete ON-SET Data Solution!) *Compressed DNG*
Post by: Northernlight on June 19, 2013, 01:24:29 AM
Downloaded this great tool and it works nicely.

BUT, you must replace the RAW2DNG converter you have in your install package, because there is a new version available now (from june 6th).
This new version of RAW2DNG seem to fixe a crucial error which are the vertical stripes occuring on the 5D3.

I too would want the DNG-folders to inherit the filenames from the RAW files..



Title: Re: [RAW2DNG] BATCHelor 2.0 Beta (Complete ON-SET Data Solution!) *Compressed DNG*
Post by: fatpig on June 20, 2013, 12:25:12 AM
yep, I fix RAW Naming in version 2.3 - will be online in a few days! thanks for your support!
until then you can replace raw2dng.exe :)
Title: Re: [RAW2DNG] BATCHelor 2.0 Beta (Complete ON-SET Data Solution!) *Compressed DNG*
Post by: fatpig on June 25, 2013, 10:16:08 PM
As soon as RAW2CDNG implements command line, I will do another rewrite.

I think cineform proxies with CinemaDNGs is the way to go.
Does anyone see the need to keep RAW2DNG or compressed DNGs option?
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: hjfilmspeed on June 26, 2013, 08:32:09 AM
Yes! well i think so. i think the dng files edited in ACR have much better sharpness and color. However i only have the 422 cineform licence not the 444. I might be doing something wrong but so far ARC exports look the best out of all the methods. But again im on windows and i have the free versions of cineform and resolve so that could be the issue. ACR might be slow but its super sharp!
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: fatpig on June 26, 2013, 09:10:57 AM
hi, well you can use the cinemaDNGs in ACR aswell, that is why I propose to let RAW2DNG go.

I also use the free version of cineform and resolve.
I think both are great to use.
Any problems with version 2.3?
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: Danne on June 26, 2013, 09:24:17 AM
Hi! Let rawtodng go? I don,t see rawmagic producing any ProRes files? I like the rawtodng app, still it have som quirks but could be sorted out in time.
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: fatpig on June 26, 2013, 04:41:22 PM
@danne:

i dont get what you are saying.

I want to replace raw2dng with raw2cdng in the future inside my app.
rawmagic is not involved.
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: hjfilmspeed on June 26, 2013, 05:46:33 PM
Quote from: fatpig on June 26, 2013, 09:10:57 AM
hi, well you can use the cinemaDNGs in ACR aswell, that is why I propose to let RAW2DNG go.

I also use the free version of cineform and resolve.
I think both are great to use.
Any problems with version 2.3?

OHHhh! Duh sorry. Yeah cdng still works in ARC so thats cool too.  No problems so far with 2.3 works great! its impressive what you all are doing!!!

The only thing i dont like about the resolve or cineform route is that it seams like ARC has the best quality so far. resolve and cineform dont look as sharp as ARC in my side by side testing. They work for me but im not thrilled with quality. It would be nice to use cineform for more then a proxy but it doesnt seem to match ACR quality yet. I could be comparing apples to oranges tho. ACR is just really slow but it looks real good!!!
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: fatpig on June 26, 2013, 06:45:48 PM
I think ACR gives more of a photo-esque look, maybe it is a little more perfect.
I can not complain about sharpness in resolve, maybe try ticking "force highest resolution debayering" and "highest resolution scaling"
(or something similar, dont remember the exact names) in delivery tab.
if your lenses are not as good, maybe try some sharpening in post.

I used the 5DII with some Zeiss primes- and the sharpness and look, especially when using a FujiFilm 3D LUT in resolve is stunning.
I will have a trailer online soon. :)

Cineform can be used for real RAW with 1/6th file size if you have the paid version, but this is not implemented in BATCHelor yet.
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: Danne on June 26, 2013, 07:20:18 PM
Quote from: fatpig on June 26, 2013, 04:41:22 PM
@danne:

i dont get what you are saying.

I want to replace raw2dng with raw2cdng in the future inside my app.
rawmagic is not involved.

Aha, I misunderstood, sorry. Agreed upon replacing dng to cdng.
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: hjfilmspeed on June 26, 2013, 07:22:08 PM
huh maybe i need to check my settings in resolve. workflow would be way faster. Delivery tab settings might be my issue. i will also have to try this lut too. thank you sooooo much for your hard work and speedy response. I have been using batchelor since the beging an ive had zero issues! cant wait for your trailer!
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: dandeliondandy on June 26, 2013, 11:11:53 PM
So, when I tried to change the file names to something other than default, it created all these .p or something files instead of dngs...
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: fatpig on June 26, 2013, 11:38:32 PM
hello again.

@dandeliondandy:
thanks for your input, it is still in beta phase.
It did not occur to me that people might rename their .RAW Files.

I might have to implement a checking routine-
just out of curiosity-

how did you name the files?
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: hjfilmspeed on June 27, 2013, 12:36:57 AM
Quote from: fatpig on June 26, 2013, 06:45:48 PM
I think ACR gives more of a photo-esque look, maybe it is a little more perfect.
I can not complain about sharpness in resolve, maybe try ticking "force highest resolution debayering" and "highest resolution scaling"
(or something similar, dont remember the exact names) in delivery tab.
if your lenses are not as good, maybe try some sharpening in post.

I used the 5DII with some Zeiss primes- and the sharpness and look, especially when using a FujiFilm 3D LUT in resolve is stunning.
I will have a trailer online soon. :)

Cineform can be used for real RAW with 1/6th file size if you have the paid version, but this is not implemented in BATCHelor yet.

AAAAAAAAHHHHHHHHHH you were sooooooooooo right! ticking that box was the trick!!!!!!!! Wow you just changed my life hahaha! ok yeah soo cdng is the way to go for sure. I know this is off topic but i would love to try the fuji LUT where did you find it? Thank you sooo much again!

Wait nope sorry i was looking a a avi render from ARC it was the wrong file i was looking at. Im still not getting good results with davici. i must be doing something wrong. thank you again!!! 2.3 is still working great for me though.
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: dandeliondandy on June 27, 2013, 01:46:42 AM
@fatpig
Actually, I didn't rename the .RAW, just the output file from its default, if based on the original RAW. It created the folder from these new files but they were all very strange formats. something like .p #@% or something. So I turned off the rename option and then it worked fine creating proper dngs.
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: fatpig on June 27, 2013, 11:23:34 AM
@dandeliondandy:
can you post the exact filenames of your input files (or one, at least) and what you typed in the rename box?
I will try to reconstruct the issue.

@hjfilmspeed:
maybe send me a PM with comparison pictures as to what exactly you think is better in ACR results than resolve?
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: fatpig on June 28, 2013, 10:11:33 PM
hey guys, i just realized I left a really annoying popup window in the code which prevents your cineform conversions from running all the way through.

Please download the 2.3 Beta again, I fixed it!
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: 1% on June 28, 2013, 10:20:15 PM
Quick, why is your raw2dng 2 months old? dcraw from 2011 and cjpeg from 2002!
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: fatpig on June 28, 2013, 10:31:44 PM
I did not keep up with updating those.
Is there a good reason to update?
I never had any problems. :)

I dont want to provoke problems through syntax change in new versions, if there is no benefit I know of :)
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: 1% on June 29, 2013, 06:23:39 PM
Raw2dng had a bunch of noise removal changes, etc. DCraw @ cjpeg probably have other fixes from years of development.
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: fatpig on June 30, 2013, 07:23:52 PM
You are probably right, as for DCRaw and cjpeg, this were the only builds I was able to find.
As for Raw2dng - okay I get it.
I am still hoping to switch to raw2cdng entirely because the ACR Workflow is not really suitable for any serious work, wouldn't you agree?
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: fatpig on July 01, 2013, 05:50:10 PM
fixed another bug just now, cineform files had wrong blacklevel set.
still version 2.3 though, same link. ;)
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: 1% on July 01, 2013, 06:43:45 PM
I've had fun with raw2cdng... the 12 bit saves some space. I dunno what your compression methods do/are so I'm unsure if I can use them.


I've used both ACR workflows.. just lower the processes version and have tried straight to video workflows which don't seem to work as well for some cameras. DNG or CDNG doesn't really matter, you'll have to use ACR anyway. Does it not do expo shifts on CDNG?

I found newer versions of both files and used those, still seems to work.
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: Northernlight on July 01, 2013, 10:42:52 PM
Quote from: fatpig on June 30, 2013, 07:23:52 PM
You are probably right, as for DCRaw and cjpeg, this were the only builds I was able to find.
As for Raw2dng - okay I get it.
I am still hoping to switch to raw2cdng entirely because the ACR Workflow is not really suitable for any serious work, wouldn't you agree?

As long as the demosaicing/debayering done from ACR is FAR superior to any other debayering process/software currently available, I can not understand what you mean with "ACR workflow not being suitable for any serious work".

I will not choose convenience over image quality, NEVER !
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: fatpig on July 02, 2013, 11:06:47 AM
@1%:
my compression is simply adobe's lossy and lossless DNG compression through their own DNG Converter, you have to install it first, of course.

@Northernlight:
I think Resolve is used in many serious productions for a reason.
I think it delivers outstanding results. And the speed increase is a nice side effect.
Add a 3D LUT and good to go... :)
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: Danne on July 02, 2013, 03:54:45 PM
Quote from: Northernlight on July 01, 2013, 10:42:52 PM
As long as the demosaicing/debayering done from ACR is FAR superior to any other debayering process/software currently available, I can not understand what you mean with "ACR workflow not being suitable for any serious work".

I will not choose convenience over image quality, NEVER !

I agree on that one. I cannot get that photographic raw look in my dng,s from anywhere but in acr. Too bad though, would be so nice to go straight into editing. For now it seems that going through dynamic link into after effects from premiere is the fastest way to get into acr module via proxyediting
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: fatpig on July 02, 2013, 04:26:55 PM
Yes of course, if you want to get that photographic look, ACR is the best option out there for sure. :)

@1%: maybe you can link me those newer versions you found, then I will include them in the next release. :)
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: platu on July 03, 2013, 09:04:19 PM
Quote from: Northernlight on July 01, 2013, 10:42:52 PM
As long as the demosaicing/debayering done from ACR is FAR superior to any other debayering process/software currently available, I can not understand what you mean with "ACR workflow not being suitable for any serious work".

I will not choose convenience over image quality, NEVER !

Agree completely with this.  I like everyone else, am looking for a faster workflow, but the difference in debayering quality is quite significant and no other workflow method seems to provide the level of quality ACR attains.  Sigh  :(
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: hjfilmspeed on July 04, 2013, 03:58:54 PM
I have even tried this: http://www.magiclantern.fm/forum/index.php?topic=6845.0 for better sharpening in resolve and i still cant get it to match the nice organic sharpening you get with ACR. For some reason when i sharpen with resolve i get this artifacty sharpness and with ACR i get nice grain like sharpness. This is not to say that cdng is bad because it works well in both programs. Also im sure we will see more cinema dng support in the near future too. it would be a lot easier to work with resolve but im still stuck on ACR quality.
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: fatpig on July 04, 2013, 07:54:53 PM
why not open a thread about it or post something here so I can see what really makes the difference for you. I am curious. :) post a comparison for everyone to see. :)
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: hjfilmspeed on July 05, 2013, 04:32:51 AM
Your right i should start another thread Im sorry if it was off topic. I think your converter is great! cinemaDNG and DNG look amazing in ARC. Its definitely not your converter. Your converter has worked reliably for me for all of your versions thus far. Im thinking maybe just add cinemaDNG to the options as ive noticed a tad more color in the normal cdng sequence in ACR. I will post my resolve tests in  another post to keep yours free of my jibber jabber.  ;D
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: dirtcastle on July 06, 2013, 02:18:36 AM
Great app!

But I'm having a problem getting Cineform to work. I am able to generate an .avi file, but it won't play in anything.  :(  I've tried playing the file in Premiere, Cineform Studio, and every player I've got. But no dice.

Any thoughts?

UPDATE: I am also unable to get Cineform conversion working in RAWanizer. I will investigate and report back.
Title: Re: [RAW2DNG] BATCHelor 2.0 Beta (Complete ON-SET Data Solution!) *Compressed DNG*
Post by: dirtcastle on July 06, 2013, 03:17:21 AM
Quote from: amsh89es335 on June 10, 2013, 07:40:06 AM
worked fine few times then I just keep getting an error. "Line 2215" Error: Subscript used with non-Array variable.

I am also getting the same error as "amsh89es335".

Error: Subscript used with non-Array variable.

I deleted and regenerated the config file. It still doesn't work. I'm running Windows 8 in Parallels on a Mac, but I'll assume that shouldn't be a problem.
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: fatpig on July 06, 2013, 04:19:40 AM
@dirtcastle:
install gopro cineform studio and copy raw2gpcf.exe to program files/cineform/tools . then give that location to batchelor. should work.

As to the error, I am curious what the problem is.
try to mess around with the file locations, make them as basic as possible, for batchelor as well as for the files you are converting and the target folders. for example put everything in c:\test

see if the error persists.
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: dirtcastle on July 06, 2013, 07:11:58 AM
The problem appears to be specific to RAW2GPCF.exe. Even when I run RAW2GPCF.exe directly from the command line, I get the same result: It generates an avi file (of the correct size and duration) that won't play. Just a blank screen.

Any suggestions on how I might debug RAW2GPCF.exe?

I currently have the Cineform Studio free version installed. Do I need the premium version?
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: fatpig on July 06, 2013, 12:19:02 PM
I also use the free version.
You can try to contact DANewman in the Cineform thread.
Maybe PM him or me your commandline, to check if smth. is wrong there.

If you correctly placed raw2gpcf and there is  no problem with your install, you might miss some prerequisites, he told me to try dependency walker when I was having problems.
Also check your source file. He posted a 5D3 source file some time ago in his thread when I was having problems.
I could transcode his source, and then I sent him some of my files to test, so he could update the software. :)
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: dirtcastle on July 07, 2013, 12:01:29 AM
Thank you for helping! I'm guessing it is a CineForm Studio installation issue. I followed Dave's instructions here http://www.magiclantern.fm/forum/index.php?topic=5479.msg46776#msg46776 (http://www.magiclantern.fm/forum/index.php?topic=5479.msg46776#msg46776). But it looks like some files are missing from the CineForm Studio installation.

I put in a support request and posted a message on http://www.magiclantern.fm/forum/index.php?topic=5479.0 (http://www.magiclantern.fm/forum/index.php?topic=5479.0). I'm excited to get this working! The speed of my current workflow is prohibitive. Using CineForm for previews and proxies should make a big difference.
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: eyeland on July 07, 2013, 03:37:09 PM
Quote from: fatpig on July 02, 2013, 04:26:55 PM
Yes of course, if you want to get that photographic look, ACR is the best option out there for sure. :)

@1%: maybe you can link me those newer versions you found, then I will include them in the next release. :)
Did you update them in 2.3?
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: fatpig on July 07, 2013, 05:05:03 PM
@dirtcastle: i hope you get it working, also maybe test on another machine.

@eyeland:
1% did not send me links yet, and I don't see any specific reason for it.
If I get them I can update them for sure.
If you want to link them to me, I will include them.
You can also update them yourself and test if it works. :)

As soon as Cinema DNG Converter has commandline I will start working on 3.0
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: eyeland on July 07, 2013, 07:54:42 PM
@fatpig : I replaced raw2dng in the BATCHelor directory with the latest version from the forum.
No noticable difference, but the original app in your package had a different filesize so I am using the latest raw2dng just in case.
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: fatpig on July 07, 2013, 09:04:23 PM
wonderful. :)
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: dirtcastle on July 08, 2013, 08:56:09 AM
Quote from: fatpig on July 07, 2013, 05:05:03 PM
@dirtcastle: i hope you get it working, also maybe test on another machine.

I got it working on a different machine! (and using BATCHelor no less. :-) Now I should be able to debug the CineForm Studio installation on my primary computer. Many thanks.

UPDATE: Doh. I spoke to soon. I was able to generate an avi file, but it will only play in Windows Media Player. Every other app returns an error when I try to play or import the file.
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: fatpig on July 11, 2013, 10:55:45 AM
If you ask me, this really sounds like an issue with RAW2GPCF - talk to DANewman..
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: SoulState on July 13, 2013, 12:44:07 AM
I have same issue with splitted raw's, as described by ted ramasola. I use canon 60D.
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: fatpig on July 13, 2013, 09:55:30 AM
hello,
what are you referring to?
split files are now handled automatically in RAW2GPCF.
Does the newest version of RAW2DNG not join split files itself?

On an unrelated note, here is the thread I made for my trailer,
for the upcoming short film "Elementarschaden" - shot on 5DII RAW with Zeiss Primes:
http://www.magiclantern.fm/forum/index.php?topic=7069.msg58923#msg58923 (http://www.magiclantern.fm/forum/index.php?topic=7069.msg58923#msg58923)
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: SoulState on July 13, 2013, 08:46:29 PM
Why COMODO Firewall threats raw2dng.exe from BATCHelor 2.3 archive as malware???
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: a1ex on July 13, 2013, 08:50:19 PM
Maybe the guys from Comodo don't like hackers :D
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: fatpig on July 14, 2013, 04:08:16 AM
many firewalls nowadays just make everything a threat that is not in their database or is written in a specific language.
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+FAST Cineform Proxy! On-Set!
Post by: fatpig on July 14, 2013, 12:51:57 PM
BIG NEWS! Raw2DNG files are now supported by Resolve!
This means you can user BATCHelor for your complete workflow rightaway-
and maybe try out that compression feature that will save you a lot of space! :)
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+Cineform Proxy! DaVinci RESOLVE support!
Post by: pascal on July 14, 2013, 01:05:58 PM
Hi, I downloaded batchelor version 2.3 and batch coverted 99 RAW files from 5D3. The processing went fast but I found it left multiple RAW files unconverted resulting in empty folders without DNG files inside. Happens 100% with the same files. This is not so good because someone must manually search for the failed conversions and do them by hand.

Beforehand I tried the raw2cdng tool. That batch converts also fast but crashes sometimes on specific raw files. Happens 100% with the same files. Unfortunately this program is not so ideal because it does not create 14 bit DNG as far as I understand and due the crash it must be restarted.

Plus I tested the EyeFrame converter and this program converts flawless to DNG but creates TIFF files on its way unnecessarily which increase disk space and processing time. However that program is a good solution for flawless batch conversion right now.
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+Cineform Proxy! DaVinci RESOLVE support!
Post by: fatpig on July 14, 2013, 01:30:49 PM
Hello pascal.

So I assume there are some files which are not 100% intact.
Please try replacing raw2dng.exe with the newest version and test again.
Sometimes when the files are damaged, older versions crash.
also try the failed files manually with raw2dng. does it work?
does raw2cdng crash on the same files as batchelor?

I will implement a checking routine in the next release.
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+Cineform Proxy! DaVinci RESOLVE support!
Post by: pascal on July 14, 2013, 01:54:15 PM
The raw2cdng application crashes entirely with the usual "application has stopped..." popup.
Batchelor application did not crash but just did not convert various files. These were not the same where the raw2cdng crashed on.

Raw2Dng.exe converts all of the RAWs and so does EyeFrame.
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+Cineform Proxy! DaVinci RESOLVE support!
Post by: fatpig on July 15, 2013, 01:22:21 AM
does batchelor work when you update raw2dng.exe in batchelor folder to newest version?
do the files work when you exchange file names with another file that works? maybe it is a name problem..
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+Cineform Proxy! DaVinci RESOLVE support!
Post by: fatpig on July 20, 2013, 01:17:28 PM
...currently working on version 3.0 with some nice new features that make you work more efficiently :)
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+Cineform Proxy! DaVinci RESOLVE support!
Post by: hjfilmspeed on July 21, 2013, 03:43:29 AM
wooooooooooooooooooooooooooo hoooooooooooooooooooooooooooooo!!!!!!!!!!!!!!!!!!!!!!!!!
3.0!!!!
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+Cineform Proxy! DaVinci RESOLVE support!
Post by: t2scorp on July 21, 2013, 11:48:57 AM
Hi,

when I try the lossless compressen I get 600kb sized files that aren't lossless. How do I get lossless DNGs like when I convert directly in the Adobe DNG Converter?

Alex
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+Cineform Proxy! DaVinci RESOLVE support!
Post by: fatpig on July 21, 2013, 12:16:25 PM
how do you know they are not lossless?
the parameters for the DNG converter are a bit flakey. It is possible that there is a mistake.
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+Cineform Proxy! DaVinci RESOLVE support!
Post by: t2scorp on July 21, 2013, 01:25:56 PM
The difference is clearly visible. The DNG lossless converted with adobe dng converter is about 2.5mb
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+Cineform Proxy! DaVinci RESOLVE support!
Post by: eyeland on July 21, 2013, 05:29:14 PM
Quote from: t2scorp on July 21, 2013, 11:48:57 AM
when I try the lossless compressen I get 600kb sized files that aren't lossless. How do I get lossless DNGs like when I convert directly in the Adobe DNG Converter?
I have been having similar experiences.
Can't really figure out what causes it, but sometimes I end up with DNGs of 900kb, sometimes 2.5mb regardless of always choosing lossless
Title: Re: [RAW2DNG] BATCHelor 2.3 DNGs+Cineform Proxy! DaVinci RESOLVE support!
Post by: fatpig on July 21, 2013, 09:54:31 PM
sadly, I could not find clear information online as to what switches have to be used in commandline for the different compression modes, it is trial and error. If someone knows more than me, please share.

Also, maybe you lot could push my request a little, if you are interested:
http://www.magiclantern.fm/forum/index.php?topic=7196.new#new

I requested the automatic split file extraction for users on FAT32 cameras like 5DII.
As a1ex stated, it is quite easy to do, but he does a lot of things right now,
so I am hoping someone else will take a look at this, as it is essential to the BATCHelor workflow I am planning for v3.0.
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha
Post by: fatpig on July 23, 2013, 02:58:30 PM
I am very proud to present the work of the last weeks:

Version 3 Alpha! :)
http://www.fatpigtures.com/software

... and now get to work, you!
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha
Post by: bumkicho on July 23, 2013, 03:26:57 PM
Has the compression mode issue been cleared up with this release?
What is difference between normal and lossless?
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha
Post by: moebiushaydn on July 23, 2013, 03:45:12 PM
Quote from: fatpig on July 23, 2013, 02:58:30 PM
I am very proud to present the work of the last weeks:

Version 3 Alpha! :)
http://www.fatpigtures.com/software

... and now get to work, you!

Just a quick "thank you" for your stellar work. I use BATCHelor exclusively these days.
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha
Post by: fatpig on July 23, 2013, 07:24:35 PM
@bumchiko:
The compression feature has not been updated yet, due to a lack of information from Adobe.
The problem seems to lie with lossless compression only.
"normal" means no compression.

thanks for letting me know, moebiushaydn! :)
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha
Post by: SteveScout on July 23, 2013, 07:30:47 PM
Thanks, a great software just got better!!!!  Trying right away!!
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha
Post by: ShootingStars on July 23, 2013, 09:49:12 PM
\^o^/ Thanks fatpig!
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha
Post by: dossisman on July 23, 2013, 11:26:02 PM
I'm having the same problem with the split files out of my MarkII.  Installed the latest RAW2DNG.EXE file, but no results.  The cineform files, though, are complete.

I guess I can edit with those proxies, but I'd love to be able to have the DNG's to grade at the end.  Any ideas/suggestions?

P.S. Fatpig, despite these issues, I think BATCHelor is quite possibly the best workflow timesaver I've used so far. So thank you.
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 2
Post by: fatpig on July 23, 2013, 11:31:10 PM
hey @dossisman:

well, the ML coders can implement this in raw2dng.exe in a very short amount of time,
this is confirmed by a1ex in my thread here:
http://www.magiclantern.fm/forum/index.php?topic=7196.0
feel free to join me in convincing them this is needed! :)

Meanwhile, use raw2cdng for spanned files or join them.
I wrote a separate tool for myself for joining files- if you are interested in testing, send me a PM.

P.S: If you want to use compression, use Alpha 2 - I just updated it.
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 2
Post by: dossisman on July 24, 2013, 02:26:53 AM
@fatpig

Thank you so much for your quick reply!

So, do I just switch RAW2DNG for RAW2CDNG?  Will it still work with your application?
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 2
Post by: fatpig on July 24, 2013, 09:50:44 AM
raw2cdng is a separate application by chmee.
It does not work with BATCHelor yet.
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 2
Post by: vikado on July 24, 2013, 11:41:49 AM
so were planning to shoot a 90min feature sometime this october.
is there a huge difference in real-time playback and color grading in comparison between normal, lossy, and lossless? or even cinemaDNG?
i'll be using resolve/premiere roundtrip method.
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 2
Post by: fatpig on July 24, 2013, 01:04:46 PM
I have not tested resolve's compatibility with compressed DNGs yet. But should not be hard to find out.
Optically it should not make a difference. Same goes for 12bit cinema DNG.
Let us know if you test it! :)


sounds like an interesting venture. Where are you based?
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 2
Post by: vikado on July 24, 2013, 09:41:10 PM
Quote from: fatpig on July 24, 2013, 01:04:46 PM
I have not tested resolve's compatibility with compressed DNGs yet. But should not be hard to find out.
Optically it should not make a difference. Same goes for 12bit cinema DNG.
Let us know if you test it! :)


sounds like an interesting venture. Where are you based?
i will definitely be testing the difference in heavy grading in resolve.
as for myself, i reside in Orange county, CA.
the shooting locations will be around the LA area.
its a sci-fi feature.
my only real concern is real time playback for a 90min feature and archiving when the movie is done.
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 2
Post by: Danne on July 24, 2013, 10:40:27 PM
Cool with a sci-fi movie. But sure you will work with proxies and render the dng,s in the final export? Shouldn,t be a problem I think
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 2
Post by: vikado on July 25, 2013, 08:42:37 AM
Quote from: Danne on July 24, 2013, 10:40:27 PM
Cool with a sci-fi movie. But sure you will work with proxies and render the dng,s in the final export? Shouldn,t be a problem I think
thanks! i definitely will use proxies.
i've done shorts before, but i've never done a feature and i've never used resolve for a feature, so i'm a bit anxious about the process.
hopefully i wont have to upgrade my pc as much as i think i should.
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: Africashot on July 26, 2013, 04:43:04 PM
This turned out to be great until avast decided to block it just this afternoon and it won't let me open anymore, it also deletes the .exe file every time Y try to run it, also if I run it as admin and confirm it as an exclusion. What really sucks is that I still have tons of footage to convert!
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: fatpig on July 26, 2013, 05:27:31 PM
disable avast and submit it as an error, I did the same.
you can also try renaming the exe.
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: ted ramasola on July 26, 2013, 09:17:37 PM
I like this! Nice feature showing thumbnails. Good job on this version.

I do look forward to this being able to merge spanned files from the 5dmkII.
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: eyeland on July 27, 2013, 02:37:30 AM
Thanks alot for your work on Batchelor fatpig! Awesome tool. That said, I am still waiting patiently for one of the batch conversion tools to integrate something like "ExifTool" for those of us who need exif data (the "makernotes" tag enables the use of "camera calibration profiles" in ACR and the ISO tag can make a difference in terms of noise handling (possibly mostly prevalent when using 2012 process) as shown by Mvejerslev.
My workaround so far (as I have already mentioned in several posts, is to snap a quick raw photo before I start shooting. I then later import full or partial Exif from that still to a batch of DNG using ExifTool.
One option (albeit cumbersome and clumsy) would be to add the above method to the batchtool.
Alternatively, someone could take a look at generating a proper xml with the proper Exif tags in-camera which would allow for a seamless automated integration.
My sincere apologies if I am starting to sound like a broken record, and again, Thanks to anyone and everyone involved in the development of ML and the associated tools!
EDIT: The Makernotes/camera calibartion seems to have been fixed (in the updated raw2dng?) but ACR still benefits from other tags..
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: fatpig on July 27, 2013, 07:01:28 PM
@ted ramasola:
this has next to no support- they wont do it on their own, even though it is really simple.
nobody of the devs knows that this is demanded- please! this goes for everyone- let them know! here:
http://www.magiclantern.fm/forum/index.php?topic=7196.0

@eyeland:
I know nothing about this issue.
What exactly can BATCHelor do to help? If the info is not in the .RAW file there is nothing to do..
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: dandeliondandy on July 29, 2013, 07:57:06 PM
Hey, great to see these new features.

I'm having an issue when I try the preview function however:

Line 9508 file batchelor_3.0alpha3.exe

error: array variable has incorrect number of subscripts or subscript dimension range exceeded.

Any ideas? Thanks!
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: spider on July 29, 2013, 10:25:57 PM
BATCHelor is a great software
But I have a question; could it be possible to integrate the PinkDotRemover tool for 650D and EOS M?
http://www.magiclantern.fm/forum/index.php?topic=6658.0
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: fatpig on July 31, 2013, 04:31:13 PM
@dandeliondandy:
please let me know the path and folder contents of your source folder.
this almost everytime has to do with these things.

for testing, try the preview on files like C:\test\M01-0101.RAW
make sure your file path is not very long.

@spider:
I can maybe include something like it,
but I am not aware of the functionality of the tool.

I read something about it being different for each camera..
which cameras need this tool?
How do you normally work with it?

Time is a little short right now, so if you supply some info maybe this can be a lot quicker :)
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: spider on July 31, 2013, 05:58:12 PM
Quote from: fatpig on July 31, 2013, 04:31:13 PM
which cameras need this tool?
650D, EOS M and probably 700D will need it too.
Quote
How do you normally work with it?
Normally I use BATCHelor to convert my RAWs. After conversion I have to select each folder and process it with the PinktDotRemover tool.  The remover writes new dngs into the same folder.

But now in a new version of it you can select all RAW files and the PinkDotRemover removes the dots directly in the RAW files.
So I thought BATCHelor could start at first the PinkDotRemover and than go on with it normal processing.

But the PinkDotRemover is JAVA software and I dont know if there is a commandline version.
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: ted ramasola on August 01, 2013, 01:58:16 AM
Quote from: fatpig on July 27, 2013, 07:01:28 PM
@ted ramasola:
this has next to no support- they wont do it on their own, even though it is really simple.
nobody of the devs knows that this is demanded- please! this goes for everyone- let them know! here:
http://www.magiclantern.fm/forum/index.php?topic=7196.0


fatpig,

rawanizer is already able to use raw2dng to merge split files in his gui app, the only problem is his current output folder naming makes it "invisible" to resolve. One has to manually rename each folder of the dngs and remove the (.dng) at the end.

If raw2dng has a new version I can merely change that in the rawanizer installation folder in windows/programfiles(x86) directory.

Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: fatpig on August 01, 2013, 09:48:10 PM
@spider:
I dont know about automating a java app- maybe the developer can tell us more. maybe inquire with him?

@ted:
my resolve can see all folders I tried :)
I can also implement a joining feature. problem is: this method is really slow.
(really, like 10-30 minutes depending on the material)
I wrote a little tool for myself for testing- and decided not to implement it.
I used raw2cdng for large files.

Instead: help push the development of this feature in raw2dng.

a1ex (one of head devs) said: "it is trivial to do".

All we have to do (yes, you too :) ) is post in the thread, requesting this feature be implemented. :)
here: http://www.magiclantern.fm/forum/index.php?topic=7196.0

I can not stress this enough: the devs think noone needs this!
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: a1ex on August 01, 2013, 10:05:48 PM
Come on, anyone with some very basic C knowledge can do it. Even some basic programming knowledge in whatever other language and some google search skills should be enough.

But yeah, it's easier to ask for someone else to do it...
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: Redrocks on August 02, 2013, 12:10:30 AM
@Ted http://www.bulkrenameutility.co.uk/Main_Intro.php you can rename a bunch of folders quickly with this.
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: ted ramasola on August 02, 2013, 12:34:42 AM
Quote from: Redrocks on August 02, 2013, 12:10:30 AM
@Ted http://www.bulkrenameutility.co.uk/Main_Intro.php you can rename a bunch of folders quickly with this.

Thank you for the links Redrocks, I downloaded them in case I would need them.

Yesterday Marten just implemented my request and issued a patch.
His app now changed the folder naming structure and they will now be seen by resolve.
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: Redrocks on August 02, 2013, 01:29:14 AM
I saw that and will give it a whirl tomorrow. Does it show thumbnails for folders (not clips) when importing to Resolve? That's what I originally got the bulk rename utility for, but it comes in handy for renaming sets of files without the (1) (10) (2) bug.
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: ted ramasola on August 02, 2013, 02:21:54 AM
Quote from: Redrocks on August 02, 2013, 01:29:14 AM
I saw that and will give it a whirl tomorrow. Does it show thumbnails for folders (not clips) when importing to Resolve? That's what I originally got the bulk rename utility for, but it comes in handy for renaming sets of files without the (1) (10) (2) bug.

When in the Library/explorer and you click on the folder holding the DNGs a thumbnail of video is shown on the side .

Dragging the folder into the media bin will display thumbnail and you can scrub on the thumbnail to go through the entire clip.
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: foorgol on August 02, 2013, 06:17:42 AM
As to the PinkDotRemover:

Quote from: fatpig on July 31, 2013, 04:31:13 PM
@spider:
I can maybe include something like it,
but I am not aware of the functionality of the tool.

I read something about it being different for each camera..
which cameras need this tool?
How do you normally work with it?

As spider explained, the tool is needed by the 650D, EOSM and (perhaps) the 700D to remove annoying artifacts (AF dots) from raw video recordings and silent pictures.

You can use the tool either with its GUI or from the command line. Only drawback when using the command line: you can't select the camera type; it's fixed to the 650D. But this restriction could be improved with reasonable effort.

The program itself is written in Java. If the BATCHelor is also written in Java, I could easily create a lib / JAR for inclusion in the BATCHelor. Otherwise a command line call from within the BATCHelor is most likely the easiest approach...

@fatpig:
PM me if you need more info!

Hope that helps....
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: fatpig on August 03, 2013, 12:50:50 PM
hey guys!

@a1ex:
It is not about programming a file joining tool (which I have already done)
but about avoiding the time-consuming joining process, because many people have started using raw2dng straight off their CF cards.
Previous joining takes a lot of time, which is not available on set, and - can be avoided, I assume.

I myself would love to include such an option into raw2dng - but this type of programming is absolutely foreign to me.
There must be some other devs familiar with it, right?

@forgool:
BATCHelor is not java, a commandline approach would be best..
check PM :)
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: Nikuya on August 05, 2013, 09:52:08 AM
Hi!

I tried the software but when I open the "raw2dng.exe" nothing happens and the "BATCHelor_3.0_Alpha3.exe" is getting detected by a virus and gets deleted by the antivirus software. Am I doing something wrong?

EDIT: I running under my own windows account that is an admin account.
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: arturochu on August 07, 2013, 12:32:55 AM
fatpig, what do you think of implementing the feature of making prores 444 or prores 422 files through ffmpeg? i think for some projects this would be ideal, since you could start editing straight from this prores files and hace the capacity to go through a nice colour correction.
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: fatpig on August 07, 2013, 08:45:12 AM
hey guys.

@Nikuya:
train your antivirus software. I guarantee you that it does not have a virus, if you downloaded from my site.
Some AV Softwares have an automatic that does not only recognize known viruses, but also assumes everything it does not know to be a virus. You can deactivate this feature. I know the problem. "BATCHelor_3.0_Alpha3.exe" is the one you want.

@arturochu:
This would be a lengthy process- putting every single frame through dcraw and then making a prores file... I myself would not consider using that ProRes file for editing, because shooting RAW is all about.. well - editing RAW, isn't it?
I think RAWanizer has a feature like that.

whats wrong with the cineform 422 Files it toutputs?
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: usasikh1 on August 09, 2013, 03:12:58 PM
I work in windows environment, and When I use Cine-form to convert it outputs .avi file , I want to grade in resolve which wont read avi files but will read .mov. IS there something I can change so it outputs .mov files. Also does anyone know what the normal , lossless and lossy options (for DNG and cineform) output in matter of bit depth? Thanks
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: usasikh1 on August 09, 2013, 03:30:54 PM
Guys what is the difference between DNG and CDNG? quality wise(color depth,bitrate etc). I have read somewhere that the CDNG files are smaller , but not sure. Beacuse I read that fatpig is eventually wanting to add CDNG as the in this software.
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: dafassi on August 09, 2013, 08:38:56 PM
Hello there!

1st thing is- THANK YOU :).
Its realy a helpfull tool!

Here is a request:

Can you add a checkbox for "write settings to thumb"?
So in the preview picture is a small field with textinformations like:

recorded in:
lens, aperature, shatter, ML resolution@camera resolution, fps ...

iE.
Canon EF35mm -- 1.8f -- 180° (1/50) -- ML_1200*512@CANON_1280 -- 24FPS

This would it make easy to compare tests!

Greets!
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: Canon eos m on August 10, 2013, 12:30:38 PM
@fatpig - is the version on the 1st post the latest edition of BATCHelor? Thanks for the amazing software. Made my life hell of a lot easier. Good stuff became even better  :D
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: dradutu on August 13, 2013, 12:02:18 AM
fatpig you did great, i pitty anyone not using your software. once i'm done editing my video i'll post a full workflow including and emphasizing your software. a big thank you!
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: spider on August 17, 2013, 09:59:32 PM
I just want to make sure you have seen this
https://bitbucket.org/hudson/magic-lantern/pull-request/184/700d-650d-remove-pink-dots-from-raw/diff

So maybe there is no need for integrate the pinkdotremover.  (ATM except EOS M) 
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: Mei Lewis on August 18, 2013, 07:47:21 PM
Quote from: fatpig on May 24, 2013, 03:43:29 PM
... with thumbnails and optional lossy/lossless DNG compression
TIP: try lossy! It's a great difference in size (sometimes reduction to 30%) but looks the same!

I'm confused by this. The lossless option seems to give me much smaller conversions than lossy, which is opposite to what I was expecting.
Eg for a file I've just converted:
RAW - 640mb
normal - 647m4
lossy - 389
lossless - 183mb

Is it possible the buttons in the batchelor UI are labelled backwards?
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: Mei Lewis on August 18, 2013, 08:03:51 PM
To follow that up, I've just opened the same frame of a 'normal', 'lossy' and 'lossless' conversion in photoshop and put them on layers above each other. By setting a layer to difference mode and using a curves adjustment to exaggerate differences it's clear that the 'lossless' conversion isn't lossless, but the 'lossy' conversion is identical to the original!
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: Africashot on August 19, 2013, 10:39:59 AM
Would it be at all possible to use a ACR preset (like this one http://www.magiclantern.fm/forum/index.php?topic=7567.0) for BATCHelor to render the cineform files with increased DR (sort of log style) so as the cineform file could be used directly rather then as proxies? The DNGs would be there in case further tweaks like cromatic aberrations or else would needed to be fixed, otherwise we could just edit the cineform files directly and grade them (especially in scenarios when we'd have to intercut with h.264 shot in cinestyle), this would safe a lot of time and space...
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: Andy600 on August 20, 2013, 12:28:22 AM
@Fatpig - What Cineform script settings does BATCHelor use?
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: mmatocq on August 23, 2013, 03:57:22 PM
Hello everybody.

I need help. Im using the ML in my 5D MIII.

Everything is working perfectly except that I can not open the last clip of each CF card.

When the camera shows me that there is no more space available it stops reccording, and this clip is not saved properly because later I can not open it.

It is, for example, a 2GB RAW clip but I can convert it in DNG files. It says that the file is empty.

Can someone help me to recover this files? I need to fix these clips!

Im using 16GB CF Card.
Thankssss
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: Rewind on August 24, 2013, 08:55:10 AM
Quote from: spider on August 17, 2013, 09:59:32 PM
I just want to make sure you have seen this
https://bitbucket.org/hudson/magic-lantern/pull-request/184/700d-650d-remove-pink-dots-from-raw/diff

So maybe there is no need for integrate the pinkdotremover.  (ATM except EOS M)

That method doesn't work, so 650d users still need the Pink Dot Remover tool. It would be great to implement it in Batchelor.
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: Rewind on August 27, 2013, 08:54:31 AM
By the way guys, while Fatpig is AFK, note that the checkboxes for "lossy" and "lossless" compresseion are just swapped around ;)
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: pascal on August 31, 2013, 12:45:39 AM
Tried the 3.0 version and it is still crashy unfortunately. Using 5D3 raw files with DNG normal export and it freezes randomly half way through.
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: hjfilmspeed on September 17, 2013, 05:06:40 AM
Where does one find the latest version of raw2dng. I cant seem to find it
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: arrinkiiii on September 26, 2013, 03:27:30 PM
In the first post there is a link to fatpig webpage for you download it. You can use batchelor or only raw2dng.
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: timbytheriver on October 09, 2013, 06:07:58 PM
Quote from: Mei Lewis on August 18, 2013, 07:47:21 PM
I'm confused by this. The lossless option seems to give me much smaller conversions than lossy, which is opposite to what I was expecting.
Eg for a file I've just converted:
RAW - 640mb
normal - 647m4
lossy - 389
lossless - 183mb

Is it possible the buttons in the batchelor UI are labelled backwards?

Thank you Fatpig for making this great tool available to us! :) I can also confirm the findings of Mei Lewis as above. I opened each file in RawDigger to find that the one output as 'lossless' was Full-Res, Lossy-JPEG, 8 8 8 bits whereas the one output as 'lossy' was Full-Res, JPEG, 16 bits.

Could it be the labels are indeed backwards?

Thanks again.

Tim
Title: workflow question
Post by: joaomoutinho on October 15, 2013, 05:50:30 AM
hello guys,

I am using the 50D, and because of the FAT32 it makes a ".RAW" file and than various ".RAR" file of the same ".RAW" . 
Is there any program that unites (puts together) all this ".RAR" files into one and final ".RAW" file?

It is getting really messy to work with this. Please, help me in this issue.

PS-My OS is Windows 7

Thank you very much
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: fatpig on November 18, 2013, 09:41:23 PM
hello guys,

I will do another update as soon as possible.
In the meantime, I ask of you one thing, again.
@joaomouthinho:
We need this feature implemented by the main devs, so everybody:

MAKE THE FOLLOWING REQUEST THREAD
and get everybody to jo join in!

"We need joining of .RAW split files automatically in RAW2DNG.exe"
I know from a talk with one of the developers, that it is really easy to do, but not enough people need it.
Show them that we need it! :)

Only when this is finally done, BATCHelor can do its job like it is supposed to do!
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: arrinkiiii on November 19, 2013, 12:07:44 AM

Let's go... +1
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: Andy600 on November 19, 2013, 12:11:01 AM
@Fatpig - maybe you should start looking at the MLV format!? It's becoming quite stable and is the way forward.
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: hjfilmspeed on November 19, 2013, 09:38:55 PM
Yes MLV is on the rise. But as far as the split files, why are people not just formatting there cards exfat. Then you can record to your hearts desire and not have to worry about any complications. I converted a 5 min clip with batchelor no problem like this. just cant formatt in camera is all. just delete through ML. Super easy!
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: arrinkiiii on November 19, 2013, 10:04:11 PM
Quote from: hjfilmspeed on November 19, 2013, 09:38:55 PM
Yes MLV is on the rise. But as far as the split files, why are people not just formatting there cards exfat. Then you can record to your hearts desire and not have to worry about any complications. I converted a 5 min clip with batchelor no problem like this. just cant formatt in camera is all. just delete through ML. Super easy!

For the 7D, at least for now, it's impossible to use exfat =((   so, split files it's a must.
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: gary2013 on November 20, 2013, 06:22:51 AM
I have tried using exfat on the M and it does work, but it also brings back the shutter bug and I have not seen anyone fix that bug so far. I can fix the bug by reformatting with a Canon menu in camera, but it then reverts back to fat32... but I do get rid of the shutter bug this way.  :(
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: hjfilmspeed on November 23, 2013, 08:51:49 PM
Oh sorry I didnt know that about the 7d and the M. Still its amazing that the 7d is even doing raw. im so happy for you 7d owners. when i had my 7d ML wasnt even possible on the dual digi. Also not to be a version 3 party pooper but im kinda liking the simpler form of version 2.3. every once in a while i get funky files out of batch 3.0 beta 3. 2.3 has never failed for me with the 5d3
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: edwmotion on November 23, 2013, 09:15:39 PM
haven't you noticed this?

lossless is lossy and lossy is lossless, options are inverted.
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: fatpig on November 27, 2013, 12:05:22 PM
Hi guys,

what is the current state of development on the RAW and MLV matter?
Can someone put me up to speed?
Currently not working a lot with ML RAW, but will be again.
I am looking to do some updates and am trying to figure out which way to go with development.

Also, I would still love to see someone starting an initiative for the split file implementation in raw2dng.exe - 5DII is not exFAT compatible, and still a lot of people use it.
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: Andy600 on November 27, 2013, 01:45:20 PM
Quote from: fatpig on November 27, 2013, 12:05:22 PM
Hi guys,

what is the current state of development on the RAW and MLV matter?
Can someone put me up to speed?


Hey :)

MLV seems to be stable on the 50D (and I believe the 5d2 etc) now. I've been shooting exclusively with it for a couple of weeks and not experienced any issues. I think, as MLV is quite robust it would be worth implementing MLV capability into BATCHelor (alongside legacy raw) if you can. At the moment it is all command line dumping to either legacy raw or DNG so to have MLV support in BATCHelor will be very useful.

Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: arrinkiiii on November 27, 2013, 04:18:40 PM
Quote from: fatpig on November 27, 2013, 12:05:22 PM
Hi guys,
Also, I would still love to see someone starting an initiative for the split file implementation in raw2dng.exe - 5DII is not exFAT compatible, and still a lot of people use it.


That's awesome  :D 

In the 7D i think exist exFat but it's not working. Split file implementation would be just great. Also in the 7D mlv is working good, except the first frame that come corrupted (we can live with it =)) 

Thanks for the hard work Mr. fatpig   
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: Luiz Roberto dos Santos on December 07, 2013, 05:34:04 AM
Hi!
Any developer can confirm if it's really too complex to implement a file ".dcp" reader in raw converters?
I have not seen any software with that, not even mentioned, in your project, and I think this is extreme importance and usefulness, as dcp curves could be used to output files logarithmic, as VisionLog makes the ACR.

I'm asking because really do not understand and because I wanted to see this incredible tool to progress in their development and not be stopped in time.

Greetings.
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: jonnyginese on December 09, 2013, 10:39:57 PM
Is it possible to setup an INI or something to use a specific "switch" commands for CineForm?  it looks like its set to -c right now or something but I'd like to get it set to -q5 or something depending on the project.
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: timbytheriver on December 10, 2013, 05:01:32 PM
@jonnyginese You may already know this: if you use the 'raw2gpcf' on the command line you can set up all your own custom switches for output to Cineform; say:

raw2gpcf D:\Source.raw E:\Output.mov -444 -l400 -d2 -q5

etc.

:)

Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: jonnyginese on December 11, 2013, 03:18:35 AM
Quote from: timbytheriver on December 10, 2013, 05:01:32 PM
@jonnyginese You may already know this: if you use the 'raw2gpcf' on the command line you can set up all your own custom switches for output to Cineform; say:

raw2gpcf D:\Source.raw E:\Output.mov -444 -l400 -d2 -q5

etc.

:)

What does the -l400 and -d2 do? And why would you just want to keep the file raw instead of -444?
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: timbytheriver on December 11, 2013, 10:39:03 AM
The -lx and -dx switches set log-curve and debayer parameters respectively, but I'd rather direct you straight to the man (Dan Newman) who created the app offer his insight here: ;)

http://www.magiclantern.fm/forum/index.php?topic=5479.msg40941#msg40941

Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: eyeland on December 11, 2013, 11:31:44 PM
Been busy for a few months and just found time to play with ML raw again.
Are the "lossy" and "lossless" options still switched?
Are we still not getting any proper exif?
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: jonnyginese on December 12, 2013, 02:44:15 AM
It would be really cool to have an "options" for cineform that has some pre loaded switches... and then also have a "custom" action that you can add your own switches in that will apply on all the footage that needs to be encoded.

I tried to just edit the INI config file with the switch but it doesn't work.

Rawnaizer has this type of feature but i cant get it to encoded from CF card to a folder on my computer.  I have to copy it to my computer first then do the conversion in the same folder. (unless someone has info on how to do that with Rawanizer)
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: Chpouky on December 13, 2013, 02:06:57 PM
Great tool, thanks ! BUT, why do I get ".dngp-@" files instead of ".dng" ? I did a quick research and it seems like nobody had this problem.
I choosed the "normal" option.

EDIT: same with the "Lossy" option
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: filmcubepro on December 31, 2013, 05:39:23 PM
this thing really gets you up and going as fast as possible so you can start editiing and grading at will. I love using batchelor, it has proven very useful and efficient. i'm a mac user, and i use it with wine, and it works like a charm.

the thumbnails are very useful, but a preview, where you can scrub through your clip to see if its any good before selecting it for conversion would be incredible.

i was wondering if that feature would be possible or not. I do not hate anything about this software, but this feature could make it even better
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: dragan on January 14, 2014, 08:06:42 PM
Hello, good program, used a few months, and today with the following message- AutoLt Error Line 9536(File"G\BATCHelor_3.0_Alpha3.exe") Error:Variable used without being declared.Somebody seen this problem before? If so tell me how to fix it. Thank you
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: lureb74 on January 28, 2014, 07:33:46 PM
Hello, I have a problem! Batchelor3 preview (the window for choosing RAW files that need to be converted) doesn't show any RAW file. I checked many times the path, that are the right path! I tried to download again the app... nothing! I tried leaving the original raw2dng.exe file, and also sobstituting it with the last one... still NOTHING! AAAARGHHHH!!!
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: guentergunter on February 07, 2014, 09:51:39 PM
Quote from: edwmotion on November 23, 2013, 09:15:39 PM
haven't you noticed this?

lossless is lossy and lossy is lossless, options are inverted.

Does that problem still exist?
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: eyeland on February 19, 2014, 04:21:30 PM
Noticed that this thread has become fairly inactive?
Have most ppl switched to a different app?
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: SteveScout on February 26, 2014, 12:46:38 PM
I love BATCHelor. But as MLV can record audio now and fixed all initial bugs most people probably switched from raw to mlv.
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: gary2013 on February 26, 2014, 03:38:15 PM
Quote from: SteveScout on February 26, 2014, 12:46:38 PM
I love BATCHelor. But as MLV can record audio now and fixed all initial bugs most people probably switched from raw to mlv.
Will BATCHelor be updated to also do MLV?
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: jhhm on March 26, 2014, 03:08:46 AM
Quote from: Chpouky on December 13, 2013, 02:06:57 PM
Great tool, thanks ! BUT, why do I get ".dngp-@" files instead of ".dng" ? I did a quick research and it seems like nobody had this problem.
I choosed the "normal" option.

EDIT: same with the "Lossy" option

I too am having a similar problem: slightly different format that ends in @ but no dng extension.  Also the thumbnail looks purple and washed out.
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: dragan on September 28, 2014, 10:02:50 AM
I'm sorry, but inside the Trojan. ??
Title: Re: [RAW2DNG] BATCHelor 3.0 Alpha 3
Post by: phil7 on July 24, 2018, 10:14:11 PM
HI

I tried now and it gets an error while trying to extract the file. Processing: normal ( no dng box checked)
Error: line 9622 error : subscript used with non-array variable.