Important
MLP project is abandoned and replaced with:
Switch for macOS Sierra (http://www.magiclantern.fm/forum/index.php?topic=15108.0).
Please use that instead to keep yourself updated with the latest.
MLP NO LONGER MAINTAINED! Use Switch above instead.
MLP – Magic Lantern Processor
download_source (https://www.dropbox.com/s/80axfje717jzis5/MLP.zip?dl=0)
user_guide (https://www.dropbox.com/s/ky2flgh4bq5wmlz/MLP_user_guide.pptx?dl=0)
Forum discussion regarding MLP starts here
MLP_discuss (http://www.magiclantern.fm/forum/index.php?topic=13512.msg158857#msg158857)
Word of advice. All processes should be run separately. Keep different files and processes separated if not stated otherwise. It,s all up to you to test and validate this workflow. I leave no guarantees. It should be treated as beta.
What,s MLP about?
MLP works with the following files:
- RAW/MLV to dng conversion. Files workable in DaVinci Resolve(embeds audio) and Premiere Pro
- RAW/MLV and folders of dng files to ProRes4444 files
- Dual iso CR2 still images are converted to workable DNG files with correct white balance applied
- HDR processing of both MLV/RAW and H264 mov files
- HDR processing of CR2 still image files
- Dual iso dng sequences are processed automatically coming from RAW/MLV files
- RAW/MLV/dng/DNG/mov previewer
- Multithreaded
Description
By right clicking a folder, containing any of the above mentioned files, and when selecting MLP from the contextual services menu to specified folder two additional folders will be created prior to running any further processing:
- A_dan_log_3d_luts
- A_lut_hold
By adding these folders you are able to add or change different settings before continuing processing such as white balance, brightness, gamma, add different luts. You are also able to change settings for HDR processing.
Adding setting files is easy. Simply pick something from the "A_dan_log_3d_luts" and put it in the "A_lut_hold". Open up the txt file and change setting and save. Then start processing you files. The tricky part is to find the right combinations for how you want your files to be processed.
Whatever setting you create will be viewable as preview tif files if right clicking a RAW,MLV,dng,DNG or mov file directly. For more in depth information the user_guide above is highly recommended.
(http://s21.postimg.org/kpigbbejb/Screen_Shot_2015_12_09_at_20_07_37.png)
What you need
You will need some additional files to have MLP fully functional, FFmpeg among them. If you follow the HOWTO.txt in the download package you should be good to go. For doing changes in dng raw files dcraw(Dave Coffin) and exiftool(Phil Harvey) and exiv2(Andreas Huggel) are used. Mlv_dump(g3gg0, A1ex) raw2dng(A1ex) and cr2hdr(A1ex) for developing dng files. For creating prores dng files are piped to FFmpeg(Fabrice Bellard) via dcraw. (FFmpeg not included in the download). For additional functionality see Howto.txt in the download folder.
For creating 3D luts I used Ben Turley´s cool tool online LUTCalc here https://cameramanben.github.io/LUTCalc/
Thanks to dfort for the tip which lead to being able to have all processes run from the same path. Also for testing and working out ways with the dead pixel fix function in dcraw and detecting a dual iso seg fault which now A1ex has fixed. For feedback and bugtests as always thank you deafeyejedi and dfort.
MLP is an open source project(GPL).
Main reason for this workflow is to optimize processes and get around issues arising in cr2hdr-r when upgrading to OS X El Capitan.
The workflow itself is build around bash scripts run through an automator service. You install it by double clicking the MLP workflow.
The best way to learn MLP workflow is to work with the user_guide.
All MLP sources are in the download. You can easily add changes in the scripts yourself. Add changes in the source_code_MLP folder then double click the A_move_content_to_workflow.command before installing MLP. More about this in the "Howto" file.
MLP still uses the core philosophy from cr2hdr-r but processes are optimized and gives a lot more possibilities to change settings manually. I rewrote the way HDR files are being treated and added some white balance templates. Processes are still multithreaded.
Many ideas and solutions are coming from people here at the forum, stackoverflow and other forums. I tweaked and optimized almost all scripts to fit the way I want it to work. MLP is still a work in progress and everything is open for changes.
Thanks
A1ex, g3gg0, Dave Coffin, Phil Harvey, Fabrice Bellard, Bouncyball, dmilligan, cpc, chmee, Scrax, Jerrykil, Dubzebass, Kichetof, Baldavenger, Andy600, Baldand, dfort, deafeyejedi and others I might forgot to mention here.
GPL (magic lantern)
http://www.magiclantern.fm/forum/index.php?topic=13335.msg128757#msg128757
cr2hdr-r automator app workflow NO LONGER MAINTAINED! Use MLP instead. For further questions regarding cr2hdr-r please pm me.
- Transcodes MLV/RAW to folders. Dual iso movie files also supported. Dng files will work both in Davinci resolve and Premiere pro CC(thanks cpc for repackto16bit binary)
- ProRes444 creation
- HDR movie (thanks to Jerrykil script)
- CR2 dual iso to DNG conversion
- 3d lut support
- Multithreading
- speed_preview (adding speed and ability to preview one frame)
thread starts around here (lut_lab version)
http://www.magiclantern.fm/forum/index.php?topic=13512.msg144696#msg144696
Always run the app from the parent folder!
Usage
- cr2hdr-r creates two additional folders (HDR_RAW_MLV and PRORES) inside the parent folder on first run, then the app quits.
- Place files in parent folder or in the created subfolders or in all three of them.
- Run the app again from the parent folder and it will convert first from parent folder then search the created subfolders for files.
All RAW/MLV originals will be placed in ORIGINAL folders after conversion
About created folders
Parent folder
- Transcoding MLV/RAW files. Dual iso is supported. dng files will work both in Davinci resolve and Premiere pro CC (Thanks @cpc for 16bit repacking binary).
- Dual iso CR2 files. If adobe dng converter is installed it will reduce the size of the resulting DNG lossless.
PRORES folder (ProRes444 creation)
- Creation of ProRes files.
- White balance control when using silent pic DNG or adding a CR2 with desired WB.
https://www.youtube.com/watch?v=S5SAnakpum0&list=UUomeOeghS6wanMOCQ8BtH_A
- add 3d luts in the mix(up to 20 luts can be used)
- FFmpeg binary needed for ProRes encoding. You find it here http://ffmpegmac.net/
The binary must have the name ffmpeg and have to be placed in /usr/bin/ folder on your computer
More speed and previews
http://www.magiclantern.fm/forum/index.php?topic=13512.msg147712#msg147712
http://www.magiclantern.fm/forum/index.php?topic=13512.msg148522#msg148522
http://www.magiclantern.fm/forum/index.php?topic=13512.msg149104#msg149104
- cr2hdr_r_lut_lab version will install a "speed_preview" workflow. Simply right click the parent folder and run "speed_preview" from services and it will add an extra process to PRORES and HDR_RAW_MLV_MOV folder. If you run the speed_preview by right clicking a mlv/raw/mov/MOV file you get one preview frame from the chosen file. Add CR2 for white balance and add a 3d lut for preset looks.
https://www.youtube.com/watch?v=2ZkXeISWC0c&feature=youtu.be
3D lut support
- Added lut support. add lut inside the PRORES folder or in subfolders together with the RAW/MLV file
- Hardcoded flat looking 3d lut when transcoding dual iso ProRes files. Thanks Andy600.
Up to 20 extra 3d luts can be added. When running the app the first time it creates some additional folder. Inside the PRORES folder some luts and a text description will be provided.
White balance handling
http://www.magiclantern.fm/forum/index.php?topic=13512.msg144750#msg144750
http://magiclantern.fm/forum/index.php?topic=13512.msg148069#msg148069
http://www.magiclantern.fm/forum/index.php?topic=13512.msg148231#msg148231
http://www.magiclantern.fm/forum/index.php?topic=13512.msg149797#msg149797
Preferred workflow in PRORES folder is to add one or more CR2 files( for white balance) and/or up to twenty 3d luts to you files.
Brightness, white balance, denoiser
Change above settings by adding commands to a generated png preview.
http://www.magiclantern.fm/forum/index.php?topic=13512.msg149461#msg149461
works with speed_previews
http://www.magiclantern.fm/forum/index.php?topic=13512.msg149476#msg149476
HDR_RAW_MLV_MOV folder Updated 2015-09-16! here
http://www.magiclantern.fm/forum/index.php?topic=13512.msg154260#msg154260
Place HDR MLV/RAW footage(48, 50, or 60 fps) in folder and it will transcode to a .mov file.
Place a .MOV HDR file and it transcodes to a merged .mov file
More info here
http://magiclantern.fm/forum/index.php?topic=13512.msg147144#msg147144
FFmpeg binary needed for HDR encoding. You find it here http://ffmpegmac.net/
The binary must be named ffmpeg and have to be placed in /usr/bin/ folder on your computer
All processes are multithreaded!
Thanks Andy600 for provided dual iso luts and N/A for updated dcraw compiles, cpc for DNGRepackto16,
Deafeyejedi and others for tests and feedback.
What is it
Cr2hdr-r relies on script made in bash calling for different binaries through an automator app. Most of the scripts have been gathered and tweaked from users here at the ML forum. The app is also provided as an automator workflow. The processing is done the same for both alternatives.
Main interest for starting this was for fast dual iso conversion(multithreaded) and to apply same levels(prevent flicker) using exiftool, to dual iso movie files but as it emerged it is now a sort of an "all in one" processing solution handling above files.
Usage
Collect all the files you want to convert into a chosen folder. You can add multiple MLV, RAW, CR2, dng, MOV files. They will be converted one after the other. While processing an ORIGINALS folder will be created and original files will be moved to this folder after after processing is done.
*Good to know
Regarding format RAW. If filmed with spanned files such as R.00, R.01 etc the app will automatically cat these files and after the cat process start converting and then erase the spanned files replacing it with the concenated file. I personally I don,t see any reason to keep the spanned files after conversion since you get a new big file instead.
Why use it
I consider it a laid back all in one processing solution taking care of many of the magic lantern processing needs.
Fast conversion of dual iso dng movie files and dual iso CR2 files (multithreaded).
Exiftool adds back metadata to processed MLV and RAW(fps) files. Also applies the same white level to dual iso movie sequences to avoid flicker.
Audio is shortened(sox) and wav metadata added(bwfmetaedit) to fit with autolinking in DaVinci Resolve.
HDR .MOV files which is converted multithreaded(thanks to Jerrykil).
Additional
automator http://www.macosxautomation.com/automator/
dual iso movie thread http://www.magiclantern.fm/forum/index.php?topic=12796.msg123437#msg123437
Recommended(mac)
MLVFS - dmilligan
http://www.magiclantern.fm/forum/index.php?topic=13152.0
MlRawViewer – baldand
http://www.magiclantern.fm/forum/index.php?topic=9560.0
Lightroom plugin cr2hdr - Kitchehof
http://www.magiclantern.fm/forum/index.php?topic=11056.0
Thanks
This is a great community. No scripting or any creation around this workflow would be possible without the community, and a special thanks to these guys.
Great thanks to A1ex, g3gg0, (cr2hdr20bit, raw2dng, mlv_dump.)
Andy600(dual iso log_lut), @cpc (DNGrepackto16), Dmilligan, Baldand, Kitchehof, Chmee,
Scrax, Jerrykil, Dubzebass and others I forget to mention.
Tester(s) for feedback.
And of course the other authors of the included binaries.
I think of this as an open, sharing community. I learn and pick up stuff along the way.
This project is me learning scripting and creatng a personlized workflow.
I have no commercial interests. If any questions please feel free to pm me.
GPL (magic lantern)
http://www.magiclantern.fm/forum/index.php?topic=13335.msg128757#msg128757
Source (https://drive.google.com/folderview?id=0B4tCJMlOYfirflpWSFdGby1QRW11VjVQMDB2eGNnTkZvci1INEpzS1V2SFNINC1JbzVpajg&usp=sharing)
Hi Danne,
Cool stuff !!
I've made some changes to your command :) Feel free to test and implement if you like it !
#!/bin/bash
workingDir=`dirname "$0"`
cd "${workingDir}"
echo -n "Enter path to DNG Dual ISO files:"
read path
find $path -name '*.dng' | xargs ./cr2hdr20bit --same-levels
Why did you move cr2hdr ? It works in the folder. So, no need to use sudo, happy user :)
If you want to move bin, don't forget to try if file exists:
if [ -e ./cr2hdr20bit ]
then
#mv ...
fi
Thanks Kitchehof! Will check this out. I,m learning so all input is valuable :)
So i keep experimenting to be able to use my external hard drive which keeps giving me random errors. Will run a few folders without the same level command and run a script after like this. It seems to be working.
#!/bin/bash
workingDir=`dirname "$0"`
cd "${workingDir}"
find . -name '*.DNG' | xargs /usr/bin/exiftool "-WhiteLevel<BlackLevel" -overwrite_original ; find . -name '*.DNG' | xargs /usr/bin/exiftool "-WhiteLevel+=50000" -overwrite_original
You could also make these into automator workflows (like mlvfs). There's a shell script action, and you can put the cr2hdr binary inside the workflow "package" (which is really just a directory => right click and show package contents), and just reference it from there (workflows are always "installed" to ~/Library/Services/). Open the mlvfs workflow in automator for reference. If you have any more questions on how it works, feel free to ask.
Been lurking around on getting the hang of automator for just that reason. Gonna do some more trying out before I get some questions out there. Good to be in this skilled coding community. Feels real nice.
Nice tool, Thanks Danne.
Found a way to multithread the conversion by adding this line this after xargs -P 4 -n 1
The number 4 can be altered but don,t go too high I say. Your computer will run hot. --same-levels didn,t work with this but I could queue the exiftool commands for white and blacklevel so whitelevel is set on 50 000 at the moment. Change the number if you like.
For cr2hdr-r MLVFS.command it would look like this (copy paste):
#!/bin/bash
workingDir=`dirname "$0"`
cd "${workingDir}"
sudo mv ./cr2hdr20bit /usr/bin/cr2hdr20bit
sudo chmod +x /usr/bin/cr2hdr20bit
find /path/to/parent/directory -name '*.dng' | xargs -P 4 -n 1 /usr/bin/cr2hdr20bit ;
find /path/to/parent/directory -name '*.DNG' | xargs /usr/bin/exiftool "-WhiteLevel<BlackLevel" -overwrite_original ;
find /path/to/parent/directory -name '*.DNG' | xargs /usr/bin/exiftool "-WhiteLevel+=50000" -overwrite_original
For the cr2hdr-r.command like this:
#!/bin/bash
workingDir=`dirname "$0"`
cd "${workingDir}"
sudo mv ./cr2hdr20bit /usr/bin/cr2hdr20bit
sudo chmod +x /usr/bin/cr2hdr20bit
find . -name '*.dng' | xargs -P 4 -n 1 /usr/bin/cr2hdr20bit ;
find . -name '*.DNG' | xargs /usr/bin/exiftool "-WhiteLevel<BlackLevel" -overwrite_original ;
find . -name '*.DNG' | xargs /usr/bin/exiftool "-WhiteLevel+=50000" -overwrite_original
Note. Once the cr2hdr20bit is placed you can erase the two sudo lines in the script.
sudo mv ./cr2hdr20bit /usr/bin/cr2hdr20bit
sudo chmod +x /usr/bin/cr2hdr20bit
An automator app is now working, at least on my macbook pro 15 inch, mavericks. It will run 4 dual iso dng or CR2 files at the time so it is pretty fast working. I followed some steps from dmilligan (Thanks for pointing me in a direction) using automator and added a y/n question when moving binaries to /usr/bin/ with the script (Thanks Kitchehof).
The app should work straight as is if you have cr2hdr20bit installed in /usr/bin/ folder together with exiftool and dcraw in the same location. If not you could try run the install.command provided with necessary binaries.
Howto
Double click the cr2hdr-r.app and point it to a specific folder, a parent folder or a mlvfs mount. That,s it. Should start conversion when folder is selected. It will convert both dual iso dng and dual iso CR2 files.
@dmilligan. I used your LICENSE text (GNU) from your mlvfs app. Not for myself but for the binaries and respecting the developers whose binaries are used. Is this the right way? Also put in the GPL statement text from magic lantern forum in another document. Please get back to me if anythng seems out of the order here.
Automator cr2hdr-r.app download link (also on the first post)
https://drive.google.com/folderview?id=0B4tCJMlOYfirckJfdkRWU09icWc&usp=sharing
Thank you all and please try it out and report back. And as always. Use it at your own risk of course.
@Danne -- Thanks again for your PM regarding this new tool. After watching your tutorial and carefully read your instruction on how to install the command tools and to edit them in text editor as well...
This is what I'm seeing...
(https://farm4.staticflickr.com/3936/15494468626_f81fcd35e7_o.png) (https://flic.kr/p/pBccGN)
I read it somewhere whereas you mentioned that I need to make sure both draw & exiftool must be in the same location?
My question would be should I locate the files and move them within or should I just redownload them and place them into the same location as the new folder that was created for the DUAL ISO files to be exported into?
Thanks again for creating this great tool. Such a time saver (when I get it right! =))
Hi Deafeyejedi!
Try this link and follow the instructions in the package. Please report back if you get it to work.
Automator cr2hdr-r.app download link
https://drive.google.com/folderview?id=0B4tCJMlOYfirckJfdkRWU09icWc&usp=sharing
One thing with dcraw I think you need to have your computer langauge set to english for it to work.
@Danne -- Thanks again for your second PM... after reinstalling the exiftool, dcraw from within the folder that I downloaded per your suggestion.
Now I can see that it actually converts four of CR2/DNG's seamlessly... Macbook Pro 2006 running Mavricks has not been feeling HOT as of yet. LOL
(https://farm4.staticflickr.com/3945/15331183238_6dfbaa2248_b.jpg) (https://flic.kr/p/pmLjDu)
But I'll be online waiting for the converts to be done and then will try to export it as a quicktime ONCE I color grade them in ACR just to see how it turns out, especially with the same levels being applied from the automator (sweet stuff @Danne!!!)
Unless I'm told otherwise... Thanks again mate!
Be in touch...
Nice to see it in action :)! Hope it turns out good.
Don,t forget to let the automator work til the end so all level commands are applied.
I hope so too and I just clicked on one of the DNG's and open it in ACR just to take a peek and its quality... I must admit that it is coming out much cleaner than it does directly from MLVFS alone (not sure why) but now my only question is...
In ACR -- is it a good idea to NOT implement with the highlights/shadows or does that not matter because the same levels has already been applied from the cr2hdr app itself?
(https://farm4.staticflickr.com/3947/15517967685_1d7cd10a33_b.jpg) (https://flic.kr/p/pDgD9Z)
I actually like doing your trick with adjusting the TONE CURVES within the Darks & Shadows.
P.S. If I still see some hot/pink pixels (EOS-M) do I just use MlRawViewer AFTERWARDS to export as DNG's with the Hot Pixel Remover enabled or is that not necessary? (Because in the newer version of MLVFS which has a built in OS to show the options to choose from such as HPR) ::)
I'm still waiting for the the converts to be done within the Cr2hdr app.
To be continue...
Nice.
Post production is a whole different story. Only reason I fiddle with acr occasionaly is to get that last bit of highlight out of the file. Only use the curve tools and not contrast, higlight slider or shadow and such. Exposure, white balance and exposure sliders seems to work. I tend to use mlrawviewer which is also giving me nice pro res files and the workflow is so fast.
Can,t help you at all with dot pixel removal unfortunately.
Feel free to discuss post production in the dual iso movie thread 2,5k.
Same levels has nothing to do with flicker caused from acr. Same levels are needed since cr2hdr treats black and whitelevel individually and not linear. THis is optimal when taking stills but not for movie sequenses obviously :).
Keep it up!
I took the liberty to modify your workflow so that it shows up as a "service" and you don't need to "install" cr2hdr, dcraw, exiftool first. I put them inside the workflow "package" contents, and reference them from there, this is possible because when you "install" a workflow service it always goes to the same directory: ~/Library/Services . So installation should simply require double clicking the cr2hdr.workflow and clicking "install" (just like mlvfs).
https://bitbucket.org/dmilligan/mlvfs/downloads/cr2hdr.workflow.zip
Thanks! I started doing a workflow service and it worked but couldn,t understand the reference thing from mlvfs.
Is this command line all it takes to reference to the three binaries?
cd ~/Library/Services/cr2hdr.workflow/Contents/
Ok, think I understand now. Everything is referenced from the ~/Library/Services and the workflow package in there.
@Danne -- I'm currently uploading a few clips onto Vimeo after using the new workflow you proposed from earlier. Thanks & Be back to you shortly!
@dmilligan -- I went ahead and downloaded the modified workflow that you created w Danne's and it is now enlisted under my 'Service' package. Thanks for that, However from what I am seeing... it seems that I am unable to locate the new files after the process is completed? (It seems to be too quick almost as if it didn't work properly) Thanks again for your work though! (I'm more than happy to help improve your workflow as well)
(https://farm6.staticflickr.com/5600/15499685556_1543a7a4ae_b.jpg) (https://flic.kr/p/pBDWvS)
(https://farm6.staticflickr.com/5607/15522467222_798fabc4f7_b.jpg) (https://flic.kr/p/pDEGHd)
Because earlier today with the cr2hdr-r app that Danne suggested worked flawlessly as far as I'm concerned.
should I stick with Danne's original way or try with the new workflow?
Unless I am missing something?
Left everything alone in ACR except for the tone curve regarding darks/shadows via your 'trick'... came out not too bad, eh? (although I think I do see some strange whitebalance changes in the middle & end of the clip -- not sure where did that come from) Just a step closer to perfection...
Thanks @Danne!
Shot MLV DUAL ISO w EOS-M > converted with MLVFS > cr2hdr-20bit (Danne's workflow w cr2hdr-r) > Export as 16-bit Tiff's from ACR > Image Sequence with Quicktime7 export as ProRes 422 HQ.
P.S. personally I would rather use MlRawViewer than QT7 so I can just apply some of my favorite LUT's... not sure why it just won't run on my macbook anymore after I tried uninstalling to downgrade back to older version but then I decided to erase that and go back to the latest version 1.3.2 and still no luck so far. Sorry @Baldand for my own stupidity! I'll retry to download from your bitbucket site once again. Be in touch!
Nice to see highlights retained without flicker. The cat is green in the end though :).
Here's Take 2 of the latest saga with the DUAL-ISO MLV > MLVFS > cr2hdr-R (20-bit) > MlRawViewer (1.3.2) export as ProRes 4444 w LUT's applied. (I tried to export as DNG's but then it crashes every time -- let me know if you would like for me to send you a crash report regarding this situation @Baldand)
(https://farm6.staticflickr.com/5605/15347898620_8dd5435cdb_b.jpg) (https://flic.kr/p/poeZxJ)
Thanks again to @Danne, @dmilligan, @Baldand & @a1ex for their correspondents & dedication!
I,m trying to get my head around extracting dng files with the raw2dng binary. I want the script to move the files to created folders and then make the command extract the dng files within the folders. Tried with xarg and a few other solutions but files either end up outside the folder or in my home directory and sometimes in the right folder? Maybe someone skilled could explain wht I,m missing here? Code below comes from g3gg0, dubzeebass and internet :)
#!/bin/bash
workingDir=`dirname "$0"`
cd "${workingDir}"
for FILE in `ls -A1 *.RAW *.raw 2>/dev/null`; do
BASE=`echo $FILE | cut -d "." -f1`;
mkdir $BASE;
mv ./"$BASE".RAW ./$BASE
done
find . -name '*.RAW' -exec raw2dng {} \;
Found the answer to get my RAW starting conversion in multiple directories. Will try to incorporate this to the app.
find . -name '*.RAW' -execdir raw2dng {} \;
looking forward to it @Danne! :)
Updated my first post with a new "app version". It will now recursively work on RAW, MLV, CR2, dng files.
Simply place all your files in a folder and run the app in the folder. The app starts creating folders and then converts the dual iso files and applies same level within the folder(This goes for RAW, MLV). At the end it puts the originals to an ORIGINALS folder. It will run 4 dng files or CR2 files at the time and your computer will work multithreaded.
It is all BETA and I consider myself noob in this territory. USE and TEST WISELY, backup with copies before testing and let me know what you think.
cr2hdr-r 0.1 "app"
https://drive.google.com/folderview?id=0B4tCJMlOYfirckJfdkRWU09icWc&usp=sharing
*update*
Although I did it twice just to make sure. For some reason after your app is completed and I get an error when trying to open the newly converted DNG's. Tried again with LR5 -- same.
(https://farm6.staticflickr.com/5614/15562684482_a85ae7b88f_o.png) (https://flic.kr/p/pHdPUf)
Will try restarting the macbook pro and try one last time before I hit the sack...
Could you upload a non working DNG?
@Danne -- my fault I fell asleep last night and here is the DNG you requested...
https://www.dropbox.com/s/t3bswzveeg0z6ti/M20-1628_000000.DNG?dl=0
Thanks.
It,s the white and black level that didn,t finish. Sure you let the script work til the end?
You can run the app on a converted folder and it will apply black and white level and skip conversion. Should be ok after that.
Get back after trying.
I actually did let it run through overnight so I'm assuming it did apply the white/black levels toward the end?
I am currently converting again with the newest app that you mentioned to me in PM from last night and will upload a sample DNG as soon as its completed..
It's still in the process so I'll wait for the white/black levels to be applied...
Cool. Maybe something interrupted the process, not sure.
Here's take 2 of the converted DNG's...
https://www.dropbox.com/s/nqnlhhj2dtaq0cs/M20-1628_000001.DNG?dl=0
Yes, it works? It is opening overe here. Not at your computer?
@Danne -- all good. apparently it opens up just fine via ACR/LR5 as soon as I got home tonight. Both takes. Perhaps the first take was due to not being fully completed (as you stated regarding the black/white levels not being applied) as strange as that could be... not sure how this happened but I wouldn't worry about it.
Could be due to my old poor 2006 macbook pro running Mavricks, ha?
will upload the test footage as soon as Vimeo is back into service from their so called maintance.
Thanks again for everything!
Hi all! I made some changes in this app and added a description about what in the first post. Mainly added the possibility to cat spanned files. This is oldschool I know but could be nice though to at least have the app handle the files one way or the other than not at all. Or use Mlvfs or Mlrawviewer for export before cr2hdr conversion.
cr2hdr-r 0.2 "app"
https://drive.google.com/folderview?id=0B4tCJMlOYfirckJfdkRWU09icWc&usp=sharing
Thanks for the update @Danne -- today my baseball game got cancelled so I'll take this opportunity to go out and shoot some dual-iso 2.5k RAW footage...
Be in touch!
Cool. Looking forward for some 2, 5k :)
@Danne...question -- any idea if its possible to enable an option in order to export dual-iso text files after its renders?
So I can read the reports to verify the DR and such...
I thought it was producing these files in the previous version but not the new one unless I'm missing something?
Thx
Don,t really know how to get that textfile, sorry. You can use the binary directly in terminal and the processing will be shown while the dng:s are baked. Around 2 minutes in https://www.youtube.com/watch?v=tCszO1nGrwc&list=UUomeOeghS6wanMOCQ8BtH_A
@danne:
Hello Danne, thank you for your tool. But isn´t "Full DualIso" provided with MLVFS? So why should i use your tool instead?
best wishes, sw
One word. RAW
Is mlvfs exporting multithreaded? Gotta check that out. This workflow runs 4 dngs in parallell.
@swinxx -- I also think it's because I noticed when converting 20-bit dual ISO w MLVFS it comes out under exposed whereas if using @Danne's app it gives you well exposed DNG's as well as fixing black/white levels for dual-ISO videos which is a PLUS!
If you rather use MLVFS -- you just gotta apply the black/white levels and/or adjust the exposures manually along with highlight recovery as oppose to @Danne's app when the highlights seems to be already taken care of because if I do try to reduce the highlights it basically makes them go a bit too low so I kind of like how @Danne's app does all the 'dirty' work for you if that makes sense...
Do you know if it is multithreaded deafeyejedi?
Quote from: Danne on November 13, 2014, 08:03:56 PM
Do you know if it is multithreaded deafeyejedi?
It is...sort of. It can process multiple frames at the same time (in separate threads), but it will only do so if you actually ask it to, i.e. if you actually try to read both DNGs at the same time. If you're reading the DNGs from a post processing app that supports "pre-fetching" or loading multiple frames concurrently, then MLVFS will be multi-threaded. I know SpeedGrade supports this and there's even a setting where you can specify the number of frames it will "pre-fetch" (it's a good idea to set it to the number CPU cores you have for this). If you only try and read one DNG at a time, then MLVFS is only going to use one thread to process that DNG. An example would be the Finder, if you use the Finder to copy files out of MLVFS mount, it only copies one file at a time. If you wanted it to be "multithreaded" you could start multiple copy operations (for example start to copy out half the DNGs, and then start to copy out the second half).
Now, I suppose that I could support "pre-fetching" internally to MLVFS => when one frame is asked for, go a head and process the next one (or the next several) in a separate thread, so it will be ready when it's asked for, but that will be some work to implement.
Quote from: DeafEyeJedi on November 13, 2014, 07:36:47 PM
If you rather use MLVFS -- you just gotta apply the black/white levels and/or adjust the exposures manually
That is not true. You should not need to adjust the black/white level with MLVFS. If you have an example file where MLVFS gives the wrong black or white level, then please share it with me so I can fix MLVFS.
As far as manual exposure/highlights adjustment goes, I've never met a dual ISO image I didn't need to make some sort of manual adjustment anyway. In fact, that's sort of the point (to have lots of ability to push the image really hard).
Been busy working lately but will dive into some more testing soon. A lot of good stuff with mlvfs and also mlrawviewer lately.
QuoteYou should not need to adjust the black/white level with MLVFS.
Yea, I was under the impression mlvfs would set the same consistent white and black level for dual iso dng:s. Gotta investigate further.
Since I mostly use dual iso for 3x zoom I,ve been working with raw but I,ve been trying some mlv stuff too and it it,s really nice too although I miss maybe one extra step in performance boost but that is ok. Nice thing with mlvfs is of course the no need for first conversion step, big timesaver.
@danne
how do i know when the app is finished?
update: i have converted a dual iso mlv, but sorry mate, i have to tell you that after converting, its flickering..
perhaps i am doing something wrong.
i installed all your required files with the command app, then i opened up the cr2hdr-r pointed to the directory of my dual iso mlv folder, and waited. when i now import those files and play it back, its flickering.
Update:
i have to point out that my shot is problematic, however... when i convert my shot with MLVFS, it is Davinci Resolve Conform and Not Flickering.
thx sw
Did you install exiftool? Not sure why it won, t work. You could post some sample variations for me to look at or simply stick to mlvfs since it, s mlv. Would be nice to find what is wrong though.
You see a small wheel at the top when the conversion is finished. It is an automator thing.
I think mlvfs and cr2hdr-r is using the same binary from Alex so flicker problem should be with white/blacklevel coming from exiftool.
Thanks
Quote from: Danne on November 14, 2014, 07:13:43 AM
I think mlvfs and cr2hdr-r is using the same binary from Alex
MLVFS does not use the cr2hdr binary. It has it's own implementation of cr2hdr. Much of the code came originally from cr2hdr, but I tweaked the code a lot and there are some important differences. The biggest difference is that MLVFS outputs CDNGs instead of plain old DNGs. Also, the black and white levels come from the metadata in the original MLV file, while cr2hdr computes them from the actual image data. This means that MLVFS's DNGs are all going to already have the same black and white levels and its a little faster (since we don't have to do some computations on the image data).
hello dmilligan and danne!
i must say that the image, which comes out of mlvfs from dual iso mlvs is brilliant and it makes a big difference!
all in all it is a slow process (as far as i can tell) but superb in terms of quality.
Thanks dmilligan for that great addon!
What,s the difference Swinxx? You could post two samples comparing? THe quality of the converted dng shouldn,t change unless dmilligan also tweaked the fullres or amazed code?
Nice to hear you efforts dmilligan, cdng, tweaked code. Have you created a mac binary which perhaps could work the same as a1ex cr2hdr20bit? Would be nice if cdng, original metadata and same levels would find it,s way into this app as well and then we also would have a raw converter :)
//D
@danne:
- as mlvfs is mlv only, this would indeed be a great idea.
- i have deleted the images from your app but will convert again for posting here. one difference here is that the conversion with your app is flickering here, and that in my scenario, the picture quality seems better. you will see when i post the pics.
greets sw
Hey Swinxx and Deafeyejedi. I,m trying to convert longer files containing more than 1000 frames. Encountered an issue when converting a longer mlv file which seemed to stop the conversion after around 700 dng:s. I look at the file that stopped the conversion but it seems fine. On rerun it stops around the same place but not on the exact same dng. Some hick up with the binary maybe.
I then tried a longer raw which seemed to work. Could anybody try a longer raw vs a longer mlv to see if the issue is reproduced?
*update. noticed this behaviour also for raw sequences. It seems the cr2hdr has som issues maybe with blurry files, hmm
Segmentation fault: 11
Copy that @Danne -- will get on it now and then let you all know if it does in fact reproduce the issue or not.
Stand by...
I think you can skip the long tests. Not exactly sure what is causing the hickup but probably the cr2hdr binary has some automation going on which could lead to make it stop. Found this in terminal. Seen it sometimes before.
Segmentation fault: 11
about to start an MLV folder containing 1181 files and you mentioned that I didn't have to do the long test -- how exactly do I shorten the routine towards to final results from the binary itself?
let me know if I should wait for your suggestion otherwise I'll just go ahead with the normal routine (long test)...
thx
If you want to stop automator right click the wheel at the top screen and abort or stop, can,t remember exactly. It will probbly run a while and the put the originals in a folder.
You could try run it to see how your file behave.
Thanks
/D
Ok, so issue regarding segmentation fault 11 seem software and picture related. Not file format spanned or exfat related.
Might occur when a file can,t be handled with cr2hdr and converted directly. Pic might be blurry to bright, or something else. It seems to work when retrying so I put in some reruns of the converter if it should stop randomly while running. Of course dual iso should be used in contrasty situations for best results and not judged from badly uncontrasty test files as with the case where I got the problem.
@danne.
i can not see a wheel when your app is working?
i have osx 10.10
greets sw
Ok, I see. I,m still on mavericks. Could it be Yosemite related? I,m curious if the app runs the exiftool white/blacklevel or not on your file since you had flicker.
the wheel (to the left)
(http://s8.postimg.org/qbgmgzga9/Screen_Shot_2014_11_15_at_08_40_22.jpg) (http://postimg.org/image/qbgmgzga9/)
I,m trying to use mlvfs dual iso implementation but I get a lagg effect on folders and in workflow. Only really tested on AE. This is when I work in fullres mode just before exporting. Preview mode seems to be working fine. What are you experiencing Swinxx?
Hi, my workflow is different:
Mount -> Copy to new folder -> Import the printed files into Resolve -> voila
The thing is that the copy procedure is as dmilligan described -> slow (1-3fps)
Will search for the wheel ;)
So you drag the folders to desktop first and gets them converted? If so, then conversion with cr2hdr-r should be significantly faster? Did you try dragging chunks of files to start parallell processing with mlvfs?
Shared a new version
Handles whitespace and also makes the app try a few extra reruns just in case cr2hdr20bit don,t succeed converting problematic files the first time.
cr2hdr-r 0.2b "app"
https://drive.google.com/folderview?id=0B4tCJMlOYfirckJfdkRWU09icWc&usp=sharing
@Danne -- once again thanks for your superb app... indeed it is faster than MLVFS (<-- I still love your app @dmilligan esp w the option to use DR & CC PP 2014) but when it comes to converting dual-iso w cr2hdr20-bit... c2rhdr-r is the one to go with and yet the latest update just makes it even more durable and reliable! :)
SJ
Nice to hear someone using this :). Thanks.
Gotta try the preview and realtime possibilities with mlvfs some more. If there is a bottleneck anywhere I, m certain dmilligan will solve this. For now I stick with my automator baby :). Which of course, from my part, is a bunch of compiled script lines ftom the community and information out there in cyberspace:)
Ran a test with several RAW/MLV files over 1000 frames (few were over 2k frames as well) and all seems to be running fine. No errors were able to be duplicated per your request.
FYI -- I always use exfat on my cards, in case you were curious.
Sounds good, thanks for testing! :)
I,ve started playing with exiftool and there is a lot to learn. I have created an experimental build. It converts much as before but after conversion is done it gives you back the metadata(MLV) into the converted DNG file. MLV of course has a lot more to tell than RAW. I also implemented a whitelevel command which should give a correct(same level) whitelevel reading read from the first dng and applied after conversion.
If anybody wants to try it out feel free. Do copies of originals!
https://drive.google.com/file/d/0B4tCJMlOYfirN1pkLTAzNTFwZUE/view?usp=sharing
This is used for copying mlv metadata, adding it back and applying whitelevel
exiftool *.dng -X > /tmp/a.xml -overwrite_original
find "${workingDir}" -name '*.dng' -print0 | xargs -0 -P 4 -n 1 cr2hdr20bit
exiftool -tagsfromfile /tmp/a.xml -all:all *.DNG -overwrite_original
exiftool -tagsfromfile *.DNG -exif:whitelevel -overwrite_original
Excellent ideas on the update for your app... Will definitely test them out tonight as soon as I get home!
Thank you, me too
As for know the metadata is being applied to mlv files when the process starts from an original mlv raw file. When you run the app on a folder with already converted dng files it works as before and with no mlv data changed after conversion except for whitelevel.
If you test please check for flicker since I didn,t include blacklevel correction. Seems to work up to 70000 on whitelevel and I,m not sure if the files go any further.
-deleted-
Meaning it wasn't worth to update? So should I downgrade back to previous version regarding your app?
Thx!
Uploading a new one in a while.
From first post.
Experimental cr2hdr-r 0.2d "app"(DaVinci Resolve)
https://drive.google.com/file/d/0B4tCJMlOYfirOHdVSkpwSmlQVU0/view?usp=sharing
Thanks to dmilligan for pointers and information about wav information and TimeCode(exifdata).
Works with RAW(no audio of course) on different framerates.
Works on MLV files with audio (Only when filmed in 25fps for now)
Above version converts as usual but with naming scheme working with DaVinci resolve. It runs audio+16-bit DNG from converted MLV files in Da Vinci resolve(only in 25fps for now) RAW is also working(Without audio of course).
Since I simply copy the missing ixml information into the audio(wav) the information for now will be hardcoded to master speed 25000. Audio and DNG will merge only when filmed in 25fps for now.
There are some new nice binaries added, SoX(shortening audio) and BWF MetaEdit and also a created bmcc.xml file. Run the command installer and then you,re good to go.
Thanks @Danne for the PM follow up regarding the latest update to your app -- I am currently waiting for the IT guys to come by and type in their Admin username/password (which I dont have access to) on this Mac Pro at work.
Stand by...
cr2hdr-r 1.0 "app"(DaVinci Resolve)
https://drive.google.com/file/d/0B4tCJMlOYfirXy1UY043R04yOTg/view?usp=sharing
It should work now with DaVinci Resolve. From my tests audio embeds when inserting ixml data to the file which matches the framerate filmed in. So included for installing is a folder with bmcc.xml. Store the originals and consider this a hacky way to get the audio to embed with the files.
Since the IT guys at work couldn't figure out the actual usename/pw in Terminal -- so here I am at back at home just started out the latest update & currently rendering overnight in both MLV/RAW along w several Dual-ISO's as well worth approximately 91.55gb...
Thanks for the update once again and stand by for the results!
SJ
Shouldnt the result be the same as with mlvfs??
should be... we'll see.
Main difference is all ixml and exif info is recopied or inserted after conversion with cr2hdr20 bit. Straight to the 16-bit DNG files. Mlvfs is producing proper cdng files and dmilligan reprogrammed to get a professional workflow and professional files.
My cr2hdr-r is for fun and learning bash and such. Maybe I get some time learning actual programming sometime. Who knows ;)
If audio embeds files should be of high quality though. Do some tests.
Updated to version 1.3 in first post. Now cr2hdr-r is also provided as a workflow service in automator. No need to install binaries, already inside the workflow service. Also added a command line which tells if it the file extracted from RAW or MLV are dual iso or not. If it,s not cr2hdr stops trying to convert files and proceeds to the next MLV or RAW file.
cr2hdr-r 1.3 "app" Works with DaVinci Resolve.
https://drive.google.com/file/d/0B4tCJMlOYfirdXZyeFc1MHNZU2c/view?usp=sharing
cr2hdr-r 1.3 workflow service
https://drive.google.com/file/d/0B4tCJMlOYfirSWNncklHUFRHU3M/view?usp=sharing
Doubleclick and install the workflow service. Right click on a folder with files to start converting. You,ll find the workflow under services when right clicking.
Dude... this app seems to be a bit quicker on the renderings. It pushes 40-45 dng's per second before the dual-iso gets converted (which does about 4 dng's every 5-6 seconds!)
Holy Smokes... 8)
Makes me want to shoot more Dual-ISO with ease on my mind!
Thanks, Danne!
SJ
p.s. +1 for the workflow service!!!
Cool :).
It is Alex snd g3gg0 wizardry. Havn,t done anything to the binaries but nice to hear it is running fast :)
Yes of course I know all of this wouldn't be possible if it weren't for a1ex, g3gg0 and everyone else including DEV's on board in the ML community. Thanks again!
It only makes me wonder how much faster could this be if I were to use a latest model of MBP's because my current 2006 15inch MPB is modified with 250gb SSD along with a mere 6gb of ram.
Stay strong...
LoL
Ssd speeds up a lot :)
MLV > cr2hdr-r > AE > ProRes 4444
Thanks for posting. Hard to tell if the flicker in the sky comes from acr, lack of including black level(only same level for whitelevel in recent version)
What do you say? Is it the same as before regarding flicker?
Not quite sure. I duplicated the workflow in ACR (highlights/shadows) as previously done in earlier test. Only difference was the fact that I didn't use AE last time so could that play a factor in this so called flickering issue? (I thought it looked good until the sun starts causing the flares which makes it look a bit flickering so I wouldn't know which to blame it on?)
Perhaps I should open the DNG's in PS and export as Tiff's like how I did before and see if that would make the differences? I don't think it would...
I dont think that is needed. What sliders did you mess with in acr?
Just watched the first clip and it also seems to have some problematic skies. I think were good.
Quote from: Danne on December 05, 2014, 07:45:19 PM
Just watched the first clip and it also seems to have some problematic skies. I think were good.
Agreed.
Quote from: Danne on December 05, 2014, 07:43:24 PM
What sliders did you mess with in acr?
I just touched the Tone Curve (Dark/Shadows @ +100).
Actually after watching the test clip several times and noticed it was slightly under exposed. Went into ACR via AE and noticed I didn't have the ToneCurve shadow slider all the way up to +100 (it was at +83) when the Highlight was still at +100.
My fault on that guys...
Here's the correct take...
MLV > cr2hdr-r > AE > ProRes 4444
Looks nice :)
Tried out 50fps and the audio issue. Not sure why audio it,s halfed in timeline in AE and the problem seems to be there in mlvfs and mlrawviever as well. Actually full audio is recorded but something doesn,t synch with higher framerate when recording MLV.
Thanks & I noticed that as well -- Hopefully there'll be a fix for the 50/60fps Audio issue sometime soon...
Probably related to ML coding & hopefully a1ex or g3gg0 will implement a quick update!
@Danne -- did another test with Dual-ISO 2.5k MLV. Converted w latest app through service workflow. My question is... Do you rather adjust Tone Curve first in ACR from AE before exporting with VisionLOG.
Because after exported I wanted to try apply a certain 3D LUT that I thought looked pretty clean but for some reason the highlights looked completely drained out (like as if I did it too much but hadn't touched the highlight slider on the main page within ACR other than the Tone Curves) so I'm not sure if I am doing something odd during this process?
Thoughts?
I actually don,t use vision log that much. I try to get some good results straight in acr. Been a while now though, a lot of other work going on. Tried vision log but I am not too skilled in post production outside acr so couldn,t get highlights back as i wanted.
Apparently I just tested out a Non dual-ISO file w VisionLOG and it comes out well than from a dual-ISO in which I guess makes sense in a way...
Since Dual-ISO ALREADY gives you that extra DR? lol
Version 1.4
Some minor changes to installation of binaries.
Whoooohoooooo thanks @Danne -- will definitely check it out!
Feel free :). Main reason for this was I realized you have to have exiftool and dcraw installed in /usr/bin/ to get things going properly. Also added an if loop in bash which tells if you already have binaries installed or not.
Tried constructing a mac install package but failed so still using the command script :P
Ahh I see. All is well though and I don't mind using Terminal ATM.
[emoji2]
*Feedbacks*
Hi -- I just wanted to confirm w you that once I convert MLV's into DNG's from your app... They won't be able to show in Previews (unlike how it can with MLVFS) could this be related to Yosemite OS X?
MLVFS:
(https://farm8.staticflickr.com/7486/15686642143_93d0a3daf8_n.jpg) (https://flic.kr/p/pUb9ci)
Cr2hdr-r 1.4:
(https://farm8.staticflickr.com/7504/16119147990_673b6e173a_n.jpg) (https://flic.kr/p/qyoR7E)
Are you still running on Mavericks on your Mac?
Thanks for your handwork on this, as always!
Sean
I don, t think I have any previews in mavericks. What can be done is metadatupdate in bridge or lightroom which could include a preview but it takes some time with a lot of dngs to update.
Strange. I swear I could have seen previews from DNG's during the hey days of Mavericks...
But guess not since you have confirmed that I was in fact incorrect.
hmmm... Thanks again @Danne!
Update to 1.5. (first post)
Been playing around with awk in terminal which led to some updates.
- Faster exiftool handling. Applies same white level and other things all in one row. This leads to faster conversion times of dual iso files.
- Exiftool applies correct fps to RAW files.
Sweet!!! Will check it out tonight after work...
Thanks again, @Danne!
Cool.
About to implement HDR conversion into the app. Not the most popular feature nowadays but might be handy sometimes to someone :).
Some prores export too with automated upscaling for slowmovideos. A lot going on ;)
That's a cool feature add-on regarding HDR conversion.
It's you that may be able to revolutionize HDR back from the 'dead' with this awesome app of yours!
I started conversions of Dual-ISO photos and man you were right...
It is indeed faster -- well job done, Danne!
Looking forward to your next update w ProRes export as well as the automated upscaling for slo-mo's!
Such a tease after all...
;D
Updated to 1.8 and added ability to create hdr movies. The hdr script incorporated comes from Jerrykil. Also included an installation instruction.
Changed the thread title.
cr2hdr-r is able to handle the following files
- dng (dual iso)
- CR2 (dual iso)
- MLV (both regular and dual iso + wav (should work with DaVinci resolve)
- RAW (both regular and dual iso)*read "Good know"
- HDR (MOV + wav (48, 50 or 60fps recommended. Fps is halfed. Script from Jerrykil)
Installation guide (app) http://youtu.be/LjbqfptpNac
(http://s15.postimg.org/5lkadl2rr/Screen_Shot_2015_01_28_at_16_25_23.jpg) (http://postimg.org/image/5lkadl2rr/)
downloads
cr2hdr-r 1.8 "app"Works with audio in DaVinci Resolve.
https://drive.google.com/file/d/0B4tCJMlOYfirdFNOMWxTRFRveVE/view?usp=sharing
Does this have the proper matrices and calibration that Andy600 uses with Cinelog? It's way easier and faster than MLVFS I'm sorry to say! Good job buddy.
Thanks!
No color matrice altering in these files. Might work to do but as for now it has to be done after the conversion step. Don, t know if it is someting that could be done with exiftool. Dmilligan, Andy600 or chmee would know more I, m certain.
Just got home from being on the road for work again. Tried downloading 1.8.
(https://farm8.staticflickr.com/7460/16219792878_648d2cfba5_n.jpg) (https://flic.kr/p/qHhFkm)
I guess it's getting more popular now than ever!
[emoji2]
Oops. Didn, t know there was downloading restrictions. Will look over this in the weekend :)
Thanks for checking download link Deafyeyejedi. There is now an alternative download link through dropbox added to the first page.
cr2hdr-r 1.8 app
https://www.dropbox.com/s/rtm1fvabd2i84ub/cr2hdr-r%201.8%20app.zip?dl=0
Thanks @Danne for the follow up regarding the link. ALL GOOD so far!
However, I notice whenever I update the app and replace in Applications -- it still says version 1.2 from within the 'Info' ( but I know it.s 1.8 ) perhaps you already know about this?
Now I'm currently testing out MLV's converted from your latest app to verify the color-matrices... so exciting!
Will be using @Andy600's Cinelog's LUT's to see best results as possible...
Haven't tested HDR videos yet... ;)
Aha, thanks for feedback. Gotta check issues later.
Havn, t implemented color matrices but it shouldn, t be to hard with exiftool. Would be nice to get some feedback on this once it, s implemented and how it will respond to Andy600 lut.
About HDR I recorded some raw 50fps and exported to prores in mlrawviewer with a flat setting before ttanscoding with cr2hdr-r.
Gave some fine results actually :)
cr2hdr-r version 2.0
https://drive.google.com/file/d/0B4tCJMlOYfirQkpITV9SRktvQWM/view?usp=sharing
New stuff.
- Ability to transcode to ProRes with audio, both regular and dual iso files.
- Automated transcoding HDR raw files to ProRes. Slowmotion clips will be automatically adjusted to correct aspect ratio. Dual iso files will be brightened. (These settings can be tweaked in script).
How does it work:(check the pics)
1 - Run the app as usual pointing to parent directory with files
2 - At first run two folders will be created PRORES and HDR_RAW and the app will quit. Next step simply put the files inside the folders for which you want ProRes och HDR transcoding to ProRes and run the app again. Everything gets converted, both parent directory and newly added folders. In the end originals will be put into the ORIGINALS folder and the ProRes files will be moved to parent directory.
Please run the install.command again as it will install dcrawx86, an older build which works better than newer builds for now.
Feel free to test and give feedback.
1
(http://s15.postimg.org/5mvd7jck7/Screen_Shot_2015_02_06_at_12_27_25.png) (http://postimg.org/image/5mvd7jck7/)
2
(http://s15.postimg.org/x8y4s7vx3/Screen_Shot_2015_02_06_at_12_27_56.png) (http://postimg.org/image/x8y4s7vx3/)
3
(http://s15.postimg.org/k7cg2d7iv/Screen_Shot_2015_02_06_at_12_28_52.png) (http://postimg.org/image/k7cg2d7iv/)
Great STUFF @Danne! (Still says 1.2 within the INFO window) <--- Not a big deal! [emoji106]
(https://farm8.staticflickr.com/7304/16432258286_d4594be438_n.jpg) (https://flic.kr/p/r34BU3)
I like how the app makes the PRORES & HDR_RAW folders before running it again the 2nd time in order to complete the process by creating DNG's as well as the ProRes.
(https://farm8.staticflickr.com/7398/16272017449_5d5b3fb7c8_n.jpg) (https://flic.kr/p/qMUkSZ)
Though I haven't test either Dual-ISO nor HDR yet. I'm getting ready for work as I type but ofc I ran a quick test TWICE with a small MLV file from 5D3 113.
*FEEDBACKS*
-I get prompted with an error after ProRes is finished rendering. (Thinking that it didn't work but was able to locate the .MOV file) However, I can still playback the ProRes Quicktime file that it created BUT apparently it makes it completely OE. Not sure if this is because the app thought it was a Dual-ISO and it wasn't?
(https://farm8.staticflickr.com/7281/16456518071_fd6879a570_n.jpg) (https://flic.kr/p/r5cXuc)
-.MOV file
(https://farm8.staticflickr.com/7382/16272370897_8fd7b68972_n.jpg) (https://flic.kr/p/qMW9WV)
-.DNG file
(https://farm8.staticflickr.com/7445/15835735514_bbcf039268_n.jpg) (https://flic.kr/p/q8mhsE)
Overall It's definitely getting closer...
:)
Thanks for testing. It is still very beta with the ProRes handling and the brigtness probably is due to as you say, thinking it,s a dual iso file. Actually, if the dng files are named with upper case letters DNG it will turn into dual iso brightness mode.
The error prompt is because of the app moving around in and out of different directories not ending and coming back as it should. I,m trying to get it to work for all kind of transcoding scenarios but clearly it is getting harder and harder for every new implementation :).
I,ll check to see what can be done soon. Might have to diminish some possibilities in the end.
Version 1.8 might be the sweet spot for this project. HDR with Pro Res files created in Mlrawviewer and then put into the folder for conversion should work really good. Some fine luts in Mlrawviewer too.
Fixed the brightness bug you had Deafeyejedi. New version here
cr2hdr 2.0
https://drive.google.com/file/d/0B4tCJMlOYfirQkpITV9SRktvQWM/view?usp=sharing
*QUICKTEST* with latest nightly ( Jan 28 ) 5D3 in 60fps @ 50mm f5.6 w ETTR enabled.
HDR Video via ISO 100/1600 (Pre-cr2hdr-r): <--- though you could see the original HDR effect but Vimeo somehow made it go away? lol
HDR Video (Post-cr2hdr-r): <--- though I'm not sure where did the random flick come from?
Dual-ISO MLV (1728 x 606) via ISO 100/1600 (Pre-cr2hdr-r):
Dual-ISO MLV (1728 x 606) via ISO 100/1600 (Post-cr2hdr-r): <--- not sure how much brighter was this supposed to be? It looked quite the same.
Thanks! The second vid looks quite good. Strange that vimeo seems to runs some antiflicker in the first vid :). Or is transcoding 60 fps to 30fps?
The random flicker in the second vid is probably due to enfuse not working linear. Need some sort of "same level" setting for it as with dual iso ;).
I could push the dcraw brightness even further but it will kll the highlights. I think what is needed is some sort of flat setting. THe challenge would be to find some way to wor gamma, contrast in dcraw but when I tried I couldn,t get it to work any good.
There is also the possibilty to tweak ffmpeg settings and maybe apply a lut in there as well.
I,ll check in later, busy weekend. Thanks for now.
Appreciated... Take your time, Mate!
*cheers* for yet another epic accomplishment in this app...
[emoji482]
*UPDATE*
This morning I shot a brief BTS for a friend's promo shoot w 5D3... even though it's not necessarily required to shoot RAW/MLV but decided to just go all out with a bunch of different types of modules under certain DR situations. Heck I even went with RAW, MLV, Dual-ISO, HDR-Video, along with some Stills and doing so couldn't have been any easier with an ease of mind only because of this remarkable app of yours @Danne! :D
It's quite rare to have this type of positive effect (or energy if I may say) coming directly from someone's sole app that helps with my fun day of shooting regardless of the assignments/situations/modules knowing in my head that EVERYTHING is going to be ALL RIGHT!
It definitely looks like it is going to be a nice long nap for me while the latest cr2hdr-r is rendering approximately 262.25 GB worth of Magic. ;)
(https://farm8.staticflickr.com/7383/16468508831_8c42c78759_n.jpg) (https://flic.kr/p/r6gpVr)
**In case you were curious, I first tried to start the app when files were on each separate Folder respectively within from each CF cards (to keep it organized and to know which card it came from) but apparently the app didn't work or won't run it -- so I then decided just to bundle all the files together from each Folders into a single Folder which seems to do the trick -- Not sure if this makes sense?
Thanks again mate and everyone else on board!
Hehe, glad to hear. Nice to see you trying out such a huge amount of files. As for now I think running a mix of files would work better than one category at the time. I, m working on it so it will work both ways. Also refining ffmpeg and hdr transcoding.
I, ll be back :)
*UPDATE* Take 2:
Maybe its because I had too many files under one folder OR could this be related to using external HD? I may have to run this whole thing again from scratch ( No worries this was to be expected ;) ). Basically I notice that it didn't render the HDR videos and seems to instead takes my regular .MOV files (non HDR) and renders those as if even tho it wasn't HDR. Strange?
Also noticed it didn't spit out .MOV's for all MLV's... Perhaps it got stopped somehow (tried again and still wouldn't produce - I'll have to look into this and figure out why/how?
Here I recorded via screen flow to show you what I've notice... Kind of difficult to explain so I hope this would be easier for you to understand where I'm coming from.
This is all done after the rendering was done overnight.
**Notice the strange flicker pattern? It's due to Vimeo's conversion takes it from 60p to 30p lol -- I'll also be testing another round with selective HDR videos into a separate folder to see if that would help as well as using the MLV file from earlier (Dodgers Stadium) to verify the brightness settings for .MOV files...
STAND BY!
I'm hoping this is an human error on my part.... hmmm?
**EDIT Part 2 (Dodgers Stadium)**
Here's what happens when I tried the same footage again from scratch...
Not sure why it won't run it?
**EDIT Part 3**
Turns out that it was in fact an error on my part because for some reason I assumed that all files could be just in the first parental directory before rendering the app 2nd time. I just took all the MLV's and placed them into the PRORES folder that was created by the app (as well as placing the HDR videos into the HDR_RAW folder) :o
This problem only occurred with the 262.25 GB folder which is connected via USB 3.0 to an external hardrive -- if I take one MLV file and placed that into a separate folder on my desktop which seems to work fine? I haven't tested as a whole because I only have 140 GB of space on my Mac Mini's SSD. I find this Strange!
I feel like I should wait before starting all over again once you get the new update released -- or is it possible to keep the converted cdng's and hope they will work with the next update or would that still cause problems?
Sorry about the mess and my fault on this one!
Took the HDR .mov files out from the BTS Promo Folder that 'wouldn't work' earlier and placed them into a new Folder.
Apparently it did the trick.
Here's an quick example...
BUT still wouldn't produce a .MOV file (because of my error from earlier due to NOT putting the MLV file inside the created folder "PRORES" from cr2hdr-r. MY BAD!)
*EDIT*
Here's the overall experience...
*Sneak Peak: HDR Video (Pre/Post-cr2hdr-r)*
FYI -- I also notice that the app STILL converts non-HDR videos ( it messes up the framerate and becomes a bit CHOPPY )http://vimeo.com/119064904 (http://vimeo.com/119064904) and maybe you are already aware of this since its basically still in BETA mode. ;)
*EDIT* HDR-videos (PRE-cr2hdr-r):
HDR-videos (POST-cr2hdr-r):
Thanks for posts, I,ll check them after work. About .MOV it will convert all files called .MOV put in the parental folder so only put in hdr .MOV in there.
About PRORES and HDR_RAW folder , they are still very beta.
Bug on my external hard drive is still exiftool randomly messing with frames. I do transcodes on my nternal drive. This is, or was a bug on mac side last I read about it. Might have gone away in Yosemite, not sure.
Thanks for efforts. I,d skip the PRORES and HDR_RAW action for now if I were in your shoes.
/D
Makes sense. Thanks, Danne!
Also it's now spitting out .MOV's for each MLV one at a time before I get prompted encountered with the error window.
Seems I have to do it manually after each MLV file renders. It's now getting more strange.
I'll just have to clean up the files and folders into original spots... perhaps start over again with 1.8 instead?
MLVFS would totally be awesome but it just takes forrrrever!
Yeah, 1.8 is the safest bet right now. THe RAW, MLV processing HDR is a slow one. I would recommend shooting raw, mlv HDR and transcode to ProRes using MLRawviewer and then put the MOV files in 1.8 app. ANdrew got all luts and white balance thing working really good. Something I can,t say in my workflow ;)
Deleted, found some bugs
cr2hdr-r 2.1
https://drive.google.com/file/d/0B4tCJMlOYfircDVWZGZMZ1FOQ3M/view?usp=sharing
New try. The app works as version 1.8 but with these addings below.
As in version 2.0 it creates two folders on first run inside the parent folder. "PRORES" and "HDR_RAW_MLV". Put files in these newly folders if you like these transcodings. Run the app again from the "parent folder", not from the newly created folders. See pics.
Should work more stable now. "HDR_RAW_MLV" is pretty slow but try it out if you like :). HDR scripts comes from Jerrykil. WOuld be fun to see it get some usage :)
1
(http://s15.postimg.org/5mvd7jck7/Screen_Shot_2015_02_06_at_12_27_25.png) (http://postimg.org/image/5mvd7jck7/)
2
(http://s15.postimg.org/x8y4s7vx3/Screen_Shot_2015_02_06_at_12_27_56.png) (http://postimg.org/image/x8y4s7vx3/)
3
(http://s15.postimg.org/k7cg2d7iv/Screen_Shot_2015_02_06_at_12_28_52.png) (http://postimg.org/image/k7cg2d7iv/)
Thanks @Danne -- It's actually really nice to be able to wake up and get an PM from you regarding your App's update.
Wish I could be more of a help regarding BUG's... so I have a bunch of already converted Dual-ISO's DNG's created from pretty much all of the MLV's from Saturday's BTS shoot.
My question is... can I Just keep these as it is and put them in the parental directory before I run your latest update?
Also I just realized that I shot the HDR-Videos in .MOV from the 5D3 (not RAW) would that be an issue if I were to place the .mov HDR videos into the HDR_RAW folder created by cr2hdr-r?
I think I should have known better... guess I'll need to SLOOOOOW down! lol
Do you mean already converted DNG files? I would put them aside as the app will maybe run same level on them. Not sure since I could have changed this.
Guess I was hoping that once the DNG's are already converted (but haven't process the .MOV's yet) will it pick up from there and spit out MOV's?
Because I just tried and it didn't work so seems like I'll have to delete all the already converted DNG's (from 2.0) and just start from stratch with the MLV's...
I won't be using the HDR-video .MOV's since they are already converted and look fine (now I wish I had shot HDR in RAW and not h.264 in my 5D3) haha.
*edit*
In other words.. I also tried using MLRV 1.4.3 to play back the DNG's (from your app) which looks really nice (can fix WB, add LUT's) and export them as ProRes but then it would crash after spitting out 3 or 4 .MOV's from MLRV (I already sent CR to @Baldand)
However, I've also tried this again with both MLRV 1.3.4 & 1.3.3 versions and get same results. (crashes after 3-4 .MOV 's)
Could this be related to your converted DNG's (Dual-ISO MLV) because not sure if I need to do this the other way around? ( MLRV > cr2hdr-r > AE )
Thoughts?
Last I tried running dual iso converted DNG files it seemed to work fine in mlrv. Havnt done any big batches though. Can try at home.
Seems the brightness comes out well regarding ProRes from regular MLV's @ Dodgers Stadium. 8)
Currently I'm running a quick test before I go ahead and redo that large folder again from recent BTS. Just need to get a bunch of .MOV's rendered ( prefer to use LUT's within MLRV but the frequent crashing is driving me NUTS even on this modified MacMini which I don't understand either <-- I uninstalled CUDA/NIVIDA just last week: could this be related to such random issues @baldand? ) but as long as I get them done by end of this week on Friday then all will be fine.
Fun stuff! :P
*EDIT*
I just swapped converted DNG's Folders out of PRORES folder and replaced w Original MLV's to start from scratch again because it wouldn't run it for some reason the other way around.
I plan on deleting the DNG's after I get all the ProRes .MOV's rendered (I know it sounds dumb but seems to be the only way atm unless you could somehow provide an option to ONLY spit out ProRes without DNG's OR just have it run off the already converted DNG's to spit out ProRes as is? I know I could have used MLRV instead but it still crashes on me.. lol got too many Dual-ISO MLV's so I would still prefer your app) However, I can view DNG's in playback fine within AE, PP, FCPX but DR11 just lags so bad.
Awesome app, thanks for sharing. I noticed dcraw had been updated to 9.23, I've got my compiler finally working so I compiled the newest version for Mac.
https://drive.google.com/file/d/0B0Yw9C0TiMN_UjBCaVdVWGh0emc/view?usp=sharing
Good Call @N/A!
Thanks N/A. I,ll update if it doesn,t give me that greenish picture I got from another compile :).
Havn,t included an option for DNG to PorRes but could probably be done Deafeye.
Nice. So should I just let it continue and do its thing all day, possible overnight again?
Hope for good things to come in the AM... ha!
Thanks again, D.
Sure, why not :). Let,s hope for the best. Many things can happen. Fingers crossed.
Quote from: Danne on February 09, 2015, 11:01:00 PM
Thanks N/A. I,ll update if it doesn,t give me that greenish picture I got from another compile :).
Lol I hope not, no warnings or errors when I compiled so I think we're safe
Quote from: Danne on February 09, 2015, 11:24:07 PM
Sure, why not :). Let,s hope for the best. Many things can happen. Fingers crossed.
Deleted the 260 GB worth of previously converted DNG's to free up space on my eHD because I did the math and it wouldn't be enough to double the space with the newly converted combined with the old so I didn't want to chance it. ;D
Quote from: N/A on February 09, 2015, 11:48:15 PM
Lol I hope not, no warnings or errors when I compiled so I think we're safe
Sounds good!
FYI regarding 2.1 update -- it goes through all RAW files just fine with ProRes...
As for MLV -- it stops after each ProRes renders meaning I would have to be on the look out and manually restart your app after each MLV files.
In case you were curious...
Crap. Multiple MLV files. One of the few scenarios I missed to check.
Updated the 2.1 link with this link.
cr2hdr-r 2.1
https://drive.google.com/file/d/0B4tCJMlOYfircDVWZGZMZ1FOQ3M/view?usp=sharing
Should work better now. Please report if other things are screwy. Could be sound , aspect ratio, etc since there are several alternative transcoding alternatives in the script.
*Feedbacks Regarding 2.1*
Dual-ISO MLV seems to be spitting out 2-3+ stops OE .mov's within PRORES.
Regular MLV PRORES .mov's are fine atm.
https://vimeo.com/119210801 (https://vimeo.com/119210801)
Question -- is it correct that your app produces 422 HQ ProRes .mov's whereas MLRV does 4444 ProRes or no?
*EDIT*
Forgot to mention that two footage I'm comparing this with in this clip (lower right) is an actual .MOV file directly from MLRV 1.4.3 which used converted Dual-ISO DNG's made from your app in case you were wondering.
Changed the download link again. Will check your bug later.
Thanks
Regarding Dual iso, I overeposure 20+ in dcraw. Gotta find some other way to handle those files to get a flat look. If I,m leaving them they are really, really dark so don,t know if ProRes 10bit would pick up the dynamic range coming out that way.
No problem.
Off to bed.
*EDIT*
Here's the comparison after the latest update regarding Dual-ISO MLV's spitting out .mov's OE... it's a little better. I wonder if it's because I didn't maximize the ETTR effect properly in my 5D3 which may be the reason why it looks like that? No?
http://vimeo.com/119215440 (http://vimeo.com/119215440)
Top left: cr2hdr-r 2.1
Bottom Right: MLRV 1.4.3
Actual .MOV's viewing comparisons between cr2hdr-r 2.1 & MLRV 1.4.3...
Cr2hdr-r
http://vimeo.com/119217224 (http://vimeo.com/119217224)
MLRV
http://vimeo.com/119217225 (http://vimeo.com/119217225)
Cr2hdr-r
http://vimeo.com/119215907 (http://vimeo.com/119215907)
MLRV
http://vimeo.com/119215906 (http://vimeo.com/119215906)
Those are good files to work with creating a good flat look on dual iso movie files to ProRes. Keep them and we try transoding when I got some flat luts going on.
Thanks
Sounds good.
Just let me know if you need the original Dual-ISO MLV's (or DNG's) for you to work with personally?
Not sure if that would help with the mathematics on your end?
Just a thought... What do you think of adjusting the OE to +18 (or +20 if you prefer) with HL toned down to -20ish (or more) along with a little contrast (+8ish) or whatever you like?
Would that help with the noise from being somewhat too obvious regarding the .mov ProRes files from Dual-ISO MLV's?
I think a lut is the way to start. I tried fiddling with gamma in dcraw but it lacks contrast and efficient highlight recovery. Got some progress with gamma changes in ffmpeg but the settings applied are still very insufficient.
you could try dcraw yourself actually. Open up terminal And write
dcraw
enter
check the alternatives to apply.
You can apply changes and convert a dng to a tiff file to see. In terminal write
example
dcraw -T -b 20 drag dng file here
enter
This will give you a brigthened (-b 20) tiff (-T) file. Tried highlight rcovery but leveling dual iso file was to hard to achieve.
Your not gonna get that much DR into a 10bit container (ProRes etc) without a log transform. A gamma function is not sufficient and you need to map the linear code values to log to be able to invert properly. I'm on it ;)
I'm thinking this will be a job for Log-C or Slog3. I don't think Cineon is enough but I'll find out.
Awesome Andy :). All input regarding this is most welcome.
Great inputs, @Andy600!
Looking forward to the progress...
[emoji106]
Quote from: Danne on February 10, 2015, 10:45:45 PM
you could try dcraw yourself actually.
Thanks, D for that. I'll definitely try it out myself since I don't mind fiddling with Terminal when timing persist. lol
*Feedbacks*
Just wanted to give a heads up regarding ProRes .mov's -- seems the Audio is corrupted in varieties of ways. I wonder if it's because of how I had to combined 5 CF cards filled with a bunch of RAW/MLV's, Dual-ISO, HDR, etc all together which included files with same names such as "mlv_rec.tmp" would have some kind of a negativity effect or perhaps confusion to your app?
(https://farm8.staticflickr.com/7295/15877099854_1a2e53376a_n.jpg) (https://flic.kr/p/qc1hCW)
Noticed that these files are still sitting in the PRORES folder after the app is done... is this normal or no?
Let me know what's the best way to show you some of the ProRes .mov's other than Vimeo?
Thanks fr feedback. Seems it converts and separates processes at the moment.
Will look into the tmp. Think it,s from the mlv files but those shouldn,t have to do with audio.
Have to look further regarding audio. You could test some audio files and see if you could narrow down anything.
Thanks
Are those mlv_rec tmp files not coming from your card which are created when recording MLV?
well when I go down to bottom of the DNG folder next to the last .dng file where you can locate the actual audio file (.wav) which playbacks fine in previews or iTunes.
But when playing the ProRes .mov file itself... it sounds like the audio would be chopping in and out (or sometimes speeds up and finishes it before the footage ends) since you say it shouldn't have anything to do with the mlv_rec.tmp files being combined which automatically changes the name to ".copy" and ".copy 2" you know that, right?
Quote from: Danne on February 11, 2015, 10:50:44 AM
Are those mlv_rec tmp files not coming from your card which are created when recording MLV?
Yes, they were dragged over directly from all the CF cards. I still have them with the original footage unformatted if that helps?
I was just unsure whether it was a good idea when I combined 260 worth of RAW/MLV all together because 3 out of the 5 cards had mlv_re.tmp files (If I can recall correctly) and was prompted to 'replace files or keep all' which I knew I had to keep all otherwise I could lose Audio though I'll double check if need to.
Are there sync issues?
The audio is chopped of in the end but just a few frames. This is to fit with resolve. I could however skip that part when creating PRORES files. Either I let the file continue the extra frames which will let the file be alittle too long in the end or I can have ffmpeg cut the audio to fit the shorter movie file. Can you upload some examples ProRes for me to check?
The rec_tmp file I don,t think would be needed for audio with the files.
I'm not quite sure yet actually but sure let me pick a few MLV ProRes .mov's for me to upload into Vimeo overnight and have it to you by tomorrow.
*more feedbacks*
(https://farm8.staticflickr.com/7380/16499952755_93d9c84095_n.jpg) (https://flic.kr/p/r93z74)
Guess it wouldn't spit out .mov's for MLV with spanned files?
I'll try it again overnight as well.
THanks, D!
It supposed to take spanned files and create a mov with those dng files. Not working?
You could dopbox some prores examples? I,d like to inspect the audio issues.
Sure if it doesn't take too long?
Should be fine. Have a good broadband connection here. Did you get the spanned mlv files to create a .mov files or was that a problem?
Thanks for help
Sounds fine now all of a sudden? Strange. I guess it was because I was looking through .mov's and playing them in Previews while your app was running in the background which could have cause the choppy playback with the audio?
Here I uploaded a few ProRes from MLV's... good thing we both have decent broadband connections! 8)
For_@Danne (https://www.dropbox.com/sh/r4d98flewdu7uhk/AAACiwuWea6cDXBsCz6vcp_na?dl=0For_@Danne)
Let me know if you rather have me not post this link on this thread for others to see? If so, please delete this post!
Goodnight, D!
*feedbacks*
Sorry couldn't sleep on this one! ;D
Regarding MLV spanned files after 2nd & 3rd attempts...
(https://farm9.staticflickr.com/8612/16499270362_37d8c4269c_n.jpg) (https://flic.kr/p/r8Z5fE)
(https://farm8.staticflickr.com/7300/16500283875_c0bfb306c0_n.jpg) (https://flic.kr/p/r95gx2)
Obviously the ProRes .mov just stops producing because the app won't pick up the rest from spanned files?
Thanks. Will check
Think I found the bug. Too long argument. Will try to fix tonight or tomorrow.
In response to your latest update from this AM regarding long spanned files.
Seems to work well for a MLV with over 7k DNG's and spanned files are placed in their original folder respectively.
(https://farm9.staticflickr.com/8574/16477898026_2d2562bb53_n.jpg) (https://flic.kr/p/r76x17)
https://vimeo.com/119374867 (https://vimeo.com/119374867)
Thanks. Problem is when trying to create a ProRes file from PRORES folder ;)
Ah sorry thought I was doing it in the proper way of placing the MLV's in the PRORES folder to spit out .mov's, right? :o
Also tried again with the non-cr2hdr-r_Long (just cr2hdr-r 2.1) and still wouldn't produced spanned MLV's (over 6k dng's) as expected per your suggestion...
I know you mentioned that you will be working on a fix sometime this week or whenever's convenient for you.
MLRV spits out ProRes 4444 HQ just fine but Audio seems to run shorter than the footage itself by several seconds towards the end.
Hopefully that won't be the issue with your next update! ;)
Thanks!
Gonna fix the audio thing. HArder though to get the huge file transcoding issue out of the way. I see what I can do.
Let me know if you want me to upload a large MLV (slightly over 8gb) for you if that would help on your end?
Not sure if it would because you can record it yourself from home w 5D3, right? lol
cr2hdr-r 2.6
- Added dcraw compile from N/A, thanks!
- MLV files to ProRes. Should work with all combinations, dual iso, audio, big files and so on. Please test if possible
- Audio. should work now.
- ProRes should be 444 now.
Todo
- Raw to ProRes. Same as MLV. It is working but bigger files might have a problem transcoding to ProRes. Try if possible.
- Waiting for a Lut from Andy600 to fit with dual iso ProRes files.
@Danne:
Now that's a massive update there you got... Wish I could just quit this job for a day and go home to play with this toy!
I'll have my 2006 MBP with me (in case I have downtime at work) then definitely will give this a try!
Would it also work with MLV's produced from FRPS (Timelapse) if I were to use this app?
THANKS AGAIN!
;D
cr2hdr-r 2.6b
https://drive.google.com/file/d/0B4tCJMlOYfirVlAzTVBxZWUyZG8/view?usp=sharing
cr2hdr-r 2.6d
https://drive.google.com/file/d/0B4tCJMlOYfirTTF6Y3N4aW9WOGc/view?usp=sharing
Small fixes.
Don,t know about frsp, you could try. Have not tried this feature and converted. Might need a newly compiled MLV_dump?
Just got home. Gotta get up early again tmw for work.
*feedbacks*
Definitely organizes files into respective folders better. (goes into PRORES folder this time) :D
Currently spitting ProRes 444 HQ is definitly taking a bit longer than usual which is to be expected.
Looking good so far! (will check out .mov file to verify Audio tmw AM before work)
(https://farm8.staticflickr.com/7383/15905521613_9c662aecda_n.jpg) (https://flic.kr/p/qevXrg)
Perhaps depending on the projects itself obviously -- if we could use an option to choose 422 or 444 or just plain good old DNG's, that would be killer!
Will also test out HDR Raw along with Dual-ISO again to verify the brightness via .mov files as well as MLV's from FRSP.
Thanks again and be in touch brother!
GN
Plain old dngs is outside the Prores folder still right?
Optional stuff could be done in different folders. Dont know about selectors and stuff. Might put in alternative folders within the ProRes folders.
Also curious what could be done about whitebalance. Right now it is on dcraw auto.
Thanks for feedback :)
Quote from: Danne on February 14, 2015, 11:30:37 AM
Plain old dngs is outside the Prores folder still right?
looks like it does?
(https://farm8.staticflickr.com/7344/16526129495_e007af9fc2_n.jpg) (https://flic.kr/p/rbmJxa)
Quote from: Danne on February 14, 2015, 11:30:37 AM
Also curious what could be done about whitebalance. Right now it is on dcraw auto.
Looks like the dcraw auto is producing different WB from as shot?
(https://farm8.staticflickr.com/7309/16339822389_d6c380b10d_n.jpg) (https://flic.kr/p/qTTRVF)
Also noticed the ProRes 4444 .mov came out shorter than the one from MLRV. no?
How much shorter?
Ffmpeg does a cut from which file is shortest, either audio or video. I could skip this cutting feature and video will probably be i tiny bit shorter than audio.
cr2hdr-r 2.6d
more fixin´
https://drive.google.com/file/d/0B4tCJMlOYfirTTF6Y3N4aW9WOGc/view?usp=sharing
Which commands do you use for dcraw? dcraw uses color matrices from adobe dng converter but I think someone said in another thread that they're outdated. Does -w work better? On a sidenote, there was an updated version (9.23.0) posted yesterday, I'll see if I can compile that one soon. On overtime right now, I really need to figure out how to compile c for os x on my android based galaxy lol.
I put in -w and it seems following whitebalance from dng metadata which is promising for mlv-files. Lesser so for RAW ;).
Here,s the automator file with -w set on MLV to ProRes (havn,t set this for RAW)
cr2hdr-r_2.6d_wb_no_short.app
https://drive.google.com/file/d/0B4tCJMlOYfird09lcXdvQnh5dkE/view?usp=sharing
Updated version of dcraw 9.23
https://drive.google.com/file/d/0B0Yw9C0TiMN_UjBCaVdVWGh0emc/view?usp=sharing
Awesome.
Will be in hopefully until monday latest.
Good to know regarding dcraw's frequent updates @N/A!
About Dcraw Auto which is actually a pretty cool feature and can be useful for some
scenarios I would suppose?
Currently on my way into work...
Have the MBP W me just in case I have downtime... [emoji2]
Thanks, D!
Might include some presets for raw (xml files with tungsten, daylight etc) and go with mlv settings for mlv?
Hmmm... Similar to MLRV?
Preset buttons 1,2,3?
*whew* I'm finally off tmw and will get to the bottom of this with you then!
SJ
Question/Theory:
Do you often find yourself having to locate which RAW/MLV was shot in HDR video because if I throw them all in PRORES folder it won't do the HDR render unless I separate them which I expected but just a thought... could it be possible for it to detect HDR videos if I were to throw it in PRORES folder and automatically spits it into the HDR folder?
Otherwise I'll just view the MLV/RAW's through MLRV first in beforehand which works fine atm. I don't mind, really! :D
Just a thought... and I'm currently testing the latest '2.6d_wb_no_short' and looking forward to Monday's update! lol
SJ
*feedback*
Re: dcraw_auto seems to run through the entire DNG's thus changing the WB constantly rather than just from the first frame and stick to it? (won't that help... no?)
https://vimeo.com/119672350 (https://vimeo.com/119672350)
Top Left - cr2hdr-r / Bottom Right - MLRV
*edit*
Notice one footage is shorter than the other.
Yup. Think that is the non linear way again. Have you tried the last uploaded version which is supposed to use the camera settings (mlv)?
I downloaded the latest one ( 2.6d_wb_no_short ) from your last PM. I double checked with the one from your link on this thread in recent post. Same?
Am I not on the latest one?
Hi! Are you saying you get inconsistent white balance with this version?
cr2hdr-r_2.6d_wb_no_short.app
https://drive.google.com/file/d/0B4tCJMlOYfird09lcXdvQnh5dkE/view?usp=sharing
COuld be inconsistencies with mlv-files then since It is not set on auto.
Could you perhaps run a version with the auto wb set with this and see which one is more correct?
cOuld be auto actually produces more linear results than native MLV wb. Not sure.
Thanks
Correct -- hence the vimeo clip or I can upload original files for you to see what I mean?
Can I just move the current .mov out from the prores folder and run the app again with earlier version per your suggestion -- would that work as it should, right?
however I will test them again with both versions in the AM to verify!
Eyes are bloodshot.
Burns like a mother...
*EDIT*
Actually I was wrong on that. I may have accidentally clicked on the older version application icon on my dock. My wrong. (it's rather confusing at times when I'm trying out all sorts of versions and the info still saying '1.2' so I have to keep reminding myself to rename the app name with extension so I know which is which. Argh!)
Take 2 coming up.
Cool.
Got to make sure dcraw actually is choosing the mlv wb and not defaulting to an auto wb but that would be shown in a comparison. I will do some testing tomorrow if you are busy. No hurry. No need for uploads but do check that mlv file and dcraw wb are the same. You can compare by opening a dng in acr.
Tried the trick that I was hoping to work. Deleted old .mov file and placed the Folder (w converted DNG's) into ProRes folder and run the app again.
Just starts spitting out .mov's which is nice.
Re: about WB between Pre/Post.
Pre (DNG exported from MLRV)
(https://farm8.staticflickr.com/7425/16515291856_ff7f8e5d20_n.jpg) (https://flic.kr/p/rapbTj)
Post (DNG exported from cr2hdr-r)
(https://farm8.staticflickr.com/7436/16515291836_cc237337cb_n.jpg) (https://flic.kr/p/rapbSY)
I doubt a change of +100 would make a difference from dcraw auto (or let alone be the reason of inconsistent WB)? I went through the entire DNG's to see if WB was inconsistence through it all but stays at constant 5100, strange it doesn't look like that in video?
Well time will only tell while your 'cr2hdr_long.app' is currently rendering the same MLV from the video I showed earlier. Hopefully it'll be more consistence this time!
Thanks, D!
Not sure if this would help because I don't know if dcraw auto produces the same 'auto' within ACR?
As shot WB within ACR:
(https://farm8.staticflickr.com/7417/16365491037_2961e6ffca_n.jpg) (https://flic.kr/p/qWaqjz)
Auto enabled WB within ACR:
(https://farm9.staticflickr.com/8645/15931226633_1447ea900d_n.jpg) (https://flic.kr/p/qgMGDg)
*Next time I should use a grey card in this particular shot with tungsten light coming in from the lamp in the back behind him along with a 27" inch monitor from his right hand side that produces cooler (blue desktop wallpaper) colors so I set my 5D3 to 5100 in order to compensate for his face (although the background is too warm but NOT sure if this could be a factor regarding dcraw auto being 'confused' somehow?* <--- I also thought this scenario wouldn't be a good way to test dcraw auto as well?
WB Comparisons Part 2 ( cr2hdr-r / MLRV ):
https://vimeo.com/119781083 (https://vimeo.com/119781083)
DNG's were converted via cr2hdr-r in case you were curious.
Also I've given up testing with this particular MLV file (has too many spanned files) so from here on out I'll be using smaller sizes in varieties (Dual-iSO, RAW/MLV, HDR Raw, etc)
One thing I thought it was strange was the fact that I somehow lost one of the two RAW files (shot in HDR Video) which were placed into the HDR_RAW_MLV folder before running app the 2nd time and it produced strange files. Like the name would change on one of the MLV file. Good thing these were just crappy footages I shot in HDR for beta testing purposes! ;D
https://vimeo.com/119782661 (https://vimeo.com/119782661)
Will try again today to see if I can produce this bug with all three different versions that I have (cr2hdr_r_2.6d, wb_no_short, _long) unless told otherwise if that would help narrow down this bug regarding HDR videos?
Thought we were allowed to shoot HDR videos in RAW/MLV and not just H.264, correct?
Im still working on the HDR-raw workflow. The originals should move to a folder within Originals folder though. The movie file created will be deleted and the merged files will produce a new version. I have a version coming soon.
Regarding dcraw wb I think mlv is set to some stuck aSshot numbers so migt look for a different solution. I was thinking of grabbing the first multiplier settings from dcraw auto and apply this to the prores file. Problem right now I cant get tee or awk to print out the numbers to a txt file altough theyre clearly showing in terminal. Strange.
You could test some short mlv files but maybe better wait for the next beta. It, s your call.
Thanks for feedback. Willcheck vids tomorrow.
No problem. Sounds good. I ended up just using all your ProRes (non dual-ISO) & instead used your DNG's (from Dual-ISO) and exported .mov's from MLRV and combined them all together in PP and currently exporting Dailies from the last BTS I shot to drop off to the client.
Also doing the same (on 2006 MBP) via MLVFS just to see the comparisons.
May be too large to handle though... (260+ GB total of footage)
Fingers are crossed!
lol
hehe. Yeah. Mlrv is the way too go. My app is still a big bunch of experiments :). 1.8 version is still to be trusted. I guess ;).
I got some outputs from dcraw going so gonna start experimenting with those numbers a bit tomorrow.
cr2hdr-r 2.7
https://drive.google.com/file/d/0B4tCJMlOYfirSGhONUszLUtYcEE/view?usp=sharing
- Linear auto white balance when creating ProRes files
The app picks the wb multipliers from the first file and applies that auto white balance setting to the whole file. SHould prevent from wb variations.
- HDR_RAW_MLV_MOV
as it says. Put all files you want to create hdr files from in this folder.
All else is running as before, dual iso and such.
The app should be more robust. Regarding MLV to ProRes they should run all kinds, coming from dual iso, with or without audio and so on. Also big files should work.
Raw to ProRes works but there is more to be done here. Huge files might be an issue.
Still working for getting some sort of lut applied to dualiso files.
Audio might need some rework.
This is beta ;)
Does HDR refer to dual ISO?
Not really. Dual iso is still running in parent folder and is more or less automated. If it is not a dual iso file it will detect what it is and progress accordingly. HDR_RAW_MLV_MOV is an extra folder/feature to try out. Film in at least 48, 50 or 60 fps when you do :)
What does it do? Is it like the interleaved HDR frames of yore? I'm just not familiar with HDR in the context of MLV.
It,s merging the frames as when filming in regular h.264 .MOV setting. Only difference you have to film in 48, 50 or 60 fps also in raw or mlv. When transcoding in post it merges the frames creating a new file in 30, 25, or 24 fps depending on original file. It also corrects the distorted aspect ratio.
It,s more or less for fun but Jerrykil created a nice script which also merges audio to the final file.
According to Andy600
QuoteA 3D lut for linear to log conversion is not recommended as it relies heavily on interpolation, doesn't map code values correctly and should only ever be used for end-to-end raw grading.
Shortcomings with ffmpeg lut implementation make me go for experimenting with the means available. A work in progress. Might not work in the end.
Experimenting with inserting a lut to dual iso to ProRes files. Since ffmpeg won,t take 1d luts( Thanks to Andy600 for checking out), I found one lut which I liked to start off with that actually worked. It is a lut called ML_RAW_to_LOG_LUT.CUBE which Andy600 created and put up in a forumlink here. In conjunction with curves in photoshop, a preset which also can be inserted to ffmpeg together with a lut, I think I got some progress in getting a good file to work with. HEre are some comparisons.
Examples are graded
printscreens so quality only for fast viewing purposes.
Andy600 ML_RAW_to_LOG_LUT.CUBE
(http://s9.postimg.org/ukbdnl5u7/image.jpg)
Andy600 ML_RAW_to_LOG_LUT.CUBE + curves preset(mine)
(http://s9.postimg.org/byd7n3ikv/image.jpg)
Andy600 ML_RAW_to_LOG_LUT.CUBE
(http://s9.postimg.org/7k4qb980f/image.jpg)
Andy600 ML_RAW_to_LOG_LUT.CUBE + curves preset(mine)
(http://s9.postimg.org/4fu2egr7z/image.jpg)
Andy600 ML_RAW_to_LOG_LUT.CUBE
(http://s9.postimg.org/5gub3l87j/image.jpg)
Andy600 ML_RAW_to_LOG_LUT.CUBE + curves preset(mine)
(http://s9.postimg.org/p18u6d8sv/image.jpg)
Beautiful... Thanks for sharing @Danne! [emoji119]
It's actually nice to be able to view footage with MLRV while your app is doing the work(s) in the background.
This feels so good... 8)
(https://farm8.staticflickr.com/7436/15958150313_ef37218dab_n.jpg) (https://flic.kr/p/qjaG7D)
Quote from: Danne on February 18, 2015, 08:32:19 PM
According to Andy600
It is a lut called ML_RAW_to_LOG_LUT.CUBE which Andy600 created and put up in a forumlink here.
Do I locate this from LUT BANK on Andy's Cinelog's site?
As for know there is no lut provided and the one I got is not optimal. Andy600 will hand me over a few alternatives to look into, after that we,ll see if it is practical enough to implement. Things that could occur is ffmpeg lut implementation won,t be good enough or if it takes too long rendering to ProRes with the lut inmplemented. LEt,s wait and see after I checked some luts when I get them.
Ah makes sense. Sounds good, D!
cr2hdr-r_3.4https://drive.google.com/file/d/0B4tCJMlOYfirRXd6YVVFQURMak0/view?usp=sharing
Hi guys!
- Two updates.
- Multithreading RAW/MLV to ProRes encoding. (My computer fan is singing) I leave no warranties if anything happens here! Be careful. My computer still working 8).
- Implemented a really fine lut, created by
Andy600, when transcoding to ProRes with dual iso raw/mlv files.
The lut is specially made for use with cr2dhr dual iso movie files. There are drawbacks with ffmpeg lut implementation.
Important
Quote"3d luts are really not recommended for this type of thing because they have insufficient code values and produce rounding errors - colors can also be clipped because they are debayered in FFMpeg to sRGB (an output referred colorspace)"Andy600.
I am using ffmpeg with dng files piped from dcraw. White balance is set to auto. The philosophy here is for fast automated ready to use ProRes files coming from dual iso. I think it is achieved much thanks to Andys lut. You be the judge. Andy provides three luts in the packackage. Inserted to the script is the "Andy600_lin_to_log.cube" lut. Below some examples. Beutiful dynamic range.
Thanks a lot Andy600!
Check out the dynamic range coming from dual iso files. Amazing.
Going from dual iso original - Andy600_lin_to_log.cube - Andy600_lin_to_REC709.cube
(http://s27.postimg.org/5l44kbdf7/image.jpg)
(http://s27.postimg.org/j4kyq0reb/image.jpg)
(http://s10.postimg.org/yxb2c0tbd/image.jpg)
(http://s27.postimg.org/jlarq74j7/image.jpg)
(http://s27.postimg.org/6kufg0skz/image.jpg)
(http://s10.postimg.org/zcmc51f8p/image.jpg)
(http://s27.postimg.org/rlkh0xw37/image.jpg)
(http://s27.postimg.org/nvku81k8j/image.jpg)
(http://s10.postimg.org/lqlmchxm1/image.jpg)
(http://s27.postimg.org/ilfvgqzzn/image.jpg)
(http://s27.postimg.org/km6f1kw4z/image.jpg)
(http://s10.postimg.org/u2hddquzt/image.jpg)
(http://s27.postimg.org/8lkz0uoqb/image.jpg)
(http://s27.postimg.org/qyq5p5okz/image.jpg)
(http://s10.postimg.org/3vg6hscq1/image.jpg)
(http://s27.postimg.org/ib8cxeldf/image.jpg)
(http://s27.postimg.org/jimapmbhv/image.jpg)
(http://s10.postimg.org/yltlz9cvd/image.jpg)
Woke up this AM and noticed 3.4 was still singing in my MBP (total 38 GB worth of footage) towards the end on the last few MLV files...
Looking forward to seeing results as soon as I get back into the hotel tonight!
[emoji108]
Nice! I,m working on multithreading HDR_RAW_MLV folder at the moment...
Nice!!! Also seems the proper order of renderings per 3.4 as it follows:
1) CR2 files
2) ProRes folder
3) RAW_MLV_Mov_HDR
Is this always going to be this way?
Asking because if I wanted to see HDR results right away -- then I would separate HDR into another parent folder & run a 2nd copy version of 3.4!
That way it'll render the HDR videos right away while the other will just do its thing...
Basically like run two separate 3.4's seamlessly at the same time... Worth it?
cr2hdr-r 3.6
https://drive.google.com/file/d/0B4tCJMlOYfireWFsanMxcTQzYnM/view?usp=sharing
All processes are now multithreaded.
Fun Stuff from 3.6...
5D3 HDR-Video:
http://vimeo.com/120761009 (http://vimeo.com/120761009)
5D3 Dual-ISO (100/1600):
https://vimeo.com/120761007 (https://vimeo.com/120761007)
On this one I intentionally pushed the EV a bit too much but hey this is just for fun, right?
8)
5D3 HDR-Video Take TWO:
https://vimeo.com/120767359 (https://vimeo.com/120767359)
Cool stuff
cr2hdr-r v 3.8b
https://drive.google.com/file/d/0B4tCJMlOYfirZEJGaFVoaFdrSnc/view?usp=sharing
This beta gives control over wb with the help of a greycard. When including a silent picture DNG of neutral white or grey the dcraw will measure the middle of the "greycard" silent DNG and apply that to the files you selected in a subfolder. This way you will have consistently control over white balance. Check the video.
Be careful, it is all beta, no warranties.
White balance control
https://www.youtube.com/watch?v=S5SAnakpum0&list=UUomeOeghS6wanMOCQ8BtH_A
Got an ok from Visioncolor to use the BMDFilm to VisionLOG-RAW.cube on regular RAW/MLV to ProRes files. Let,s test and see. It is in the version.
Such a fantastic app for MLV on our OSX machines. Running quietly and really fast in background, and i love the organization it does (MLVs in the "originals" File, that's great) !
Keep up the good work Danne !
Thanks. Glad you like it and use it.
It is all g3gg0, Alex and a bunch of other fine programmers that inspires me to create some good workflows so I can get most out of my filming.
Next up is lut support for prores and refining some other stuff :)
*feedbacks*
After running 3.8b twice to make sure it gets all the files properly. Only to find a few in HDR and a few in ProRes seem to STILL have few .mov's with popping up "Quicktime Can't convert" errors... not sure why though?
Also notice the auto stretch for slo mo's don't always work and some come out stretched out weirdly too.
https://vimeo.com/120999131 (https://vimeo.com/120999131)
Thanks, D!
Thanks Deafeyejedi!
Is the file empty the isn,t being able to read in quicktime? Sometimes the transcoder will do this. I,ll see if I can narrow down the problem.
Autostrecth is detected through aspect ratios from 5d mark 3. Did the problem come in HDR or PRORES folder?
Yes. The .mov file is empty from both MLV & HDR (0 kb):
(https://farm9.staticflickr.com/8574/16504290200_e5958b6d9d_n.jpg) (https://flic.kr/p/r9qNtA)(https://farm9.staticflickr.com/8601/16071719343_cc2ab0ca3e_n.jpg) (https://flic.kr/p/qucLen)
Auto-stretch seemed to be problematic for both HDR & ProRes (randomly though):
(https://farm9.staticflickr.com/8600/16666000916_cda7e058c4_n.jpg) (https://flic.kr/p/roHBro)(https://farm9.staticflickr.com/8646/16071720013_2565466a18_n.jpg) (https://flic.kr/p/qucLqV)
Spanned Files Bug?:
(https://farm9.staticflickr.com/8645/16505539929_e0a4e6975d_n.jpg) (https://flic.kr/p/r9xcYD)(https://farm9.staticflickr.com/8615/16484404107_3c66f8f9b1_n.jpg) (https://flic.kr/p/r7ET2V)
cr2hdr-r 4.6
https://drive.google.com/file/d/0B4tCJMlOYfirV1RsaGNYd0VJUHM/view?usp=sharing
- Added lut support. add lut inside the PRORES folder or in subfolders together with the RAW/MLV file(up to three luts works)
- Added the Andy600_lin_to_REC709.cube when transcoding regular ProRes files. These files looks so clean and good. Thanks Andy600.
- Rearranged folder structure a little
About luts. Up to three extra 3dluts can be added. When running the app the first time it creates some additional folder. Inside the PRORES folder some luts and a text description will be provided. For instance you could preview luts in the "lut3d_lab folder". Info about this in the text file.
Dual iso RAW/MLV to ProRes comes hardcoded with Andy600_lin_to_log.cube
Regular RAW/MLV comes hardcoded with Andy600_lin_to_REC709.cube
Beware of limitation in lut handling in ffmpeg and also difference between dual iso RAW and MLV. Gonna check on this later.
I'm relatively new to using the dual ISO feature and am currently using the windows script that utilizes VirtualDub and Enfuse to extract the A & B frames to get C. This has been a slow process since I'm on a Mac and have to run VirtualBox to make this work. I've read through this entire thread and am under the impression that I can use cr2hdr-r for a similar, more logical workflow but seem to be missing something.
I am simply shooting dual ISO .MOV files, not RAW. I've followed the install directions (even watched the YouTube install video), when run the app and point to the folder with my test.mov file, the new folder structure is created but no automator tasks seem to continue. In fact I never see the gear icon in the top menu bar.
I'm clearly missing something here. It was late, after a long day when I read through this thread, so I may have missed something. Any help will be appreciated.
MBP 2011 13", OS X 10.10.1
Dual iso .MOV? Do you mean HDR?
Which version are you using?
if 1.8 you just put the .MOV in the folder where you want your files.
If running experimental builds you first run the app as it will create needed folders and then quit. You then put your .MOV in the HDR_RAW_MLV_MOV folder and then run the app from the parent folder. NOT from the created sufolder(HDR_RAW_MLV_MOV).
Are you with me?
Yes I meant HDR. I was working with the latest two experimental builds. After your suggestion I was able to get the process where it appeared to be working but after about 15 minutes, no additional files had been created and the progress in the status bar remained at 0%.
I used 1.8 and everything seems to be splitting and merging fine. Thanks!
Strange. Could you share a printscreen? Would like to see the problem. Are you running the app from outside the created subdolder?
Wait a minute with the .MOV. Gotta fix a thing.
*Fixed bug. Updated the links
Ahh I learned something new today... D'OH! :P
After struggling to figure out why 5.0 stops running after it completes the Lut3D_Lab folder (Although I had already ran the command shortcut for Lut3D_Lab prior to which worked well!) and then tried again after emptying out that particular folder... Voila!
https://vimeo.com/121489716 (https://vimeo.com/121489716)
Lut3D_Lab folder is definitely a nice addition and it's worth checking prior to rendering with a certain LUT applied as a whole.
Yeah, the idea is that when you organized all your files you could stuff some files in the lub lab folder and as long as you,re in there the files won,t start transcoding. At least inside ProRes folder. After you take them out you start the app and leave.
Thanks for sharing
Regarding HL handling for Raw... or maybe its best to leave them alone and it all comes down to proper exposures? lol
https://vimeo.com/121533690 (https://vimeo.com/121533690)
Dual-ISO's are coming out really nice though... :)
Latest cr2hdr for mac
https://www.dropbox.com/s/0yqh0baqur4wlcf/cr2hdr.zip?dl=0
Wonderful N/A. Gonna put it in during the weekend.
@deafeyejedi. Could you share the raw regarding HL? I, ll see what could be done.
Could you specify what is what in the examples you provide from your film Deafeyejedi? There are three different outputs. The ding is obvious but what about the other two .mov ?
(http://s15.postimg.org/q1vfomn3b/Screen_Shot_2015_03_07_at_20_13_12.png) (http://postimg.org/image/q1vfomn3b/)
(http://s15.postimg.org/65zg9361z/Screen_Shot_2015_03_07_at_20_13_33.png) (http://postimg.org/image/65zg9361z/)
I'm out away from home atm coaching little league baseball practice. Then the Wife will be taking me out to dinner afterwards. So I'll be able to do it as soon as I get home.
In my own recent memory if I can recall correctly that each 3 of these files goes as it follows ISO 1600, ISO 100, Dual-ISO @ 100/1600...
But that's just from what I can think of and could be wrong.
Plus I was using a manual lens -- 14mm t3.1 and I think I left it wide open or may have closed it down to 4-5.6 (it was just a quick test for slo-mo's aspect ratios purposes) so sorry Danne I don't mean to keep you up waiting on me!!!
After all, I doubt this may be a bug on your end. It could be due to this particular lens?
Quote from: Danne on March 03, 2015, 10:46:50 AM
cr2hdr-r 4.6
Dual iso RAW/MLV to ProRes comes hardcoded with Andy600_lin_to_log.cube
Regular RAW/MLV comes hardcoded with Andy600_lin_to_REC709.cube
@Danne I want to try out this workflow for Dual ISO/HRD Raw , but I see you have Hard Coded Luts Can you make Optional ?
I prefer to do Color Space myself or is there a older build of this app that's not Hard Coded with Luts ?
Thanks
Hi Reddeercity. THis version is without the hardcoded luts.
cr2hdr-r_5.3_all_no_lut
https://drive.google.com/file/d/0B4tCJMlOYfirYzA3eUloZmVDNVU/view?usp=sharing
You need to uninstall and install the new files with the new scripts. If you only want to change the "bmcc_ixml_luts" folder than grab it from the downloaded pack and put it in /usr/bin/bmcc_ixml_luts.
You can add up to three luts simultaneously.
I added the possible formats that ffmpeg is suppose to support
https://ffmpeg.org/ffmpeg-filters.html#lut3d-1
Highres luts don,t seem to work so please report if you get some good luts working here. Some luts will probably not work.
Also treat it as beta. It is multithreaded and needs to be tested. Could have missed a letter somewhere in the script, a lot of text :)
Thanks Danne , I'll download and go for a "Road Test"
I will Report back with results :D
Go for it :)
Thanks to N/A we now can make use of A1ex latest cr2hdr20bit binary. Just updated with some other things.
Thanks!
cr2hdr-r_5.3f(beta-experimental)
https://drive.google.com/file/d/0B4tCJMlOYfirell2elNQN1Zwemc/view?usp=sharing
When I run cr2hdr-2 its just creating audio .movs, can someone tell me what to do?
I'm running 5.3f
Quote from: Danne on March 09, 2015, 08:55:57 PM
Thanks to N/A we now can make use of A1ex latest cr2hdr20bit binary. Just updated with some other things.
Thanks!
cr2hdr-r_5.3f(beta-experimental)
https://drive.google.com/file/d/0B4tCJMlOYfirell2elNQN1Zwemc/view?usp=sharing
Cool, happy to be of assistance.
Can anyone help me?
What are you trying to convert? Mlv, hdr, what?
HDR
Ohhh I don't have any hdr's to test. Care to upload one?
give me a sec
Thanks N/A
https://www.dropbox.com/s/b7pqtwfwv874e3n/EPIC4635.MOV?dl=0
I guess what I am asking is: Why am I only getting an audio file from this and not Video? Could I be missing a script in my install? I have un-installed it and re-installeded it 2 or 3 times and it is confusing the heck out of me.
This is what i am getting
https://www.dropbox.com/s/3itleo948mafsuh/HDR_EPIC4635.MOV?dl=0
What version are you running?
With the experimental version it goes like this.
https://www.youtube.com/watch?v=EXGFLlS9c6c&feature=youtu.be
Here,s your file converted by the way. It looks good but you really can,t go under 50 or 60 fps if you don,t use some interpolation method in post. Try 50 fps in raw. Could give some nice results.
https://sprend.com/download.htm?C=08512d4c87ed49b8bdd65fbfae2e0b99
What version should I use that is solid? I am using 5.3f. Thank you for converting that file, why do you think there is so much video noise in the converted file?
I am converting the file exactly like you showed me but just getting audio?
Strange. You could try the latest version in the first post. What does terminal say when you uninstall/install binaries?
Beat me to it lol.
Last login: Tue Mar 10 13:28:56 on ttys000
/Users/epicmedia/Desktop/cr2hdr-r_5.3f/Install\ these\ first/uninstall.command ; exit;
macintosh:~ epicmedia$ /Users/epicmedia/Desktop/cr2hdr-r_5.3f/Install\ these\ first/uninstall.command ; exit;
Password:
rm: /usr/bin/cr2hdr20bit: No such file or directory
rm: /usr/bin/exiftool: No such file or directory
rm: /usr/bin/dcraw: No such file or directory
rm: /usr/bin/mlv_dump: No such file or directory
rm: /usr/bin/raw2dng: No such file or directory
rm: /usr/bin/bwfmetaedit: No such file or directory
rm: /usr/bin/sox: No such file or directory
rm: /usr/bin/lib: No such file or directory
rm: /usr/bin/bmcc_ixml_luts: No such file or directory
rm: /usr/bin/enfuse: No such file or directory
rm: /usr/bin/ffmpeg: No such file or directory
logout
[Process completed]
Like it says. The files do not exist. Did you run the install command and put in your password?
Thanks for helping out N/A
Yes, this from the install
Last login: Tue Mar 10 13:40:17 on ttys000
macintosh:~ epicmedia$ /Users/epicmedia/Desktop/cr2hdr-r_5.3f/Install\ these\ first/install.command ; exit;
Password:
mv: rename ./Binaries_cr2hdr-r/lib to /usr/bin/lib: No such file or directory
mv: rename ./Binaries_cr2hdr-r/sox to /usr/bin/sox: No such file or directory
mv: rename ./Binaries_cr2hdr-r/exiftool to /usr/bin/exiftool: No such file or directory
mv: rename ./Binaries_cr2hdr-r/cr2hdr20bit to /usr/bin/cr2hdr20bit: No such file or directory
mv: rename ./Binaries_cr2hdr-r/dcraw to /usr/bin/dcraw: No such file or directory
mv: rename ./Binaries_cr2hdr-r/mlv_dump to /usr/bin/mlv_dump: No such file or directory
mv: rename ./Binaries_cr2hdr-r/raw2dng to /usr/bin/raw2dng: No such file or directory
mv: rename ./Binaries_cr2hdr-r/bwfmetaedit to /usr/bin/bwfmetaedit: No such file or directory
mv: rename ./Binaries_cr2hdr-r/bmcc_ixml_luts to /usr/bin/bmcc_ixml_luts: No such file or directory
mv: rename ./Binaries_cr2hdr-r/enfuse to /usr/bin/enfuse: No such file or directory
mv: rename ./Binaries_cr2hdr-r/ffmpeg to /usr/bin/ffmpeg: No such file or directory
logout
[Process completed]
Sure sounds like a hiccup with Sudo's via Terminal.
Need to type in admin password in order for it to run properly, I believe!
Try latest version. I could have missed including binaries.
https://www.youtube.com/watch?v=0nFcRAL9J7w&feature=youtu.be
Can you post the latest version for me
Should be this. From first post. I, m not by the computer.
https://drive.google.com/file/d/0B4tCJMlOYfirYTlCTzVwb2NuTE0/view?usp=sharing
currently testing 5.3f with same files for comparison purposes.
I also learned (once again) that I accidentaly forgot to turn off slo-mo's (instead of 50/60fps I should have done so in 24/25/30 when it comes to crop-mode -- D'OH!!!)
Otherwise you'll get a whole bunch of lava's flowing down upon over your keyboard... :P
https://vimeo.com/121811554 (https://vimeo.com/121811554)
Thanks again, D, for your kind eagerness with the frequent updates, as always!
It's a great way to keep us all refreshing (at least for me)
/S
????? So confused, just getting an audio file
https://www.youtube.com/watch?v=Gsh7kKnM89M&feature=youtu.be
You could try to move all the binaries manually to the folder.
Hit cmd shift g. Then print /usr/bin.
In this folder drag all files and folders from the binary folder into /usr/bin.
I am not sure why you cant get the files right so it might not work even doing this.
Tried it on a different computer and it worked. Thank you. Not sure why its missing something on my main computer. How can I do a clean install of this app?
No installing really, only moving a bunch of binaries with the command script. You remove them with uninstall.
You could try installing from different location. Maybe works.
@EpicMedia:
https://vimeo.com/121815925 (https://vimeo.com/121815925)
Per your main Mac -- sounds like you accidentally deleted the files that were meant to be installed.
I've ran into this situation before.
Just simply download latest version from link and reinstall in order for you to run command.install with proper files.
Thanks DEJ. I tried several times with the same result. Even tried re-starting the computer too>
Ok, Here is my converted file from 720 60p file. It looks pretty noisy under the table on the chairs. Not used to noisy images as the camera shoots so crisp and clear even in low light. Got any suggestions on why that would be happening with this process?
Thanks again for all of your help.
Where is the video?
So, with the latest version, first page I added the "cr2hdr-r_speed_boost" function. As for now it will start transcoding two-three files at the time in ProRes and HDR folder and if you want to kick in your computer to work more simply add speed_boost :).
Right click on the parent folder while converting and select speed boost.
https://www.youtube.com/watch?v=2ZkXeISWC0c&feature=youtu.be
Very nicely done. Thanks Danne.
kirk
Currently testing out the speed boost from 5.3j_s (Thanks Danne for the HDR fix):
(https://farm9.staticflickr.com/8635/16594897438_beff3324f6_n.jpg) (https://flic.kr/p/rhrbRm)
***However I noticed all the speed_boots stays at 0% -- am I doing something incorrectly? :-\
Here's what I was referring to earlier with previous version 5.3i_s re: Spanned Files not picking up after the first file... possible bug?
(https://farm8.staticflickr.com/7607/16782315015_39e152374b_n.jpg) (https://flic.kr/p/ryZKyT)
Thanks for sharing. Wouldn,t find those bugs as quickly otherwise.
I updated the first post with a fixed version "cr2hdr-r_5.3k_s"
Should move spanned files correctly.
About the speed boost I would recommend one extra push. Can,t say what will happen if more repeats are started.
Sorry, had some family issues yesterday and couldn't get back to the computer. Here is the link.
https://www.youtube.com/watch?v=srAJ_RXaCEg
The flickering under the table comes from enfuse. There might be settings to tweak but I don,t know how. You could try getting a flat look from start to see if that will give more even results. If shooting raw you can xport nice raw prores from Mlrawviewer.
Does it work with HDR video?
You export to ProRes .MOV with Mlrawviewer and then you run the .MOV file in the HDR_RAW_MLV_MOV folder in cr2hdr-r. Will work fine.
Thanks, I'll give it a shot
Some changes due to changed metadata routines in cr2hdr20bit and MLV files. Very nice.
cr2hdr-r_5.3l_s(beta-experimental)
https://drive.google.com/file/d/0B4tCJMlOYfirX1FuNDZSZ0lCdHc/view?usp=sharing
Without hardcoded luts implemented
cr2hdr-r_5.3l_s_no_lut
https://drive.google.com/file/d/0B4tCJMlOYfirWnNMLXBhYU9IY0k/view?usp=sharing
*feedbacks*
I know this is for the older version but may be worth noting regarding MLV Dual-ISO conversions...
5.3i_s:
https://vimeo.com/122078704 (https://vimeo.com/122078704)
5.3j_s:
https://vimeo.com/122078705 (https://vimeo.com/122078705)
Also regarding 5.3j_s -- there were few other strange bugs such as not all dng's were converted as well as another file showing random xml file being put in thus corrupting a frame during .mov as well as another file showing strange pattern of unconverted Dual-iso dng's as well as missing an MLV file somehow. May have disappeared! lol
https://vimeo.com/122079084 (https://vimeo.com/122079084)
Anyway thanks for the 5.3l_s and will do another run at it.
*cheers*
Some quirks. Will fix these before release.
cr2hdr-r_5.3m_s
*feedbacks* re: 5.3l_s:
Dual-ISO Brightness changed?
https://vimeo.com/122130333 (https://vimeo.com/122130333)
cr2hdr-r files in trash which takes forever to delete manually (been doing this ever since...is this normal)?
https://vimeo.com/122130332 (https://vimeo.com/122130332)
HDR-Spanning_Possible Bug (once the MLV w spanning files gets skipped...it won't convert the remaining non-spanned MLV's in the HDR folder)?
https://vimeo.com/122133040 (https://vimeo.com/122133040)
Fun Stuff from 5.3l_s -- 5D3 shot in Dual-ISO MLV 24fps 1080p w 16-35L II:
100/1600 Pre:
(https://farm8.staticflickr.com/7632/16817472182_b94e9b56e8_n.jpg) (https://flic.kr/p/rC6WyW)
100/1600 Post:
(https://farm8.staticflickr.com/7608/16817501311_b26df48a92_n.jpg) (https://flic.kr/p/rC76ea)
https://vimeo.com/122219546 (https://vimeo.com/122219546)
100/1600 Pre:
(https://farm9.staticflickr.com/8580/16817472262_12430ab09b_n.jpg) (https://flic.kr/p/rC6WAj)
100/1600 Post:
(https://farm9.staticflickr.com/8667/16792708286_9519d41842_n.jpg) (https://flic.kr/p/rzV28d)
https://vimeo.com/122219545 (https://vimeo.com/122219545)
100/1600 Pre:
(https://farm9.staticflickr.com/8725/16611346357_69ecd05af4_n.jpg) (https://flic.kr/p/riTuxp)
100/1600 Post:
(https://farm8.staticflickr.com/7655/16817570041_d10766a99b_n.jpg) (https://flic.kr/p/rC7rEa)
https://vimeo.com/122219543 (https://vimeo.com/122219543)
100/1600 Pre:
(https://farm8.staticflickr.com/7651/16198717933_f20cdc82fd_n.jpg) (https://flic.kr/p/qFqEue)
100/1600 Post:
(https://farm9.staticflickr.com/8630/16792775736_b9849f89a6_n.jpg) (https://flic.kr/p/rzVnb9)
https://vimeo.com/122219544 (https://vimeo.com/122219544)
Nice one. How were they postprocessed? Did you skip the ProRes making?
Just uploaded the .mov's... took awhile earlier, sorry!
They were processed with Andy's_lin_to_REC709_full_range LUT.
and no I did not skip the ProRes making. 8)
I'm off tomorrow and Monday so I plan on making time for Audio testings per your request.
Talk soon!
/S
Cool. Those luts works great.
Audio will be updated in coming version.
Thanks
New version up
cr2hdr-r_5.3p_s(beta)
https://drive.google.com/file/d/0B4tCJMlOYfirQlRIQ0pOUVQwdG8/view?usp=sharing
- Exactly matched audio for embed in davinci resolve. It counts amount of frames extracted from mlv_dump divided with frame rate and calculates the seconds and shortens accordingly. This has nothing to do with audio sync! Only matches the sometimes too long audio track recorded with MLV format.
Ran a bunch of files and they all transcoded and worked in Davinci resolve with embedded audio. Most framerates are supported. If audio don,t embed most likely I have to provide some additional audio info in xml.
Please run the app shortcut from outside the downloaded folder. Exif data(MLV) won,t apply to converted dual iso DNG files otherwise.
Sounds great regarding 5.3n_s(beta) and will definitely go out and do some quick audio tests within different FPS settings.
Thanks again, D.
/S
Why aren't you getting any aliasing?
@dubzeebass:
Which video are you referring this to? Because I do still get these if I do not use crop-mode....
This one in particular shows tons of aliasing if you look at the semi truck rig trailer as well as the parking space lines (as to be expected because it's not shot in crop-mode):
https://vimeo.com/122078704 (https://vimeo.com/122078704)
I guess it comes down to certain scenes based on the set location... ya know? Also I use a circular profiler filter on the 16-35L II so not sure if that could play a role in reducing the aliasing effect?
Hi thanks for your work!
After i have processed a mlv file with CR2HDR . I find that the dng files produced are 1 dark fram and then 1 bright frame and so on as filmed. How do I proceed to make a HDR video from that? Thankful for help!
Best regards
Hdr works that way.Dual iso and hdr are working very differently so I recommend trying out one of them at the time.
From my experience with various testings... It is definitely best to NOT combine them both together (HDR + Dual-ISO) in which I previously have in the past by an accident and it's not so pretty...
[emoji37]
Pick one or the other...
Hi! Thanks for you answer DeafEyeJedi and Danne.
I am new to HDR video and if i decide to go with only the HDR movie function and the result is a first dark frame and then a bright frame and so on, how do i process that on a mac to make it a viewable movie?
Second Q. Is it possible to shoot mlv-files with only dual iso checked in expo menu? Is that the prefered way to shoot movies?
I think that having dual iso checked will give me the right framerate since the hdr-fuction will give me half the framerate since it merges 2 frames. Is that correct?
Best regards Pettermannen
For HDR you can do like this. Just put either an .MOV .RAW or .MLV in the folder(5.3 version)
https://www.youtube.com/watch?v=EXGFLlS9c6c&feature=youtu.be
Dual iso will work best in zoom mode http://www.magiclantern.fm/forum/index.php?topic=12796.msg126471#msg126471
. You film like any other moviemode and postprocess can be made in either parent folder or in PRORES folder. It will detect if dual iso or not.
On the first page you have the experimental(5.3) and the more stable release 1.8. They work a little differently. 1.8 don,t have any PRORES or RAW_MLV hdr conversion mode.
Quote from: Danne on March 23, 2015, 08:28:57 PM
Hi! Some progress in dnxhd and ffmpeg. Found a setting for 10-bit 440M! DOn,t know if this is overkill or not. Not really sure if it,s an alternative to ProRes444 from ffmpeg but hope you guys would shed some light here.
Fast
dnxhd1obit-440M
(http://s27.postimg.org/9wceo3sfj/dnxhd.png) (http://postimg.org/image/9wceo3sfj/)
ProRes444
(http://s27.postimg.org/z13f1irvz/Prores.png) (http://postimg.org/image/z13f1irvz/)
(http://s27.postimg.org/67mpomien/Screen_Shot_2015_03_23_at_20_19_25.png) (http://postimg.org/image/67mpomien/)
*Further progress on this theme will be on the cr2hdr-r thread. Got carried away in dnxhd discussion here, realize this thread is about cinelog.
I thought these comparisons were quite interesting because I noticed that the highlights were slightly clipped in the dnxHD10bit-440 as oppose to the ProRes444...
Is there a reason for that in particular?
Just curious...
P.S. I quoted your post from the Cinelog thread respectively in effort to keep from making a mess. Hope that's okay with you.
Cool.
Havn,t checked the dnxhd 10-bit too much yet but you can be right about the clipping. It should be dnxhd 10-bit 422 and probably it can,t outrun the ProRes444.
Thanks Danne!
(Kör engelska så andra kan hänga med)
I use 5d MK2 and latest build and when i shoot with dual iso activated in expo mode. I get a message that i have to record raw in movie mode.
When i choose raw movie mode instead of mlv the iso is not alternating in the preview and the dng´s are not in dual iso. I therefore assume that
i can´t create dual iso dngs with interlaced scan lines when i shoot movies with 5d. Is that correct? If i shoot stills the cr2´s got scan lines though.
I also imported a HDR recording with MLV in after effects with MLVFS (with bright and dark frames) I exported a prores movie from aftereffects with alternating frames and followed your link to the video on how to process a .mov file with cr2hdr-5.3. I put that movie both in the mov.mlv.raw folder and also in the proves folder. But nothing happened when i hit the button. Does it have to be mov file directly from the 5d?
It still puzzles me on how i should process my mlv recordings (HDR video). And what to do with movies exported from aftereffects with alternating frames. please help me.
Best regards Pettermannen
I,ll pm you instead. One moment.
Hi Danne,
I've been trying to test Magic Lantern Dual-ISO (for photography only,NOT videos)for my 70D - took me almost 12 hours (not straight 12 hrs or i'd go bonkers lol) and I saw this forum. I notice this forum mainly focus on the RAW Videos so I hope my problem should hopefully (hehe) be an easier fix for you :D
initially I installed the cr2hdr-r-1.8 zip files (from your 1st post in this forum) - I followed the instructions to run the install.command and copied the cr2hdr.app to my desktop - I double-clicked the app and point it to my directory containing the CR2 files - the DNG files were created but for some reason it won't render - Photoshop said it could not parse the DNG files.
So I continued reading your thread and saw you uploaded the latest cr2hdr-r zip (version 5.3-s ). after downloading I thought i should run the uninstall command on the 1,8 version, then do the 5.3 install.command. I was surprised it didn't ask for a password so I tried to close the terminal windows and rerun the 5.3 install.command. Then I am getting these errors now :((
~ xxxxxxx /Users/xxxxxxx/Downloads/cr2hdr-r_5.3i_s/Install\ these\ first/install.command ; exit;
mv: rename ./Binaries_cr2hdr-r/lib to /usr/bin/lib: No such file or directory
mv: rename ./Binaries_cr2hdr-r/sox to /usr/bin/sox: No such file or directory
mv: rename ./Binaries_cr2hdr-r/exiftool to /usr/bin/exiftool: No such file or directory
mv: rename ./Binaries_cr2hdr-r/cr2hdr20bit to /usr/bin/cr2hdr20bit: No such file or directory
mv: rename ./Binaries_cr2hdr-r/dcraw to /usr/bin/dcraw: No such file or directory
mv: rename ./Binaries_cr2hdr-r/mlv_dump to /usr/bin/mlv_dump: No such file or directory
mv: rename ./Binaries_cr2hdr-r/raw2dng to /usr/bin/raw2dng: No such file or directory
mv: rename ./Binaries_cr2hdr-r/bwfmetaedit to /usr/bin/bwfmetaedit: No such file or directory
mv: rename ./Binaries_cr2hdr-r/bmcc_ixml_luts to /usr/bin/bmcc_ixml_luts: No such file or directory
mv: rename ./Binaries_cr2hdr-r/enfuse to /usr/bin/enfuse: No such file or directory
mv: rename ./Binaries_cr2hdr-r/ffmpeg to /usr/bin/ffmpeg: No such file or directory
mv: rename ./Binaries_cr2hdr-r/cr2hdr_r_speed_boost.workflow to /Users/xxxxxxx/Library/Services/cr2hdr_r_speed_boost.workflow: No such file or directory
logout
[Process completed]
could you share why i am getting these errors? :(
Hi Danne,
Sorry I just saw a post from EpicMedia from a few weeks ago who had the same problem - it seems like he eventually was able to install it on a different machine. I on the other hand only have one Mac machine :(
i saw you suggested in your post#271 in this forum as follows:
You could try to move all the binaries manually to the folder.
Hit cmd shift g. Then print /usr/bin.
In this folder drag all files and folders from the binary folder into /usr/bin.
am wondering if you could kindly share a more detailed way to do this? from looking at the errors it seems like its trying to copy/rename the ./Binaries_cr2hdr-r/* to /usr/bin/* but the ./Binaries_cr2hdr-r/ path is missing? From my limited unix knowledge I could just right click on the "install this first" folder and select service> New terminal from folder... after that I don't know which command I should execute ... please bear with me and appreciate your help.
You run the install command from the folder it,s in. Did you move anything after unzipping?
You could try to unzip or redownload the app and run the install command again. It looks like the binary folder is empty? If it doesn,t work I suggest you create a screen recording of your install steps and pm me a link.
About 70D for now you can run the script from here https://drive.google.com/file/d/0B4tCJMlOYfirSTNNeV9JLXBkMms/view?usp=sharing
after you have converted your files to DNG files. As soon as a new version is compiled I try to put in the app.
If you move files manually you grab them all from the binary folder and drag/drop them into /usr/bin. I wouldn,t suggest this if you don,t really know what you,re doing.
Hi Danne -THANK YOU - actually yes I did realize that before I found your reply - I found the binaries were empty (cause I ran install already) so I had to re-download again.
But this time, I downloaded the cr2hdr-r_5.3l_s version (not the latest, but I believe it should work for my photography CR2 files). i ran install.command for the binaries after install and it was successful!
I replaced the cr2hdr.app with this new version, and double-clicked the app and pointed to my folder containing the two PHOTO CR2 files.
I have read your posts so I knew there would be those new (PRORES and HDR_RAW_MLV_MOV) folders created to handle the RAW or MLV videos - but I was expecting to but I don't see DNG files created :( I wonder where should I find my DNG files?
Again, appreciate your comments!
BTW is there a way to post screenshots or attachments here ? I do not have a dropbox account :(
Quote from: ciriuss925 on March 30, 2015, 01:48:23 AM
BTW is there a way to post screenshots or attachments here ? I do not have a dropbox account :(
http://picload.org
http://imgur.com
or any other pic hoster
http://www.filedropper.com/
or any other file hoster
thanks Walter - I just realized I have a google account so yes I should be able to share my files via Google Drive
Did you run the app once more after all the folders were created? First run only creates the folders.
Hi Danne,
Thanks again for your input - was just getting ready for bed when I saw your reply.
I reran cr2hdr-r.app as you suggested and - voila - within one minute the DNG files were generated (and the CR2 files went to ORIGINAL folder as expected).
However, it is strange that when I try to open the DNG file via Photoshop - Photoshop issues this error message: Could not complete your request because the file-format module cannot parse the file.
I am attaching one of the CR2 file and its corresponding DNG file as follows -
IMG_7442.CR2 file - https://drive.google.com/file/d/0BwB_poTzzVK8RElTQ2Z1R0lndU0/view?usp=sharing
IMG_7442.DNG file - https://drive.google.com/file/d/0BwB_poTzzVK8bEtQamZKbDgtR1U/view?usp=sharing
Thank you so much! Will check back in the morning :)
For now you have to run this script in the same folder as your DNG files.Doubleclick the command.
https://drive.google.com/file/d/0B4tCJMlOYfirSTNNeV9JLXBkMms/view?usp=sharing
It applies missing color matrices for your camera.
I think N/A is compiling a cr2hdr20bit which will include the 70D.
Hurrah - the 70D_color_matrix.command worked - and big thanks to you, Danne!!!
I can now open the DNG files (no more errors!) - although I still do see some noise but its not as bad as before. I am still figuring out how to make my dual ISO CR2 shots cleaner (must be something with my exposure setting).
Will play around with ML extensively again this weekend :-) I will be trying the HDR bracketing and time-lapse next - I think these may be easier to test than dual ISO :D
Cool. Glad it worked.
Updated first post with version 5.5 both with luts and no hardcoded luts.
added
- latest cr2hdr20bit - should work with 70D (Thanks to N/A, compiling and I think it,s Nikfreak,s version)
- latest dcraw (Thanks to N/A)
- updated mlv transcoding now also adding the color matrices the other updated workflows/apps are using.
- dampened the brightness in dcraw for the hardcoded lut when transcoding regular raw/mlv files so should look really good now.
Got a version working with white balance, brightness, combining luts coming up but wanted to get version above out of the way first :)
Good job! For some reason the audio is showing as a separate file in DR. Any ideas? v1.8 works fine, Resolve likes those BWF.
Do you know the exact framerate for those files? Or is it for all the files?
Thing is I hardcoded a lot of fps but there are "inbetweens" that will miss the correct fps. I could make some awk, grep for and write the actual fps but will take some time since I don,t really know to do it yet.
However, if you send me the different fps that you use I will update the xml presets.
Tried hastily creating some luts in davinci resolve and added to the Prores file during transcoding in cr2hdr-r. It can take up to three luts at the same time. First clip is straight out of the box.
Thumbnails (screens)
(http://s12.postimg.org/7gy5irevt/Screen_Shot_2015_04_05_at_23_15_45.png) (http://postimg.org/image/7gy5irevt/)
(http://s12.postimg.org/o3b4e3ift/Screen_Shot_2015_04_05_at_23_16_21.png) (http://postimg.org/image/o3b4e3ift/)
(http://s12.postimg.org/9y5bca9eh/Screen_Shot_2015_04_05_at_23_16_41.png) (http://postimg.org/image/9y5bca9eh/)
(http://s12.postimg.org/kc655iu55/Screen_Shot_2015_04_05_at_23_17_16.png) (http://postimg.org/image/kc655iu55/)
Just got home from being on the road and man this is such a dream come true for yet another accomplishments of yours, Danne!
Looking forward to seeing its results.
Thanks for the update... even the next one just sounds so damn GOOD!
Love the Cat!
Updated again to version 5.6_s
- Davinci resolve and folder embedded audio. Should work with all frame rates chosen in cam (no more hardcoded fps xml files).
- removed "lut_lab" folder. Instead a "lut_previews" command will be provided. Just double click for one frame preview. Works with or without preview 3d lut.
A new betaversion
cr2hdr-r_5.8_lut_labhttps://drive.google.com/file/d/0B4tCJMlOYfirLUdyS3pLMGJXMlE/view?usp=sharing
https://youtu.be/isFaVrf-kBs
- If adobe dng converter is installed it effectively reduces CR2 dual iso files to less than half size. Lossless.
- Changing brightness, white balance, working and combining up to 15 preset luts ("mylooks"). Combining log and rec presets.Biggest news is the creative possibility to combine "mylooks" and changing brightness and white balance. It is all in betaphase so don,t know what it will bring. For now there are 6 "mylooks" 3d cubes in the "my_presets" folder but please make your own since these are only examples. You can keep up to 15 "mylooks" stored and combine them freely by calling them from a created preview png file.
All is done through writing command in a created png file. This is created with "lut_preview.command" provided in the PRORES folder. You either create a preview png for every raw/mlv or a master PNG which will create the setting for all files in the folder. It is all really hard to explain but I tried recording some sort of workflow which I put up on youtube.
Needed
-
Davinci resolve 3d luts - Would be nice to have 15 solid presets luts to provide in the my_presets folder. Feel free to post examples.
-
5 log and corresponding rec709 luts, created as 3d luts(not 1D luts, won,t work in this workflow)
Here is the command list:
command_line
brightness (b10 being brightest)
b-10 to b10white balance (w1 being coldest)
w1 to w5preset looks(up to 15, 5 looks provided. Change them as you like)
mylook01 to mylook15log (log05 flattest)
log01 to log05rec (should fit with corresponding log. Example log01rec01
rec01 to rec05example
1 - create a png frame with the provided lut_previews.command by double clicking next to a raw/mlv file
2 - apply commands as you like by renaming the png file.
example 1
[filename]b5w1.png (will give a very bright and cold image)
example 2
[filename]b-8w5log01.png (will give a dark file very warm and with log applied)
example 3
[filename]mylook01mylook03b2w3.png (will add to of your preset looks brighten image 2 steps and white balance 3)
If you want to preview the result simply run the lut_preview command once again with the png file next your raw/mlv file and a master PNG will be created. If you like the look copy the commands to the master PNG file which will be the file to be used when transcoding batches of files.
If you want to keep alternate looks for each file you can leave the png files without creating a master PNG file and the raw/mlv will add each png look separately for each file.
This is awesome, but for some odd reason, it does not create a wav file for me:/
Can you be more specific? What other converters have you tried? Camera? Have you tried to reproduce the issue? Do you have a sample file?
*FEEDBACKS*
Good to be back... Thanks for the wake-up call! 8)
Ran out and shot a quick nighttime streetlight test with/without Dual-ISO in MLV w Audio.
Apparently with 5.6_s beta, some but not all were imported w synced audio after render from ur app. Strange?
(https://farm8.staticflickr.com/7725/17096624175_de5624b79e_n.jpg) (https://flic.kr/p/s3LEJk)
No big deal for me... I just thought it was worth noting, however I'll need to double check again with MLRawViewer to verify if I can get audio during playback. (will get back to you on that one!)
Shot in MLV on 5D3 w 24-105L in 24fps @ 1920 x 960 (This was a quick test so yes I know I could have done it in full HD)
Dual-ISO was done in 100/1600, respectively!
ProRes straight out from the app as it is:
https://vimeo.com/124601584 (https://vimeo.com/124601584)
Keep in mind that I only used the Andy's LUT (Full Range) in combination with non-Dual ISO MLV's as well (I think you mentioned that I shouldn't do that but didn't want to run the app twice with two different LUTS for each, ya know?)
or Maybe I could have just threw in both for all and see if the app's smart enough to recognize which is what? possible or no? LoL :P
Thanks again, @Danne!
Now with the latest beta (5.8_s) which comes with brightness, wb, etc... controls -- oh so sexy!!! Perhaps I should run the same MLV files again and post them for comparisons?
Nice clip :)
One thing I noticed when conversion is overlapping to the next day from 23:59 to 00:00 It could happen that it will rename and start conversion again. Often creates a double without audio.
I think I found a way to extract the correct wb multipliers through dcraw which will mean more accuracy in white balance handling. Just have to rewrite a few things in lut_lab version.
version cr2hdr-r_5.9_lut_lab
https://drive.google.com/file/d/0B4tCJMlOYfirekNXUE1UYjNrSzQ/view?usp=sharing
reworked whitebalance handling. Create png with lut_previews.command. Choose between w01 to w20 w01 being the coldest kelvin.
example: [filename]w03.png
version
cr2hdr-r_6.2_lut_labhttps://drive.google.com/file/d/0B4tCJMlOYfirMEhSejU3Mm9xZnM/view?usp=sharing
More white balance stuff.
- Including a CR2 still photo will make use of the white balance from camera and apply this to the ProRes file. Place the CR2 file next to the files you are transcoding in the PRORES folder. Check the movie below.Example.
If you create a custom white balance in camera and take a still CR2 from that scene before shooting. Adding the file in transcoding to ProRes will give you that exact white balance. Sweet.White balance tools right now are following.
- Auto wb. (default when not using any other alternative. Still linear for each file).
- DNG (add a silent picture DNG of the shooting environment or from a greycard).
- dng (add a dng file from the mlv/raw file and it will use this wb for all your mlv/raw files You have to extract a dng first of course).
- PNG (use the lut_previews.command to generate a preview and select between w01 to w20 for Kelvin temperature control.
- CR2 (add a CR2 still photo to use white balance recorded in camera. Use it as a master wb settings for all files or place files in specified folders. Watch movie below)
Dude I just woke up and man... 6.0 is definitely CAFFEINE and won't be needing coffee anymore! (actually never have liked it or needed it) HAHA!
It's nice to be able to just snap a photo and apply the CR2 file next to the MLV's to get the proper WB. So NICE and crazy!
I'm gonna run it again with the nighttime files again (since I didn't take a photo CR2 so I'll just use the dng from MLV for now)
Hopefully that good old blue border line is gone for good! lol
Thanks again, D!
8)
*Progress* (used a dng from earlier ProRes convert since I didn't take a photo CR2)
(https://farm8.staticflickr.com/7590/16922435700_8cd31aec41_n.jpg) (https://flic.kr/p/rMnUyL)
:)
There is no hardcoded lut on regular mlv/raw files. I suggest you include the CANON5D-UEX-SL.cube or the Andy600_lin_to_REC709.cube from the cr2hdr_lut_lab folder next to the files. Or you can call the logs from a PNG file. log01.PNG will be the first, log02.PNG the second suggestion. The Andy600_lin_to_REC709.cube is a bit on brightside since it,s intended for dual iso primarily. If you create a PNG file you can also include that and set it to b-7 or b-8 even to lower brightness. Would look like b-8.PNG. Capital letters for master_png.
If you skip the .cube you could use a png like this. b-7log01.PNG or b-7log02.PNG.
Getting some decent results with ProRes workflow and 3d luts created in DaVinci resolve lite. Created a log 3d lut and a contrasty one to match the view I get from the camera. When including a CR2 still photo you will get control over color. Workflow is to include the luts and the CR2 still photo in the PRORES folder together with your mlv/raw files.
If anyone likes to try here are the luts. Don,t forget to create a white balance CR2 file to go with these two luts.
https://drive.google.com/file/d/0B4tCJMlOYfirOWp0Y0NMWkwwNWc/view?usp=sharing
Adding a CR2 only works with version cr2hdr-r 6.2 here
https://drive.google.com/file/d/0B4tCJMlOYfirMEhSejU3Mm9xZnM/view?usp=sharing
Some screenshots. Contrast and log. Custom mode.
White balance CR2
(http://s28.postimg.org/ayjdkn4x5/image.jpg) (http://postimg.org/image/ayjdkn4x5/)
(http://s28.postimg.org/isokjs23x/image.png)
(http://s28.postimg.org/lwun2ttil/image.png)
(http://s28.postimg.org/fodwmzlbh/image.png)
(http://s28.postimg.org/uj2i15uwd/image.png)
(http://s28.postimg.org/3nsgm9dwt/image.png)
(http://s28.postimg.org/cnx26ga0d/image.png)
(http://s28.postimg.org/4h52evjxp/image.png)
(http://s28.postimg.org/bvue795t9/image.png)
(http://s28.postimg.org/597qe2o4t/image.png)
(http://s28.postimg.org/ck38q74j1/image.png)
Holy Moly, that's just so... MARVELOUS!!!
Can't wait to get my hands on 6.2!!!
Also thanks for sharing these 3D LUTS!
[emoji119]
Your welcome.
Having an issue where the files are creating only audio files??? Weird
(//)/Users/epicmedia/Desktop/Screen Shot 2015-04-16 at 4.45.02 PM.png
Your picture isn,t showing. Could you relink?
Version 6.6_lut_lab
https://drive.google.com/file/d/0B4tCJMlOYfirTERtNWVQMV9OdGM/view?usp=sharing
Including 15 preset master_PNG files. Simply view the look of the PNG file and put the desired preset next to your mlv/raw files. The 3d luts that are called from in the PNG are all created in da vinci resolve except the andy600 luts.
As always. 3d luts are lowres compared to 1d luts. My goal is to get nice flat .mov files to work with in preferred NLE and with professional 1D luts after I get my prores files transcoded from the app. Also included ability to use noise reduction by writing a value to the PNG file you choose. Value goes from denoise01 to denoise10.
example mylook03_cr2hdr-r_dan_log_03.PNG add denoise01 for lowest setting of denoising. example mylook03_cr2hdr-r_dan_log_03denoise01.PNG
Preferred workflow is to add a CR2 file( for white balance) and either a master_PNG or up to three 3d luts to you files.
Hi Danne,
I have a question as to when the cr2hdr-r.app converts CR2 to DNG files (still images, not movies).
I was finally able to test some dual-iso images this weekend. Two weeks ago when I initially installed ML I was able to create a few dual iso CR2 images, put them into a folder, then I ran cr2hdr-r.app and pointed it to the new folder, then almost immediately the cr2hdr-r.app creates three sub-folders (PRORES, ORIGINAL, and HDR_RAW_MLV_MOV folders) inside my folder ****plus*** I saw that the CR2 files were also converted to DNG. However, today, I tried the same steps with my new set of DUAL ISO CR2 images (putting them into another new folder, and run the cr2hdr-r.app against this new folder I created today). The PRORES, ORIGINAL and HDR_RAW_MLV_MOV subfolders were created as expected, but the CR2 images were not converted. Could you advise me as to what I may be doing wrong? I know that when the CR2s are being converted to DNG, the CR2 files are immediately moved to the ORIGINAL folder. I checked the ORIGINAL folder just now and it is understandably empty (since there was no DNG conversion that happened).
Your input is much appreciated!
- - - - - -
just a quick update - about a few minutes after I posted this - I saw the DNG files were created. It seems like if there is a delayed reaction of cr2hdr-r.app?
Hi!
On first run the app creates the folders. On second run it will start the transcoding.
The delay is probably A1ex binary working with the CR2 files doing the magic. It takes a while before all processes produces the final DNG.
In later versions I implemented the possibility to use some of the command line options in cr2hdr20bit. It works by writing the option directly into a CR2 file. This CR2 will apply written settings to all the CR2 files present in the folder.
example: cs3x3graymax.CR2
Now all the CR2 files will get chroma smoothing 3x3 and graymax white balance.
Command line list here:
cs2x2
cs3x3
cs5x5
reallybadpix
graymax
graymed
compress(require adobe dng converter installed)
compresslossy(require adobe dng converter installed)
Also, if you already have adobe dng converter installed already it should compress the produced DNG files to about half the size with no loss in quality automatically.
Hi Danne, just wanted to thank you again for your clarification re: cr2hdr-r. I noticed that the time varies for cr2hdr-r to convert CR2 to DNG- sometimes it is fast, sometimes I had to wait for a few minutes - but it does eventually convert the files. :)
You, re welcome.
Got some Dual-ISO test footage from 70D... 8)
Do I need to replace the cr2hdr & dcraw in order for it to recgonize the files from 70D or is it already implemented in the latest beta?
Thanks again, D!
Cr2 dual iso needs nikfreaks binary. Dng, s moviefiles should work with recent build.
I'm new to dual iso and HDR raw video, so just wanted to know, is there an app like this for windows?
There is some batch tool for windows and hdr files. Can,t remember the name. Search and you probably find it.
A lot to read about a lot of things. Take your time :)
And of course, there is Chmee,s fine work on raw2cdng.
@BokiA:
or just simply buy a Mac... it'll make your life easier! 8)
I agree with Jedi - Mac is sooo much better (though I hate that Apple took away the option to increase memory RAM for the current iMACs - though I think the default 8GB RAM + faster processors should be enough for your work - I have a late-2011 iMac 21" and was lucky to be able to increase the RAM from 4GB to 12 GB).
*feedbacks*
I replaced the cr2hdr20bit binary with the 70D cr2hdr binary (assuming this is actually 20bit from @nikfreak's thread which was provided by @N/A) from the link on first post in 70D thread but it doesn't seem to convert them after using the latest cr2hdr-r app (could be an error on my part)?
Videos still shows blueish/pinkish random flickering during Dual-ISO but as for Photos they seem to come out normal (with lines) but need to convert them properly somehow.
https://vimeo.com/125883959 (https://vimeo.com/125883959)
Can't wait for the day to come when theres a 20bit binary for all cams!
Could you try this version with above clip? Only change the cr2hdr20bit binary if you are developing still photos. If any problems occur then change to nkfreaks binary. Also specify if you are shooting mlv or raw.
Did the conversion work to prores as it should?
cr2dr-r_lut_lab 6.7
https://drive.google.com/file/d/0B4tCJMlOYfirajRjejB1SkJaelE/view?usp=sharing
Just got home. Will download and test.
It was just rather strange behavior w 70D files as you noticed in the clip above regarding ProRes as well as HDR not being converted (MLV & .mov as well as CR2).
But will do it all again w 6.7 momentarily.
Stand by.
*feedbacks*
Doesn't seem to be working or should I wait until its completely finished? Running two takes at once:
(https://farm9.staticflickr.com/8767/17262127171_71c09b799a_n.jpg) (https://flic.kr/p/sioV1g)
https://vimeo.com/125979967 (https://vimeo.com/125979967)
Will post final results shortly.
Oki, so if you change to nikfreaks binary things are working with the 70D?
Just tried again with nikfreak's binary (by replacing yours) and still produces somewhat similar random effects. Not sure why?
@Danne:
Sorry I fell asleep last night @ 2am. :o
Anyway, here is the link of 70D files (RAW,MLV, Non-Dual-ISO and Dual-ISO) in 2-3 second clips each for you to scroll through.
https://mega.co.nz/#F!yoNQWBTa!3ohyAu9UggiyreAiFjo8nA
I'm gonna try to run @nikfreak's binary again via Terminal (though it's a PITA) and see if it does actually work... hmm?
What file do not convert right? CR2 or raw/mlv files? Just ran your raw files and they work fine. If CR2 you either use Nikfreaks binary. Place it in /usr/bin/ folder and replace the cr2hdr20bit.
Or use this command script on the DNG files after conversion. Adds the lacking color matrices.
https://drive.google.com/file/d/0B4tCJMlOYfirTG9xN0pCN0pxTGM/view?usp=sharing
RAW/MLV comes out fine (sometimes it gives me strange colors almost the same as if they were Dual-ISO) but without the flickering... strange?
As for CR2, I haven't been able to get it to work yet but it could be an error on my part when replacing the binaries.
Is it possible to have one 6.7 app for other camera and duplicate another 6.7 (with replacing the cr2hdr20bit with nikfreak's cr2hdr)?
That way I can have one app for 70D and another app for the rest of the other cameras... obviously this will be temporarily until then!
Thanks, D!
Did you try the command script?
Could make a parallel cr2hdr-r with nikfreaks binary. Not today though.
No, not yet. Busy @ work.
Here's the clip I was referring to earlier about strange colors (possible lacking color matrices?):
https://vimeo.com/126014706 (https://vimeo.com/126014706)
Thanks.
I noticed I put in the some wrong numbers which could be the culprit here. I,m not sure. Is ith the raw or mlv files that are strange?
Check again against this version 6.7. Put up a new one.
https://drive.google.com/file/d/0B4tCJMlOYfirbVA0bkFjcDdCeVk/view?usp=sharing
I also would advice to use the script when working with CR2 files instead of a 70D version to get the latest cr2hdr20bit(corrected border interpolation, and commandline options)
Thanks, testing it out now.
However when I get the 70D DNG's from Dual ISO cr2's -- it says permission denied when trying using your script with the DNG's via Terminal... any ideas?
Thanks!
*EDIT*
Here's the clip that shows strange colors w ProRes .mov's from latest 6.7 but if use DNG's instead (within AE) and it exports as ProRes fine:
https://vimeo.com/126099527 (https://vimeo.com/126099527)
You, ll have to upload problematic sample files for me to test. I cant follow what files are problematic. Raw seems to work. Is it dual iso files? Mlv? Dual iso raw?
You have to give the script chmod rights to get pass permission denied state. Do it in terminal. Dont remember exact but google it.
Thanks
It's actually MLV for both Regular and Dual ISO. Will post them for you to scroll through via MEGA.
Will look on google for giving rights to the command script.
Thanks!
Try this version
cr2hdr-r_6.8b_lut_lab
https://drive.google.com/file/d/0B4tCJMlOYfirQ1dDLWVESlExYzA/view?usp=sharing
THANKS, D, for the 6.8 update.
Currently rendering the 70D files. As I was checking one of the DNG's converted from Dual-ISO CR2 (it stills says file format module cannot parse the file after opening in PS) so it looks like I still have to use the script command that you sent me from earlier?
Still googling around on how to get my stupid MBP to allow it to run it. Even though I have control over sudo -- so I don't understand.
BRB.
6.8b *feedbacks*
Both MLV & RAW 70D files work fine. (Good work, D!)
Dual-ISO MLV/RAW still flickers (but improvement is noticeable).
Dual-ISO CR2 (converted DNG's) should work fine with @nikfreak's binary but I can't confirm this yet because I'm still trying to get the command script to work.
Other than that... It's definitely a big step forward regarding 70D files.
Thanks!
70D111B Dual-ISO CR2 converted to DNG finally works now... THANKS, D!!!
(https://farm8.staticflickr.com/7662/17121751698_548f2675af.jpg) (https://flic.kr/p/s5Zsgu)
(https://farm8.staticflickr.com/7693/17122114400_43d5fcd7cb.jpg) (https://flic.kr/p/s62j5Y)
(https://farm8.staticflickr.com/7719/17283574236_6e0f2b14ed.jpg) (https://flic.kr/p/skhQtf)
https://vimeo.com/126356593 (https://vimeo.com/126356593)
Thanks for feedback.
The flashing files are corrupted ones. Has nothing to do with color matrices or transcoding. Check them with mlrawviewer or another app to verify corruption issue. Also, adding the script to other files than CR2 transcoded dual iso files is of no use since cr2hdr-r already applied these numbers on all files but still images.
Just did a side by side comparison...
https://vimeo.com/126458308 (https://vimeo.com/126458308)
Version cr2hdr-r_6.9_lut_lab
Downloads in first post
- Added 14 to 16 bit support and repack of 16bit (dual iso movie DNG) for use in premiere pro CC. Thanks cpc!
After correspondense with forum user cpc, author of slimRAW, check this thread out for more info
http://magiclantern.fm/forum/index.php?topic=15027.msg146234#msg146234
he created a binary, which in post processing will repack extracted dng files from 14 to 16bit and also repack the already 16bit dual iso movie DNG files so they will work with premiere pro CC. This makes the files a little bigger, (typically 3,7mb to 4,1mb 1920x1080), but they will be workable both in davinci resolve and premiere pro CC. Actually dual iso movie DNG files will loose some weight in post process repack (typically 4,4mb to 4,2mb).
The repacking post processing adds some extra time to the transcoding process but it is still very fast repacking.
Repacking to 16bit is only done in parent folder of cr2hdr-r.
ALL BETA and for testing purposes. Do backup of important files.
Big thanks for this contribution.
Holy Smokes this is a HUGE upgrade. You were right, Danne about this one!
Now I definitely can't wait to get my hands on this and test the footage out in PP, finally at last!
Once you go Adobe, there's no going back!
Thanks to @cpc for your contributions, much appreciated!
Finally back on the MBP here at work after a dreadful weekend full of nothing but moving loads after loads from an apt into an house.
Downloaded 7.0 and will share results from both 5D3 & 70D files separately (unless you want me to combine them together lol) online today this afternoon.
Let's hope my back can hold up...
Stand by!
*FEEDBACKS*
7.0 seems to be responding to 70D files well (besides the Dual-ISO movie files)...
(https://farm9.staticflickr.com/8858/16764001133_bbf0e28988_n.jpg) (https://flic.kr/p/rxnTui)
https://vimeo.com/126977653 (https://vimeo.com/126977653)
Also tried using the DNG's to make it readable in PP (CS6 not CC -- I don't think I got it working yet since only the Audio file shows up within the DNG folder inside PP) could this be the culprit due to not being CC?
I think I have CC on my MacMini but only CS6 on MBP -- perhaps I should find a way to update to CC, eh?
Cool. Don,t need to separate. I noticed a lut is missing when transcoding duai iso RAW to ProRes which will stop from creating the ProRes. Gonna upload a new version soon with that fixed. Also will refine an issue that stops some other anomalies which occur when the clock goes past 00:00 and transcodes are running. Probably fixed tomorrow.
Good stuff that you got fixed! These were important...
Standing by for the anticipated 7.3!
Thanks for 7.3!!!
Got a bunch of files from 5D3, 70D & M.
Question first before I run it... oddly enough that 5D3 and 70D produced identical file names in both RAW & MLV formats... how do I get around this? Run them separately would be best, right?
(https://farm8.staticflickr.com/7723/17207146599_5618bd0456_n.jpg) (https://flic.kr/p/sdx8cn)
lol
Yes, separate. If the prefixes are named the same they will get mixed up.
I fixed an issue with dual iso. Don,t know of you notice but will upload when ready.
Ok, Thanks.
Wouldn't know since I haven't started 7.3 yet - should I wait then?
Also what about combining the MLV audio files from different cameras? Should I rename them if I'm allowed to?
Different file names should do. Yes, better wait. I put up too many versions ;)
new one up now.
Rendering 7.3b overnight.
(https://farm8.staticflickr.com/7740/17213365259_3bca142f67_n.jpg) (https://flic.kr/p/se5ZMD)
Here's to sweet dreams!
p.s. that particular HDR file I mentioned earlier worked out fine on MacMini as soon as I got home. It just takes a long time to spit out ProRes.
*feedbacks*
Sorry couldn't sleep on this one... LOL
https://vimeo.com/127127708 (https://vimeo.com/127127708)
Thanks for feedback.
Any conclusions? Which are the files that are problematic and how? When dual iso lines shows in the middle of the clip it could be it detects the dng as non dual iso.
Ran 7.5b.
(https://farm8.staticflickr.com/7686/17232301028_0bd2d88271_n.jpg) (https://flic.kr/p/sfL3Jq)
Looks much cleaner and back to what it used to do. =)
https://vimeo.com/127240698 (https://vimeo.com/127240698)
However, I've narrowed down that it was actually the Dual ISO files from EOS-M that did not have the correct aspect ratio (even tho it was shot in normal 24p as all files were) weird?
(https://farm8.staticflickr.com/7700/17232312788_97ae5a28ee_n.jpg) (https://flic.kr/p/sfL7eb)
Not so pretty on the 70D @ ISO 6400 lol...
(https://farm8.staticflickr.com/7722/17233834319_32765f7330_n.jpg) (https://flic.kr/p/sfTUwt)
Thanks again, D!
Cool, but otherwise all working?
I think so... Is it normal for HDR files to come out looking like 4:3 when it was shot in 16:9 or 2.35? (Will have to test more HDR files to confirm this though)
If shot in raw it corrects ALL files with 1.61x aspect ratio. If you place a MOV file in the folder it doesnt touch aspect ratio.
If you have raw material with correct aspect ratio first convert them in PRORES folder then put the MOV file in hdr folder.
Good catch, Danne!
Will keep that in mind.
does this mean that you wont be able to colorgrade the final raw HDR sequence before its assembled into a MOV??
Not quite sure actually.
Maybe try placing the RAW HDR file into the ProRes folder first and wait for it to spit out DNG's then you can try and import the DNG's into LR5 AE (ACR) to color grade them and then save them.
Then take that DNG folder you just edited into HDR FOLDER again and run the app once more...
Not sure if that will work but doesn't hurt to try?
Otherwise stand by for his response.
Also do you own any wide angle glass with you to perhaps try Dual-ISO in crop-mode?
Best way I believe is to create a flat prores file and then run it in HDR_RAW_MLV_MOV folder. You can use mlrawviewer, PRORES folder or you get a flat look straight in HDR_RAW_MLV_MOV folder so maybe run the file from there from the start. Then you grade the created MOV file in what nle you like and export the final movie once again.
Creating a flat look in the start will probably lessen the enfuse flickering effect that sometimes occur.
If you want a ready to go look you can achieve this by adding a 3d lut in HDR_RAW_MLV_MOV folder. There are a few provided but otherwise I recommend exporting a mov file and the grab one frame and create a 3d lut in davinci resolve with a desired output look. Then add the 3d lut from start in the folder with raw/mlv files.
Changes to dng files won,t follow to any program but AE and acr so that little lightroom trick won,t work :)
Also, if you run a MOV file in the folder the suffix has to be in capitals MOV, not mov.
This is why I LOVE AE & ACR...
They make a great couple!
[emoji12]
Had to update some things in HDR_RAW_MLV_MOV workflow so first post updated to
7d(will now transcode .mov and .MOV files in HDR_RAW_MLV_MOV folder)
Here are two ways to go about with raw/mlv HDR footage shot in 48, 50, or 60 fps
Here is the contrast lut I,m using in the movie
https://drive.google.com/file/d/0B4tCJMlOYfirMi1RQXNHeXh1Slk/view?usp=sharing
Here is a warmer white balance lut
https://drive.google.com/file/d/0B4tCJMlOYfirMi1RQXNHeXh1Slk/view?usp=sharing
*update
Managed to get this look when adding the contrast lut and a warmer white balance lut. Wb lut download above.
Another go with a few clips. 48 fps 1920, mlv added contrast and wb lut to most of the clips. They,re actually pretty nice.
Excellent fix regarding .mov/.MOV files...
Should definitely make our lives much easier and great job on getting the HDR section ironed out in 7.5d!
Love how your warm LUTS came out with a bit of contrast -- really nice work, Danne!
Updated to 7.6 (First post)
lot of things regarding HDR_RAW_MLV_MOV folder.
- White balance support from an included CR2 still picture
- A folder with contrast and white balance luts will be present in HDR_RAW_MLV_MOV folder with a description(Add a contrast lut for a ready to go look. Add white balance if needed)
- Small fixes
For best quality HDR work with MLV/RAW files and simply add them to the folder. 48, 50, 60 fps are recommended. If no lut is added a log look will be applied.
Happy filming and please share examples if you have any.
Updated download with the latest cr2hdr from A1ex. Compiled by Kichetof.
http://www.magiclantern.fm/forum/index.php?topic=7139.msg147286#msg147286
Some more test shots with HDR :). Still a cool feature.
Developed in HDR_RAW_MLV_MOV folder
shot in:
- RAW 48fps HDR mode iso 100/1600
- added two 3D luts(provided in the HDR_RAW_MLV_MOV folder, no other post work)
02_cr2hdr-r_dan_log_01_warm_+05.cube03_cr2hdr-r_dan_log_01_to_contrast_01.cube - Also included a CR2 still picture from location with correct base white balance.
(http://s22.postimg.org/5epn1b1sh/image.jpg)
(http://s22.postimg.org/akw6ylr69/image.jpg)
(http://s22.postimg.org/nt065ae35/image.jpg)
(http://s22.postimg.org/ue8arb4k1/image.jpg)
(http://s22.postimg.org/vj2cwor0x/image.jpg)
(http://s22.postimg.org/f9gs7j5qp/image.jpg)
Simply stunning!!!
Good old classic HDR is still indeed a very cool feature. [emoji3]
Just shot few test HDR shots with both 70D & 5D3.
Will download 7.6 and post results to you shortly.
Thanks again, D!
Looking forward to some tests.
*FuN sTuFf*
70D shot in:
- RAW 60fps HDR mode iso 100/1600 (I know I could have done it in 48fps but wanted to push it for this test with 70D) hehe...
- added two 3D luts (provided in the HDR_RAW_MLV_MOV folder, no other post work)
02_cr2hdr-r_dan_log_01_warm_+05.cube
03_cr2hdr-r_dan_log_01_to_contrast_01.cube
- Also included a CR2 still picture from location with correct base white balance. (I made an error on this part realizing the CR2 was in the wrong WB so I will have to do another run with 7.6 tmw - my fault on that, D!)
(https://c4.staticflickr.com/8/7783/17630026691_db82f0f195_z.jpg) (https://flic.kr/p/sRUuHr)
(https://c2.staticflickr.com/6/5338/17443636839_ddd4afea0e_z.jpg) (https://flic.kr/p/szrcvi)
(https://c2.staticflickr.com/6/5447/17442112298_a7838c46e9.jpg) (https://flic.kr/p/szioj7)
(https://c2.staticflickr.com/6/5464/17603625546_5d793ed26e_z.jpg) (https://flic.kr/p/sPzbzh)
(https://c1.staticflickr.com/9/8756/17009606263_b4d13bcc49_z.jpg) (https://flic.kr/p/rV5Fkv)
(https://c2.staticflickr.com/6/5457/17603626966_243d89bcb1.jpg) (https://flic.kr/p/sPzbZL)
https://vimeo.com/127802306
Lots of aliasing w these 70D HDR files, eh?
Stand by for the 5D3 files (currently rendering on 7.6) 8)
If you skip CR2 file you get auto WB. Also try to push the shadows even higher to get even more light from inside.
Thanks for inputs, D.
5D3 shot in:
- RAW 60fps HDR mode iso 100/1600
- added two 3D luts (provided in the HDR_RAW_MLV_MOV folder, no other post work done)
02_cr2hdr-r_dan_log_01_warm_+05.cube
03_cr2hdr-r_dan_log_01_to_contrast_01.cube
(https://c2.staticflickr.com/6/5335/17663184972_c838b9eae1.jpg) (https://flic.kr/p/sUQrvW)
(https://c4.staticflickr.com/8/7671/17478047540_1a33253c19.jpg) (https://flic.kr/p/sCtyBf)
(https://c4.staticflickr.com/8/7676/17665630785_1870f80aa6.jpg) (https://flic.kr/p/sV3Yz8)
(https://c4.staticflickr.com/8/7692/17477814848_844fd82717.jpg) (https://flic.kr/p/sCsnrj)
(https://c1.staticflickr.com/9/8778/17639306606_01853aa625.jpg) (https://flic.kr/p/sSJ4iY)
(https://c1.staticflickr.com/9/8820/17045299983_f76fc905e5.jpg) (https://flic.kr/p/rYeBQt)
https://vimeo.com/127903841 (https://vimeo.com/127903841)
Although the Auto WB does a good job but perhaps I should be able to grab a DNG with proper WB into the HDR folder (since I forgot to snap a CR2 photo for this test) correct?
Really nice looking files. Want to see more :).
You can retake a cr2 or silent DNG afterwards if you remember the settings or you have the same lighting.. If you grab a dng from the raw file itself it is the same as using auto white balance.
Thanks, D and on top of that I actually used a NIKKOR 24mm f/2.8 D with this test... Not too bad for a FF, huh? (Looks okay on 70D tho)...
New upload, 7.7 first post.
- cr2hdr-r_speed_preview.workflow (former cr2hdr-r_speed_boost)
- some more fixes
Reworked speed_boost workflow service and added a preview possibilty. Right click on a file/files and select cr2hdr-r_speed_preview at the bottom.
Add luts and/or a CR2(white balance) next to the file/files. You will get one preview png file which you could also use as a starting point for creating complimentary luts in Davinci resolve for instance. Also added som luts and white balance luts which will be added when running a preview file the first time.
When cr2hdr-r_speed_preview is applied to the parent folder it gives the extra speed just as before with the speed_boost service.
*Don,t know if it,s an automator thing but folders can,t be named with spaces or dots or previews won,t work.
When selecting a file
(http://s12.postimg.org/4rvs3au21/Screen_Shot_2015_05_17_at_09_34_55.jpg) (http://postimg.org/image/4rvs3au21/)
When selecting parent folder
(http://s24.postimg.org/bmbtj7q8x/Screen_Shot_2015_05_17_at_09_39_42.jpg) (http://postimg.org/image/bmbtj7q8x/)
Once again... Brilliantly done with the newly revamped speed boost service which also allows previews now -- simply amazing!
Thanks again as always, D!
Thanks mate :)
Installed 8.0 and just shot a few more test shots (RAW HDR, Dual-ISO) on 5D3 w Nikkor 24mm 2.8 -- will post results hopefully before I leave for work.
(https://c2.staticflickr.com/6/5444/17717477599_3f7dbcf761_n.jpg) (https://flic.kr/p/sZCGPH)
Thanks, D!
Nice. I,m implementing an automation workflow with included multiple CR2 files in PRORES folder. More about that later :)
Version 8.2, first post.
Trying out a feature.
- Automated CR2 white balance handling(PRORES folder only)
Workflow
1 - Take a preshot CR2 still image with chosen/correct white balance before filming. When changing white balance take a new chosen CR2 white balance picture before filming the next scene. Keep on going.
2 - When finished simply drop all mlv/raw files together with all preshot white balance cr2 stills. White balance from your CR2 will be applied according to time filmed and group the CR2 to your movie files, fully automated. Do not mix raw and mlv files when doing this. Not working with dual iso files handling.
(http://s15.postimg.org/lrwzlzkyv/Screen_Shot_2015_05_21_at_21_56_18.jpg) (http://postimg.org/image/lrwzlzkyv/)
Sounds so friggin awesome! Such a brilliant idea and actually makes shooting more fun and fluidly with the ability to snap a photo after each scene without hesitation. [emoji56]
Also it would be even more awesome if you were able to implement the ability to throw in RAW and MLV along with Dual-ISO files all together but I understand that it may be too complex w the coding.
Great job once again with your amazing work. Keep up the eagerness and it is much appreciated, D!
[emoji108]
Version 8.4, first post
Calculations found out through dcraw and from discussions with Chmee(Thanks!) here
http://www.magiclantern.fm/forum/index.php?topic=5618.msg148135#msg148135
and here
http://www.magiclantern.fm/forum/index.php?topic=6779.0
- Added white balance matching with dng files in parent folder
Works the same as with PRORES foldes. Snap a CR2 with white balance and then start to film. When changing white balance, snap another picture and then continue filming. Keep going. When finished drop the mlv/raw files in parent folder with CR2 files. It will automatically choose the preshot CR2 and the group of files filmed after taken the CR2 file. It then takes the next CR2 and moves on to the next group of movie files.
- As these CR2 files will interfere with dual iso CR2 conversion you have to write WB or wb to ONE of the white balance CR2 files. That way it will pass on the dual iso conversion and use these CR2 files specific with mlv/raw files. Don,t mix mlv and raw files as in the picture when using wb CR2 files.
example
(http://s9.postimg.org/x2afi9d0b/Screen_Shot_2015_05_24_at_20_56_09.jpg) (http://postimg.org/image/x2afi9d0b/)
*Fun StuFF 8.4*
Shot on 5D3 earlier this year in h.264 format (not RAW) 720p 60fps HDR video on 5D3 and converted files with 8.4 which worked well -- Thanks, D!
(https://c4.staticflickr.com/8/7743/18153746801_06a6df4753_n.jpg) (https://flic.kr/p/tEbGsv)
(https://c4.staticflickr.com/8/7733/18152616505_2b9f1b46e4_n.jpg) (https://flic.kr/p/tE5UsD)
(https://c1.staticflickr.com/9/8867/17532032163_c32c3b8095_n.jpg) (https://flic.kr/p/sHffmB)
(https://c1.staticflickr.com/9/8870/18153745861_e164eede12_n.jpg) (https://flic.kr/p/tEbGbi)
(https://c1.staticflickr.com/9/8774/18126133476_6dd2484653_n.jpg) (https://flic.kr/p/tBKaYG)
(https://c1.staticflickr.com/9/8760/17964738968_6d0e3f33d4_n.jpg) (https://flic.kr/p/tntZ1L)
(https://c4.staticflickr.com/8/7796/18126133066_72ceb07201_n.jpg) (https://flic.kr/p/tBKaRC)
(https://c4.staticflickr.com/8/7775/18152615215_c6c743d459_n.jpg) (https://flic.kr/p/tE5U5p)
(https://c4.staticflickr.com/8/7790/17964737818_f12e36766c_n.jpg) (https://flic.kr/p/tntYEW)
https://vimeo.com/128966965 (https://vimeo.com/128966965)
Cool, thanks for sharing
Up next will use these files again and export from AE with Pixlemotion plugin per your suggestion from earlier.
[emoji3]
version 8.5 first post
Reworked the speed_preview workflow.
http://www.magiclantern.fm/forum/index.php?topic=13512.msg147712#msg147712
By right clicking on a raw/mlv/mov/MOV file you get one preview png frame from the chosen file/files works with following files.
- MLV/RAW regular files
- Dual iso movie files
- Higher fps, 48, 50, 60 fps (will autocorrect aspect ratio)
- HDR recordings - You have to put in the word HDR in the file for the preview to recognize it as a HDR file! example M09-1234hdr.MLV
- MOV, mov regular files (might be handy previewing 3d luts in general
Main usage is for a fast workflow with trying out 3d luts and checking CR2 white balance before taking of in the PRORES folder.
Simply add the chosen lut and/or the CR2 wb file next to the files and run the preview service.
Start up idea I had from dmilligan compression mlv tool which works with an automator service.
for f in "$@"
do
By adding above it works on selected files.
Then I added below for listing directory
cd "`dirname "$f"`"
Incorporated 3d lut, wb support, used mtime to only erase 30 sec old clips and used g3gg0, A1ex cool mlv_dump -f frames to extract only a few frames from the file. This and a lot of other stuff :)
All scripts are provided in the download package.
Added some more luts created in da vinci resolve. Will be automatically copied to folder when using the speed_preview on a file.
Just downloaded 8.8...
tempted to check out the new preview method!
:D
Thanks, D!
*update*
(https://c1.staticflickr.com/1/473/18451591361_081509016a_n.jpg) (https://flic.kr/p/u7vegx)
This can be a fun feature (I often have to remind myself to delete png files after each previews otherwise it won't take effects if I were to leave them in) though not sure if this was to be expected?
It can sometimes be confusing when trying to decide which log/luts I used previously that looked good from last time I used the app (any suggestion on how to make myself familiar with them ) other than spending more time with it in order to speed up the workflow -- no pun intended! lol
Looking forward to see the results!
*cheers*
Your welcome.
* Thanks for feedback. What would be a faster workflow with previewer?
Don, t understand the question with luts. I always use dan_log_01 or 02 as base log and then it is up to the user to add wb and/or contrast_03 lut.
HDR folder has dan_log_01 hardcoded in the script so no log is needed in that folder.
I guess I can easily forget which LUTS to use after applying the logs (either dan_log_01 or 02) then this is where I get a brain freeze (or writers block) if I may say...
so I guess a faster workflow would be if possible if I can just run preview again with different LUTs AFTER previously running it as oppose to having to delete the PNG files each time? (not that I do mind but it kind of slows down the thinking process a little bit) unless I'm missing something...
Does that make sense?
Yea, I had automatic png removal before. Might throw that back in there. Will think a bit.
Another issue is that preview doesn, t work with spaces in folder names. Annoying. Tried adding quotes in script but no succes.
I know I read that and didn't use spaces or dot which worked fine.
But with It does not.
Not that important comparing to others I would say.
Hmmm?
Great work though as I'm very pleased with having the ability to keep myself from exporting ProRes again only because I didn't Iike the look from the logs/LUTS I chose...
Overall it's an excellent addition & a great tool -- just needs a little refinement and it'll be gold!
Updated the previewer. Download in first post. On rerun of the speed_preview service png files will be erased. All png files within 20 minutes that is. Older files you have to manually delete.
Version 8.9
I added a batch_folder inside the dan_log_luts. Dan_log_luts folder is created when running speed_preview service on a raw/mlv file the first time. You can put in up to 10 files in then batch_folder and then run the speed_preview on a selected file. This will run all .cube files from inside the batch_folder and generate their names. Typically you start of with testing all your logs. Find one then go for lets say white balance luts, pick one, and finally run all your rec709(contrast) luts and pick one. You now have a combination of three luts tested and ready for batch run in the PRORES folder.
Might clear things a bit with short tut.
https://www.youtube.com/watch?v=LLMhCsqS7xc&feature=youtu.be
Now I'm starting to smell gold as we move on to 8.9 and can't wait to get my hands on this as soon as I get home from work!
Love how you're digging in like crazy with speed_preview especially the newly implemented batch_folder -- nice tutorial btw!
8)
*feedback/question*
Just got home and was anxious to get my hands on 8.9 -- however after reinstalling it twice (just to be sure it wasn't a bug) but it could be and apparently once I start the speed_preview after placing the 3 logs in batch_folder from Dan_log_luts folder per your suggestion via tutorial and it produces two DNG's files but then it randomly stops before spitting out png's.
https://vimeo.com/129955819 (https://vimeo.com/129955819)
Hopefully this is an error on my part instead and maybe you can point me into the right direction?
Im on a cellphone. Cant really see :).
I reuploaded a late fix some hours ago. Male sure it, s the latest download. No spaces or dots In the folder name.I, ll check your movie when home again.
Thanks for feedbacks.
Yep, just downloaded it from first post 20 minutes ago and was using the same folder/files that I had tested with previously which worked fine but not with 8.9 -- no worries & no rush!
I can wait on it... Thanks again for this awsome feature with update and it'll be worth the wait for the gold rush!
:P
Tried reproduce but couldn,t. If you double-click install.command, does it say ffmpeg is missing or ffmpeg exists?
* For now preview function don,t work when using spaces and punctuations(dot) in the folder name.
*feedbacks*
Downloaded 9.1 (Thanks for the reminder) and I'm impressed with how quick the previews actually come up... Great Job!
https://vimeo.com/130069956 (https://vimeo.com/130069956)
(https://c1.staticflickr.com/1/477/18565505686_5403e22d88_n.jpg) (https://flic.kr/p/uhz52C) (https://c1.staticflickr.com/1/542/18404226090_b198f21dab_n.jpg) (https://flic.kr/p/u3jtdW) (https://c1.staticflickr.com/9/8856/18593983591_02638586bd_n.jpg) (https://flic.kr/p/uk62vZ) (https://c1.staticflickr.com/1/373/18405716119_5578b8e1a7_n.jpg) (https://flic.kr/p/u3s7a6) (https://c1.staticflickr.com/1/381/18593983151_7d91507cd8_n.jpg) (https://flic.kr/p/uk62op)
I tried running the same speed preview in HDR folder -- is this not to be expected to work because I tried it and it doesn't do the trick - normal?
I think I used both .MOV and RAW in HDR and neither didn't spit out any png's...
Currently testing out the align sharpening for HDR .mov files again with 9.1 -- Thanks again, D!
Thanks for sharing workflow and testing. I think mlv files will work in HDR folder. MOV files works outside and it is really not a priority. I only kept it in there out of laziness :).
Regarding RAW. SInce mlv_dump has the ability to determine how many frames to extract I can stop after lets say ten files but with raw I have to simply kill the terminal process. I have put it to stop at 0.5s. When it comes to HDR files I select frame 9 and 10 and if the raw file hasn,t extracted up to at least ten frames it won,t have any files to work with. Maybe I have to set it to extract for one whole second instead of 0.5s.
Version 9.2
Extended preview RAW to 1 second extraction before terminating process. Shoud now work on lazy ;) computers extracting/creating a HDR preview.
Also added automated inclusion of CR2 files when running .cube files from batch folder for correct white balance.
* Version 9.3
-Add up to 20 luts simultaneously to your files in PRORES folder. Up to 10 luts in HDR_RAW_MLV_MOV folder.
-Removed hardcoded lut to HDR files
Version 9.4
- Readded possibility to change settings to the image by adding commands to the generated png preview. Following information is provided in the lut_lab folder which is copied to location from when speed_preview service is run the first time.
"Regarding generated png files.
Ability to change following settings directly in the generated png file. You can add all three settings to the same png file. Just keep the png file when running cr2hdr-r while creating prores files.
Brightness
b-10 to b10
example_01(brighter)
M03-2312_1_2015-06-12_0001_C0000_000000b2.png
M03-2312.MLV
example_02(darker)
M03-2312_1_2015-06-12_0001_C0000_000000b-2.png
M03-2312.MLV
White balance
w01 to w20
example_01(cold)
M03-2312_1_2015-06-12_0001_C0000_000000w01.png
M03-2312.MLV
example_02(warmer)
M03-2312_1_2015-06-12_0001_C0000_000000w20.png
M03-2312.MLV
Denoise
denoise01 to denoise10
example_01(less denoising)
M03-2312_1_2015-06-12_0001_C0000_000000denoise01.png
M03-2312.MLV
example_02(more denoising)
M03-2312_1_2015-06-12_0001_C0000_000000denoise10.png
M03-2312.MLV"
Man.. the icing on the cake just never ends, doesn't it? If it ain't too sweet, then it ain't enough. If it ain't broke, then it hasn't meet it's potential (not if it ain't broke, don't fix it). 8)
Just downloaded Version 9.4
Looking forward to playing with your new features re: B.W.D. commands -- do I still type in the word 'sharpenalign' at the end of the file on top of directory or is that not needed any longer?
Thanks a bunch, D!
Still work in progress :)
Version 9.6
- speed_preview now works with brightness and white balance commands
- added previews for CR2 files. Good for creating lut base working with highres still images
- added MOV and other formats that might work. Try out and see what works. Will export one frame to jpg
From txt info file in lut_lab folder
"*
When using speed_preview for generating previews, if you want to use brightness or white balance settings simply write the command straight to a MLV/RAW file
example
M03-2316b3w20.MLV
Will generate this png
M03-2316b3w20_1_2015-06-12_0001_C0000_000000
Keep it when you want to run the PRORES transcoding and it will pick this particular file to go with the original MLV."
https://vimeo.com/130580854
I seem to forget how to apply more contrast within the luts to use for .png speed preview??
excuse for my noobness...
:P
To get control over lut looks you start with the logs to see what is good. You can add up to ten in the batch folder. Throw one out that you like and then continue with filling the batch folder with all the contrast luts. Mixing logs and luts in the batch folder won,t do the trick ;)
Two step operation to achieve a base look. Check the vid again.
https://www.youtube.com/watch?v=LLMhCsqS7xc&feature=youtu.be
Sorry got bad news on my end... totally my fault as I was trying to clean up my external drive to place the original MLV files back into another folder in order to make room for another test run and somehow I accidentally deleted all the MLV's (not knowing) and emptied the trash on the OS X system -- I've just tried to recover the MLV files through 'DiskDrill' app that I have but no luck yet so far. Such a shame on me! (though I am confidence I'll get those precious files back!)
Good thing I have all the DNG's already converted somewhat properly and will have to stick with these merciful DNG's -- whew such a lifesaver you are, Danne, huh?
Imagine If I had only been using MLFVS... I would have been very upset and depressed for a quite while... such a devastating feeling losing loads of MLV files is like burning your films in a barrel of fire!
Anyway here's a quick sneak peak from one of my favorite Dual-ISO files...
Watch how much more DR I can gain with Dual-ISO (plus using ND.9 filter) on 16-35L II wide open in 29.97fps @ ISO 100/1600 along with the use of Cinelog-C in post (Thanks @Andy600) and here's the workflow as it follows:
cr2hdr-r 2.2 > AE (Smart Import 2 w Cinelog-C) > FCPX (used @Danne's LUT's plus Eastman from @Andy600's -- all three combined) for a contrasty decent warm filmic look...
https://vimeo.com/130798248
Thanks for 9.7 and will definitely check it out!
Question... if I no longer have the MLV files to convert... am I allowed to run newer version with converted DNG's just to fix whatever needs to be fixed or is it already baked in?
Sorry to hear about the loss of mlv files.
Cr2hdr-r works with mlv/raw files so dng sequences will have to be run in outside NLE.
no worries. Check out this clip below. Nice Dual ISO combine with your LUTS and Andy's...
https://vimeo.com/130819329
I'm just trying to narrow down this so called bug when it won't go by each sequence folder after each ACR settings applied (adjust exposure & apply Cinelog-C) but instead it just keeps popping up ACR for me to adjust by each DNG frame by frame as oppose to Folder by Folder from each MLV... does this make sense?
It works great if I use MLVFS (tho I confirmed in exiftool that both cr2hdr-r & MLVFS seem to spit out 16-bit dng's but not sure if that's the factor here?)
I'll shoot a screen flow of what Im talking about when I can...
Once Smart Import 2 works with sequence folders then this workflow would be champ and yet so safe to use!
Thanks again for everything bro!
*edit*
It looks promising with the recovery of MLV's in progress... Special Thanks to Disk Drill! 8)
(https://c2.staticflickr.com/6/5533/18224013953_b926636282_n.jpg) (https://flic.kr/p/tLoQr8)
Stay calm. Foam Party!
Script problems might be related to dng meta tags. Mlvfs runs cdng with tags categorized differently from dng files coming from mlv_dump and raw2dng. It is just guessing here. Think you have to investigate further.
It is definitely related to the dng meta tags. Still have to investigate furthermore.
Meanwhile I wanted to share some fun stuff from using 2.3 with 70D files.
70D MLV Cinelog-C (Koji Sony SLog3Sgamut3Cine to SLog2709 2383 + @Danne's customized LUT's) (http://www.magiclantern.fm/forum/index.php?topic=14309.msg149652#msg149652)
*feedbacks*
Ran 2.4_fm (Thanks for that!) and love the fact that I can check out previews of dng's files within the directory while it's rendering.
(https://c4.staticflickr.com/4/3737/18840327156_690b805c14_n.jpg) (https://flic.kr/p/uGRASQ)
It sang beautifully well and once it was all done, packed and organized nicely (very handy!) and opened AE...
https://vimeo.com/130902116
It was one of the best feelings in the world especially after waiting for literally like two good years (my fault on that) to get this remarkable app of yours to mate well with Smart Import 2!!! LOL
Now I owe you a REAL drink, or two.
8)
hehe, thanks for sharing. It,s always good to see good use of the nice tools from the great ml coders and that my scripting at last start to work and give some nice results ;).
version 9.8 and version 2.4
- Added CR2 white balance support also for dual iso movie files. This works for files in the parent folder only.
It is supposed to be sort of intuitive in that sence that cr2hdr-r will always pick the CR2 file photographed closest to your mlv/raw file. This means you can have a bunch of CR2 files in the folder, it will still choose the one still image you took right before starting filming.
* You can mix dual iso files and non dual iso files when using CR2 workflow. Don,t mix raw/mlv files if you want the right CR2 to be picked.
version 9.9 and version 2.5
- Added auto white balance to dng files if no CR2 file is added. It adds auto wb multiplier generated from dcraw.
version 10.0
-Added ability to include xmp files. They are stashed in the dan_log_3d_luts folder which is copied to folder when using the speed_preview as preview service. Include one xmp and some parameters will be applied when viewing the dng files in acr. Only the first files will have a different setting from the xmp. Not all.
Thanks, D for implementing the ability to use xmp files to generate certain looks created in ACR... totally nice!
(https://c1.staticflickr.com/1/387/18983835619_320cb3a5fe_n.jpg) (https://flic.kr/p/uVx7WF)
Will report feedbacks after more in depth testings.
Thanks.
- as it snaps the xmp next to the mlv/raw file and applies this to the first dng file nine more alternatives are created.
Good or bad? Should it only use the first one?
Also. Should the xmp apply to all the dng files or only the first? It, s all a matter of a little extra time it will take for it to be added. AE I believe only needs the first file in a sequence.
Alternatives as in what are being used based on the sliders in ACR? (is that what you meant?)
If so, I think it's a useful feature. I'm looking at the ProRes file spitting out from beta 10 and I was surprised how close (or spot on) it looks from the adjustments that I made in ACR would show up on movie file without any flickering -- AWESOME!
I think you are correct that it only needs to be applied to one DNG per MLV... because I just tested out by opening the DNG sequence folder spitted out by beta 10 in AE with Smart Import 2 and it worked like a charm!
I was surprised to see that once the DNG file opens up and I looked at the ACR with all settings at "0" even tho I notice that colors are what was applied from previous .xmp file being used from version 10 (but doesn't show up on ACR during 2nd time) while doing this test on AE.
Maybe it's not that important since it was already applied from the first time using your app. right? :P
This new addition feature of yours with being able to read xmp files sure would help us to skip AE which can save us time.
xmp feature only works in parent folder, not with ProRes.
Oh right duh that makes sense -- will run it again and thanks for the double clarification that I supposedly missed.
[emoji5]️
No probs :D
Sorry. Im new with this amazing app, but I can´t get it to work. I have download I think all the files. I have INSTALL FIRST the command stuff, and the run the app and select the folder in the CF CARD where the MLV hdr files are and them some folders appear like ORIGINAL, but inside the folders there is not any mov or converted dngs. I don´t get what to do.
Can anybody help? Thanks. I have a mac yosemite and 5D mark 2
THANKS
You need ffmpeg for it to work. Link and description in first post. The binary has to be placed in /usr/bin/ folder.
Also recommended that you place your files on the computer rather than working from cf card.
I have ffmpeg in this place "usr/bin" because first it says was missing, but as I say it doesn´t work.
Ok, so if all is installed you follow the instructions
1 - On first run the app creates folders and then it quits. (PRORES, HDR_RAW_MLV_MOV, ORIGINALS folder)
2 - Place the files in the folder that you want. For instance if you want HDR files you have to move the HDR files to the HDR_RAW_MLV_MOV folder. If you want prores files move your files to the PRORES folder. If you only want dng folders keep the files in the parent folder. That is outside the other folders.
3 - When all files are sorted in the right folder you run the app a second time and then the transcoding will start searching through the folders one by one.
*If it says ffmpeg is missing you have to manually put it in the /usr/bin/ folder since it is not provided in the installation package.
Great job on updating the first post with guidelines, valuable information and useful tut's for others. Thanks for keeping up with your work ethics, stay strong and be swell!
Man it feels good to be back in here... I decided to give it another run with cr2hdr-r again from the service workflow with a bunch of quick Dual ISO shots (did a bunch of quickies from varies of cameras for @AWPStar) anyway I noticed this odd behavior or bug when viewing my EOS-M files through ACR within AE during SmartImport2 -- I noticed that a few out of several of the converted DNG's stated that the camera was 5D3 but it was really from EOS-M... I'm sure this has happened before and you may already be aware of it but what can I do to help you fix this?
If possible?
Hope all is well with you and the family at home!
8)
Not sure where the problem occurs. Could you tell me more?
Here are the quick M (https://mega.co.nz/#F!CoUmmCAT!bbt5LpCVkgPRke79J4GQ6w%3Cbr%20/%3E/M)files... You'll see what I mean. mean.
No files in the link.
I need to know where in the program you converted the files. Did you reproduce the problem. How was the files lined up in the folder?
My apologies for the silent treatment. Got caught up with work lately. Decided to run Beta10 instead of the service workflow (twice to be sure) and this is what I was able to reproduce...
https://vimeo.com/134869764
Spanning files seems to occur during crop mode shooting but not sure if that's the culprit here.
No big deal though just thought it was worth noting.
Will try to shoot some more test files (non crop and crop mode) to determine the real problem but then again there may be no problem at all but just points back to the limitations of the EOSM being shot in Crop-Mode because it just randomly spits out spanning files (tho I admit that I had to turn off camera by taking battery out because it just kept saying "busy" after finished recording the crop-mode shots thus the reason why it kept creating spanning files but theres really nothing in it? Just all pitch black just like how you see it in the video.
Sorry for the off topic but I probably should post this to the EOS M thread... Thanks again,D!
Hi deafeyejedi. Always nice with a video. I, ll check it when it, s ready.
By the way. Do I have a "workflow" that differs from beta10 and the 2.5 version somewhere :)?
The M15 numbered file doesn,t have the original .MLV file so it can,t convert anything. The other issue I have no idea how to look for. I may very well be fully related to the eos-m camera so that has to be ruled out first.
THanks
Updated to version 10.7_align in first post.
Biggest changes is in HDR_RAW_MLV_MOV folder. As default I added jerrykil align script implementation to HDR conversion. It is multithreaded although slow. It will give you much better quality to your HDR files. To disable it write the letter x to a RAW/MLV file. More info here.
"HDR_RAW_MLV_MOV folder
Main usage
RAW, MLV files
1 - Create a folder and put in either RAW, MLV, mov, MOV files in your created folder. Preferrably files filmed in 48, 50 or 60 fps but other fps settings will also work.
2 - Double click cr2hdr-r icon and when the prompt opens select your parent folder. An ORIGINALS colder will be created in which the originals (RAW, MLV, MOV, mov) files will be stored. First cr2hdr-r will create regular .MOV file of your RAW/MLV files, secondly it will create a second .MOV file which will merge the frames and create the end result.
MOV, mov files
1 - When filming h.264 HDR the cr2hdr-r goes right into creating a HDR file and creates a second .MOV file for end result.
NOTE_1
Aligning.
As default cr2hdr-r is set to align RAW/MLV HDR files. This will take longer but the end result is much better than without aligning. To disable the align feature simply put the word x in the name of one of your RAW/MLV files. This will disable aligning for all files making conversion much faster.
example
M02-1721x.MLV
NOTE_2
sharpen
HDR files filmed in h.264 tend to be softer since the preferred method is to film with camera settings set not to sharpen in camera. By writing the word sharpen to one of your files. This will sharpen all of you MOV files. Preferrably you use this with h.264 files and not RAW/MLV files.
example
O42A9647sharpen.MOV"
Hi,
When i transcode a normal mlv file, i have a "Canon EOS 5D Mark III" metadata in the resulting DNGs, but when i transcode a dual iso mlv i end with a "canikon" metadata in the DNGs. The consequence is to not be able to choose camera profile in ACR. It is not specific to this last version, i think.
Have i missed something?
Regards,
Which version of this converter did you use?
Havn, t checked dual iso in a while. Did you run the app outside the downloaded folder? Put the cr2hdr-r onto your desktop and run it from there and report back.
It's version 10.7_align. The app was run from the applications folder, and i made another try putting the app on the desktop. The folder containing the MLV file is on the desktop.
If i open the dual-iso MLV with MLVFS i can see that the metadata tag is "Canon EOS 5D Mark III" in the DNGs.
When i use CR2HDR-R to convert the dual-iso MLV, i have a "canikon" metadata tag in the DNGs after conversion.
Gonna check later what, s going on. Thanks
@Bayard1965
Just ran the 10.7 version cr2hdr-r with a dual iso file and metadata copied fine to the new files. Try download the 10.7 version again and do following if you havn,t done so
1 - run the uninstall.command before running the install.command
2 - run the app again
By the way. What OS version are you using? If it,s not working, could you upload a sample dng?
Also try downloading a later version of exiftool. Shouldn, t b necessary since a version is provided but worth a try.
Thanks.
@Danne
Running the uninstall.command before running again the install.command resolved the problem, now it's works. I have the good tags embedded in the DNGs.
I do not understand why, but it's works.
Thanks a lot.
Bayard1965.
Probably you were using an older build of exitool or cr2hdr20bit. Good you solved it.
*new stuff
folder_ProRes444 workflow
Updated top of first post with a download link
Been thinking of creating an automator workflow service which would transcode folders of dng files to ProRes444 files. Mainly to be able to use it with dmilligan,s highly useful mlv file system or if having folders with dng files lying around. folder_ProRes444 transcodes multiple folders in parallell and these files are exported next to the mlvfs partition in to a created PRORES folder. Has to be this way since It can,t create subfolders in the mlvfs partition. It will scale stretched slowmo footage.
How to use it
1 - Install the the folder_ProRes444 service.
(http://s16.postimg.org/6ibgk7e3l/image.png) (http://postimg.org/image/6ibgk7e3l/)
2 - click done.
(http://s16.postimg.org/m2iuaqo81/image.png) (http://postimg.org/image/m2iuaqo81/)
3 - Select only ONE folder in the mlvfs partition(see pic below). This will make the workflow search through the whole directory and transcode 3 or 4 folders in parallell and continue til all folders are transcoded to ProRes444 mov files. Don,t select all folders at once since it will start to convert all folders at once. Bug.. Fixed.
(http://s16.postimg.org/da1vn2335/image.png) (http://postimg.org/image/da1vn2335/)
4 - Wait for the files to get ready. The files will be placed in to a created PRORES folder next to your mlvfs partition.
(http://s16.postimg.org/ysn2ntw69/image.png) (http://postimg.org/image/ysn2ntw69/)
This is so much like Beauty and the Beast...
Finally a happy ending for all of us and I also tested this new workflow service while playing with AE to see if I can still color grade them while exporting ProRes444 for me to use as dailies or quick previews for clients or even use them to color grade (maybe not as good as if you were to use as a flat log) which seems to work well!
https://vimeo.com/140266576
Merry Christmas, Danne! [emoji12]
folder_ProRes444_lut (alpha)
Updated first post with yet an additional workflow service. This one includes the ability to use 3d luts in the conversion process. It,s on the top first page.
Instructions are included in the download. If any problems, write here.
folder_ProRes444_lut Download in first post
There is some more "howto" info in the download.
Some different updates amongst them being able to include a single dng file in lut_hold folder for linear white balance. Mlvfs is delivering correct wb when shooting in "k", manual wb mode, but sometimes you might want the same wb for all clips if camera was set differently for some reason. Recommended to simply drag a dng(or CR2) file of choice through mlvfs straight to lut_hold folder. Wb multiplier settings will apply to all ProRes files.
01 - Install the the folder_ProRes444 service.
(http://s14.postimg.org/3uoq0jw8t/01_Install_the_the_folder_Pro_Res444_lut_servic.png) (http://postimg.org/image/3uoq0jw8t/)
02 - click done.
(http://s14.postimg.org/5xz587w1p/02_click_done.png) (http://postimg.org/image/5xz587w1p/)
03 - Select one folder in the mlvfs partition to start the transcoding(see pic below).
(http://s14.postimg.org/jhfzdxa0t/03_Select_only_ONE_folder_in_the_mlvfs_partiti.png) (http://postimg.org/image/jhfzdxa0t/)
04 - PRORES folder and two more folders inside PRORES folder will be created next to your mlvfs partition for a 3d lut workflow. After the folders are created the workflow will quit. This will give you time to select 3d luts which you put in the lut_hold folder.
(http://s14.postimg.org/tax6qqc59/04_PRORES_folder_and_two_more_folders_inside_P.png) (http://postimg.org/image/tax6qqc59/)
05 - When luts are ready start the workflow a second time. More info inside dan_log_3d_luts folder
(http://s14.postimg.org/6ky1xqsxp/05_When_luts_are_ready_start_the_workflow_a_se.png) (http://postimg.org/image/6ky1xqsxp/)
06 - lut_hold folder now supports linear white balance when including a single dng or CR2 file. Wb multipliers from the selected dng will be used to all mov files.
(http://s14.postimg.org/tg5je58u5/07_Include_a_dng_file_for_linear_white_balance.png) (http://postimg.org/image/tg5je58u5/)
07 - Create a HDR folder in PRORES folder for HDR transcoding
(http://s15.postimg.org/bbsytgoxz/08_Create_a_HDR_folder_in_PRORES_folder_for_HD.jpg) (http://postimg.org/image/bbsytgoxz/)
08 - fill the batch_folder with different luts.
(http://s2.postimg.org/4feir944l/09_fill_the_batch_folder_with_different_luts.jpg) (http://postimg.org/image/4feir944l/)
09 - Work_with_previews_also_in_HDR
(http://s29.postimg.org/br0vwnrc3/10_Work_with_previews_also_in_HDR.jpg) (http://postimg.org/image/br0vwnrc3/)
tutorial
Hi Danne -- excellent work and exciting to see active development in action.
I took a look at cr2hdr-r a few months ago but at the time I was only using dual_iso for still images and I was also learning how to use Lightroom so I decided to go with kichetof's Lightroom Dual ISO Plugin. Now I'm looking into shooting a project in raw video so I'm trying to figure out a workflow to deal with the MLV files and whoa! I'm confused by the sheer number of options available. Of course everyone seems to have their opinion on which is the "ideal" workflow.
Revisiting your project I'm also finding it somewhat confusing because it is not only for dual_iso but it also encompasses raw video, export to ProRes, LUTs, etc. I'm sure this all makes perfect sense to you and other users who have been following your project but I've already run into issues trying to install the command line tools your project depends on. For example, in your source code you have:
/usr/bin/enfuse
Mac users should be aware of the restrictions that the latest OS, "El Capitan" is putting on where files can be installed and /usr/bin is now off limits. There are ways to work around this but maybe we should ask ourselves if defeating these new Apple policies is something that we really want to do in order to get things working as they used to. The flip side of that argument is that Apple is doing things wrong because OS-X (a.k.a. Darwin) is a Unix type of system and "The UNIX Philosophy" (http://www.amazon.com/UNIX-Philosophy-Mike-Gancarz/dp/1555581234/ref=sr_1_1_twi_pap_2) is to work with a bunch of small programs installed on the system each doing a specialized task, the output of one piped into another and rely heavily on shell scripts to glue them all together. So, why not have it both ways? It seems that it would make everything much simpler if all of the dependencies are bundled inside of the app so the user doesn't have to install half a dozen apps in various directories.
I heard of issues regarding "El Capitan" even before updating my system. A cr2hdr Lightroom Plugin user was on a location job and the system update broke the plugin. It seems that not only was /usr/bin off limits but the plugin couldn't use anything that was installed in /usr/local/bin either. I was asking for a while why was it that the dependencies for the plugin were included in the package but the Mac couldn't utilize them. By the way, Windows did use them so the plugin had to have different installation instruction for Windows and Mac. I started playing around with the code (Lightroom plugins are actually written in lua) and with the help of dmilligan and johnrellis at the Adobe Lightoom SDK forum (https://forums.adobe.com/community/lightroom/lightroom_sdk) the plugin now works the same on Windows and Mac without the user having to install any dependencies--well, except for maybe the Adobe DNG Converter for compressing DNG's.
The trick (by dmilligan) we ended up using in the plugin looks like this:
if MAC_ENV then
command = 'export PATH="'..LrPathUtils.child(_PLUGIN.path, 'bin"')..':${PATH} && '..command
end
result = LrTasks.execute(command)
However I was also experimenting with a shell script (suggested by johnrellis) that would probably work for this project.
PATH=`dirname -- "$0"`:$PATH
cr2hdr $@
That just might be a fancy way of adding the current directory (represented by a single dot) to the path but it should persist through the rest of the terminal session. On the Lightroom SDK the path setting doesn't persist and needs to be used every time a call is made to cr2hdr. I would try this out on your project but since you don't have your source code on a distributed version control server (like bitbucket.org which is used on most Magic Lantern projects), it makes it rather difficult to submit suggestions (a.k.a. pull requests) to your project.
FYI to the readers of this topic, Danne and I have been sending PM's back and forth and helping each other out but we believe that this conversation might be best done on the forum so anyone can chime in. After all, this is an open source project and user input is not only welcome but encouraged.
Thanks dfort. I,ll check into this asap. Meanwhile all scripts are provided in the download. Really cool if this would work. all binaries are being called upon from usr/bin. Not sure how I would implement the solution here.
I made a demonstration repository for you:
https://bitbucket.org/daniel_fort/cr2hdr-r
Note there is an issue, check it out. There is also a pull request showing a suggestion on how to set the path. In addition there is a download area with your distribution files in it.
Of course this isn't really going to work yet, just a demonstration. I haven't been able to install your project on my "El Capitan" equipped Mac so I can't verify that my pull request even works. I'm also not sure how you have things setup. Is it an Xcode project? I've never worked with one of those.
It takes a while to set up the repository but it is rather easy with the SourceTree app (https://www.sourcetreeapp.com/) which made to work with bitbucket.org. In addition, dmilligan has posted Mercurial tips (http://magiclantern.fm/forum/index.php?topic=9524.0) and he has helped me out on several occasions--I see he's helped you out too.
The great part about this is that other developers, and some users, can easily submit their suggestions yet you still maintain full control of your project.
Quote from: Danne on October 09, 2015, 12:15:41 AM
Thanks dfort. I,ll check into this asap. Meanwhile all scripts are provided in the download. Really cool if this would work. all binaries are being called upon from usr/bin. Not sure how I would implement the solution here.
Your scripts are there and the app is there but how did you build your app? If you setup an Xcode project you will discover that it supports Git or Subversion repositories but the Magic Lantern repositories are Mercurial. There is an Xcode plugin available and it is hosted on bitbucket:
https://bitbucket.org/creaceed/mercurial-xcode-plugin
Getting back to the "El Capitan" /usr/bin issues, here's what happens when trying to install cr2hdr-r.
You've got a script that installs the binaries in "cr2hdr-r_11.7_align/Install these first/install_uninstall.command" and the binaries to install are located in "cr2hdr-r_11.7_align/Install these first/Binaries_cr2hdr-r" so let's see what happens on OS-X 10.11, I'll use dcraw as an example:
First of all check to see if dcraw is installed on this system.
Rosie-Forts-Computer:Install these first rosiefort$ which dcraw
Rosie-Forts-Computer:Install these first rosiefort$ ls /usr/bin/dcraw
ls: /usr/bin/dcraw: No such file or directory
The install script is meant to be run by double clicking on it but since it is from an "unidentified developer" you need to control click -> Open the first time you run it, here's the terminal output:
/Users/rosiefort/Desktop/cr2hdr-r/cr2hdr-r_11.7_align/Install\ these\ first/install_uninstall.command ; exit;
Rosie-Forts-Computer:~ rosiefort$ /Users/rosiefort/Desktop/cr2hdr-r/cr2hdr-r_11.7_align/Install\ these\ first/install_uninstall.command ; exit;
Password:
ffmpeg binary is missing. Download and place in /usr/bin/ folder for Prores and HDR transcoding.
logout
Saving session...
...copying shared history...
...saving history...truncating history files...
...completed.
[Process completed]
So it looks like except for the optional ffmpeg that isn't in your Binaries_cr2hdr-r everything got installed but on "El Capitan" nothing got installed, not in /usr/bin or anywhere else in the system path. Running install_uninstall.command again results in:
Rosie-Forts-Computer:~ rosiefort$ /Users/rosiefort/Desktop/cr2hdr-r/cr2hdr-r_11.7_align/Install\ these\ first/install_uninstall.command ; exit;
cr2hdr-r_speed_preview.workflow
do you wish to uninstall Y/N?ylogout
Saving session...
...copying shared history...
...saving history...truncating history files...
...completed.
[Process completed]
So it seems like it uninstalled but there was nothing to uninstall.
It would probably work following wadehome's instructions:
- Restart the computer, while booting hold down Command-R to boot into recovery mode.
- Once booted, navigate to the "Utilities > Terminal" in the top menu bar.
- Enter csrutil disable in the terminal window and hit the return key.
- Restart the machine and System Integrity Protection will now be disabled.
- Run install from cr2hdr package to install the files.
- (optional) To reenable System Integrity Protection follow the steps above, except use the csrutil enable command for step 3.
However, wouldn't it be better if the app would work without having to install dependencies or work around the new security policies? Placing the dependencies inside of your app, like was done with the Lightroom plugin, and running them from there would certainly simplify the installation. Users could still install custom versions of the binaries if they desire by simply control clicking on the app's icon and Show Package Contents then replacing the binaries.
It, s shell scripts running through automator. I have no idea how to work with xcode. It, s all bash scripts.
I have no time right now but install dependencies will be checked if I could do something about.
Wadehome solution works but I could also direct all binaries to usr/local/bin before a more stable solution is made.
Thanks for taking the time dfort.
Got it--I never worked with automator. Checked out the documentation and it looks like an interesting app. Reminds me of HyperCard which I never learned how to use either. Wow, I just dated myself.
Completely understand about not having the time to do this. I retired recently and can finally put my time into the projects that interest me the most. However I'm getting called back to work to fill in for an editor that landed in the hospital. Didn't know operating an Autodesk Flame was that dangerous :o
Anyway, I took the first (and maybe final) step--changed everything in your ".workflow" files and source code from /usr/bin to /usr/local/bin. The binaries now install in /usr/local/bin and everything seems to be working fine on "El Capitan". One side benefit is that you don't need administrator privileges so I also took out your sudo commands and now the user doesn't need to enter a password to install-uninstall.
Here you go: https://bitbucket.org/daniel_fort/cr2hdr-r/downloads/cr2hdr-r_11.7_align_OS_10.11_test.zip
Hi dfort. I actually have a version with the local/bin folder. Wanted to make sure it was working in el capitan before putting it up.
Something has doubled the size of the "install these first" folder of yours from around 105 to 239mb? I also noticed that when I don,t enter the full /usr/local/bin path to both dcraw and exiftool they won,t work in tha workflow as it would from usr/bin without full paths. They are found in terminal alright but not in cr2hdr-r. usr/local/bin/exiftool/dcraw will work. This goes for OSX maverick anyways.
THanks for pushing this forward.
I'm still trying to figure out how to use this so if something doesn't work I wouldn't even know about it. Now that you mention it I do remember seeing some calls that didn't have the full path to the binary but if I type "which exiftool dcraw" it is in the system path. You're probably right though, we had similar issues with the Lightroom plugin.
By the way, the difference in file size was my mistake. I've got a bunch of extra stuff in your folder_ProRes444_lut.workflow package - no idea how that happened.
:D
I put up a cr2hdr-r version with usr/local/bin paths. Should be ok. Test it if you like.
Excellent progress gents and now I'm itching closer towards to updating to El Captain but I refuse to do so on my brand new MBP -- I don't mind biting the bullet with my old MBP just in case.
Looking forward to testing this out and report back soon!
Thanks!
Oh come on Sean -- get on the bleeding edge!
Seriously, like it or not at some point you are going to have to update or fade into obsolescence.
So back to the topic, this is so much more than batch converting dual_iso files. You can also batch convert MLV files to ProRes in 10-bit log color space? That is huge.
Actually you're right, Daniel! [emoji28]
Yes, sir! Actually this app is one of the greatest stand alone tool that does all the dirty work for you. I seriously cannot wait to meet Danne one of those days and get hammered in Germany!
Try shooting Dual-ISO MLV or RAW and honestly cr2hdr-r is all you need.
Simply start it and sit back for a dip of Tea of have it run overnight for you with peace of mind!
Let's do lunch next week and we'll talk more over this!
Quote from: DeafEyeJedi on October 10, 2015, 04:49:12 AM
I seriously cannot wait to meet Danne one of those days and get hammered in Germany!
I thought Danne was in Sweden. Whatever, count me in too.
Quote from: DeafEyeJedi on October 10, 2015, 04:49:12 AM
Simply start it and sit back for a dip of Tea of have it run overnight for you with peace of mind!
So is the tea so you'll get up several times at night to check on the progress?
Quote from: DeafEyeJedi on October 10, 2015, 04:49:12 AM
Let's do lunch next week and we'll talk more over this!
Next week is good for me. I could use some Magic Lantern tutoring.
Shoot another user error on my part... Sweden it is and for the most part once I'm done with Tea I would probably just swing by and check on it before hitting the sack for the evening!
Other than that it is pretty solid and reliable for the most part!
Trust me I can't imagine life without cr2hdr-r especially when it comes to Dual-ISO, HANDS DOWN!
Don't forget that it also deals with not only Dual-ISO but HDR (both H264 & RAW) files as well as spitting out ProRes4444 in either with a log or LUT applied (even for HDR & Dual-ISO files too) right off the bat hence the title of this particular thread.
After all there's No ACR nor After Effects. No DR12. No Joke!
Basically a poor man's best batch conversion tool especially when it comes to me being lazy at times.
Nice, eh?
Getting hammered in Germany. Too funny :P.
You, re both welcome to Sweden :).
If you, re going prores try out the previewer and the batch_folder function.you quickly spit out batches of looks. I developed this even further in folder_prores444_lut and included some more nice 3d luts.
Might do a video tutorial soon.
I got a chance to try out the installation on a virgin Mac running El Capitan and thought I'd pass along some notes.
First of all it won't launch the "install-uninstall.command" script because:
Quote"install_uninstall.command" can't be opened because it is from an unidentified developer.
Your security preferences allow installation of only apps from the Mac App Store and identified developers.
Google Chrome downloaded this file today at 9:34 AM from docs.google.com.
The workaround for this is to control-click on "install_uninstall.command" and choose Open from the pop up menu. That tip should be in "install notes.rtf" unless Danne becomes an "identified developer" or puts this on the Mac App Store.
(https://farm6.staticflickr.com/5794/21885950120_47c41a054a.jpg)
Here's the terminal session from that script:
Last login: Fri Oct 9 13:28:28 on ttys000
Rosies-MacBook-Air:~ Fort$ /Users/Fort/Downloads/cr2hdr-r_11.7_local_align/Install\ these\ first/install_uninstall.command ; exit;
Password:
mkdir: /usr/local/bin: Operation not permitted
ffmpeg binary is missing. Download and place in /usr/local/bin/ folder for Prores and HDR transcoding.
logout
Saving session...
...copying shared history...
...saving history...truncating history files...
...completed.
Deleting expired sessions...none found.
[Process completed]
Checking out the posts about this issue it seems that if the system had a /usr/local directory before the El Capitan update there's no problem making modifications to it but a brand new Mac like the one I'm testing out doesn't have a /usr/local directory even though it is in the default path:
/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbinApparently there is no way around this. You have to disable System Integrity Protection (SIP) just to create /usr/local. Once that is done you can (and probably should) turn it back on. If you have a /usr/local you shouldn't need administrator privileges "sudo" to make changes.
[UPDATE: I just went into recovery mode, turned off SIP, rebooted, created a /usr/local directory (needed root privileges to do this) then reenabled SIP. Now I can't make any modifications in /usr
or /usr/local. It looks like this is going to be a bit more complicated.]
mkdir: /usr/local/bin: Operation not permitted
That is one crappy situation.
Thanks for sharing dfort.
I guess it,s possible to direct the whole thing to ~/Library/Services/ or something similar?
That is certainly a possibility or you can use Library/Application\ Support or anywhere that you have write access. Then you will either have to set the path or call the binaries using the full path name. My suggestions to put the binaries inside of your cr2hdr-r package was before I understood how it runs--not that I really know now.
The best solution that I have found is to turn off SIP then run this command:
sudo mkdir /usr/local && sudo chflags norestricted /usr/local && sudo chown $(whoami):admin /usr/local && sudo chown -R $(whoami):admin /usr/local
Then immediately go back and reenable SIP. This will allow full access to /usr/local. Now for the fun part, you can easily delete /usr/local but you can't recreate it without doing the csrutil disable/enable song and dance.
[EDIT: I should give credit to that command that sets the permissions for /usr/local. I found it here: http://digitizor.com/2015/10/01/fix-homebrew-permissions-osx-el-capitan/ ]
Just found out why cr2hdr-r breaks after the "El Capitan" update. The update moves files located in /usr/bin and other locations into a quarantine folder located in /Library/SystemMigration/History/Migration-(UUID)/QuarantineRoot/
(https://farm1.staticflickr.com/640/21496304404_cd61521267_z.jpg)
Interesting.
I should have made it into a service workflow. Too late now. When I tried it in the beginning I had the problems with cr2hdr calling exiftool from system rather than from where I point it too. Interesting you found a solution in the lightroom app.
I just made a tutorial about how to use the stand alone folder_ProRes444 workflow. This stores all that,s needed inside the workflow so should work straight away in el capitan.
http://www.youtube.com/watch?v=nllfXNd-U58
Danne--I was going through the steps and believe that your folder_ProRes444_lut.workflow instructions (http://www.magiclantern.fm/forum/index.php?topic=13512.msg154716#msg154716) are showing folder_ProRes444.workflow screenshots.
Still figuring this stuff out but hey, it works great on El Capitan and I was able to make a good looking ProRes Log file without having to install any dependencies.
Thanks for checking. Good that it works on El Capitan. I plan on installing the new OS on a laptop today.
About the screenshots I just named them incorrectly. They are about the lut version. See if I, ll get it fixed soon :).
Mind if I post a feature request?
Rescale image.
Except for maybe the 5D3, most cameras can't shoot 1920x1080 raw video. It is best to do the resizing before creating the ProRes movie file. Then of course there are several scaling algorithms to choose from. It looks like ffmpeg is fully capable of resizing (http://trac.ffmpeg.org/wiki/Scaling%20(resizing)%20with%20ffmpeg) and it also has several scaler options (https://ffmpeg.org/ffmpeg-scaler.html).
Your source code hinted at this possibility:
#FFmpeg used to transcode to ProRes444 with or without audio. FFmpeg will also scale certain kind of stretched footage to get a normal looking file.
#commands/effects used
#-vf scale=iw:ih*1.66
but how to implement rescaling options without overly complicating it? How about the same way you're handling dcraw settings by putting the command line options in text files that you can drop into the lut_hold folder. There are a lot of possible combinations of height x width options when recording MLV. Some need to be stretched or squeezed to create a normal looking image and many won't fit neatly into a 16x9 frame. Add in the rescaling algorithm choices and there's a mind boggling amount of options. Of course you can't include all the options but maybe some of the more popular choices? I'd really like to be able to take MLV files shot at 1280x720 and batch convert them to 1920x1080 Log-C ProRes 444.
As long as we're on the subject of rescaling, dare I mention 4K? Sure, you can't get more resolution when you upscale a single image but what using multiple images? I played around with image stacking with video footage (http://www.magiclantern.fm/forum/index.php?topic=15306.msg149059#msg149059) and though I haven't figured it all out yet there may be some way to create a script that will make this practical. One idea is vary the the depth of the image stack depending on how many images can be stacked before it is no longer possible to align the images.
Been thinking about scaling options. Placing them as droplets in lut_hold folder is possible and probably the best idea. Is 1920x1080 the only wish or could there be more scaling options?
By the way, I skipped all stretching x1.66 in folder_prores444_lut since dcraw reads the default scale tag implemented by dmilligan in mlvfs. Really cool.
About the 4k things I have no idea how to do that right now. What software is used right now? Are you working through command line?
The image stacking experiments I did with Photoshop. No big deal doing it for still photographs but video would require setting up a rather elaborate action (https://helpx.adobe.com/photoshop/using/creating-actions.html#creating_actions) or writing a Photoshop scipt (http://www.adobe.com/devnet/photoshop/scripting.html). Your method of using freely available command line tools like dcraw, enfuse, ffmpeg, etc. along with some shell scripts to automate the process is also a possibility.
For regular scaling I would think that getting the image to fit in a 1920x1080 frame would be the best place to start because it is a well established standard. Sure, some users like working with ratios other than 16x9 but that could be done with custom settings instead of trying to come up with all the possible rescale options.
Is is very cool that MLVFS takes care of any necessary stretching (http://www.magiclantern.fm/forum/index.php?topic=13152.msg153802#msg153802) so you can just concentrate on rescaling to fit the frame. Maybe just crop to fit or letterbox to fit?
I think something along the way like -vf scale=1920:-1 Should keep a constant 1920 and the height will follow accordingly and leave the footage unstretched.
It would also be possible to change the aspect ratio straight in the text document which would leave it up to user to write whatever aspect ratio wanted.
Scaling techniques here
https://trac.ffmpeg.org/wiki/Scaling%20(resizing)%20with%20ffmpeg
How do you set the scaler flags?
Looks like there's a lot there to experiment with to try and find the best quality rescale.
sws_flags
Set the scaler flags. This is also used to set the scaling algorithm. Only a single algorithm should be selected.
It accepts the following values:
'fast_bilinear'
Select fast bilinear scaling algorithm.
'bilinear'
Select bilinear scaling algorithm.
'bicubic'
Select bicubic scaling algorithm.
'experimental'
Select experimental scaling algorithm.
'neighbor'
Select nearest neighbor rescaling algorithm.
'area'
Select averaging area rescaling algorithm.
'bicublin'
Select bicubic scaling algorithm for the luma component, bilinear for chroma components.
'gauss'
Select Gaussian rescaling algorithm.
'sinc'
Select sinc rescaling algorithm.
'lanczos'
Select Lanczos rescaling algorithm.
'spline'
Select natural bicubic spline rescaling algorithm.
'print_info'
Enable printing/debug logging.
'accurate_rnd'
Enable accurate rounding.
'full_chroma_int'
Enable full chroma interpolation.
'full_chroma_inp'
Select full chroma input.
'bitexact'
Enable bitexact output.
Good question. I uploade a version which simply scales without any scaler flags. Not sure what the default scaler is set to.
You can write straight to the text file to change settings.
folder_Prores444_lut, top of first page.
Updated the download again with more info on how to choose between scaler options. Double click scale.txt to read more. This document is also the one you put in the lut_hold folder.
In short. This is base nside the document scale=1920:-1, If you want to change scaler flag it should look like this (example) scale=1920:-1:flags=bicubic,
Simply change the first in the document and put it in lut_hold folder. Somebody mentioned "spline" as a good scaler, scale=1920:-1:flags=spline,
Well that was quick. Only thing is, I can't find the scale.txt in the latest download.
[EDIT: Tried it again and now it is there. Maybe I didn't blow off the old PRORES directory? The scale.txt script is very well commented. Thanks!]
Thanks for the suggestion. Good to have it. Once the dan_log folder or PRORES folder is erased the latest one will be copied to the prores folder with the scale.txt file.
I also must rename or exclude the folder_ProRes444_lut from cr2hdr-r since it, s not updated like the stand alone version.
Only thing is, I can't seem to get it to rescale. Tried it with a lut and tried scale.txt by itself but the size of the ProRes file stays the same as shot. Am I missing something?
Strange. Worked here when I tried yesterday. The scale.txt is in the lut_hold folder?
It was me.
I've too many services and ran folder_ProRes444 instead of folder_ProRes444_lut the second time. Maybe I should remove folder_ProRes? So is this going to replace cr2hdr-r?
Gonna give this a try once my MBP is finished updating to El Captain...
Stand by!
You can skp the folder_ProRes444 and keep the one with the lut at the end. It can,t replace cr2hdr-r since this is only working on folders with dng files. However I had plans on including folder_ProRes444_lut to cr2hdr-r as well but I think I,ll skip that part. I,m about to put up a new cr2hdr-r with some fixes.
I updated first post with version cr2hdr-r 12.0_align
- Included install procedure when using El Capitan.
Will have to do for now since I couldn,t get the migration to usr/local/align to work properly. Procedures are all provided in the install folder. Maybe if I get the the time I give the migration thingy another go with dfort :).
- Dual iso CR2 will now obtain the correct white balance values.
This is working through getting the multipliers from dcraw and then recalculated to fit AsShotNeutral values.
Thanks Chmee, dmilligan, A1ex and others discussing and solving problems related to white balance.
More info here
http://www.magiclantern.fm/forum/index.php?topic=16024.msg155670;topicseen#msg155670
Thanks, D!
Running El Captain and your download link for cr2hdr-r 12.0 from OP seems broken?
Had to take care of a bug. It,s up now :)
@Danne
If I've got "creeping" in the image what am I doing wrong? Don't know what it's called but it's as if there are loads of pixels in the image that are moving / changing exposure fast.
Firmware: 1.2.3
Canon 5D Mark iii
Modules in ML:
Raw Video (mlv) 1920x1080
Dual iso 100 / 800
Video settings in camera:
Manual mode
Shutter 1/50
(AWB or set WB gives the same result)
FPS: 23.976
Workflow:
Record -> transfer through kingston 3.0 usb card reader -> OSX.
Edit with your program cr2hdr-r (put MLVs in folder and run the program, yields folders with dngs and a wav)
DNGs are first created, and then re-created (for the dual iso conversion I assume).
When I edit these files in Davinci Resolve 11 the creeping is present. If I record under same circumstances but with standard RAW (not dual iso) then there is no creeping in the image.
What gives?
Hmm, could you upload dng example? Tried recording with global draw off?
Thanks dfort for /usr/bin/csrutil status. Updated install script in cr2hdr-r to check if SIP is enabled. Also added some previewing changes in folder_ProRes444_lut and some fixes related to batch_lut folder.
@rullebullefrulle.
I checked your files you sent and I say that the creeping is normal when shooting dual iso in non crop mode. To get the best result in dual iso it,s recommended to shoot in 3x crop mode. Examples here
http://magiclantern.fm/forum/index.php?topic=12796.msg125268#msg125268
@danne
thanks for pointing me in the right direction. I found this video to be quite informative for those stumbling on the thread and don't understand what 3x crop means:
http://www.magiclantern.fm/forum/index.php?topic=6039.0
Would you all be interested in a sample video if I would shoot?
Hello forum,
Yesterday I took a few DUAL-ISO shots and was trying to run cr2hdr-r to convert the dualiso files to DNG, but nothing happened. its been months since I tried to convert Dual ISO raw images so I decided to go with the latest cr2hdr-r version (cr2hdr_12_3_align) and downloaded it.
Once downloaded, I first ran the install_uninstall.command (I assume - and hope - that this command would remove the contents installed by the old cr2hdr-r versions?) - as expected it prompted for my password and I entered it, and the command ended with [Process completed].
Then i created a folder called "ML NOV 15" - and ran the cr2hdr-r.app - it proceeded to create those folders (HDR, PRORES, ORIGINAL) etc under the new folder. I copied the DUAL ISO raw images into the "ML NOV 2015" folder. Then ran cr2hdr-r again. It only moves the CR2 files into the ORIGINAL folder - I didn't see DNGs created.
I also saw your DUALISO_TO_DNG app (which seems to be an easier app to use) - followed the steps from youtube https://www.youtube.com/watch?v=Q48HhBDH4Z4&feature=youtu.be ... i created a new folder "DUAL ISO CR2" - right click on services and selected "dualiso_to_DNG". It created a "commands_list.txt" file and a new "ORIGINAL" folder, copied the CR2 files to the "ORIGINAL" folder and... there is no DNG file in sight :( i tried to reboot my machine and re-do the steps - still no dice :(
Did i miss anything? Your inputs are appreciated.
WHat OSX are you on? I tried here and it worked.
Hi Danne, I am still on Yosemite.
i am wondering that maybe because there's "way to many versions" of cr2hdr-r that i downloaded and installed over past few months may have messed something up?
Oh btw I forgot to mention that when I ran the cr2hdr-r and pointed it to the folder with my CR2 (there are only two CR2 files) - it just moved one CR2 , and i had to run cr2hdr-r one more time for it to move the 2nd CR2 to the ORIGINAL folder.
I don,t think so. Try redownload it again and install again. I,m on Yosemite here as well.
Are you running cr2hdr-r from the downloaded folder? In that case put the cr2hdr-r on desktop or in applications folder.
Hello Danne - i copied the cr2hdr-r to the Application folder, and ran it from within the Application folder :(
i just re-downloaded it - but its still showing the same behavior.
Maybe I should have run the uninstall.command from the previous cr2hdr-r version (already removed it) before installing this new one?
Shouldn, t be necessary. Could you film your procedures? Or upload an example file?
Hello Danne - here is one of the CR2 files - https://drive.google.com/folderview?id=0BwB_poTzzVK8fm9OYVcwM002UG9BSDdVb2lPOVd5c2ZkVm1fMkZfWkd6eW9CZDZ6dXpIOE0&usp=sharing
Thank you so much!
P.S. Ooops forgot to mention the file name - its the IMG_9986.CR2 file (city hall pic).
Just tested 9986.CR2 and worked fine.
Does it look something like this in the Binaries_cr2hdr-r folder after you have run the install command?
(http://s28.postimg.org/mqhlb9qqx/Screen_Shot_2015_11_15_at_23_25_33.jpg) (http://postimg.org/image/mqhlb9qqx/)
Hi Danne, yes it looks the same - except of course for the timestamp (i am in Pacific time) :) I have posted the screenshot in my google drive link for your reference.
not sure how to post the screenshot on the forum posting :(
Hm, I have no idea. What version did you hae that last worked? I could upload an older build or try folder_ProRes i sent you.
Thank you Danne - a quick update - it just created a DNG file now for the same CR2 file i sent you- I don't know why its running now but I am glad it did.
When I took the dual iso shots, they look ok, but the processed DNG looks all over-exposed. Did my CR2 look over-exposed to you after it was processed?
i will try the folder_ProRes - where can i get it?
Thank you for your patience, Danne. Really appreciate it.
Check you message inbox. Do you shoot with a 70D? Then that could be the problem here.
Yes, it was taken with 70D - didnt know until now that the 70D shots in dualiso turn out this bad :(
and yes, Danne - i got your message in my inbox now. thank you!
Probably not bad but certain ACR versions will read the file as corrupt. Nothing wrong with the files. You can try change camera model name with exiftool to eos 6D instead.
Thank you Danne, I'll take a look at your suggestion - you're the man! :)
Could you try double clicking this command among a files with converted DNG files coming from a 70D and see if that helps?
https://drive.google.com/file/d/0B4tCJMlOYfirVEpCa2hLdWdBWm8/view?usp=sharing
hi Danne, sorry i don't quite follow the instruction you shared. i did download that eos 6d command but it gave me the "insufficient access" error message.
I believe the intent of this command file is to change the camera model for the converted DNG files from 70D to 6D, and once this command is run I'll reopen the DNG file and see how it looks like?
Anyway, i googled and found some instructions on changing the model using exif -
1. go to Terminal, and navigate to the folder containing the DNG files
2. type 'exiftool -l <dng file name>' - it shows model = Canon EOS 70D
3. type 'exiftool -MODEL="Canon EOS 6D" to change the model to 6D
4. type #2 again - this time the camera model is showing Canon EOS 6D
However, when i tried to open the DNG file in Photoshop - which opens ACR - it still reads it as Canon EOS 70D :(
Appreciate your input!
@ciriuss925 The camera model shows up in a few different places in the EXIF data. What Danne's command is changing and what you are changing are different. Try this:
exiftool "-UniqueCameraModel=Canon EOS 6D" -overwrite_original
I'm surprised that there is still an issue with ACR. It has been updated several times since the problem was first pointed out in this forum.
hi dfort,
thank you for the share! And actually I was able to finally run that Canon_EOS_6D.command!
I am using Photoshop CC 2014 which uses ACR 8.8 - I've read that ACR is now in version 9 and wondering if this 70D dual-iso DNG issue still persists? Which version of ACR are you using, and are you still getting this problem?
Older versions works with 70D. I reckon the problem is a conflict between the color matrices which are the same for both 6D and the 70D.
If the script fails try to give it chmod permissions.
chmod u=rxw [drag script.command here]
hit enter
Hi Danne,
the Canon_EOS_6D.command works now! I followed that chmod command to update the permissions to the file and it worked wonders :) ALL DNG files now open beautifully without over-exposing.
THANK YOU SO MUCH!
You,re welcome. There could probably be a fix in the script that applies the 6D tag to the 70D dual iso files. Challenge would be separating those files from other DNG files from other cameras if you have mixed footage. Of course one could script a question to every file but would slow up things.
Is there a difference between cr2hdr-r OSX app and the cr2hdr- Plugin for lightroom, in the way it works with Dual ISO Video?
In the PRORES folder Cr2hdr-r applies same white level to the file to avoid flicker. It also adds a 3d lut(hardcoded) To bring out the most of the shadows and highlights to the prores file. Multithreading which makes it faster.
If you only transcode to DNG files (parent folder) it will add only same whitelevel and color matrix. The files will be usable in preferred NLE.
Kichetof is working on stuff for film sequences from what I,ve seen in his thread.
Okey, thanks for clarifying.
I,ve added a test out feature in MLP. Downloads in first post. It is an additional MLP_guide workflow which is intended to be installed together with MLP. The guide won,t work if not both workflows are installed. By choosing the MLP_guide instead of MLP on a folder the user will be presented with a few steps which will add settings files to the A_lut_hold folder. It is far from perfect and I,m not sure what more could be done with this through automator.
More info is to be find in the use_guide page 16-17.
User_guide (https://drive.google.com/file/d/0B4tCJMlOYfirRmhwUW5UdTZ0ZEE/view?usp=sharing)
(http://s2.postimg.org/o18o832g9/image.png)
Reworked the list thingy with automator. It,s now called MLP_look_base and it starts off with a look_preset bank followed by a full manual list. More info starting at page 16 in the user guide, first post.
Look_preset bank would be the real game changer here because not only it speeds up our workflow but this is also an excellent way of exporting dailies with ease and basically eliminate the need of an IT on set.
It's a friggin' Robot named MLP and Thanks, Danne!
[emoji319]
Your welcome Sean. I also included a MLP_look_base(app) in there. Does the same as the workflow but more like cr2hdr-r in that sense you choose a folder with files instead of right clicking.
I'm having trouble getting MLP to produce ProRes files. i have my clips in DNG folders through MLVFS. I right-click a folder and select MLP, then the PRORES folder shows up and after I add a LUT to the hold folder and right-click the DNG folder again, the automator wheel spins for a little and then goes away. But no MOV file ever shows up. Is there a setting I have to enable or something?
Sorry but I've poured through the user guide and page after page of this forum with no answer, it's really baffling me...
Did you follow the howto file in the download? FFmpeg has to be installed for prores to be created.
MLP is kind of new and a follow up to cr2hdr-r so info on MLP starts around here. Should put up something about this in the first post I guess.
Yea, I'm pretty sure it's converting because the fps_01, fps_02...files show up as it processes, but a movie file never actually appears.
I've tried this on two separate machines and the result is the same, clearly I'm doing something wrong. Can somebody give me some basic instructions to get to the point of converting to ProRes? The user guide never actually gives any step by step instructions.
Edit: Fixed it. Re-copied the binaries manually to ~/Library/Services/MLP/Contents/
However I still have another question! How do I convert to ProRes 422 instead? The text file specifies that ProRes 4444 is the default, and has an entry at the top, but it's pretty clearly not the command line to create ProRes 4444 files.
Shouldn't it be, for ProRes 422,
-pix_fmt yuv422p10
or
-profile hq
instead of for ProRes 4444:
-pix_fmt yuv444p10
But the default (supposedly ProRes 4444) is
-c:v libx264 -preset slow -crf 10 -c:a copy -pix_fmt yuv420p
Which I have no clue, but it looks like some kind of h264 encoder, not ProRes 4444? I'm so confused now!
You can use the file called MLV_RAW_MOV_dng_FFmpeg_output.txt. Put it in A_lut_hold folder and change to whatever output you like. Change the top line of the document. You have to search the internet to explore more output settings. I included a few examples in there.
If you don,t use this document it defaults to prores4444.
Ah! I see now. The idea of moving files into folders in order to activate certain options is a novel concept that has taken me a while to fully recognize, but I get it now. Thanks for the help.
Cool. Hope you find it useful. Feel free to post any examples using it.
The txt documents is to give more manual control and since I don,t know how to build a gui this is the way for now. Or try the list in MLP_look_base.
Danne, thanks for all of this, I really appreciate your work and the help of other ML gurus
It is very complicated though...
I am trying to "develop" a MLV movie with alternating low/high ISO HDR (image A/image B -> merged C).
In the "old" times, it was the HDR-workflow-051.zip script made by a1ex:
https://bitbucket.org/a1ex/magic-lantern/downloads
It worked on JPEGs
Now, it is yours, working on DNGs, though only for Mac
1. Is it correct that the only way to develop alternating low/high ISO HDR MLVs is to run folder_ProRes444_lut service twice, and create an additional HDR folder, as in this video 12:47
https://www.youtube.com/watch?v=nllfXNd-U58
I wasn't able to use "MLV" service instead of folder_ProRes444_lut service... and I'm not sure which is more recent
2. This technique produced a resulting MOV file.
How to prohibit the script from deleting the "merged" C files? To use them in, e.g., DaVinci Resolve?
3. Could you provide the basic bash scripts that sort out the A and B images from the folder with DNGs and create the merged C images please? Having all the binaries for Windows, and rewriting the bash script, why not to use that technique also in Windows, instead of the old Alex's HDR-workflow-051 (which is still the greatest thing on Win :) ?
Thanks in advance and best wishes | P
Hi Piotr. folder_Prores is replaced by MLP first post. It,s the better way of working with HDR files. Please feel free to modify and share improvements.
The way enfuse works it enfuses tiff intemediates which are created int an output folder. These tiffs are the one you could use in DaVinci resolve.
You can start by erasing the rm –r output line all the way in the end of the three scripts that starts with process_enfuse_XX.txt files
Then you double click A_move_content_to_workflow.command
Check the pic.
(http://s12.postimg.org/960tjmnb1/Screen_Shot_2015_12_20_at_20_10_12.png)
Then you install MLP by double clicking it
All tiffs that,s created are in those output folders. A follow up would be to rename the folder so it will be suitable in DaVinci Resolve. Maybe move the folder out of the dng folder and so on...
You could try replacing
rm –r output to
mv output ../output
mv ../output ../"$file"
I did this in the process_enfuse_XX.txt file. You can do something similar in the other two scripts. Only change the "$file" accordingly.
Don,t forget to double click A_move_content_to_workflow.command two write changes before install.
Thanks Danne. I did, but this is for MPL workflow, not the folder_ProRes444_lut workflow.
In the folder_ProRes444_lut workflow, one creates HDR folder and it works.
How to deal with the same (alternating low/high ISO) in MLV workflow?
Thanks | P
Not sure what you mean. Could you show what you mean is working with what? Maybe printscreen, example files? Screen recording or what part of what script?
Danne please see my earlier post.
I am talking about the possibility to turn an alternating low/high ISO HDR MLV or MOV file -- into a HDR movie.
See this, minute:seconds 12:47
https://www.youtube.com/watch?v=nllfXNd-U58
It works with "folder_ProRes444_lut service"
How to do the same with "MLV" service instead? | P
1 - read the first post
2 - read page 5-6 in the user guide
3 - download MLP and read the howto
*updated some additional info about HDR workflows on page 5 and 6 in the user guide
Some updates to MLP - download in first post.
- It is now possible to create icc profiles of .cube files. There is a script to help you out once opencolorio is installed. Use the icc profiles the same as with cube lut files.
Thanks Andy600 for hints.
Major thanks to Baldavenger for tests and feedback on MLP and sharing deeper insights about color management and for some upcoming stuff later.
- I put in dfort very thourough pixel map list for eos M in the dead pixel list. How to work with that is described inside the dead_pixel_list.txt file
I'm liking MLP, Danne. Having some trouble with getting it to take my DNG files to ProRes however. I have followed your HowTo and User Guide to the T. All the binaries are installed and moved via the workflow. Can anybody help? Many thanks :)
Cool. We should get MLP going I hope.
1 - did the script tell you all binaries are installed? Green text.
2 - what are you processing? Maybe put up a printscreen or a screen recorded video of what you are doing. Hard to draw any conclusions right now.
Here is what I'm trying to process, plus the file structure of the folder I'm calling "RAW Tests". You can see the folders MLP have created, as per the manual, and I'm trying to process DNGs into ProRes (from MLV originals)
http://i.imgur.com/GvSJ4Fi.jpg (http://i.imgur.com/GvSJ4Fi.jpg)
Yes, it did show green text.
Here is the "Contents" folder inside the MLP workflow app inside /Library/services/
http://i.imgur.com/2QNeyRl.jpg (http://i.imgur.com/2QNeyRl.jpg)
What's happening is, when I choose the MLP option under "Services" to process into ProRes, the cog in the status bar shows and a file quickly appears labeled "fps" and then disappears, quickly followed by the cog and process of MLP stopping altogether.
Are you uisng a recent version? I fixed a bug that wouldn,t start the workflow if the folder was named RAW before. Just tried over here and it works. Not sure what is going on.
When you install a new version you can run the install binary command and it will ask if you want to recopy the old binaries before installing.
Latest version. I have since reinstalled everything and still no luck.
I'm missing something or it's clashing and causing it to crash.
bwinter88 seemed to have had a similar problem a few days ago here: http://www.magiclantern.fm/forum/index.php?topic=13512.msg159022;topicseen#msg159022 (http://www.magiclantern.fm/forum/index.php?topic=13512.msg159022;topicseen#msg159022)
He seemed to have cured it by manually re-installing the binaries. I've tried that to no avail.
Just to confirm, then:
0. I've installed MLP. I've done nothing else.
1. I just have a MLV file in a folder called "RAW Tests"
2. I choose MLP from the services menu. It creates the two LUT folders.
3. I choose MLP again, it creates the DNG folder from the one MLV file. It moves the file to a seperate originals folder.
4. I choose MLP again (to create ProRes) and this is where I'm having the issue.
Note: MLP has never created a ProRes folder for me?
Should work. Easiest if you take the time and create a screenrecording of the whole process. I can, t say what, s going on unfortunately. You can use quicktime for screenrecordings.
By the way, what camera are you using?
@BatteriesNotIncluded
Just wondering, what is in your A_lut_hold directory? You should have a file names MLV_RAW_dng_straight_to_prores444.txt in there and you shouldn't need to run MLP a third time in order to create the QuickTime files.
Have you tried renaming the "RAW Tests" directory to something else, preferably something without spaces?
Finally, how far from the root directory is "RAW Tests" located? I've had problems with various programs if the path is very long and/or contains spaces.
@BatteriesNotIncluded
Try giving ffmpeg chmod rights.
Goes like this:
1 - open terminal
write following:
chmod u=rwx [drag ffmpeg here]
enter
With continued support from @Danne, the riddle has been solved and I'm now able to process ProRes from DNG files. (with thanks to @dfort for the other suggestion)
For those who may encounter the same issue - and it pertained to dcraw - here is the fix:
First install "homebrew":
1. Open Terminal.app from inside Applications>Ultilities
2. Copy and paste the following:
ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)"
3. Hit enter and let it download. An installer window may popup. Follow those steps too.
4. If Terminal is asking you to hit "return", make sure you do to finish the installation.
After homebrew is installed:
5. Copy and paste the following:
brew install dcraw
6. Hit enter.
You're done. Try again and you will hopefully be processing ProRes files.
Thanks for sharing and good it is working. Tried to reproduce the issue by trying on a fresh macbook air without exiftool and dcraw installed except from inside MLP but it all worked as it supposed to. Dfort tried as well with the same result. Let,s see if we can narrow down the issue completely later on.
Nice effort, @BatteriesNotIncluded and Thanks for sharing!
Quote from: Danne on January 02, 2016, 07:34:40 PM
Thanks for sharing and good it is working. Tried to reproduce the issue by trying on a fresh macbook air without exiftool and dcraw installed except from inside MLP but it all worked as it supposed to. Dfort tried as well with the same result. Let,s see if we can narrow down the issue completely later on.
Interesting. I just realised as well that I'm running 10.11.3 Beta (15D9c), so I'm wondering if that's playing a part here or not.
Could be. Then we,re in for some more El Capitan messing again. Or, it could be as simple as putting in a couple of quotes in the export path command again. We,ll see :)
Gotcha.
Now that I'm able to process ProRes, a quick question:
I'm editing the dng's with ACR in Adobe Bridge. I apply the changes to all the dng's and Finder reflects the changes. However, when I then process into ProRes it's the original RAW image. Any thoughts?
ACR is a stand alone system. MLP works by working with dcraw and FFmpeg settings and through 3d luts(ProRes files). The changes made in MLP to the dng files will reflect in ACR, DaVinci resolve, lightroom etc but not vice versa.
Updated first post with a new MLP version containing a new feature. The looks_creator.command. On page 19 in the user guide you can find out more.
What it does it runs previewer functions while you are selecting settings from menu windows. You can also call MlRawViewer(hi Baldand :)) from this script if it is installed in MLP. See the Howto file about this.
(http://s3.postimg.org/m214ro12r/Screen_Shot_2016_01_03_at_23_48_26.png)
This is a BRILLIANT move on your part by combining MLRawViewer within MLP for an exclusive previewer while having the ability to fine tune our files in a much more complex depth in order to get the most out of our videos altogether with your app!
I salute to you once again and thanks for starting an incredible way into the new year ... I'll be testing/playing and will report back asap.
@ Everyone else that are interested in trying this out ... Please do not hesitate from using it as I know it may seem complicated for newcomers at first but I can promise you all from the bottom of my heart that it isn't at all and it's just like riding a bike or better yet ice skating.
Once you get into rhythm and then it'll just turn into Magic!
[emoji106]
New version again. It includes a media pipe through FFplay. This means we can preview footage in altered MLP settings more or less in real time.
I tweaked settings in dcraw (-h, half color) a fast FFmpeg transcoding option and scaling down the footage to 800 x 450 while streaming. These settings can be changed through txt files. Check page 19 in the user_guide.
The FFplay stream works when right clicking folders of dng files. Does awesome work in dmilligans MLVFS but also works on folders of dng files created in MLP. Whatever setting changed in A_lut_hold folder will be seen in the media stream.
This also means I had to rewrite ProRes transcoding in conjunction with MLVFS. Now you simply right click the MLVFS partition to start the processing (page 8, user_guide)
MLVFS
(http://s21.postimg.org/wd4sbmq5j/Screen_Shot_2016_01_06_at_17_10_50.png)
MLP
(http://s21.postimg.org/cwk2p3v1j/Screen_Shot_2016_01_06_at_17_11_53.png)
Yet more excellent work Dan, and what a fantastic commitment to such a useful project. Magic Lantern continues to not just survive, but actually flourish with this level of engaged contribution from people such as yourself. Well done sir.
Thanks for those kind words Baldavenger and thanks for your own commitment. Open source is what makes it all possible and creative. Bash can take you far it seems :)
and I love how your Sigma 20 1.4 art comes out on these screenshots above ... Oh drop it like its HOT!
How Do I uninstall this?
You enter /library/services/ and delete MLP. All dependencies are inside MLP contents folder.
Do you have a valid reason why you want to uninstall MLP @Caserta?
Here is a little something for HDR movie enthusiasts. This completely slipped my and anyone elses radar I guess.
By exporting using the filter_complex option -vf tblend=all_mode=average in FFmpeg you will get on the fly exports of HDR footage. And most important, the exported files will still keep the same fps. No image interpolation is needed. This speeds things up considerably as it will export footage like regular ProRes exports. I made it work both with H.264 and MLV/RAW files and also with MLVFS. When the tblend option is selected FFplay will also playback HDR folders of dng files and HDR H.264(right click the movie file) files as regular looking files when previewing.
Check page 5 and 7 in the user_guide
(http://s1.postimg.org/rssbp4i8v/Screen_Shot_2016_01_09_at_22_28_37.png)
(http://s1.postimg.org/nidntjd5r/Screen_Shot_2016_01_09_at_22_44_57.png)
Seems recent dcraw and FFplay player wouldn,t work because of dependency issues. Reverted back to a static dcraw and a update about what could be done to have FFplay player working. (Download in first post)
Install notes FFplay
Following instructions will install FFplay and FFmpeg to your system(outside of MLP). This is needed for FFplay to work. (SDL library needed)
From page 23 in the user_guide
Open up terminal
1 - Install homebrew by entering this command
ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)"
Press enter
2 - Install FFplay/FFmpeg by entering following in terminal
brew install ffmpeg --with-fdk-aac --with-ffplay
Press enter
You are now able to right click MLP on folders of dng files and also MOV files if using the HDR_tblend_average.txt file.
Hey guys,wondering if anyone else is having a hard time importing the .dng files produced from MLP in After Effects.I am using MLP on .mlv files on Mac 10.9.5,and have no problem creating the .mov files.But I was trying to import .dng files into After Effects 13.6,and for some reason after the Camera Raw adjustments it will crash After Effects.I also converted the same .mlv files with MlRawViewer to .dng,and had no problem importing,adjusting in Camera Raw,and completing the import with no crash issues.Perhaps someone can let me know if I need to pull a specific .txt file into A_lut_hold folder to prevent the crash.Any advise would be great,the pro ress files look great,but I just wanted to see if I could push the .dng files a little further then the pro ress.If a crash log or a sample of the .dng is needed,I can provide for sure.Thanks again guys, and @danne this is an amazing app and I am just trying to get used to it sir.
Interesting. And welcome aboard the MLP thread :).
Could you.
1- upload a sample dng?
2- tell me if you have all the binaries installed in MLP?
3- what txt files were used in A_lut_hold folder?
1.https://www.dropbox.com/s/n56voagqpmcmd2f/M16-0604_1_2016-01-16_0001_C0000_000000.dng?dl=0 (https://www.dropbox.com/s/n56voagqpmcmd2f/M16-0604_1_2016-01-16_0001_C0000_000000.dng?dl=0)
2.Yes sir,I followed all proper instructions and placed all binaries that were instructed,also installed homebrew via command line in terminal.
3.I stuck with just the starting point .txt files found in the A_lut_hold folder produced from MLP.
Here is a screen shot of my ~/Library/Services/MLP/Contents/
https://www.dropbox.com/s/xofofxuv1ycfduv/binarieslibrary.tiff?dl=0 (https://www.dropbox.com/s/xofofxuv1ycfduv/binarieslibrary.tiff?dl=0)
Thanks for the help sir.
Thanks. It works over here in AE CS 6. If you have audio try remove the wav file and see if that helps. You could also reprocess your MLV file and this time add the MLV_RAW_dng_repack_16bit.txt file in the A_lut_hold folder as well before processing you dng files. This is for use in premiere pro but maybe it helps in AE too? If nothing works you could maybe upload a short sample MLV of a problematic file as well?
I have little trouble using the MLP.
I've copied all my RAW files to my LACIE disk, but then i right click i don't get the Service tab. When i right click on a random folder on my desktop, i do however get the Services tab. Why is that?
You have to right click on a folder or a file to use MLP. Are you right clicking in empty space?
No, i'm right clicking the folder which holds all my RAW files. The only time i get the Services tab is when i right click on a folder that's on my Desktop.
Hm, that is strange. Could you make a printscreen of what i looks like? Also the name of the folder and its contents. Could be name-related. I could try to reproduce if I get the exact steps.
Sure. This screenshot is from when i right click a folder directly from the Desktop.
https://www.dropbox.com/s/bfukgwwjegw1ghu/Screenshot%202016-01-17%2016.52.35.png?dl=0&preview=Screenshot+2016-01-17+16.52.35.png
This is from when i do it from Finder.
https://www.dropbox.com/s/qy63moe0qyx4jfl/Screenshot%202016-01-17%2016.53.46.png?dl=0&preview=Screenshot+2016-01-17+16.53.46.png
I'm running Yosemite, but trying to upgrade to El Capitan.
Sorry, I can,t really follow your steps. You say
QuoteI've copied all my RAW files to my LACIE disk, but then i right click i don't get the Service tab. When i right click on a random folder on my desktop, i do however get the Services tab. Why is that?
WHat is it that you are right clicking here? Are you on another harddrive?
Quotebut then i right click i don't get the Service tab
Then you say in the next message
QuoteThis is from when i do it from Finder.
Are we on the lacie harddrive or is this another issue?
Just trying to follow your steps. This is what works for me.
1 - Right click
any folder containing RAW/MLW/CR2/MOV/mov files and the services "MLP" option appears.
2 - Right click straight on files like MOV, dng, DNG, RAW, MLV and services "MLP" is showing.
Is there any other way to do this?
/D
First, thanks for helping. I really appreciate it!
Sorry if i'm not thorough enough.
I copied all my RAW files to a folder on my LACIE disk called RAW TEST SHOOT. I right click on the folder, and i don't see any Services tab. Not even if i right click on some of the RAW files. The only time i get the Services tab is when I'm on my Desktop and right click a random folder.
Ok, Could you try this.
Press the buttons cmd g
When opens up go here
~/Library/Services/MLP.workflow/Contents/
(http://s9.postimg.org/vs9nx45lb/Screen_Shot_2016_01_18_at_00_49_27.png)
Take out some items from the contents folder and then put them back again. Try A_dan_log_3d_luts and HDR_align and put them back again. Sometimes automator has to be "woken up". Now if that doesn.t work you could try renaming your folders to something more casual like My_files or something.
Do you have the latest download from the first post by the way?
Here,s a little workflow of how to use HDR "on the fly" function with canon native H.264 MOV files.
By adding following files to the A_lut_hold folder all functions needed will be available.
HDR_tblend_average.txt
HDR_tblend_average_half_FPS.txt
FFplay_Histogram.txtFirst file is filmed in 60 fps, the rest is filmed in 50 fps.
Thanks for your help Danne
I upgraded to El Capitan with a clean install and now it seems to work. I'm a little curious though. I started conforming about 64gb of footage and it takes forever.
I've conformed 9 RAW files each about 1 GB. It took about 32 min in total. I used to use RAWMagic to conform my files, and i just did a quick test and i was able to conform a single file of 1GB in less than 30 seconds. What's the difference between MLP and RAWMagic except for all the extra settings?
Maybe it's my workflow. This is what i do. I right click the folder containing my RAW files. I get the two folders A_lut_hold and A_dan_log_3d_luts. I delete the prores text file cause i don't need them. I then run looks_creator.command and hit "r" to conform the files.
Best, Morten
HI, nice to hear that it works. Are yu using the MLV_RAW_dng_repack_16bit.txt file? If you don,t work in premiere it shouldn,t be needed and will save some time. Exiftool is the other process that will prolong processing since it is inserting missing metadata.
No, i'm only using the standard files.
MLV_RAW_dng_dcraw_any_command.txt
MLV_RAW_dng_gamma_2.4_0.txt
That's it.
Hi,
and thanks for the great app!
Cant seem to get all functions working, lately the HDR conversion. Followed the procedure in the video, but i can only preview, not write a new file. Tried re-installing the app, maybe I should re-install the binaries also?
The app codes for a while and then exits and put the .mov file i the A_HDR_folder. Any suggestions?
What HDR workflow are you using? Seems FFmpeg needs a -strict -2 in the syntax in some circumstances. I have a new version of MLP coming up later tonight.
Could you do following.
1 - upload a sample file
2 - check if all binaries are present. Should say so if you used the script.
2 - what files are you using in the A_lut_hold folder?
Thanks, Im doing some testing at the moment..
I used the tblend_average.txt and the tblend_average_half_FPS.txt og histogram. I installed all the binaries when first installing MLP, couple of weeks ago.
Here is the file I tried with: https://www.dropbox.com/s/lpahqby6yq9unfo/MVI_6693.MOV?dl=0
I, ll check later. Should work. Meanwhile, download the latest version and run the binary script prior to installing. It will ask if you want to reinstall the old binaries. Not sure if it will grab dcraw as well. It should be updated to the version in latest download.
New version up. Reworked main script a lot due to some changes before. It should also not mix folders named to files name with the actual files now. A lot of different processes to keep track of here.
@aschille84
Just checked your file and it rendered perfectly over here. A lot of aliasing on the 6D, you might wanna turn the sharpening down and also use the disable_sharpening.txt file. I put these in the A_lut_hold folder.
FFplay_Histogram.txt
HDR_MOV_disable_sharpening.txt
HDR_tblend_average_half_FPS.txt
HDR_tblend_average.txt
Here,s you file rendered.
https://sprend.com/download.htm?C=c7b69f70dd4b4192a5df474cc188fa9e
Thanks @Danne!
Great tip with the sharpening, aliasing is massive In 720pon the 6d. Also got MLP working now, re-installed binaries. Not sure I had Mlrawviewer In there before.
Thanks @Danne!
It works for me; I was able to process the HDR MOV!
However, some points to note:
The
ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)"
command needs the Xcode.app to be pre-installed (and this is > 4 Gb download)
The
brew install ffmpeg --with-fdk-aac --with-ffplay
command installs new version of ffmpeg in /usr/local/Cellar/ffmpeg/2.8.5/bin folder (and adds links to /usr/local/bin/ folder)
So, in order to use the MLP, one needs to remove the old ffmpeg (I renamed it by:
1. cd /Users/piotr/Library/Services/MLP.workflow/Contents/
2. mv ffmpeg ffmpeg.old
)
And, to copy the new ffmpeg installed by brew into MLP folder:
cp -p /usr/local/bin/ffmpeg /Users/piotr/Library/Services/MLP.workflow/Contents/
Then, MLP was able to create the HDR version of the MOV file
One thing I cannot fix is the looks_creator.command
Every time I use it, the OS X says it was downloaded by Chrome and is dangerous... Have to go to the security settings and allow to use it. How to disable this warning?
Thanks again! | P
Quote
The
ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)"
command needs the Xcode.app to be pre-installed (and this is > 4 Gb download)
4gb, have to find another way to make FFplay work then. There is actually mpv player https://mpv.io/installation/ , a fork of mplayer which also stream FFmpeg content which works too but without sdl. Lacks the wave monitor it seems unfortunately.
QuoteSo, in order to use the MLP, one needs to remove the old ffmpeg (I renamed it by:
1. cd /Users/piotr/Library/Services/MLP.workflow/Contents/
2. mv ffmpeg ffmpeg.old
I downloaded a recent version from the link in the HOWTO file which works. Older FFmpeg will probably not work. Are you using the latest MLP version?
QuoteOne thing I cannot fix is the looks_creator.command
Every time I use it, the OS X says it was downloaded by Chrome and is dangerous... Have to go to the security settings and allow to use it. How to disable this warning?
I believe there,s a setting for this in system preferences.
Thanks for feedback.
Quote from: Danne on January 20, 2016, 06:58:17 PM
Are you using the latest MLP version?
Hmmm... The versions are not numbered or dated, are they? The way I update is by reading this thread. If new binaries are needed, I install them (for instance, the ffmpeg via brew). I then download and unzip the MLP.ZIP file and click MLP.workflow. The system says there is an old one, and shall it be replaced. I say 'yes'.
Is there another way to upgrade the MLP? | P
@piotr.23 I dont think Xcode is 4gb if installed thru terminal and the homebrew-process. I did this yesterday and it only took like 5-10 min to download. There is a hint when running the ruby command.
Quote@piotr.23 I dont think Xcode is 4gb if installed thru terminal and the homebrew-process. I did this yesterday and it only took like 5-10 min to download. There is a hint when running the ruby command.
I had the same experience, thanks for sharing.
@Piotr.23
I replaced dcraw due to been having a version that needed libraries before. Therefore I would recommend to download the latest version and dcraw will already be included. However, since FFmpeg are updating and changing commandline outputs I had to change some of the commands in MLP. This will be problematic when using the script which asks to redownload the former versions installed. So suggestion. Either redownload all binaries and run the script again or replace FFmpeg after you have run the script and then install. Quite the hassle but that,s what we get in this open source community :)
Guys, I'm not making things up: using the terminal, the command
ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)"
on my El Capitan 10.11.2 stopped and asked for the Xcode.app to be installed via App Store. And I have no problem with this! just saying it took a day via wifi (which is fine)
Re: dcraw: the version that is in my /Users/piotr/Library/Services/MLP.workflow/Contents/ folder is v9.26.
So it seems to be the same as in MLP.ZIP/source_binaries/dcraw_GPLv2+.txt
MLP is pretty... experimental and needs some knowledge in shell use.
I'm just sharing my observations, perhaps some of ML users may find them useful | P
No one is making things up. Simply sharing different experiences.
Well my advice is this. Change to a fresh FFmpeg if anyone been using MLP for a while and wants to download the latest MLP version. First time users can simply follow instructions in howto.
Regarding xcode hassle. This will only be needed if you want FFlay as a previewer.
Anybody can feel free to participate in building a static version of FFplay. I havn, t figured out how yet.
*Updated MLP
If you have an older version of MLP already installed and needs to replace ffmpeg.
1 - Download the latest version of MLP and download ffmpeg from the download link in the HOWTO file and move it to the Place_binaries_here folder.
2 - Run the move_binaries.command and and follow the instructions.(Press yes to recopy and press yes again to overwrite ffmpeg)
If you,re a new user simply follow the HOWTO and disregard what,s written above.
Uploaded a new version. Contains a link to an alternative media player which doesn,t have to install external libraries. It,s called mpv and instructions are in HOWTO file. You can still run FFplay by installing it on the system if you rather have that(will be chosen before mpv if both players are installed) Some additional info on page 23 in the user_guide.
*updated the move_binaries.command now so it should be easier to follow especially if you want to put in something new in the PLace_binaries_here folder continuing with an older build.
Uploaded a MLP version with the following changes.
- folder names for MLV files will contain the date from the actual record date instead of the date you actually transcodes to dng files.
- inserted dfort,s fine script which fixes the focus pixel issues for cameras like eos M, 650D, 100D, 700D.
The script handles these problems automatically by calculating the map coordinates on the fly from a collection of fpm files. Still a work in progress. More info in this thread. http://www.magiclantern.fm/forum/index.php?topic=16054.msg162313#msg162313
Note that this pixel maps works when exporting to Prores and not to the actual dng files. Check out MLVFS for dng handling.
Would be really nice if people with the affected cams could test and report the picture quality and if it works as it should. Thanks dfort and others involved in fixing these long lasting issues.
Quote from: Danne on February 15, 2016, 06:55:24 PM
Uploaded a MLP version with the following changes.
- folder names for MLV files will contain the date from the actual record date instead of the date you actually transcodes to dng files.
- inserted dfort,s fine script which fixes the focus pixel issues for cameras like eos M, 650D, 100D, 700D.
The script handles these problems automatically by calculating the map coordinates on the fly from a collection of fpm files. Still a work in progress.
Would be really nice if people with the affected cams could test and report the picture quality and if it works as it should. Thanks dfort and others involved in fixing these long lasting issues.
Whew ... once again it has been
too long since I last hung out in this fabulous cave of yours, Danne, and for that I apologize. :-\
Last night I ran a few old files from SL1 just to see how the Focus Pixel Fix works on the fly. I am pleased to say that it works well for Non-Dual-ISO footage but then when I tried running the same quick test with Dual-ISO files which works OK but not as much as it would with the None-Dual-ISO files (I remember @dfort mentioned that this was a still work in progress) however I admit that all of is so
fly!
Please see below of my two quick tests comparisons (even tho I am still trying to manage to get the FFplay to show up) and play the footage in previews as oppose to the Tiff's (must be an user error on my part even tho I followed the instructions on the looks_creator.command) but maybe I need to install a missing specific binary that I'll need in order to make this one feature work other than that
I AM IN LOVE with the new rendering which spits out the Original Dates from day of shoot instead of when we rendered them. This is HUGE and definitely makes our post lives easier by lightyears! Thanks for implementing @dfort's brilliant concepts into your amazing app to keep things as simple as possible. Hence @dmilligan's infamous words of courtesy "
KISS (http://www.magiclantern.fm/forum/index.php?topic=16054.msg162525#msg162525KISS)" which applies to everything else in life, right?
Also
Special THANKS to @dfort for your drudgery work on the FPF -- it was indeed such an uphill battle so far!
https://vimeo.com/155903766
https://vimeo.com/155904938
More to come... :)
Eliminating the focus pixels on dual iso is still a bit of a challenge. Combining some chroma smoothing with the focus pixel fixer helps.
I like how Danne incorporated focus pixel fixing so it is invisible to the user.
Yes, it is a work in progress, like all things in Magic Lantern.
Thanks for testing.
Quoteeven tho I am still trying to manage to get the FFplay to show up
To use FFplay/mpv media previewer you simply right click a folder containing dng files.
If you want the 5 fps media previewer you right click a MLV or RAW file. To activate this function add the
MLV_RAW_player.txt to the A_lut_hold folder. This works outside the looks_creator.command.
Also updated MLP with the latest pixel map files from dfort
http://www.magiclantern.fm/forum/index.php?topic=16054.msg162567;topicseen#msg162567
I'm completely lost..I know nothing of coding. I'm trying to edit dual ISO images from my 70D and the LR plugin simply doesn't work. Tried installing binaries for MLP and that seemed to work. Now I have no clue what I actually need to do in order to edit these files of mine.
Edit your DNG files as you normally would. They can be dark so then you push your blacks. Work with your sliders in lightroom for instance.
Also try search here on the forum. Plenty to read about workflows and such.
@jakepetre & anyone else that are curious...
https://vimeo.com/149488954
New version up.
Been having good collaborations with dfort who,s refining his pixel map script which works through dcraw. He created an awesome script which works in MLP. Check out the script here https://bitbucket.org/daniel_fort/ml-focus-pixels/src
For MLV files the focus pixel fixing is pretty much automated in MLP and now with some minimal manual user handling it also works with RAW files as well.
I think we,ll soon can change to use mlv lite http://www.magiclantern.fm/forum/index.php?topic=16650.0
which handles metadata much better but there will always be some need for handling of RAW files so here is one way to do this. The affected cameras are.
Canon eos M, 650D, 700D, 100D.
no pixel list added
(http://s13.postimg.org/rme5edas7/image.png)
Pixel list added
(http://s13.postimg.org/t2u9a932v/image.png)
Workflow
1 - Add your RAW files from any of the affected cameras into a folder. Right click the folder and select MLP the usual way. On first run it creates the usual folder structure. On second run a menu screen will pop up with some alternatives. It will find out automatically if the RAW file contains dng files from any of the affected cameras. Info is found via exiftool.
2 - From the menu select you camera and movie mode. Your RAW folder can include mixed footage sizes within the same mv mode. You can,t mix mv modes however. One mv mode at the time. After selection MLP will continue processing. A dead_pixel_list.txt file will be created inside the folders of dng files.
(http://s14.postimg.org/bkj5m1241/Screen_Shot_2016_02_25_at_10_06_58.png)
(http://s14.postimg.org/9rg8xpgxd/Screen_Shot_2016_02_25_at_10_05_52.png)
Great thanks to dfort for bringing in the possibilties to work with RAW with these problematic cameras.
Digging @dort's work on these humpy dots with some test files shot from SL1 ... Really nice actually and Thanks for the update @Danne! 8)
Pre: Post:
https://vimeo.com/156803224 https://vimeo.com/156803227
https://vimeo.com/156803226 https://vimeo.com/156803223
Dual-ISO's coming up next... :-X
Question(s) ... am I on the right track here in terms of the workflow while running through MLP?
-PM sent-
Ok, sorry that i didn´t respond to you yesterday, i will try some more this evening. Thanks i will try the thing you wrote 02 @dfort and danne
Question ... Dont remember if I want to import the DNG's into DR12 then I'll need to add Repack to 16-bit for proper DNG reading on DR12, correct?
For premiere. DR takes 14-bit just fine.
Ah, ha ... that's right. Thanks for the friendly reminder. 16-bit would have a slight edge over 14-bit when it comes to color-grading, correct?
I'm actually currently rendering some 2.5k Dual-ISO test footage I shot with an Opteka 6.5mm lens (I know it doesn't work for full frame since its made for APC-C sensors) but hey if it works then why not?
Curious if I'm allowed to mix old RAW with MLV Lite files together if I want to run MLP or best to keep them separated? lol
Stand by...
Some quick 2.5K test shots on 5D3 w an Opteka 6.5mm and rendered entirely in MLP.
This is what I used in the A_Lut_Hold Folder.
(https://farm2.staticflickr.com/1639/24691891833_7b44082119_o.png) (https://flic.kr/p/DBWpbZ)
Then I took ProRes4444 and Color graded them in FCPX with each Non Dual-ISO and Dual-ISO have their own separate setting under LUT Utility.
(https://farm2.staticflickr.com/1524/25318648995_23c7c81d10_n.jpg) (https://flic.kr/p/EzjGfX) (https://farm2.staticflickr.com/1694/24691892513_f73b35dfcf_n.jpg) (https://flic.kr/p/DBWpoH)
I know it may not be the best solution to try and color grade Dual-ISO files AFTER rendering in MLP ... May need to do another test run and perhaps do the color grade process in MLP prior to exporting into ProRes4444, ya?
Be sure to watch it in 2K HD under your Vimeo viewing settings for best quality.
https://vimeo.com/156988930
Thanks @Danne for making it possible to use your logs especially for Dual-ISO ... Up next I think I'll need to steal some of of your old custom LUTS that you previously made to apply on Dual-ISO footage. :P
Alway nice to see the dynamic range in dual iso. I put in a 3.6 gamma lift aswell for dual iso. You could try changing to that from the 2.4 gamma.txt. if you like you can also try a stronger highlight regain in the dcraw_any_command.txt file. Open it up and put in -H 6 instead of -H 2.
Thanks for sharing.
By the way. The 14-16bit repack won,t give better image quality. It,s only numbers for picky premiere.
True. I think the DR can be achieved better if I instead use the 3.6 gamma lift per your suggestion. Forgot that Dual-ISO requires this and Thanks for yet another friendly reminder!
Btw, I just decided to shoot some quick HDR test and since I can't go into crop-mode while recording slo-mo @ 60fps ... So instead of using crop-mode (because all I see on the 5D3 is a square of the 6.5mm lens made for APS-C sensors) I then randomly fiddled with the aspect ratio down to 1280x432 which magically fitted into the entire 6.5mm (well just literally) and I couldn't believe what I was seeing and the best part was shooting this in RAW.
Now I gotta digest these files and hopefully they'll come out well. Need a friendly reminder here ... Which HDR settings is best used for RAW footage (not H264 in which I'll test later on) and I'll be much appreciated for your kind suggestions as always, Danne!
Both tblend filters. Nothing else.
Thanks! Not even the ProRes4444 text file in the A_Lut Folder, correct?
Check Reply #603
Something similar should work for raw footage aswell. Also see page 8 in the user_guide.
Right, I've seen that and you mentioned shooting in H264 in that very Post but I shot in RAW and wasn't sure. Thanks, D!
Some new HDR FuN sTuFf that I decided to see what can be done with an Opteka 6.5mm f3.5 specifically aimed for
APS-C cameras but once I fiddled with the Aspect Ratio while in 60p mv720 on
5D3 (managed to get into the cropped part of the lens) without the need of using crop-mode (it wouldn't work with slo mo anyway since its limited to 30p only) and so the
fun part begins...
•These are screenshots of the ML settings I fiddled with that did the trick for this particular lens...
(https://farm2.staticflickr.com/1587/25238720221_753d060e40_n.jpg) (https://flic.kr/p/Esg3dD) (https://farm2.staticflickr.com/1458/25331820355_05ac3bb443_n.jpg) (https://flic.kr/p/EAucDn) (https://farm2.staticflickr.com/1696/24701200604_74e0c7c1aa_n.jpg) (https://flic.kr/p/DCL7n3)
•These are what I used in the A_Lut_Hold Folder for HDR...
(https://farm2.staticflickr.com/1663/25331819675_6c61d7749f_o.png) (https://flic.kr/p/EAucrD)
•These are what I used to color grade with the converted HDR files in FCPX within the LUT Utility (Thanks @Danne for your lovely .cubes)...
(https://farm2.staticflickr.com/1608/24701200434_9fd45f8e86_n.jpg) (https://flic.kr/p/DCL7j7)
https://vimeo.com/157008140
Not bad for a cheapo Fish Eye lens that's a bit tad slow, eh? :P
Thanks, D!!!
The advantage of filming HDR in mv720 60fps compared with dual iso is to be able to use lenses in a non cropped movie mode. The image artifacts are less noticeable in HDR as well. Now this is not fully true when filming raw since 60fps would yield a compromise in image size to get continuous filming. Try H.264 as well. 100-3200 for instance.
That's true about HDR having an advantage over Dual-ISO with this situation ... However I don't think I can use this particular lens when shooting in H.264 since I won't be able to downsize the resolution in order to "compensate or hide" the APS-C cropped effect or in other words a
gigantic squared vignette effect!
(https://farm2.staticflickr.com/1534/24964129819_e82a6961aa_n.jpg) (https://flic.kr/p/E2ZG4n)
Either way I'll give it a shot during the day when the Sun comes up as its 1:20am PST in here atm. Thanks for your inputs as always, tho! [emoji3]
Here,s some short unedited HDR 100-1600 clips shot in 1600x540 60fps in RAW and upscaled to 1920x1080 (thought I was shooting mlv_lite but not)
lens samyang 14mm f2.8(scratched coating)
Content in A_lut_hold folder
01_Ca_C-Log2.cube
03_Ca_C-Log2_Ca_Ci_Gamut_02b.cube
HDR_tblend_average_half_FPS.txt
HDR_tblend_average.txt
That's just simply beautiful. Thanks for inspiring me to finally pull out this Rokinon 14mm T3.1 from a bag packed into a bag. Haven't been too fond of the distortion along with its softness no matter how I tack the focus down. Anyway off I go with this so called cheap cine lens.
Decided to do two different kinds of tests w 5D3. One with H.264 (in two different Picture Profiles) for experimenting purposes. Also shot another in MLV_Lite which then all converted nicely in MLP.
•HDR (100-1600) 1280x720p @ 60fps in H.264 and upscaled to 1920x1080p
Contents in A_lut_hold Folder
(https://farm2.staticflickr.com/1711/24742430523_72a107d262_o.png) (https://flic.kr/p/DGpqzH)
•HDR (100-1600) 1600x540p @ 60fps in MLV_Lite and upscaled to 1920x1080p
Contents in A_lut_hold Folder
(https://farm2.staticflickr.com/1530/25073549450_aaced39865_o.png) (https://flic.kr/p/EcEuGJ)
•Screenshots
H.264 (CineStyle ungraded)
(https://farm2.staticflickr.com/1552/25250888962_9ffacbf170_n.jpg) (https://flic.kr/p/Etkpyw)
(https://farm2.staticflickr.com/1667/25342975036_2d136d8550_n.jpg) (https://flic.kr/p/EBtnxs)
H.264 (CineStyle graded)
(https://farm2.staticflickr.com/1620/24742426963_e6eaefd7c9_n.jpg) (https://flic.kr/p/DGppwk)
(https://farm2.staticflickr.com/1596/25276101911_904c8eb54a_n.jpg) (https://flic.kr/p/EvyCux)
H.264 (Standard Profile)
(https://farm2.staticflickr.com/1708/25250887222_f5e130e767_n.jpg) (https://flic.kr/p/Etkp3w)
(https://farm2.staticflickr.com/1527/25250891682_524e0b2350_n.jpg) (https://flic.kr/p/Etkqnq)
MLV_Lite (graded in MLP) ;)
(https://farm2.staticflickr.com/1515/25342978086_4ae729f477_n.jpg) (https://flic.kr/p/EBtos3)
(https://farm2.staticflickr.com/1699/25250893712_3bb9acffbc_n.jpg) (https://flic.kr/p/EtkqYq)
https://vimeo.com/157103680
Cool stuff. No ghosting. Now 14mm would be good for MLV lite since cropping to get continuous filming. H264 works very well on 5D mark 3 due to less aliasing comparing with other cameras.
Interesting tests and a good argument in favor of using a smaller image size at a higher frame rate (http://magiclantern.fm/forum/index.php?topic=15306). Though with HDR the frame rate is halved after processing as opposed to dual_iso, right? Nice work with MLP lining up the light/dark frames, very little ghosting in the footage.
There were some glitches in the MLV Light footage. It looks like some frames were corrupted and recording didn't stop automatically. You might want to show an example to dmilligan.
(https://farm2.staticflickr.com/1609/24748477264_056665abeb_z.jpg)
The 14mm on the 5D3 slightly cropped so that it approximates the area of an APS-C (Super 35mm) sensor will give you about the field of view that Emmanuel Lubezki "Chivo" favored on Gravity, Birdman and The Revenant. That's an Academy Awards "Hat Trick" that rarely happens. Of course a 14mm lens won't guarantee you an Oscar.
Fps is only halfed when using the HDR_tblend_average_FPS.txt filter. That,s the beauty of the FFmpeg tblend filter.
Well corrupt frames could defeat the whole reason to kill the RAW format in favor of MLV lite project. I still havn,t found any corrupt frames either in raw or mlv nor mlv lite. More tests then.
So, it seems deafeye mixed mlv lite with regular MLV format. That,s the real reason for corruption in the dng files. MLV lite is still golden.
Hi all,
I've tried to process my HDR DNG sequence a few times but it won't work.
I choose '09' HDR process then 'r', then it processes the DNG's but when I preview them in mlviewer they are still separated (light & dark frames)
Any ideas?
Thanks,
Tom
Hi slingbacker. MLP doesn,t merge the dng files itself but exports to a movie file. The dng files itself are still light/dark.
By the way, you write dng as DNG which indicates dual iso processing. you havn,t mixed any of the processes? Just to be sure.
Ah, thank you.
I can't seem to locate the output .mov file... Any ideas?
Not sure how closely you read first post and the user_guide but you need FFmpeg installed and the MLV_RAW_dng_straight_to_prores444.txt inside the A_lut_hold folder to start processing prores files. Or you can also simply rerun "r" after the dng processing is finished or right click the folder you have your folders with dng files a second to time to start the movie processing.
Thanks so much for helping, just tried that. I keep getting the same errors.
Here's a .doc of the error report:
https://mega.nz/#!xkBzmCSD!6WeZzqmjtaeOqcFw48vVV4EufXf6rrYpJF777mAfIk0
Thanks again,
T
I also don't have a PRORES folder when I run the service.
T
I,m out so can,t watch on my cell phone. Depending on what you do the processing will work digferently. Prores folder is only created when working with mlvfs so if thats the case read the parts about that in the user guide. Also tead the Howto in the download but probanly you did already.
By the way @slingbacker ... Have you previously used MLP for regular footage with ease or is this your first time using this app on your Mac?
Hi Deafeye, I haven't used it for normal footage yet no. Thanks, T
Checking your output it doesn,t seem to have ffmpeg installed. Did you follow the HOWTO file in the download package?
If you want some more efficient help I suggest you create a screen record of your installation steps or at least describe them as carefully as possible. Also describe exactly what kind of files and what camera and what mac OS you are using.
Thanks everyone, I've cracked it!
Looking great, I'll post some test videos soon.
Hi Danne,
I'm really enjoying using MLP, it's incredible. Thank you!
Whilst testing what it can do I'm wondering if it's capable of merging a folder of alternating exposure DNG sequence?
I'm trying to get a good HDR look on my 5Dmkii.
Thanks again,
Tom
See reply #652.
Thanks Walter.
@slingbacker
If you try to merge two DNG files into one new dng file that is not gonna work. If you want to create a HDR prores movie from the DNG files please check page 9 in the user_guide(first post).
I tried working with HDR_merge which in fact can achieve merging of dng files using libraw and through command line but there is other problems such as not producing linear files and he,s using dng deflate compression which won,t work in premiere or Davinci resolve. Feel free to ask him if he could create something useful for video as well as for stills.
http://jcelaya.github.io/hdrmerge/
New version in the first post.
- MOV_backup_syst.txt (suggestion from dfort, read what it does inside when opening the file)
- Set an alternative ProRes4444 output folder (will also work with MLVFS)
Following information is also documented in the user_guide starting at page 14
An output selection menu will appear when selecting MLP
on an empty folder
(http://s18.postimg.org/7g2xez4xl/Screen_Shot_2016_03_08_at_17_10_34.png)
Select one of three alternatives and then rerun MLP.
This time on your source folder
(http://s18.postimg.org/odww3p7zt/Screen_Shot_2016_03_08_at_17_10_46.png)
New version up in first post.
Added so one can export dng folders straight to a selected output instead of from the same location as your MLV/RAW files. Right click an empty output folder to bring up the menu and choose an alternative. Then right click MLP on a folder or memory card with MLV/RAW files the usual way.
(http://s24.postimg.org/njlgpx2bp/Screen_Shot_2016_03_15_at_17_41_26.png)
HI Danne,
Back in November 2015 I had issue with the DNGs created with the "folder_ProRes444_lut 12 5" Service being shown as over-exposed in Adobe Camera Raw. You had provided the explanation that the 6d and 70d DNGs created by the "folder_ProRes444_lut 12 5 " Service are not being rendered correctly by later versions of ACR thus you created the Canon_EOS_6D.command to fix the issue.
Recently i took some dual iso shots again and I tried to execute the same workflow but when I double-clicked on "Canon_EOS_6D.command" file after the DNGs were created by the ProRes444 service a terminal window appears and spits out the following error messages:
args: exiftool: No such file or directory
logout
Saving session...
...copying shared history...
...saving history...truncating history files...
...completed.
I had the Canon_EOS_6D.command file copied into the MAIN folder where the DNGs are located.
Am I missing a step ? Your advice is appreciated. Sorry for the bother.
Don,t remember exactly what,s in the command. Could you upload it. Or if it say -name try changing that word to -iname.
Hi Danne, sorry for the late reply - here s the link to the original Canon_EOS_6D.command.
https://drive.google.com/open?id=0BwB_poTzzVK8YVI5TVhIS0c3QVk
I tried your suggestion - I duplicated the file and I see "-name" and changed it to "-iname" in the duplicate copy (not the original) but I am still getting the same error as before when I tried to control-click /open the file:
xargs: exiftool: No such file or directory
logout
Saving session...
...copying shared history...
...saving history...truncating history files...
...completed.
[Process completed]
BTW the only change between November 2015 and today is that I was still using Yosemite then and now using El Capitan.
Thank you!
It means you don,t have exiftool onto your system anymore. You can use exiftool from within MLP or you can download and install it to your system via homebrew or exiftool homepage.
I made some changes to the script. If you open the script by right clicking and choose open with TextEdit you can erase everything with this and if you have MLP installed it should work after this. You can have the script next to your folders instead of inside the folders or next to the files as before if you like.
workingDir=`dirname "$0"`
cd "${workingDir}"
find . -maxdepth 2 -name '*.DNG' -print0 | xargs -0 ~/Library/Services/MLP.workflow/Contents/exiftool "-UniqueCameraModel=Canon EOS 6D" -overwrite_original
If you want the old script to work you can download exiftool from Phil Harvey,s webpage and install it.
http://www.sno.phy.queensu.ca/~phil/exiftool/Image-ExifTool-10.13.tar.gz
or download it via homebrew.
Enter following in terminal to install homebrew
ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)"
then write lines below to install exiftool
brew install exiftool
Thank you Danne - I downloaded the latest exiftool (10.13) dmg file from Phil Harvey's webpage as you indicated, and installed the pkg. Thats all I did - and now the Canon_EOS_6D.command is working! Appreciate your input as I've always been.
I will take a look at the MLP - wish there is a video tutorial for using the MLP hehe.
Yeah I know, there is a lot to learn. However if you have anything special you want to use it for it,s almost the simpliest way. To start out with one function and learn about that one.
What I did wrong? I succeeded one time to delete focus pixels and convert it to prores 444 mode. Then nothing.
so nowadays the mlp makes this:
1) services and I click MLP and it creates folders.
2) do it second time and he asks camera (100d) and I'll choose it
3) photoshop opens and says this:
http://imgur.com/7iPuZnj
4) it converts raw file to dng photos and prores 444 file, but it dont remove hot pixels.
So, what i do wrong?
Interesting. Could you upload a sample file MLV or RAW for me to test with?
Hey Danne thank you :)
I decide to give MLP a try - am pretty 'skittish' as it seems to be more of a video processor than a stills photo :D
So I have downloaded the MLP zip and uncompressed it - I am looking at the instructions in the Howto file and it says to download quite a few files. I googled a few - sox, ffmpeg - and found that these are for audio/videos. If I just need to do stills photos, do I need to download all of them or just a select few?
For still CR2 dual iso files you don,t need to download anything additional. Check page 2 and page 4 in the user_guide after you installed MLP. Good luck :)
New MLP in first post.
Been spending some time trying to learn basics on timecode. Been disussing with dfort checking and verifying information sharing valuable knowledge on different angles on using timecode in real life plus I,ve been reading different posts on the topic. It,s just a little number in the dng file but for some people probably very useful. Anyway. I had some necessary help from Phil Harvey, creator of exiftool who created a config script which made it work in MLP. Big thanks for this help.
http://u88.n24.queensu.ca/exiftool/forum/index.php/topic,7117.msg35940.html#msg35940
No dropframe inclusion.
This is a start.
For now it will count frames like this
24, 23.976, 23.98, 48 fps 00-23
25, 50 fps 00-24
30, 29.97, 60 00-29
@Oswald -- curious to see your file samples from your 100D as I also own a SL1 myself and works well with MLP as far as I'm concerned.
@Danne -- Excellent progress on the TimeCode feature (Thanks @Dfort for the suggestion) and I am actually pleased by @Phil Harvey's work with exiftool.
Will definitely download this and test it out. Thanks, D!
Hi,
Im new to mlp and i cant get ta pro res mov from dual iso dngs.
I keep getting a zero bytes mov.
I reinstalled MLP twice.
My non-dual iso files are processed fine.
BTW, Im using a MAC running yosemite
Camera a 5dIII
Im also running MLVFS
Any help in the direction would be great.
Darkframe processing through mlv_dumpNew version of MLP in the first post.
Always been curious about how to work with the average function in mlv_dump but never got around to do it until now. Been having some conversations with Baldavenger about how this works and I finally think I got the hang of it. Take a look here on Baldavengers excellent post on the topic.
http://www.magiclantern.fm/forum/index.php?topic=15801.msg164620#msg164620
This is a dark frame. You,ll need one. Quote from link above.
BaldavengerQuoteSo for the example above, put the lens cap on the camera (with the correct settings) and record a few seconds. If you were to view the frames of the MLV you would see almost black frames (except for a magenta looking noise). A Dark Frame is a single frame that is to be subtracted from every frame of the destined (actual footage) MLV, so an average frame is made from the few seconds that were shot with the lens cap on.
Big gratitude toward g3gg0 for fixing a bug in the mac version of mlv_dump and for implementing the average darkframe function in mlv_dump.
I put in quite a few things to be used around darkframes. Some ideas are related to Baldavengers thoughts on a workflow, (storing sets of darkframes), other ideas are naturally following the MLP philosophy.
I will try to present my ideas through a few scenarios through pictures and short youtube tutorials. Don,t hesitate to ask or point out things or ideas.
Scenario 1 Full automation
1 – Right click a folder and select MLP to build the folder structure
2 – Place your darkframe footage inside A_lut_hold folder and your footage next to the A_lut_hold folder
3 – Right click your folder once again to start processing
During the process MLP will create the averaged files in the A_lut_hold folder and they will be renamed with camera model, resolution, iso and fps. The original darkframes will be placed in a folder named darkframe_orig inside the A_lut_hold folder. Next MLP will start processing each file in your folder and if it matches the info from the darkframe it will apply the averaged mlv file from the A_lut_hold folder to your movie footage. If no match it will process the mlv files as it normally would.
Movie tutorialhttps://youtu.be/ppN5hsw8Upk
(http://s18.postimg.org/555lxssth/01_folders.jpg) (http://postimg.org/image/555lxssth/) (http://s18.postimg.org/hv9uaw0rp/02_darkframes_A_lut_hold.jpg) (http://postimg.org/image/hv9uaw0rp/) (http://s18.postimg.org/64vwti7z9/03_darkframe_processing.jpg) (http://postimg.org/image/64vwti7z9/) (http://s18.postimg.org/ssb5znnj9/04_Pro_Res_processing.jpg) (http://postimg.org/image/ssb5znnj9/)
Scenario 2Creating darkframe mlv files
1 – Right click on a folder containing your filmed darkframe footage
2 – Place your darkframe footage in the A_lut_hold folder
3 – Run MLP on the folder and your averaged darkframes will be created and renamed
Movie tutorialhttps://youtu.be/JTRJD0SAA3s
(http://s29.postimg.org/o890muzqr/06b_create_avg.jpg) (http://postimg.org/image/o890muzqr/) (http://s29.postimg.org/5tyhivng3/07b_create_avg.jpg) (http://postimg.org/image/5tyhivng3/) (http://s29.postimg.org/51vtjoj8z/08b_create_avg.jpg) (http://postimg.org/image/51vtjoj8z/)
Scenario 3Storing darkframe footage to 05_my_darkframes folder
1 – Once your darkframe mlv files are done you can move them to a storage folder called 05_my_darkframes folder. You can do this by manually move them or simply right click the A_lut_hold folder
2 – If your 05_my_darkframes folder contains darkframe files you can store them to your system by right clicking selecting MLP on the folder. The files will then be stored to ~/Library/Services/looks/05_my_darkframes folder
3 – By selecting the MLV_RAW_my_darkframes.txt file and putting it in the A_lut_hold folder you will activate darkframe processing of mlv footage only now it will match the footage with the files in the 05_my_darkframes folder instead of from the A_lut_hold folder
4 – If you want to erase the darkframes stored in your system you can do this by right clicking MLP on the A_dan_log_3d_luts folder.
Check the movie
Movie tutorialshttps://youtu.be/_2S34ZI2rAk
https://youtu.be/ouwtq3-9Ws4
(http://s9.postimg.org/t75hj3c8b/09c_storage_folder.jpg) (http://postimg.org/image/t75hj3c8b/) (http://s9.postimg.org/sgcrdb9uz/10c_storage.jpg) (http://postimg.org/image/sgcrdb9uz/) (http://s9.postimg.org/nlj2f1bjf/11c_txt_file.jpg) (http://postimg.org/image/nlj2f1bjf/) (http://s9.postimg.org/svo16bvsb/12c_MLP.jpg) (http://postimg.org/image/svo16bvsb/)
Scenario 4Adding and renaming darkframe mlv files to the 05_my_darkframes folder
1 – In order for MLP to accept the files in the workflow the darkframes must be prefixed with avg_. If you choose to add random darkframe mlv files to the 05_my_darkframes folder they will be renamed according to metadata info following camera model, resolution, iso and fps
2 – Add your files to the 05_my_darkframes folder and rename the content by right clicking MLP on the 05_my_darkframes folder
Movie tutorialhttps://youtu.be/tKsiBqW166U
(http://s10.postimg.org/c7z3q1ypx/16e_rename_darkframes.jpg) (http://postimg.org/image/c7z3q1ypx/) (http://s10.postimg.org/xiwnubgud/17e_rename_darkframes.jpg) (http://postimg.org/image/xiwnubgud/)
Off I go to join into the Darkside ... Man I'm not even sure if I should do 'Scenario #2' first to create my average dark frame files from MLV (shoot some with caps on) prior to do 'Scenario #1' or vice versa?
I just downloaded the latest MLP and about to shoot some quick test files in ISO 1600, ISO 3200 and ISO 6400 ... Thanks D and may the force be with you!
Once again SPECIAL THANKS to @baldavenger for the implementation of your work as well as to @g3gg0 for the mlv_dump update!
*edit*
For the DarkFrames MLV's that I shot (ISO 1600, 3200, 6400) for each ... do I rename them into a proper name without ruining the MLV file itself, correct? (Just did and all seems fine and normal)
*edit #2*
Looking good so far...
(https://farm2.staticflickr.com/1709/25415025974_18c9bfe71f_n.jpg) (https://flic.kr/p/EHQDM1)
However, I just noticed that Crop-Mode MLV's won't respond to DarkFrame's rendering ... is this to be expected? My wrong I forgot to shoot a dark frame (w caps on) for crop-mode. D'oh!
I also plan on doing another test in increments of 200, 400, 800, 2000, etc just to see the differences between analog and digital ISO when using this feature. Should be interesting.
Here's a quick glimpse of what I was able to accomplish from last night's late-night out testing.
Just for this particular test comparisons it was shot on 5D3 in 1/48th 24p ISO 6400 w 50mm @ 1.2.
•Here's the screenflow of how I organized the the Files into their respective locations prior to render/export within MLP re: Scenario #1.
https://vimeo.com/160392434
•Here are the comparisons in AE (Cinelog-C vs Cinelog-C REC709 FM Wide DR v2).
https://vimeo.com/160392435
•Screenshots Comparisons (cropped @ 200% in AE).
Pre_DF
(https://farm2.staticflickr.com/1688/25769449150_eb684990df.jpg) (https://flic.kr/p/Fgaarq)
Post_DF
(https://farm2.staticflickr.com/1720/25949761692_d549e36158.jpg) (https://flic.kr/p/Fx6j5m)
•Here are the GIF's for DF comparisons.
@ 200% (cropped):
(https://farm2.staticflickr.com/1654/25975738311_0cfb74b64a_o.gif) (https://flic.kr/p/Fzos26)
@ 100%:
(https://farm2.staticflickr.com/1587/25975996371_db3ae9069e_o.gif) (https://flic.kr/p/FzpLJp)
Here's the DF overall video comparisons.
https://vimeo.com/160412605
Now the question is ... is it worth all the extra effort to reduce the noise w DF processing?
I very much think so even tho it may not be noticeable but I can definitely tell. 8)
Hell yeah! Any noise reduction that doesn't degrade the image is worth it 8)
QuoteHell yeah! Any noise reduction that doesn't degrade the image is worth it
I tend to agree. It,s still the same dng but hot pixels, strange colors and banding will dissapear. Maybe the effect is bigger with frsp and shooting nighttime timelapses on higher isos. I welcome any deeper insights on the the darkframe theme and more examples too.
Those gif don,t really show what,s happening. The gif itself seems full of artifacts. Better if you show cropped examples of before, after @deafeyejedi
Quote from: Danne on March 26, 2016, 08:12:05 AM
Those gif don,t really show what,s happening. The gif itself seems full of artifacts. Better if you show cropped examples of before, after @deafeyejedi
Looks like you were right ... I took them down and replaced them with somewhat better examples (non-Cinelog-C, etc and they are cropped per your suggestion) and let me know if there's anything else that I can do to help.
More to come this weekend!
https://onedrive.live.com/redir?resid=CF04D6F1ABB25DA8!239&authkey=!AOmutAiKS-Ov5ug&ithint=file%2cRAW
I got it working, Instal-lion did not succeed well on my hackintosh. I don't know why, but I reinstalled MLP and then it works without any problem. :) But here is link.
7D Crop-Mode won't respond to DF Avg Process re: MLP atm.
Here are the example Files for whoever wants to try them.
https://mega.nz/#F!6wN1jATb!QWq_l7waSfGuox0jMfELGw
It says empty folder?
Had to reboot MBP. Froze up during upload. It's completed and online atm.
Keep in mind other crop-mode's from 7D worked fine during DF Avg. process except for this particular file for some reason.
Which was why I thought it was worth sharing. Thanks, D!
I am a novice to use the MLP. Is there an opportunity to preview different settings? it says about tiff? As I do now, I get to drive the entire process to see what the different 3D LUTs provide image. hope you understand the question
What happens when you right click MLP on the actual MLV or RAW file?
see page 13 in the user_guide, first post
i think i miss some files..
https://drive.google.com/open?id=0B4KcdNcQPavBcFVLSGc5Wmp4Qk0
Did you run the move_binaries.command before installing the latest version? Otherwise you could be missing all your files needed. in this case ffmpeg. If so you can redownload what,s missing following the HOWTO file.
ok, that was the problem. Thanks!!
Updated first post with latest MLP
- For some time there has been support for exporting to openexr and dpx files if imagemagick is installed. More info on this on p27 in the user_guide
- Also included in this version is a new repack txt file called MLV_RAW_dng_repack_or_compress_DNG.txt Which mainly will repack dng files from 14-16bit files but, there will be an alternative here. I,ve been having some conversations with cpc, author of slimraw (http://www.magiclantern.fm/forum/index.php?topic=15027.msg165213#msg165213) about adding some commandline options to his program. Now there is so as a non dependent alternative MLP will call for the -premiere option if the program is installed in the application folder. Dng files will be turned to lossless cdng files after they have been extracted to folders. This is something I personally find useful but of course it,s optional for the user.
I was testing to shot some raw mlv today, and the result was gr8, @dfort gr8 work no dots and MLP worked very well!
check it out! https://www.youtube.com/watch?v=G1K8Rh0hLR4
Looks great @Macke1. Could you share settings in cam and what luts you used? Did you film any dual iso or regular MLV? What cam?
I used canon 700d, regular raw movie MLV. Settings in cam - 1280 720 and allow frame skipping.
I used MLV_RAW_dng_straight_to_prores444 - MLV_RAW_dng_gamma_2.4_0 - MLV_RAW_dng_dcraw_any_command - brightness_+2 - 01_HDR_MOV_sRGB_01.cube.
New version out in first post.
A simplistic menu will appear when including legacy RAW files in your parent folder. Choose either to create MLV files from legacy RAW files or to simply process RAW to dng the regular way. It will batch process all RAW files in the directory. Nothing will be deleted or moved if converting to MLV. After conversion you can manually delete or choose to keep the RAW files.
Converting RAW to MLV is all possible thanks to bouncyball. Big thanks for this effort. Check his thread.
Also note that processing RAW to dng files now works without the need of concatenating spanned files. Bouncyball fixed this as well.
http://www.magiclantern.fm/forum/index.php?topic=17185.0
Menu selector
(http://s32.postimg.org/r788iqrut/Screen_Shot_2016_05_08_at_18_49_49.png)
The script part looks like this
#courtesy bouncyball at magiclantern.fm
if grep 'RAW' /tmp/magic_l_prores/list_RAW
then
ls *.RAW > /tmp/magic_l_prores/list_RAW_00
echo > /tmp/magic_l_prores/RAW_demolish
open ~/Library/Services/MLP.workflow/Contents/bmcc_ixml_luts/MOV_set_output.command
while ls /tmp/magic_l_prores/RAW_demolish
do sleep 1
done
if ! ls /tmp/RAW
then
exit 0
fi
if grep '01_legacy_RAW_to_MLV' /tmp/RAW
then
while grep 'RAW' /tmp/magic_l_prores/list_RAW_00
do
~/Library/Services/MLP.workflow/Contents/raw2dng "$(cat /tmp/magic_l_prores/list_RAW_00 | awk 'FNR == 1 {print; }')" --mlv $(ls A_lut_hold/*.MLV | head -1)
echo "$(tail -n +2 /tmp/magic_l_prores/list_RAW_00)" > /tmp/magic_l_prores/list_RAW_00
done
exit 0
fi
fi
Been busy scripting a CR2 still image HDR workflow. Since magic lantern has a really good hdr bracket function and MLP already works with enfuse I might as well put in something that works with that. Put in the CR2_HDR_enfuse.txt file in A_lut_hold to activate the menu below. Parent folder must contain CR2 files. Some more info in p4 in the user_guide. Processing is multithreaded.
(http://s32.postimg.org/9xgte6sk5/Screen_Shot_2016_05_10_at_14_03_26.png)
New version in first post
This one goes out to bouncyball. The guy that reworked raw2dng so that we can convert RAW to MLV. On a sidenote he also solved the spanned file problem in raw2dng.
http://www.magiclantern.fm/forum/index.php?topic=17185.0
After some discussion I pointed out a few things I always wanted to fix in MLP regarding mlv_dump and to make this happen there is no better branch than the work from dmilligan here https://bitbucket.org/dmilligan/magic-lantern/branch/ml_dng
There is actually quite a few things that dmilligan shares that I personally thinks deserves a lot more attention.
Ok, so what happened is that bouncyball reworked a lot of things in the ml_dng branch that was either missing or was somehow problematic and put the code up here.
https://bitbucket.org/bouncyball/ml_dng-branch/src/cca020d2d94ec0bb1bd082f6189227ec36a1c229/?at=ml_dng
Following is now implemented and tested working in mlv_dump coming from bouncyball ml_dng branch/fork?
- White balance handling(same as mlvfs – ufraw matrix math) All modes working except auto white balance in camera)
- Default scale tag(automated)
- Timecodes(as fixed in mlvfs. Chmee code originally?)
- Removed forward matrices(my wish, not cdng standard)
- Added focal resolution tags
Maybe I missed something here. I fill up with information as developing evolves.
The reworked mlv_dump together with a speedup in dng developing(converting 4 chunks in parallell, works since you can select frame range in mlv_dump, thanks g3gg0 – Thanks so-rose for pointing out.) will make developing dng files a lot faster. No need depending on exiftool and exiv2(actually very fast). All metadata handling is baked from within the mlv_dump binary.
Big thanks bouncyball listening, continuing developing, refining dmilligan´s stellar work in ml_dng branch. As always g3gg0, A1ex for mlv_dump, Chmee for a lot of early work around matrices, timecodes etc, and of course dmilligan for groundbreaking work in mlv_dump. Please tell if I missed thanking somebody here.
Daaaaaaammmmmnn @Danne's at it again. This time it's no turbo nor a supercharger. It's a freakin' 74-Z Military Speeder. So quick 'n dangerous like laser speeds! Sings beautifully on the Mac's while running MLP as usual. It's just even more pure Magic!
Funny how when one experiment actually solves one another and remarkably solves a lot of things overall together. That's the beauty of collaborations from certain people on this Forum. I am not even part of that crew.
This is beyond legacy stuff and much credit goes to you for your never ending work on this beautiful script in MLP which seems to get the most Updates (frequently) out of most if not all apps out there. For good reasons. He obviously cares for those that uses his fine work along with other amazing apps/converters as well out there on this forum. Thanks again Danne for yet another Christmas gift for all of us.
Remember none of this would have been possible without the amazing discoveries that @bouncyball recently made for us and has contributed so much in so little time. Keep on rolling, Buddy!
Special Thanks also goes out to @dmilligan, @g3gg0, @a1ex, @dfort, @Chmee, @so-rose & those that have contributed to keep this community well alive and always reviving.
Off I go into the speed comparisons experiment between the older and newer versions of MLP and will report the results as soon as I can. Fasten seat belts and best be sure to hold on to these speedy 74-Z's!
Some findings about the format EXR started out as a side topic so I grabbed the information and put it up here instead.
Seems photoshop is pushing exr files to gamma 2.2 when it should be linear 1.0. DaVinci Resolve is respecting linear output for exr format.
A "fix" is to set midpoint to 0.45 to get back to linear in PS.
http://forums.cgarchitect.com/80010-saving-exr-gamma-settings.html
QuoteIf you were comping your EXR's you'd want them to remain linear, and as such they shall appear too dark. But you want to do the maths on them like this. To see what you are getting as a result, you would put a gamma of 2.2 on top of the comp. In PS I would do this with a levels adjustment layer at the top of the stack. The mid point is set to zero by default, but you can type in 2.2 (or 0.45 if required) to adjust the gamma output.
If you're not concerned with linear compositing, it's still useful to know.
Closer
Photoshop
(http://s33.postimg.org/hrn6uoasf/Screen_Shot_2016_06_03_at_21_47_02.png)
DaVinci Resolve
(http://s33.postimg.org/v9u36ymxr/Screen_Shot_2016_06_03_at_21_48_30.png)
Some more stuff in AE. By selecting Preserve RGB(interpret footage) the output seems linear.
(http://s33.postimg.org/6f63a81pb/Screen_Shot_2016_06_03_at_22_05_46.png)
(http://s33.postimg.org/meoqtrxr3/Screen_Shot_2016_06_03_at_22_06_42.png)
Changing color settings in AE as well
(http://s33.postimg.org/6pl033btr/Screen_Shot_2016_06_03_at_22_13_16.png)
Pretty much matches DaVinci Resolve output
After effects
(http://s33.postimg.org/t2xc3n25b/Screen_Shot_2016_06_03_at_22_12_42.png)
Davinci Resolve
(http://s33.postimg.org/v9u36ymxr/Screen_Shot_2016_06_03_at_21_48_30.png)
Set to camera RGB profile seems even closer
(http://s33.postimg.org/9xpj3oalb/Screen_Shot_2016_06_03_at_22_22_20.png)
In photoshop you can set RGB to convert to actual rgb and it will show the correct linear gamma. But we,re suddenly in RGB and not sRGB color space right now, hmm
(http://s33.postimg.org/xzw74lbcf/Screen_Shot_2016_06_04_at_08_50_20.png)
Answer from Andy600
Quote@Danne - Instead of setting gamma to .45 try the inverse of the sRGB transfer function (as a lut). I'll bet it matches precisely.
My answer
QuoteNot sure how to create inverse luts but I added the sRGB to linear lut from VFX IO(Davinci Resolve) lut to the clip in AE and I assume it,s the same thing? Looks right to me :)
(http://s33.postimg.org/6z3hm66r3/Screen_Shot_2016_06_03_at_22_37_26.png)
@Danne - The Resolve 'sRGB to Linear' lut is fine for this but I personally wouldn't set the workspace to Camera RGB ICC because it's non-standard. Try it with the sRGB or Rec709 ICC profile and a grayscale chart image if possible. You can't know for sure what is happening without some kind of reference.
I restarted AE so I believe it choose the sRGB colorspace(EXR colorspace) as default. Here it is again with color settings actively set to sRGB.
I checked how to get into linear gamma in photoshop too and they have some "actual RGB" setting which overrides the sRGB setting in the exr file but that seems plain wrong to do? Applying the sRGB to linear lut for gamma applied to the EXR sRGB colorspaced image must be the better approach. What do you say?
AE color settings set to sRGB
(http://s33.postimg.org/jrdjdoz73/Screen_Shot_2016_06_04_at_10_59_00.png)
An EXR workflow should use a linear float workspace so AE's workspaces ICC should be linear too. Looking at your AE settings you need to click 'Linearize working space' before doing anything else or you can end up with double gamma issues which may be why the image looks like it does i.e. it looks almost log to me - there may be an additional gamma compound issue to deal with.
Assuming the image was produced in MLP, have you tried creating an EXR in Resolve using the original raw i.e. without MLP? How different is it to MLP?
Exr from DaVinci Resolve produces the same results when previewed on mac or imported into PS or AE(overbrights) Will upload comparison files later.
Double linear gamma happens in DaVinci when selecting -colorspace RGB in MLP(imagemagick). Or would this actually be the linear file we,re looking for?
I would trust Resolve's interpretation above ImageMagik because, as you say, it produces the same results in AE and PS but also in Nuke and Baselight. If AE color management is set up correctly it will produce EXR's the same as Resolve. You should aim at getting ImageMagik to match Resolve EXR but that may involve tweaking the source code - I don't know ImageMagik well enough and have only used it a couple of times for calibration/testing.
Sorry if I was unclear. Both Imagemagick and Resolve output delivers overbright gamma in preview and photoshop.
The really hard part here is to understand where in the pipe things goes wrong. I don,t even know what is supposed to be the correct starting point here :P
Please have alook at these two examples from Davinci resolve and image_magick.
DR(half float)
https://drive.google.com/file/d/0B4tCJMlOYfirbkxXLWpCdGZLaVk/view?usp=sharing
IM
https://drive.google.com/file/d/0B4tCJMlOYfirVkl3MlZpVW5RSUU/view?usp=sharing
Sorry @Danne to be a party pooper but I tried to download latest MLP from OP and seems the link is dead?
On both Chrome and Safari I've been getting this...
(https://c5.staticflickr.com/8/7322/27372524700_0cd95cdfdb_n.jpg) (https://flic.kr/p/HGPkX3)
Anxious to try out the latest FFplay menu features ... Thanks, D! :D
Seems to work over here?
Actually just tried it on my iPhone's safari which does show the latest MLP (updated 19 hours ago) so I'll restart my MBP and try again. Sorry for the false alarm, D.
New upload in first post.
There is still things to develop around HDR
http://www.magiclantern.fm/forum/index.php?topic=17334.msg168376#msg168376
By duplicating an image sequence one can obtain the original framerate instead of having HDR halfen fps due to fusing images. Instead of going A+B, A+B, A+B you can do consecutive blending by fusing A+B, B+A, A+B and so on.
To activate correct framerate in HDR processing add HDR_enfuse_correct_FPS.txt into the A_lut_hold folder. This works automated both with dng and H.264 movie processing.
Now this workflow is already working with ffmpeg tblend average filter however with enfuse you also have the possibilty to work with aligning via Hugin.
Also added in MLP is a small menu helper when right clicking folders with dng files which activates FFplay previewer.
Thanks for the update, D!
Here are my findings when using H264 HDR footage...
https://vimeo.com/170872340
Is this normal for the a_lut_hold to be a File rather than a Folder? Because when I go into the dcraw_FFmpeg_settings Folder to pick out a few HDR features which then won't go into the a_lut_hold because it's not a Folder? Should I delete that 'file' and create a new Folder with the same name?
You should select 'q' exit and quit from the menu if you are working from the same folder as your files.
Recommend you to test some short 30 fps since the quality is better and aligning takes a while.
I have a new version coming up soon which fixes an interpolation issue creating flickery parts from enfuse.
New version uploaded which fixed align/enfuse issue by auto crop with hugin.
When running MLV/RAW files include following files in A_lut_hold folder
example:
HDR_enfuse_correct_FPS.txt
HDR_enfuse_straight_from_dng_settings.txt
HDR_MOV_disable_sharpening.txt
When running H.264 mov material include:
example:
HDR_enfuse_correct_FPS.txt
HDR_enfuse_settings.txt
HDR_MOV_disable_sharpening.txt
Try 24,25 or 30fps to see how it works. If you want fast enfusing add HDR_disable_aligning.txt only the ghosting will be severe. Remove the HDR_MOV_disable_sharpening.txt
if you want a slight sharpening added to your files.
Here,s a little something filmed in HDR iso 100-1600(H.264 MOV), 24 fps keeping the original framerate by copying and enfusing double amount of frames.
Following settings in A_lut_hold folder.
HDR_enfuse_correct_FPS.txt
HDR_enfuse_settings.txt
HDR_MOV_disable_sharpening.txt
Wow, this looks suprisingly good! None of the ghosting and jittering from my own tests a little while ago. Good job :)
Thanks. Did you try it out yourself with aligning function enabled? Could you share some results @aschille84?
I should definitely try it. Ill see what I am able to come up with in the coming weeks!
Ok, so I tried the enfuse-workflow with the newest version. And it works really well. On my 6D I would prefer working with HDR h264 over RAW any day. The only drawback is the rendering time, on my 2012 macbook pro, rendering 30sek HDR took like 25min.
here is an example:
https://www.dropbox.com/s/pbcpwh9woc0hdfj/HDR_MVI_8093.mov?dl=0
I was thinking if its possible to have some kind of proxy workflow.
Is the tblend average option faster?
I,ll check soon. Oh yes, the tblend filter is in realtime. Caveat you don,t have the aligning function so 50 or 60fps is recommended. I consider the tblend filter workflow the most useful actually.
Just checked you vid. ANd also the one you posted before here http://www.magiclantern.fm/forum/index.php?topic=17444.msg168711;topicseen#msg168711. Nice work.
Do try the tblend filter. I think it could be useful :)
Updated MLP so it works with the latest FFmpeg. Planning on maybe implementing the new atadenoiser filter which seems good.
Had to change some commands used in ffmpeg in older versions so when updating see to it that the latest ffmpeg is present in the Place_binaries_here folder before migrating binaries from the older version.
Latest FFmpeg can be found here
http://www.osxexperts.net/ffmpeg302osx108.dmg
Clarification
Old user(already MLP installed)
1 - Place the updated FFMpeg in Place_binaries_here folder(download package)
2 - Double click the move_binaries.command and follow instructions(say yes to both questions)
New user
1 - Follow the HOWTO.txt in the download package
Noise reduction sounds intersting!
One question, is the prores files produced from DNGs In MLP in linear color space by default?
Hi aschille84.
Settings defaults are
dcraw $icc +M $br $dpf_a $any $ga -c -6 -W -q 3 $r $wb
Where the important picture settings are
dcraw +M -H 2 -g -6 -W -q 3
+M/-M Use/don't use an embedded color matrix
-H [0-9] Highlight mode (0=clip, 1=unclip, 2=blend, 3+=rebuild) Set to -H 2(slight higlight recovery. Works very well)
-g <p ts> Set custom gamma curve (default = 2.222 4.5) Gamma set to -g 2.4 0
-6 Write 16-bit instead of 8-bit This setting is not linear altough -H 2 moves towards linear output. For linear output use following
-4 Linear 16-bit, same as "-6 -W -g 1 1" Not used in MLP
-W Don't automatically brighten the image
-q [0-3] Set the interpolation quality
You can change these basic settings by removing the gamma and any_settings file in A_lut_hold folder.
Thanks, Danne!
Ill try to get some results with this. Im interested in using this with color space transfrom latest resolve update.
So can I change the settings in MLV_RAW_dng_dcraw_any_command.txt to +M -H 2 -g -4 -W -q 3 or do I have to change this in another file?
Well, some dcraw code settings might not apply since they are not put into variables.
Easiest would be to change in the source_code_MLP folder in following files(look at the bottom of each file). Put in the same code in all four files(multithreading)
fold_prores_01.txt
fold_prores_02.txt
fold_prores.txt
process_01.txt
After changing stuff in there double click A_move_content_to_workflow.command in the source_code_MLP folder and then install MLP after doing your changes. Don,t forget to migrate binaries with move_binaries.command before installing.
Alternative you do these changes straight inside an already installed MLP versionand test your results.
Go here ~/Library/Services/MLP.workflow/Contents/ and search for these files
fold_prores_01.command
fold_prores_02.command
fold_prores.command
process_01.command
Let me know how it works or I help you out later. Prepare for dark files and even darker with -H 2 selected :).
Ok, so I did a test.. Ended up making a custom LUT to match the DNGs in a ARRI Log-C timeline in DR12.5. Ungraded prores 444 to the left, slightly graded to the right.
The last clip is a HDR clip with the
enfuse_correct_fps.txt setting. I couldnt get the scaling to work with the HDR workflow, not a big deal though.. Its low res 6D, but the colors are still great.
Cool stuff. HDR is great working with.
How are you using the scale MLV_RAW_MOV_dng_scale.txt file? I just tested changing to 2500k in by replacing scale=1920:-1, with scale=2500:-1, and it worked over here.
New version uploaded.
Created a menu selector in which one can add different settings in ffmpeg. It works with previewing and HDR as well. Report any bugs since I had to change a lot of scripts.
TO activate the menu add the FFmpeg_settings.txt file to A_lut_hold folder prior to running MLV/RAW, MOV, or folders with dng files. Add settings and when ready select run MLP.
You can also exit the menu before running MLP and do previewing and then run MLP again when ready.
(https://s32.postimg.org/mhr938zf9/Screen_Shot_2016_06_28_at_01_13_13.png)
Quote from: Danne on June 28, 2016, 05:01:04 PM
Cool stuff. HDR is great working with.
How are you using the scale MLV_RAW_MOV_dng_scale.txt file? I just tested changing to 2500k in by replacing scale=1920:-1, with scale=2500:-1, and it worked over here.
Thanks! I agree.
I plotted in the same resolution as the DNGs 1600x680 and it worked great with
non-HDR footage. (Otherwise movs streched vertically).
But with the enfuse process the same scaling didnt work. (Thou the original resolution was different, and I kept the 1600x680 scaling ). Need to check again.
Edit: due to different res, not hdr-process
Strange.
Could you show me exact what you put in the A_lut_hold folder and I will try to reproduce.
Maybe even put up a test file(short one)?
Also, you should keep the 1 and only put in the width number scale=1600:-1
Excited to try out, the denoise function! Will test it soon.
It checked the scaling again. When using scale=1600:-1, it scales the picture to 1600x1133 i. e 16:9. With different resolutions it does keep the fixed width, but scales any aspect ratio to 16:9.
If i plot the same resolution as the clip scale=1600:680, its okey for that clip. But not several clips with different resolutions. Workaround is to only process clips with same resolution, I guess.The clips used were: 1600x680 and 1280x582:
Link to MLVs:
https://www.dropbox.com/sh/gommijju5i2dmaf/AACt9JtJ7l8ZHp2lfcHvJtJha?dl=0
Folder:
https://www.dropbox.com/sh/fy1gio3lqjl9b07/AACCohFg5JWbB4yNl8oKSBs2a?dl=0
Thanks a lot for sharing your findings. I think I come to a solution.
Seems going from tiff images to .mov files keeps a pixel dimension tag in the exported file. Even though the image size shows 1600x680 the aspect ratio will still be 1600x1133. This tag cannot be erased with exiftool but ffmpeg has a setting that will let you alter aspect ratio. If you want 16:9 relation you write the following in the scale text document.
scale=1600:680,setdar=16:9,
Let me know if this works.
More info here
https://ffmpeg.org/pipermail/ffmpeg-user/2012-April/006201.html
I,ll update this post with more findings later.
scale=1600:680,setsar=1:1,
is even better. Might automate this one into the script.
*update
Seems to be a problem with this version of mlv_dump changing the default scale tag on regular fps files. This creates wrong aspect ratio on your files. Will check.
You filmed these clips in regular 1080p mode and not 720pmode?
Thanks for helping out, you do a great job with this app, @Danne. Even for this very specific need :) ill come back with more findings, and maybe some travelogue summer vids!
Spent a few hours trying to understand some of the code around how to detect whether or not to add the default scale tag. Checking in ml_dng branch(dmilligan) he calculate the active area (width and height) from the raw buffer(dng)_info) and if height can be doubled before it meets max width it can be determined for squeezed footage.
Another assumption is <=720 and if that doesn,t match it continues to ask if rawW could be < 2000(width).
However. Since your footage orignally was filmed in 1600x680 mlv_dump wrongfully assumes it,s squeezed footage.
The solution right now is for you to either film an aspect ratio that won,t be taken for squeezed footage or run footage through mlvfs. Or export it back to correct aspects with ffmpeg.
To fix this we must have mlv_dump determine the active area from the raw source rather from the raw buffer like in mlvfs. I see what I can do here but I will need some help :P.
Uploaded a new version.
I might have fixed the rare default scale tag problem. It has to be tested with some different cameras since I only have a 5D mark III right now.
Instead of checking for 2.0 I put in to check for 2.5 which could be the better number here.
if(aspect_ratio > 2.0 && rawH <= 720)
is changed to
if(aspect_ratio > 2.5)
How to verify
Testing with maybe three different aspect ratio settings going from low medium to highest and camera set to mv720 mode(slowmo) and develop to dng files. Open in acr or run in MLP. Footage should come out unsqueezed.
Or simply scroll through aspect ratio menu and calculate the settings addition Height*2.5. The numbers should be more than width setting if filming mv1080 and below if filming mv720 mode.
Looking forward to some lovely summer vids aschille84 :)
Nice find @aschille84 and MUCH Thanks for the quick fix @Danne (even without help) and I'll definitely do the suggested test verification with slo-mo files in mv720 mode for unsqueezed footage. This will be a huge time saver as it usually take forever to do so in DR12.5 (I don't know of a short cut to fix AR for each MLV within timeline as copy and paste doesn't do the trick) and also this can be a bit quicker in AE anyway.
There is some setting for aspect ratio in resolve. At least there was before. When that was set one can work freely with squeezed dng files.
But what about working with a bunch of different footage (mv720 mixed with mv1080) together or something in that regard?
Then we have a problem I suppose :)
Hey,
Im curious if it would be possible to wirte a script to upscale the dng's to say 4k if possible?
It,s possible to do this already inside this file. MLV_RAW_MOV_dng_scale.txt.
Simply replace scale=1920:-1, to scale=4000:-1, and put the MLV_RAW_MOV_dng_scale.txt file into A_lut_hold folder prior to running MLP. Inside the file you can also choose between different scaling techniques. This will output a mov file to 4k. Upressing the actual dng files isn,t possible.
Ive been using ml raw for about a year now and i love the dynamic range that it gives me. I do alot of run and gun style shooting and picked up a sony a6300. I love the slog2 color and i want to match up color as best i can. MLP is the fastest workflow and most powerful that i have used to process my raw file.
Long story short ...
MLRAWviewer can convert to slog2. How can i use MLP or can that file be create in MLP with the other log files to convert my raw files to slog2 mov's?
Here is an example of a video i did with mixed footage from a6300 and 5dIII raw
https://vimeo.com/165436917
Thanks for sharing Bobbyshots! Great vid :)
Could you try these luts?
Slog2
https://drive.google.com/file/d/0B4tCJMlOYfirOVU3eEZESXFIanM/view?usp=sharing
Also run them with MLV_RAW_dng_dcraw_any_command.txt for highlight recovery(knee)
Hey,
I came across this link where the guy upressed 1080 dng to 4k thats why i ask about up ressing.
I figured his process of using after effects to upressed you guys could do using chdr or repacking or some other step.
The file that you pointed to does the job but does it degraded the quality?does it create the MOV in 1080 then upres the MOV to 4k?dioes the quality get degraded? Maybe only if you pixelpeep?
http://blueoceanproductions.com/blog/?p=89 (http://blueoceanproductions.com/blog/?p=89)
It really depends on upscaling algorithms how degraded the picture is gonna be. Of course a higher quality source file will yield better results. One have to test and see what works or not.
Hi guys!
I feel extremely stupid for this... but here it goes:
In the HOWTO it says "2 - Extract the enblend-enfuse-4.0-mac.tar Move enfuse to Place_binaries_here folder 13,6 MB in size' But I don't seem to find a file named "enfuse" inside the extracted folder.
Well, I also need to mention that the file downloaded is enblend-enfuse-4.2.tar not 4.0
IDK if it makes any difference.
Any leads here? Is there a folder I need to move or what?
Thanks!
Thanks for noticing. I updated MLP in the first post. Also a google search "enfuse 4.0 mac" will get you there(first post). Get back if you encounter any other problems.
Quote from: Danne on July 14, 2016, 07:32:21 AM
Thanks for noticing. I updated MLP in the first post. Also a google search "enfuse 4.0 mac" will get you there(first post). Get back if you encounter any other problems.
Thanks D, that worked!
Now to see how the hell do I work with all of this! LOL
Thanks for taking the time and making this!!!
Testing, testing :). You could always put up questions and work in progress here. Personally I found HDR tblend workflow useful and fast and it don,t even uses enfuse. Page 7 in the user_guide. This works best with 50 or 60 fps and when in 720p mode 5D mark III holds up the picture better than other cameras.
Is the HDR tblend workflow best use for H.264 or RAW?
As long as you maximize frames from 48 fps and upwards I,d say go for tblend filter. In other cases enfuse workflow with align function on(default) both h264 and raw/mlv.
I must say when first downloaded MLP and realized there was no .dmg file located in it, I was instantly turned off and terrified; however, @DeafEyeJedi talked me into all the magical wonders this application bring to ML. He stayed up with me last night and walked me through the whole installation process for MLP via text message. @Danne, this man is working overtime to promote your product and get people to use it, I don't know him personally but I really appreciated that. MLP is "GOD DAMN AWESOME" I'm super new to it but I see myself marrying it, trust me, if you are new to this program, it is worth every bit of the installation process, do not be afraid of it, it is magical. I LOVE IT! Thank you very much @Danne and the whole team for giving me this, I have a 550D and now the footage look so much better. THANK YOU. I will be posting to my video soon.
Hey,
I think i maybe missing something im trying my hand at hdr. When i try to process giving this setup i dont get a final mov file. I get a prompt to delete or keep tif files. i hit delete. I see the process going create the tiffs. Then there is no move file after the process is finished. Am i mission something in my a_lut_hold or enfuse? I do believe enfuse is installed.
any help will do. thanks.
https://www.dropbox.com/s/c70gkem8slwzso5/Capture.JPG?dl=0 (https://www.dropbox.com/s/c70gkem8slwzso5/Capture.JPG?dl=0)
Sent you a PM. The install script should say if you have enfuse installed or not.
Great TK... that you got MLP working and thanks deafeyejedi.
@Bobbyshots2 enfuse problem been solved with teamviewer seesion. Enfuse binary needed chmod u=rwx permissions and after this it went smoothly. Good luck with the footage.
Do you know if the enfuse issue reported by @Bobbyshots2 was only affecting with his Mac or do I need to update MLP (which I don't think) as I've been sorting out best workflows when it comes to quantity vs quality especially with quick turn arounds.
I could definitely use some good luck charms from you, @Danne!
If my partner instincts to stick with 30p @ 1080p to better match with his drone shots -- then I'll have to use enfuse rather than tblend mode but it's just seems like a looooooong time for it to spit out HDR converted files. [emoji5]
Sent from my iPad using Tapatalk
The problem was with permission of that specific binary. Keeping framerate HDR workflow should be tested more. There are some interpolation steps due to enfuse causing flickery edges otherwise. This itself could maybe be problematic with lots of movement for instance.
Some 30p HDR (ISO 100/1600) testing in H.264. Rendered with tblend average. Applied with varieties of cubes in A_lut_hold folder.
https://vimeo.com/176006431
Also in regards to MLV RAW HDR ... I may have also encountered that same so called enfuse bug reported by @bobbyshots2 from earlier.
Here are the screenshots of the empty .mov file...
(https://c1.staticflickr.com/9/8354/28225583120_f7529dc76d_n.jpg) (https://flic.kr/p/K1cuuQ)
(https://c5.staticflickr.com/9/8843/27892544804_96044cff18_n.jpg) (https://flic.kr/p/JuLzNU)
Thanks, Danne!
Thats a good lighting example for HDR. Could you pm me it for testing?
What are your aim here. The files in A_lut_hold is for raw/mlv workflow?
Tblend will never be good with footage below 48 fps right now. I suggest you try with HDR_enfuse_settings.txt file and the keep_correct_fps.txt file. And skip the luts as well. When footage is aligned you probably won,t see any ghosting.
Also check if you have enfuse installed.
Appreciate all the work you guys have done for Magic Lantern - really love the DualISO and the new MLP workflow (new to me, that is) !
Just installed MLP and the newest ML beta for 70D two hours ago - and happy to share no glitches so far!
Great! Good that your 70D is working. There has been many reports of 70D dng files which won,t open in acr but that doesn,t seem to be a problem in your case.
Quote from: Danne on July 24, 2016, 11:51:45 AM
Thats a good lighting example for HDR. Could you pm me it for testing?
Done. Check your PM. Includes both H.264 files (not sure if you still want the RAW files?) but let me know either way. However, I didn't think these were good HDR files (or at least I thought so) especially with the first take (MVI_7210) due to the shutter effects from panning too fast across the room and felt that it looked slightly better in the 2nd take (MVI_7211) in which you can tell the differences between these two. This was all shot in 30p so the shutter was set at 1/60 respectively.
Quote from: Danne on July 24, 2016, 11:51:45 AM
What are your aim here. The files in A_lut_hold is for raw/mlv workflow?
Tblend will never be good with footage below 48 fps right now. I suggest you try with HDR_enfuse_settings.txt file and the keep_correct_fps.txt file. And skip the luts as well. When footage is aligned you probably won,t see any ghosting.
Also check if you have enfuse installed.
I was only referring this workflow aiming at the RAW files as I wasn't aware that it only needed the HDR_enfuse_settings.txt (and not the enfuse_straight_from_DNG_settings.txt) but I guess I also needed to give enfuse permissions via Terminal. Perhaps I'll try this again and report back my findings. Thanks again D!
If you follow the userguide you have a good chance of getting things right. Otherwise it,s a lottery ;).
Quote from: Danne on July 25, 2016, 06:28:05 PM
If you follow the userguide you have a good chance of getting things right. Otherwise it,s a lottery ;).
Haha ... After reading the user guide thoroughly again and learned that it was either one or the other. Can't be used together.
Thanks for also pointing me out to the missed tip on the FFmpeg update (http://www.magiclantern.fm/forum/index.php?topic=13512.msg169077#msg169077update) as my MBP is currently singing while rendering MLP!
Sounds so sexy actually...
Great solving. If I get the time I might put in a little crying sign if there,s an older ffmpeg version installed in MLP :)
i have installed the MLP on my Mac Pro , OS X 10.11 ,and the raw video transformation is good,but when i use MLP to handle dual iso cr2 images,it ibreaks and no response.
the command line tips:
r
rm: /tmp/magic_l_prores/lock_matrix: No such file or directory
ls: *.MLV: No such file or directory
ls: *.RAW: No such file or directory
/Users/DavidLee/Library/Services/MLP.workflow/Contents/mlv_rawb.command: line 23: cd: nohup: No such file or directory
ls: A_lut_hold/FFmpeg_settings.txt: No such file or directory
ls: /tmp/magic_l_prores/lock_ffmpeg_settings_exit: No such file or directory
ls: A_lut_hold/DNG_exr_dpx.txt: No such file or directory
ls: /tmp/MOV_set_output.txt: No such file or directory
ls: A_lut_hold/DNG_compressor.txt: No such file or directory
grep: /tmp/CPRS: No such file or directory
ls: A_lut_hold/DNG_compressor.txt: No such file or directory
ls: A_lut_hold/DNG_set_output.txt: No such file or directory
/tmp/A_lut_hold_content
find: *1_C0000: No such file or directory
ls: *.txt: No such file or directory
File not found: *_000000.dng
File not found: *_000000.dng
File not found: *_000000.dng
File not found: *_000000.dng
/Users/DavidLee/Library/Services/MLP.workflow/Contents/mlv_rawb.command: line 249: list_01: Permission denied
cat: list_01: No such file or directory
rm: list_01: No such file or directory
ls: /tmp/magic_l_prores/lock_matrix_01: No such file or directory
ls: /tmp/magic_l_prores/lock_matrix: No such file or directory
ls: /tmp/magic_l_prores/lock_matrix_01: No such file or directory
ls: /tmp/magic_l_prores/lock_matrix: No such file or directory
cat: ../fps: No such file or directory
/Users/DavidLee/Library/Services/MLP.workflow/Contents/mlv_rawb.command: line 280: ../fps: Permission denied
find: illegal option -- p
usage: find [-H | -L | -P] [-EXdsx] [-f path] path ... [expression]
find [-H | -L | -P] [-EXdsx] -f path [path ...] [expression]
cat: ../fps: No such file or directory
rm: ../fps: No such file or directory
cat: /tmp/magic_l_prores/wav: No such file or directory
cat: /tmp/magic_l_prores/sound: No such file or directory
File not found: *.wav
ls: *.wav: No such file or directory
rm: /tmp/magic_l_prores/wav: No such file or directory
ls: ../A_lut_hold/HDR_enfuse_straight_from_dng_settings.txt: No such file or directory
rm: /tmp/magic_l_prores/d_lick: No such file or directory
grep: A_lut_hold/MOV_set_output.txt: No such file or directory
ls: A_lut_hold/MLV_RAW_MOV_new_output_path.txt: No such file or directory
ls: A_lut_hold/MOV_backup_syst.txt: No such file or directory
==============================
dcraw_FFmpeg_settings
------------------------------
Please enter your choice to add a file.
Reenter your choice to erase the added file.
Preview tif files will be generated in the background while selecting or removing
settings.
Main_settings_menu Contents A_lut_hold
(l) A_dan_log_3d_luts MLV_RAW_dng_dcraw_any_command.txt
(br) dcraw_brightness_whitebalance MLV_RAW_dng_gamma_2.4_0.txt
(l+) additional luts MLV_RAW_dng_straight_to_prores444.txt
dcraw_FFmpeg_settings
(00) CR2_HDR_enfuse.txt
(01) CR2_cr2hdr20bit_settings.txt
(02) Frames_per_second.txt
(03) FFplay_Histogram.txt
(04) FFplay_Waveform.txt
(05) HDR_disable_aligning.txt
(06) HDR_enfuse_correct_FPS.txt
(07) HDR_enfuse_settings.txt
(08) HDR_enfuse_straight_from_dng_settings.txt
(09) HDR_MOV_disable_sharpening.txt
(10) HDR_tblend_average.txt
(11) HDR_tblend_average_half_FPS.txt
(12) MLV_mlv_dump_settings.txt
(13) MLV_RAW_dng_Auto_white_balance.txt
(14) MLV_RAW_dng_dcraw_any_command.txt
(15) MLV_RAW_dng_dual_iso_gamma_3.6_0.txt
(16) MLV_RAW_dng_gamma_2.4_0.txt
(17) MLV_RAW_dng_linear_gamma_1.1.txt
(18) MLV_RAW_dng_move_to_parent.txt
(19) MLV_RAW_dng_repack_or_compress_DNG.txt
(20) MLV_RAW_dng_scene_folders.txt
(21) MLV_RAW_dng_straight_to_prores444.txt
(22) FFmpeg_settings.txt
(23) MLV_RAW_MOV_dng_scale.txt
(24) MLV_RAW_MOV_new_output_path.txt
(25) dead_pixel_list.txt
(26) MLV_RAW_my_darkframes.txt
(27) MLV_RAW_player.txt
(28) MOV_regular.txt
(29) MOV_backup_syst.txt
(30) DNG_exr_dpx.txt
(v) MlRawViewer
(re) reset A_lut_hold folder
(pp) tif previewer
(p) 4 second tif previewer
(pr) rerun preview MLV/RAW
(c) close preview window
(h) hide terminal window
(o) open A_lut_hold folder for 5 seconds
(d) delete content in A_lut_hold folder
(qq) stop processing
(q) exit and quit
(r) run MLP(MLV/RAW)
grep: A_lut_hold/MOV_set_output.txt: No such file or directory
ls: A_lut_hold/MLV_RAW_MOV_new_output_path.txt: No such file or directory
ls: A_lut_hold/MOV_backup_syst.txt: No such file or directory
grep: A_lut_hold/MOV_set_output.txt: No such file or directory
ls: A_lut_hold/MLV_RAW_MOV_new_output_path.txt: No such file or directory
ls: A_lut_hold/MOV_backup_syst.txt: No such file or directory
grep: A_lut_hold/MOV_set_output.txt: No such file or directory
ls: A_lut_hold/MLV_RAW_MOV_new_output_path.txt: No such file or directory
ls: A_lut_hold/MOV_backup_syst.txt: No such file or directory
ls: A_lut_hold/HDR_enfuse_settings.txt: No such file or directory
How do you process the cr2 files? It should be done by right clicking a folder containing CR2 files. Are you running (r) from the menu command? That will probably not work.
Did you check page 5 in the user_guide?
https://www.dropbox.com/s/wpgsilongl80oa8/MLP_user_guide.pptx?dl=0
It took a long while of reading and re-reading, but i finally figured this thing out. I'm still in the learning process, but so far I am very impressed and happy with the development of MLP. My only comment would be a more thorough guide or walkthrough. As a start-from-scratch user, I found a lot of the language and terms used were difficult to follow/understand especially with no reference to what things actually were. Nevertheless, as i said, if you really want to learn how to use MLP then you have to be ready to read through all the documentation, as well as this thread, very carefully.
I'll be posting some dual-iso MOV and dual-iso MLV real estate videos in the future.
Thanks for all the hard work and dedication to the development of this app Danne.
Have you tried figuring out what the issue(s) was on your end @thusboy?
New upload in first post
Minor menu update. Added some options which will pop out when including CR2 dual iso files. Options are straight from a1ex cr2hdr. I left out white balance options since MLP script already provides correct white balance with help from dcraw and some division math. There are other options left out but anything could be added.
Usage:
Select a setting. Reselect setting to erase. When ready hit (r). If running defaults just hit (r) without selecting anything else. All settings applied are placed in a settings file in A_lut_hold.
(https://s10.postimg.org/leq33ulwp/Screen_Shot_2016_08_12_at_20_47_52.png)
Thanks Danne for the update. Definitely useful features for CR2 Dual-ISO. Will test them and report back.
Meanwhile, I feel that it is also important to note how useful (extremely useful) it is to use DarkFraming Average Process within MLP and yet it's so easy!
Here are some samples for those who are still curious or unsure whether to take a quick dive into the Dark Side even tho I am a Rebel.
5D3 @ ISO 3200 (pushed exposure to +5.00 in ACR for this test purpose):
Pre-DF Avg
(https://c3.staticflickr.com/9/8314/28849933250_49cf5ecc86.jpg) (https://flic.kr/p/KXns3f)
Post-DF Avg
(https://c2.staticflickr.com/9/8465/29059880121_92c0f55fd9.jpg) (https://flic.kr/p/LgVtVT)
https://vimeo.com/179781739
7D @ ISO 6400 (pushed exposure to +3.00 in ACR):
Pre-DF Avg
(https://c6.staticflickr.com/8/7778/29162807805_a10d15decc.jpg) (https://flic.kr/p/Lr21K8)
Post-DF Avg
(https://c5.staticflickr.com/8/7771/29056924252_4ab33c23af.jpg) (https://flic.kr/p/LgEkfC)
Still unsure whether or not this helped for the 7D? Check again while zoomed in @ 200% in ACR :D:
Pre-DF Avg
(https://c1.staticflickr.com/9/8898/28541472544_7cdc9fa3bd.jpg) (https://flic.kr/p/Ku7vqd)
Post-DF Avg
(https://c7.staticflickr.com/9/8425/28541472854_ea4b5fa263.jpg) (https://flic.kr/p/Ku7vvy)
Another good one from 7D @ ISO 3200:
Pre-DF Avg
(https://c1.staticflickr.com/1/588/31972392500_178a40bb92.jpg) (https://flic.kr/p/QHhSoy)
Post-DF Avg
(https://c1.staticflickr.com/1/516/31538261303_a82abbc0e1.jpg) (https://flic.kr/p/Q3VQiV)
New version
a1ex added some really nice progress around crop_rec.mo module and I will try to follow the progress in MLP.
Thread here
http://www.magiclantern.fm/forum/index.php?topic=17021.msg171148#msg171148
I added the changes recently added from here and slightly modified some default switches in this version of mlv_dump.
Code in sources_binaries upon download. The modifications are work in progress.
Original commits
https://bitbucket.org/hudson/magic-lantern/branch/bad_pixels
So if you download the crop_rec.mo and put in the ML folder(onto your memory card) according to instructions you can develop the MLV files the usual way in MLP.
What you have to do to get rid of the colorsplotches is to add this file in the A_lut_hold folder
MLV_mlv_dump_settings.txt
Inside the MLV_mlv_dump_settings.txt file specify this at the top row to disable vertical stripes cotrection and add fix cold pixels.
--no-stripes --fixcp
Post your findings in the crop_rec.mo thread. Hopefully this will help get this module a little closer to the nightlies :P
I'd really love to give MLP a chance considering the good things I'm reading about it but when I click the source download link on pg. 1 it says the file was not found. Where can I download MLP? Other methods I've tried have given me unusable ghosting and it seems like it's minimized with this process.
I have a shot looking out a train window and panning to someone sitting that was shot in mlv with dual iso and I'm afraid no matter what method I try I'll get too much ghosting because of the fast motion in the shot (shot at 24 fps). Anyone have suggestions as to which way to go about processing?
Cheers!
Dropbox had a problem creating links before. Should work now. Try downloading again.
Regarding you ghosting problem. Dual iso isn,t giving ghosting but HDR will. Have you mixed up your workflows?
Quote from: Danne on August 29, 2016, 11:08:12 PM
Dropbox had a problem creating links before. Should work now. Try downloading again.
Regarding you ghosting problem. Dual iso isn,t giving ghosting but HDR will. Have you mixed up your workflows?
Yes, I did end up confusing the two. As far as this shot goes I think I'm shit out of luck with the HDR video ghosting since I shot it in 24fps. If I shot HDR mlv video in 48fps and then used the HDR_tblend_average_half_FPS.txt would it give me no ghosting (max record time with those settings must be next to nothing)? What's the advantage of using HDR video over dual iso? Seams like they do the same thing but HDR video is more for landscape/slo-moving shots because of ghosting issues?
I just did a little dual iso test in my home for practice purposes. I used cinestyle, at 24fps, iso 100/1600 w/ -0.3 ev, then loaded the dual iso gamma 3.6, dang straight to prioress, and dcraw in MLP and ran. My pores clips look great but are strangely playing back at double fps? not sure whats going on. I shot this handheld and sure, it's the morning and I haven't had my whiskey yet, but the shake is ridiculous. Very difficult for a first time user to dive in head first with this sort of DIY program but I'm slowly realizing how much of a benefit MLP is. Any help would be much appreciated!
That looks like an earthquake :o. Never seen it before :).
Welcome aboard the HDR train. Quite some workflows here to learn. Firstly. Dual iso and HDR don,t work together. Are you working HDR? MLV/RAW or H.264? 48 fps or more? 24 or 25 fps? If you give me this information I can give you some handy advice.
By the way. Really liked your Wicked game video.
Even if it wasn't intended for but that footage looked real good if it were an actual movie about earthquakes. So bad ass!
Give us the detailed info and we'll be glad to get this train moving smoothly for you @calebdescognets!
Quote from: Danne on August 30, 2016, 10:03:19 PM
That looks like an earthquake :o. Never seen it before :).
Welcome aboard the HDR train. Quite some workflows here to learn. Firstly. Dual iso and HDR don,t work together. Are you working HDR? MLV/RAW or H.264? 48 fps or more? 24 or 25 fps? If you give me this information I can give you some handy advice.
By the way. Really liked your Wicked game video.
Quote from: DeafEyeJedi on August 30, 2016, 10:43:13 PM
Even if it wasn't intended for but that footage looked real good if it were an actual movie about earthquakes. So bad ass!
Give us the detailed info and we'll be glad to get this train moving smoothly for you @calebdescognets!
haha you two bring a smile to my face. Thanks Danne! Currently working on another one for the same artist and you can expect to see it here when I'm done ;)
I laid out what I did in my first post.. " I used cinestyle, at 24fps mlv raw video, duel iso mod at iso 100/1600 w/ -0.3 ev, shot these two clips, popped cf card in reader, loaded the dual iso gamma 3.6, dang straight to prioress, and dcraw in MLP and ran." Did I need to add any other commands to the A_Lut_hold folder for duel iso conversion? The user guide seemed to think I only needed the 3 I stated above and MLP would automatically recognize if the .mlv clips were duel iso or not and adjust accordingly
If you shoot dual iso gamma 3.6 can be a good idea. If HDR not so good.
If you shoot HDR 48fps than to put this in the A_lut hold can be a good idea. Don,t set camera to dual iso while shooting HDR.
Try this in A_lut_hold folder
HDR_tblend_average_half_FPS.txt
HDR_tblend_average.txtYou can throw out the HDR_tblend_average_half_FPS.txt is you want to keep 48fps instead of 24fps.
An alternative if you downloaded hugin alignment binary you can align footage. THis will take a really long time but then use these files in A_lut_hold. Footage will end up in 24fps.
HDR_enfuse_settings.txt
HDR_enfuse_straight_from_dng_settings.txtIf you shoot 5d mark III I can really recommend 50 or 60fps h.264. Use the same files as in first suggestion.
HDR_tblend_average_half_FPS.txt
HDR_tblend_average.txtThere,s a lot of stuff going on in this sentence.
QuoteI used cinestyle, at 24fps mlv raw video, duel iso mod at iso 100/1600
Quote from: Danne on August 30, 2016, 11:11:32 PM
If you shoot HDR 48fps than to put this in the A_lut hold can be a good idea. Don,t set camera to dual iso while shooting HDR.
Try this in A_lut_hold folder
HDR_tblend_average_half_FPS.txt
HDR_tblend_average.txt
You can throw out the HDR_tblend_average_half_FPS.txt is you want to keep 48fps instead of 24fps.
wouldn't keeping footage at the original framerate (shooting at 48 and finishing in 48 or shooting in 24 and ending in 24) only introduce ghosting with HDR video? Isn't that the appeal of dual iso so that you don't have to double your frame rate (shoot 48fps) if you want to end in 24fps?
Quote from: Danne on August 30, 2016, 11:11:32 PM
An alternative if you downloaded hugin alignment binary you can align footage. THis will take a really long time but then use these files in A_lut_hold. Footage will end up in 24fps.
HDR_enfuse_settings.txt
HDR_enfuse_straight_from_dng_settings.txt
What do you mean by alignment? Does that eliminate ghosting? You can tell that Im really just after shooting higher dynamic range video without ghosting. That's why I shot the dual iso test video above. I asked before but What's the advantage of using HDR video over dual iso? Is it really just ghosting with HDR video vs. moire and aliasing with dual iso? Pick your poison kind of thing? My apologies if this was already made clear
Still any ideas as to why I might be getting this weird earthquake effect on my PRORES clips after MLP processes the .mlv clips?
Sorry, thought you were still mixing HDR with dual iso. Realize you are shooting dual iso now. Hm, not sure why you,re footage comes out like that. Was all files successfully processed? Check your sequence and see so cr2hdr didn,t skip any dng;s.
If the file isn,t to big you could maybe upload it for testing?
By the way. Cinestyle or any picture style won,t bite on raw mlv files. Pic styles works only with H.264 material.
Quote from: Danne on August 31, 2016, 06:31:54 AM
Sorry, thought you were still mixing HDR with dual iso. Realize you are shooting dual iso now. Hm, not sure why you,re footage comes out like that. Was all files successfully processed? Check your sequence and see so cr2hdr didn,t skip any dng;s.
If the file isn,t to big you could maybe upload it for testing?
By the way. Cinestyle or any picture style won,t bite on raw mlv files. Pic styles works only with H.264 material.
Realized I had it on cinestyle for no reason right after I uploaded the footage haha ???
No DNGs were skipped in the sequence and when I scroll through the frames one by one there isn't any of this earthquake effect we're getting in the final prores clips so it's gotta be when it's converted from the DNG sequence to prores.
Here is a dropbox link to the original .mlv files: https://www.dropbox.com/sh/5ws86clk1tmkgga/AABJ4tshiYuDezoRgpHfbbZQa?dl=0 (https://www.dropbox.com/sh/5ws86clk1tmkgga/AABJ4tshiYuDezoRgpHfbbZQa?dl=0)
Hi @calebdescognets.
I just ran one of your files and the exported fine without any of the earthquake effect. Did you reproduce the issue? Did you interrupt processing in any way, like running MLP while it was already running for instance?
These were my files in A_lut_hold folder
MLV_RAW_dng_dcraw_any_command.txt
MLV_RAW_dng_dual_iso_gamma_3.6_0.txt
MLV_RAW_dng_straight_to_prores444.txt
Quote from: Danne on August 31, 2016, 08:41:08 PM
Hi @calebdescognets.
I just ran one of your files and the exported fine without any of the earthquake effect. Did you reproduce the issue? Did you interrupt processing in any way, like running MLP while it was already running for instance?
These were my files in A_lut_hold folder
MLV_RAW_dng_dcraw_any_command.txt
MLV_RAW_dng_dual_iso_gamma_3.6_0.txt
MLV_RAW_dng_straight_to_prores444.txt
I just re-processed the files and I'm getting the same shake in the final proves clips. Maybe it's my version of MLP? I'm unsure what may be causing this anomaly ::)
I could always just import the processed DNG sequence in AE and export as cineform/prores there but it'd be nice not to have to switch back and forth
Let,s try to get to the bottom of this. Try these suggestions.
If you have your folder with dng files or MLV file in your folder do following.
1 - double click looks_creator.command located in your folder. From the menu select (r) and enter. Terminal will tell you what is happening when processing. Copy paste this content into a txt file and upload the file and sent it to me. You can even reprocess starting with your MLV file if you want.
2 - Send me over your first three DNG files from your sequence.
3 - If I can,t find what,s wrong you can zip your version of MLP and upload it for me to check. Write in terminal
open ~/Library/Services/ hit enter. You,ll find MLP in there, zip and send.
Quote from: Danne on September 01, 2016, 06:54:12 AM
Let,s try to get to the bottom of this. Try these suggestions.
If you have your folder with dng files or MLV file in your folder do following.
1 - double click looks_creator.command located in your folder. From the menu select (r) and enter. Terminal will tell you what is happening when processing. Copy paste this content into a txt file and upload the file and sent it to me. You can even reprocess starting with your MLV file if you want.
2 - Send me over your first three DNG files from your sequence.
3 - If I can,t find what,s wrong you can zip your version of MLP and upload it for me to check. Write in terminal
open ~/Library/Services/ hit enter. You,ll find MLP in there, zip and send.
Awesome, thanks Danne. Click the dropbox link below. I included the first 3 DNGs from both sequences, the original mlv files, and the txt doc
https://www.dropbox.com/sh/5ws86clk1tmkgga/AABJ4tshiYuDezoRgpHfbbZQa?dl=0
Hi guys ! Magic Lantern is really awesome , but honestly I cant get the MAC cr2hdr or any other APPS to transfer DUAL ISO into DNG in China . Because the dropbox is blocked here .......... REALLY BAD THING . So if there anyone who can see this , could plz send the app to me by email ? THANK YOU VERY MUCH !!! Here it is
[email protected]
Could someone here with a Mac upload a sequence of Cinema/DNG's with Darkframe Averaging. Mininum 5 Sec.
Preferably with high ISO and lots of noise or if with low ISO, then a dark scene where I can push the Exposure to get noise. Also low darks, ETTR.
I would like to do some NR tests on the footage.
Post link to download here or PM me.
@Kharak -- check your PM. Let me know if you need anything else.
Thanks to @calebdescognets for lending me a dng frame from his video here.
http://www.magiclantern.fm/forum/index.php?topic=17927.msg172410#msg172410
Here is a little something useful when working with dng sequences in acr. One issue when opening up dng files is the lack of retrieving highlight information. Dng files are simply clipped in display referred working space as a starting point. Main reason I work with raw files is to get into scene referred working space having all dynamic range represented unclipped as a starting point. Ok, so working with still images using the highlight slider is possible to use for retrieving highlight information back but with movie dng sequences this will give you flicker being non linear treating every image indivdually.
Solution is to create a linear dcp profile in adobe dng profile editor. Free for download here.
https://www.adobe.com/support/downloads/product.jsp?product=195&platform=Macintosh
Once your in the editor it is very easy to create this profile. Open up a dng file in the editor and select linear under tone curve. Then export this linear profile as a dcp and you will be able to select the dcp from within acr when importing your dng files. It,s under "camera profiles"
Here is a linear dcp profile for 5D mark III
https://drive.google.com/file/d/0B4tCJMlOYfirQ21wVk9SYTg3Z3c/view?usp=sharing
Linear setting
(http://s10.postimg.org/n99i9xpqx/Screen_Shot_2016_09_22_at_10_28_34.png)
Exporting the dcp profile
(http://s10.postimg.org/yznfrbijd/Screen_Shot_2016_09_22_at_10_28_48.png)
Examples with and without the profile
Without the dcp profile
(http://s9.postimg.org/57rvq8cm7/Screen_Shot_2016_09_22_at_00_09_14.png)
With the dcp profile
(http://s9.postimg.org/nm2eu7owv/Screen_Shot_2016_09_22_at_00_08_53.png)
Example from MLP using dcraw exporting linear and –H 2 –b 2 then adding linear_to_cineon
and then adding a Cineon_to_rec709.cube. Dcraw is doing fine job here.
(http://s9.postimg.org/z0yvyu19b/M14_0707_1_2016_08_14_0001_C0000_000000.jpg)
What is also very cool in acr is that you can retrieve even more highlight information
by changing parametric settings in tone curve.
(http://s10.postimg.org/68kocdc55/Screen_Shot_2016_09_22_at_11_49_11.png)
Tone curve
(http://s22.postimg.org/53sgoyucx/Screen_Shot_2016_09_22_at_11_52_03.png)
I am digging this yet another new hidden trick big time, @Danne and gonna take a dip with this one!
Thanks for sharing and will report my results when I can. If I remember correctly that MLP does by default go with -H 2 -b 2 if we were to add the linear_to_cineon/cineon_to_rec709 combo within Dcraw?
Well I think you can do like this. Erase any gamma files and simply add -H 2 -b 2 into the dcraw_any_command.txt file.
Updated to Mac OS Sierra and everything seems to work as before when it comes to MLP. Of course there is still the gatekeeper problem when double clicking a novel command file so that part still have to be handled(ctrl + right click or make a gatekeeper exception in privacy/security settings). I tried getting around this by creating an installer through an apple script put into an automator app but to no avail. However I decided to keep the installer and replaced the original installer script. The HOWTO tell you what to do.
I managed to create a dmg package of the bundle as well but since most stuff isn,t bundled in MLP the benefit of creating the dmg is none. Creating a writable dmg isn,t working good either since it will acting as a big balloon file into which one can fill it up with stuff until the limit size says stop. I used dmilligans very nice script for this coming from here(below link). Just change size and content (source) and you can create your own little dmg package :).
https://bitbucket.org/dmilligan/mlvfs/src/9f8191808407bb49112b9ab14c27053ae5022749/build_installer.sh?at=master&fileviewer=file-view-default
Hey Danne,
Ive been away for a while just checking ad seeing this last post about acr... Looks awesome great work.
Im going to do some testing with those settings in dcraw.
If you need any help wth testing let me know.
Quote from: Danne on September 29, 2016, 09:12:18 PM
Updated to Mac OS Sierra and everything seems to work as before when it comes to MLP.
Got the gatekeeper issue fixed (Thanks @reddeercity & @dfort) and just downloaded MLP from OP with the new installer (really nice!) and now when I tried to run MLP after selecting 'q' to spit the usual Folders for me to work with but it doesn't do anything. Spinning wheel comes on for a second then goes out. Tried reinstalling and restarted my Mac to no avail. I had just used this last night (before I decided to give the download link a try this monring) so I guess I shouldn't have done that? :) My wrong @Danne -- ran into another hiccup with OS X 10.12 Sierra when connecting NTFS drivers (external drive was from client who wanted me to batch process H.264 files to ProResHQ) so now it all seems normal after I learned that I had to reinstall NTFS for Mac OS X since I guess it wasn't corresponding and sorry for yet another false alarm!
Pressing Q? Are you starting from an empty folder? What are your trying to do?
You could try running MLP via looks_creator.command and check if you get anything of interest in there.
*solved. Deafeye updated former question.
After the whole installing process (by the way do I have to keep the MLP folder? can I move it on the applications folder?) I get this error:
- Impossibile aprire il documento "MLP.workflow" perché è danneggiato o incompleto.
That means that MLP.workflow is damaged or incomplet. I'm on a mbpr 15" mid 2012, 10.11.6
I'm trying to installt to have another option for conversion. By the way can this automatically detect and correct hot pixels in dng export?
Hi. thanks for notifying. Seems I uploaded an incomplete version to dropbox. Should be fine now.
Regarding hot pixels they an only be manually mapped out by specifying the coordinates of the pixel in this file. It,s called dead_pixel_list.txt
and you put it inside A_lut_hold folder before starting MLP. Note that it will only apply to the ProRes file upon export and not to the actual dng file.
Thanks for the reply! I'm trying again.
edit: tried, no luck. Still same error. And maybe now I've screwed something up because after another try with the installer I can't even see the menu option anymore. Maybe I should uninstall everything first? How is it done?
I'm mainly installing this because I've just noticed some ugly vertical stripes in some highlight that I need to push on some footage. Also in a few shadows but less disturbing. Does MLP correct it on dng export? I've tried both MLRW and RAWMagic, they have some stripe correction option but it doesn't work. I was also wondering if the exported dng can be compressed, that'w a terrific feature in MLRW that saves ton of space.
Hi togg. Sent you a pm.
About compressing that can be done with MLP if you have slimraw installed to your system. It,s optional of course. It activates compression when MLV_RAW_dng_repack_or_compress_DNG.txt is included in A_lut_hold folder.
Apologies if this is covered somewhere in the previous 32 pages of this thread (I looked a bit but haven't read every post), but I've just installed MLP and tested it by using it on a folder containing a single MLV file. I didn't change any of the 3 txt files that appeared in the A_lut_hold folder. I noticed the following, when I compared the results to the output of MLVFS and to a simple invocation of mlv_dump:
• The generated prores4444 quicktime file seemed to be constructed of all the frames running in some random, jumbled, unwatchable order. I've got 8 cores, maybe they ran in parallel and concatenated frames to the file out of sequence? I'm just puzzled by this result.
• When I open the generated dng sequence in Davinci Resolve, its embedded white balance settings are very different than the white balance settings of a dng sequence created from the same MLV file simply using "./mlv_dump.osx --dng" from the command line --and those have slightly different white balance settings than the dng files generated from the same MLV using MLVFS. Any idea why all 3 of these methods would embed different white balance values in the resulting dng sequence? For what it's worth, in Davinci Resolve's camera raw settings for each clip I've got all 3 set to "Decode Using: Clip" "White Balance: As Shot" "Color Space: Blackmagic Design" "Gamma: Blackmagic Design Film" with "Highlight Recovery" checked. Here's an image of what I'm seeing for frame 1 of each sequence:
https://dl.dropboxusercontent.com/s/3yagz5n2lur1ptg/2016-11-29%20at%2012.57%20PM.jpg
Apart from that white balance metadata, the content of the DNG frames appears to be the same - if I change the color settings of the MLP to match those of the MLVFS they look identical. I'm just curious why these 3 methods are all coming up with different metadata for white balance and why MLP's are so different from the other two.
Thanks for any help or information.
Hi.
Not sure what the reason could be here. If you can send me a dng over I could check your file for white balance. ProRes output should be in order though. Randomness indicates something is not right maybe with ffmpeg. Not really sure.
By the way. If you could check with this program cr2hdr.app and see if results are better? It,s stand alone and it exports to prores the same way as in MLP only the bash code in here is built around menus to make it all easier to work with.
cr2hdr.app
http://www.magiclantern.fm/forum/index.php?topic=15108.msg146822#msg146822
Thanks for the reply. I'll check with cr2hdr.
After a bit more googling, I came across this page: http://www.cinelogdcp.com/news-updates/2015/1/27/important-information-for-magic-lantern-users
It looks as though the white balance metadata requires the use of a separate matrix for each camera. They claim MLVFS is doing it right and provide a link to the commit that includes the matrices --maybe mlv_dump doesn't use them?
MLP and cr2hdr.app uses the color matrices needed. You also get the correct unique camera model tags instead of sometimes localized camera model names.
Most code comes from dmilligan ml_dng branch which is then partly modified by bouncyball.
About your white balance issue. You probably filmed with your cam set to AWB. If so then MLP calculates auto white balance for you since that mode is the only one that can,t be found in mlv metadata.
What you see in mlvfs is the underlying kelvin temp which your cam is set to.
Regular mlv_dump exports hard coded wb values around 5500k.
That makes sense.
I ran cr2hdr - it generated a Prores Proxy and Prores 4444 quicktime with the same random-seeming frame order, just like MLP.
On a different note -- is there a way to get cr2hdr to keep its terminal window around so I could watch the output of the commands and thus get visual feedback during processing (might also help for diagnosing problems like the one I'm experiencing)?
Here is a version of cr2hdr.app which will print text files next to your dng files. They will be called out_01, out_02 etc depending on which process will run. They will show what ffmpeg is doing.
https://drive.google.com/file/d/0B4tCJMlOYfirUmRfX2EwbFZQLTQ/view?usp=sharing
If you want to use MLP that might be even better. You can run MLP through the looks_creator.command script which is inside the folder with the rest of your files. Double click that command file and then choose (r) run MLP(MLV/RAW) and terminal output will be shown while processing.
Could you upload a file that doesn,t work here? What camera are you using? Are you shooting normal footage 14-bit or 10/12-bit?
I'm running "Magic Lantern Nightly.2016Sep10.5D3113" firmware on a Canon 5D mk III, capturing to the MLV 2.0 format with audio at 1080p 23.976. I think the resulting files are 14-bit raw.
I ran cr2hdr on several additional MLV files, and in each case the resulting quicktime file featured random frame order. On the plus side, the dng frames are in sequential order.
I'm in the process of running the version of cr2hdr.app that will print text files next to the dng. I don't see any text files yet and several dng sequences have appeared. I'll leave it running a while.
I'll see if I can find a smallish MLV file that exhibits the problem to post to dropbox.
Here's a folder on dropbox containing a small-ish MLV file, the quicktime file that cr2hdr made from it, and the output text file:
https://www.dropbox.com/sh/76steg8004016hf/AACiMj5cdU_6YcWxtlwj37Uma?dl=0
Just tried your file and it works fine over here. Could you zip and send me your folder with dng files of that same mlv file over? Maybe there is something in those files that is not working idk.
What OS are you on? What specs on your computer?
Did you try working from the looks_creator.command script in MLP? I couldn,t find anything in your ffmpeg output textfile unfortunately.
I've added the folder containing the dng sequence to the dropbox folder. It should show up in there in a couple of minutes.
I'm running OS X 10.11.6.
The MLV file and the directory to which dng and quicktime output are directed are both stored on a thunderbolt RAID that's a ZFS filesystem. I suppose that's maybe a little bit of weirdness I've injected into the process.
What's the command that sends the dng files through to ffmpeg? Maybe I can just have it echo the filenames in order rather than pipe it into a process, and see if it's getting them jumbled and track that down.
Your files works fine over here. You can try some other ffmpeg binary to see if that helps.
http://www.osxexperts.net/ffmpeg/ffmpegexperts.html
All binaries are located inside cr2hdr.app/Contents/
You might wanna try another version of dcraw and exiftool as well. Hard to tell in this case what,s going on. Try on another filesystem if you think that,s the case.
or...
If you are working with cr2hdr.app you can change code inside the source folder. When you,re done you double click Build_dmg_package.command to build a new dmg file. You have to change code in four scripts since they work in parallell. You can start by changing stuff in the first script and run tests on one dng sequence.
!A faster way is to work from the command scripts inside the cr2hdr.app itself. The same file are inside cr2hdr.app/Contents only they,re suffixed as command files!
Anyway. Back to source folder...
FFmpeg_produce_01.txt
FFmpeg_produce_02.txt
FFmpeg_produce_03.txt
FFmpeg_produce_04.txt
(https://s13.postimg.org/v0gebsa1j/Screen_Shot_2016_12_01_at_18_17_20.png)
I,d suggest scroll down to the bottom of FFmpeg_produce_01.txt file and maybe try do something with the find "$out""$out3""$name""$sl". -maxdepth 1 -iname '*.dng' -print0 | xargs -0 dcraw....
The find command at the bottom affects the ProRes4444 output activated from the ProRes4444 to mov menu.
#check if ProRes4444 settings file contains information
if ! [ x"$(cat /tmp/FFmpeg_settings | grep -v 'HL\|AWB\|dcrawA')" = x ]
then
mkdir -p "$out""$out2"$(date +%F)_ProRes4444
#export ProRes4444
find "$out""$out3""$name""$sl". -maxdepth 1 -iname '*.dng' -print0 | xargs -0 dcraw +M $h2 $o $S -c -6 -W -q 3 $gam $wb $pix | ffmpeg $wav -f image2pipe -vcodec ppm -r "$fps" -i pipe:0 $sd -vcodec prores_ks -pix_fmt yuv444p10 -n -r "$fps" $cin$cin_01$cin_02$cin_03$cin_01b$cin_02b$cin_03b$scale$denoise$sharpen "$out""$out2"$(date +%F)_ProRes4444/"$name".mov
fi
I'll have a look when I get a chance -- am about to have a few days away from the computer. My bet is that for whatever reason the find command is coming back with frames out of sequence for zfs. Maybe I need to change it to something like:
find "$out""$out3""$name""$sl". -maxdepth 1 -iname '*.dng' -print0 | sort | xargs -0 dcraw ...
or maybe 'sort' wouldn't produce the right order but adding the '-s' flag to 'find' would do the right thing.
If that,s the case some sort command should probably do. Last time I checked wildcard function should sort anyway. Hopefully you,ll narrow it down.
I ran a test on the same MLV file on an HFS+ filesystem and the resulting quicktime was all in order. So I was pretty sure the results I was getting must've been due to the 'find' command somehow returning a list of dng files in jumbled order when run on a directory of dng files that are stored in a ZFS volume.
So I opened all the FFmpeg_produce files and added " -s " to every invocation of "find". I ran it on the MLV stored on HFS+ and there was no adverse effect. Then I ran it on the MLV stored on ZFS and the result was a quicktime file with frames in the proper order. So the find invocations looked like:
find -s "$out""$out3""$name""$sl". -maxdepth 1 -iname '*.dng' -print0 | xargs -0 dcraw +M $h2 $o $S -c -6 -W -q 3 $gam $wb $pix | ffmpeg $wav -f image2pipe -vcodec ppm -r "$fps" -i pipe:0 $sd -vcodec prores_ks -pix_fmt yuv444p10 -n -r "$fps" $cin$cin_01$cin_02$cin_03$cin_01b$cin_02b$cin_03b$scale$denoise$sharpen "$out""$out2"$(date +%F)_ProRes4444/"$name".mov 2> out_01
Just that little "-s" flag did the trick. So that seems to be a solution.
Pretty weird little quirk of find and openzfs. Interesting.
https://openzfsonosx.org/
Nice find. And fix.
The user guide link is broken. Does anyone have an alternative?
It,s up again. I made a slight change this afternoon and forgot to link. Enjoy. Link in first post.
Also feel free to check this workflow. All menu based.
cr2hdr.app
http://www.magiclantern.fm/forum/index.php?topic=15108.msg146822#msg146822
Hi sorry noob here.
I want to figure out a workflow to convert my 48fps 1920x508 to 48fps 1920x818 with MLP. Since I will love to avoid AE in all cost. But if this can not be done, I will love to know how should I approach this. So after I ran MLP with a folder of all the dng files, do I important them into After Effects to stretch them to 1920x818? And from After Effects, how can I easily get a ProRES4444 C-log mov file so I can edit inside Adobe Premiere? I use Magic Bullet Colorista for color grading so if it is c-log, I know what to do next. But do I output from After Effects to ProRes4444 after stretching? Or can I stretch the footage and save it back as DNG sequence for Resolve to color grad to create offline edit in Premiere? Sorry I am so confuse the Mark III RAW workflow here and I am noob and trying to figure it out. Lots of guide out there is out of date... Thank you so much in advanced!
Also, I don't see the wav file inside the PNG folder. I thought MLV file should have Audio file embeded in it, right?
Only if audio was enabled, though.
You had MLV_SND.mo loaded and audio recording enabled?
No stretching in AE necessary. MLP(dcraw actually) will unstretch your footage upon export.
Also check this workflow. Pretty much the same but simplified and stand alone.
https://bitbucket.org/Dannephoto/cr2hdr
Well welcome back @hughred22 and I was just about to say all you would need is Danne's latest cr2hdr.app (https://www.magiclantern.fm/forum/index.php?topic=15108.0cr2hdr.app) to literally skip AE at all cost (but why would you?), if you will! 8)
Hi, thank for such a nice processer.
I have a question. So I am using it and my Mac is frozen at some point. So if I forced restart my mac, how can I resume from when I crashed? What is the workflow for that? My files are also in an external hard drive. Also, since the process take days, how can I pause and resume it if it I need to unplug my hard drive and go somewhere? Thanks!
What are you processing if I may ask. Unplugging in the middle is impossible I,m afraid. Are you processing HDR material?
hi all,
noob here - please forgive the lack of etiquette. I have ML on my camera and have shot some raw footage - lovely. Hats off to the devs. However, I am not a developer, nor a video workflow expert - I'm just a dude who wants to see what he filmed on the big screen of his computer, rather than on the teeny screen of his camera. I thought I had success with CR2HDR - which created .dng files without issue - it also apparently installed MLRawviewer, which seemed really cool, because I could view my MLV files! But then when I thought, hey, it would be cool to share this as a .mov for friends and family, I ended up down a rabbit hole - somehow I got to MLP and installed it and all the addons, but now when I right click an MLV file and choose MLP, it creates a tiff file and two dng's, then it deletes the dng's. no other output - nada.
What am I doing wrong, and is there an easy way to go from the MLV on my SD card to a .mov on my Mac?
Thx!
It may be helpful to tell us which software you are using to edit your non-RAW videos. And the OS version.
@johnnay - MLP is and can be quite complex for a first time user (but easy enough to follow through and get it figured out) meanwhile why don't you take a peak at @Danne's latest work in cr2hdr.app (https://www.magiclantern.fm/forum/index.php?topic=15108.0cr2hdr.app) which has all the bells and whistles especially for the recent lossless (https://www.magiclantern.fm/forum/index.php?topic=19300.msg182052#msg182052lossless) compression.
As deafeyejedi points out I strongly suggest working with cr2hdr.app instead. It can export to mov files just as good as MLP.
FYI when you right click onto a file in MLP it creates a preview tiff. THe dng files are leftovers from this process and will be deleted once the tiff is created.
Thanks for the responses - I guess I got confused as to which was the later process - CR2HDR or MLP - I thought it was the latter, but using the CR2HDR app I can watch the output in MLRawviwer - still haven't managed to export to a quicktime .mov file tho.. I'll keep reading and ask a more specific question if I can't figure it out...!
Hi all,
My first post on this forum and a little out of desperation. Have been trying to figure out how to use the MLP script for hours now and can't figure it out.
Basically what I want to do it blend together my dual ISO files from my canon 5D3 to make an HDR video. I have read the user guide over and over and only get to the point where I can move the .txt files from one folder to the hold folder. From there, I cannot work out how to do the next step to merge the high iso files with the low iso files.
I am total newb at this an really hoping someone can give me some quick guidance on this.
Much appreciated!
Aaron
Sorry, but you are mixing things up:
Dual ISO generates frames where alternating lines with different ISO settings are used in each single frame. This will preserve frame rate. Downside: Vertical resolution is diminished and you have to deal with aliasing.
HDR video option will generate alternating frames (normal/low exposure) thus output will not harm resolution but results in*half* the frame rate.
Thanks Walter.
Regarding processing dualiso files I suggest you jump to cr2hdr.app instead. It will automate the processing. Much more simplified.