Lightroom plugin cr2hdr v3.0 DEV (WIP)

Started by kichetof, March 18, 2014, 05:04:33 PM

Previous topic - Next topic

0 Members and 2 Guests are viewing this topic.

Levas

Don't know if I'm correct, but the way I read it, there is no log for "same levels" with the settings to apply to another picture.
Description says  "for all frames passed in a single command line".
It just needs all filenames of a serie in one single command line.





kichetof

The only way to obtain log file from cr2hdr is to redirect stdout to a file. Or another way, add an option into cr2hdr to log like : --logfile

If you observe my log file, they are 2 dual iso files, this is my command:

cr2hdr --same-levels /Users/tof/Documents/MagicLantern/Dual ISO try/_MG_8353.CR2 /Users/tof/Documents/MagicLantern/Dual ISO try/_MG_8354.CR2 > /Users/tof/Documents/MagicLantern/Dual ISO try/log.txt

I'll see to add a function log file to cr2hdr exec (if my knowledges are enough!), it's more simple to treated after

kichetof

Maybe I've a solution, parse the log file and extract the filename like _MG_1234.CR2 from Input file and use it as a key like:

info[_MG_1234.CR2][k]

So, in the loop, if I read "Input file" change the key with this value (functional for one or more file)

What do you think ?

Audionut

Would it be easier to process all of the files multithreaded through cr2hdr, and then run your own exiftool processing (with it's log file) afterwards?

kichetof

Quote from: Audionut on August 30, 2014, 12:32:19 AM
Would it be easier to process all of the files multithreaded through cr2hdr, and then run your own exiftool processing (with it's log file) afterwards?

That's exactly what I think now. Use cr2hdr --same-levels photoN and after that, loop into log file to add exif.

I'm currently writing the new processus to add --same-levels, and I resolve some interrogation progressively (and add a lot of interrogations too!)

Levas

I'm wondering what is the best approach for developing the exposure for dual iso files:

I usually take a good look at the histogram and then adjust the following:
Lift exposure by 2 to 4 stops
Compress the highlights using the highlight slider (putting it to -50 to -100)
Raise the shadows with the shadow slider (putting it to +50 to +100)
Normally I never use the black and white sliders (I mean the two sliders below the highlights and shadows sliders  ;) , don't know if they are called like this in the english version...)

Recently I saw on youtube a whole different approach.
This guy used the curves tab and raised the darks and shadows with the sliders available there.
I tried this too, but I didn't like the result, pushing the shadow slider in curves tab, creates some really flat looking shadows, too less tones for my tastes.

Now I'm curious how other ML users develop their dual iso files, how do you develop you're exposure in lightroom ?

Audionut

The sliders and the curves are basically the same thing, just the curves will give you more control.

I tend to rely on the histogram, placing everything in the correct zones.  Which usually means having the highlight slider close to -100, and the shadow slider at + some value.

lureb74

Hi!
I don't know if anyone already reported it, but I have a couple of weird aspects to report about the LRplugin (in order of relevance):

- In my pc I have the temp and applications cache folders setted on a RamDisk (for drastic speed improvement and to avoid tons of read-write cycles to SSD, and I suggest people considering this!), so this plugin is setted to use the default user temp folder, right? Is it possible to put an option for choosing a custom temp path? I'm shooting Dual-ISO clips (even 2.5k), so the problem is the RamDisk is getting full too soon (I can maintain only a 4GB RamDisk, due to the total amount of ram I have installed)! Also, I'm wondering why the plugin makes a temp copy, it couldn't make the job leaving the files in the original path?

- The "Compress" option doesn't work well: it makes the job in the temp folder, but after that it deletes the temp folder without copying the results in the original path, so there's no final file!

- If I try to enbed the original CR2 (in case of video, changing the extension from DNG to CR2 before conversion), the original CR2 file is not deleted.

- the "skip-existing" option doesn't produce any difference. I think without flagging it, the plugin should overwright existing files (or at least ask to do so).

Thank you,
Lorenzo

kichetof

Hi Lureb! I'm working on the new version and nothing are exported, only converted into cr2hdr (more speed, less ram used)!!

Regarding the options for the 20bit version, I'll check it!

Work in progress! Check the commits! Lot of changes!

Danne

Hi Kitchehof! Question. Will there be a possibilty to export to a specific folder again opposed to the current one within the same folder? In early versions this was possible. Reason I ask is that Dmilligan created a "mlvfs" app simply mounting mlv files working in realtime with raw dng files.
http://www.magiclantern.fm/forum/index.php?topic=13152.0
Specifying a folder could mean being able to convert dual iso dng mounted with mlvfs directly through your lightroom app. This doesn,t work now since the fuse mount only has read permission.
I tried using an early build of yours 1.0.3 though it says It will only export raw files not dng:s but I get the feeling an updated version allowing dng conversion would work :)

kichetof

Hi Danne,
Unfortunately, I can't do it.
The future release, could use --same-levels  8), use an other way for converting.

Before future release: Export CR2/DNG to temp folder with suffix, convert with cr2hdr into temp folder, reimport into LR with or without subfolder, apply metadata and all.

Future release: Convert with cr2hdr original file, reimport into LR with or without subfolder, apply metadata and all.

My problem is, I can't specify to cr2hdr an output file where I want, so, for the moment I can't use MLVFS but I'll think for a way ;)

Looks at the commits for testing the new plugin, future beta when I fix a bug with DNG files ;)

Danne


kichetof

New BETA v3 available !

Check first post for download link and change logs!

Don't forget, this is a BETA, please use at your own risk!

(I made a lots, a lots and a lots of tests, but we are never too careful)




Information about DNG file. If you convert a DNG, this file is overwritten by cr2hdr and moved with suffix by the plugin and original file kept in Lightroom (but file is missing).

Stedda

5D Mark III -- 7D   SOLD -- EOS M 22mm 18-55mm STM -- Fuji X-T1 18-55 F2.8-F4 & 35 F1.4
Canon Glass   100L F2.8 IS -- 70-200L F4 -- 135L F2 -- 85 F1.8 -- 17-40L --  40 F2.8 -- 35 F2 IS  Sigma Glass  120-300 F2.8 OS -- 50 F1.4 -- 85 F1.4  Tamron Glass   24-70 2.8 VC   600EX-RT X3

kontrakatze

Hello,
to test the new version, do I need a current version of the cr2hdr package for osx and does anybody maintain this package? Mine is still from 4th of October 2013 and I can't find any newer anywhere.


Regards,
kontrakatze

kichetof

Hi kontrakatze,
The only thing do you need on Mac, is exiftool and dcraw. You can install it with a_d_ package or manually.

cr2hdr and cr2hdr-20bit are included with the plugin ;)

kontrakatze

Oh, thank you! I took a look into the package and found them  :)

By the way, why do I get a message stating: "catalog has to be updated to use this new plugin"
I'm not quite sure if this was exactly what it said, as it appeared only once.

Regards,
kontrakatze

kichetof

You received this message because you haven't updated your catalog when you have installed the plugin.

Try to disable and re enable the plugin in the Plugin manager or if it doesn't works, uninstall and reinstall it. Let me know!

Danne

Nice work Kitchehof! I imagine you,ve been working a lot on this. Same levels working! That is goood news :)
I gave it a first try.
So, all worked fine with same levels and all dng files are converted and exiftool is doing its thing. So when I reach the end two dialogues pops up. There is also two pics missing. I think it is exiftool related.

[img=http://s21.postimg.org/h368f1d03/Screen_Shot_2014_09_13_at_16_58_58.png]

[img=http://s21.postimg.org/bqhe0wp3n/Screen_Shot_2014_09_13_at_16_59_07.png]

[img=http://s21.postimg.org/w0epg1q8j/Screen_Shot_2014_09_13_at_17_07_40.png]

I also tried the export trick to get several conversions going in parallell and the I got the dialogues from each export and this time with more photos missing.
I had some issues with photos gone missing when using the -overwrite_original before with exiftool but I have no idea if this is related to this.

Once again. Big thanks.


kichetof

Hi Danne,

Effectively, I worked hard to make it possible :)

Could you send me some informations:
- the number of pictures exported (approximatively)
- the settings of the plugin (included cr2hdr)
- the name of your picture
- the name of the log file text on your folder (generated by cr2hdr)
- where do your dualiso come from ?

I think that the problem come with the way I store the name of the log file. (rename and move)

Does the file : M22-1411_000000-M22-1411_000190-dualiso.TXT exists on the folder ?

Danne

Hi Kitchehof! With these settings I got it to work successfully, both on my desktop and from my external hard disc drive.

- I use Mlrawviewer 1.2.3 for exporting
- New test used 44 pictures dual iso from 5d mark 3

I use default settings and then as below.

Settings
[img=http://s14.postimg.org/acjsbw09p/Screen_Shot_2014_09_13_at_18_34_28.png]

Name of the picture
[img=http://s14.postimg.org/cwff5zntp/Screen_Shot_2014_09_13_at_18_38_35.png]

Succes
[img=http://s14.postimg.org/pmjnj2vrx/Screen_Shot_2014_09_13_at_18_36_48.png]

text file
[img=http://s18.postimg.org/hdj7xatud/Screen_Shot_2014_09_13_at_19_39_25.jpg]

I managed to reproduce some problems when I erased the suffix of dual iso output file. Plugin wasn,t to happy about that.

Erasing suffix gave me most of my pics but also some random stops. Not sure but it happens in the end and probably exif tool related.
Will try this tool some more and report back.
Massive thanks on great efforts made here!!

[img=http://s24.postimg.org/kuzp4p5kh/Screen_Shot_2014_09_13_at_19_04_05.png]

[img=http://s24.postimg.org/xvbg14s4x/Screen_Shot_2014_09_13_at_19_06_07.png]

[img=http://s24.postimg.org/3rwx96ovl/Screen_Shot_2014_09_13_at_19_06_16.png]

[img=http://s24.postimg.org/ip5ea7241/Screen_Shot_2014_09_13_at_19_06_43.png]

[img=http://s24.postimg.org/ugt9kzwq9/Screen_Shot_2014_09_13_at_19_06_54.png]





Danne

The minimum to get successful with the same level dual iso conversion is to "Keep the log file after conversion" ticked.
[img=http://s10.postimg.org/rtgl2akxx/Screen_Shot_2014_09_13_at_20_22_08.png]

If not ticked this pops up
[img=http://s10.postimg.org/g1sprhqbp/Screen_Shot_2014_09_13_at_20_22_49.png]


kichetof

Quote from: Danne on September 13, 2014, 07:46:00 PM
I managed to reproduce some problems when I erased the suffix of dual iso output file. Plugin wasn,t to happy about that.

Erasing suffix gave me most of my pics but also some random stops. Not sure but it happens in the end and probably exif tool related.

Many thanks for your tests!
I need to check how I added suffix to enforce this!

Quote from: Danne on September 13, 2014, 08:26:50 PM
The minimum to get successful with the same level dual iso conversion is to "Keep the log file after conversion" ticked.

For sure !! If I delete the log file.... I know what I need to change! Tomorrow after a good night of sleep!

kichetof

Hi Danne,

Could you replace MLProcess.lua (inside cr2hdr.lrplugin, right click, show contents package) with this corrected file. In my case everything works fine! (but my workflow is mainly with CR2 files. I converted to DNG from LR).

Let me know !

Danne

You nailed it Kitchehof! The updated  MLProcess.lua totally worked! So nice to see this. If suffix is not filled it creates a name itself. Nice. Also did not need to tick keep the log file. Will test with some freshly filmed dualiso movie files from today to see how this flow will work when converting a lot of files. I,ll report back.

Question. Is it a good idea to grey out the"add the converted file to this subfolder" when dual iso dng same levels is selected? As for now the originals are all converted and of course will not move to a subfolder for that reason. Instead creates a message "no such file or directory" if you specify a folder.

The folder containing the converted dng files needs to be synchronised after conversion since it creates a ghost duplicate of every file. It is very fast doing since they,re virtual duplicates but would be nice to have this automated if not to much trouble. Small things really. This app will be number one for dual iso movie files.

If it,s any help I uploaded 50mb of dualiso dng:s here.
https://drive.google.com/file/d/0B4tCJMlOYfirMUpoRXdjWTkyY1U/edit?usp=sharing

Thanks again.