Magic Lantern Forum

Using Magic Lantern => Tutorials and Creative Uses => Topic started by: RenatoPhoto on September 16, 2013, 01:04:18 AM

Title: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: RenatoPhoto on September 16, 2013, 01:04:18 AM
Update: Sept 17
Note: This is brand new and may not work on all cameras.  It works on 5D3 from my testing.  Please let me know if you have tested this modules with other cameras to update this post

If you know nothing about ETTR then go here:
(Auto) ETTR (Exposure to the Right): -- History & Beginners Guide
http://www.magiclantern.fm/forum/index.php?topic=5693.0

If you know nothing about DUAL ISO then go here:
Dual ISO - massive dynamic range improvement
http://www.magiclantern.fm/forum/index.php?topic=7139.0

For a comparison of ETTR and DUAL ISO go here:
Dual ISO vs Auto ETTR
http://www.magiclantern.fm/forum/index.php?topic=7835.0

What is new?

The Auto Exposure To The Right module has now been expanded to squeeze the last bit of information of the camera sensor by the automatic use of DUAL ISO.  This is best used in situations where the high dynamic range of the scene require DUAL ISO to better capture the details of the image.  The latest implementation analyzes the image and automatically decides when to use DUAL ISO.

For the latest ETTR and DUAL ISO Modules go here:
Nightly Builds - try the very latest stuff here
http://www.magiclantern.fm/forum/index.php?topic=3072.0

PLEASE BE ADVISED THAT THESE MODULES ONLY WORK IF YOU HAVE ENABLED THE BOOTFLAG IN YOUR CAMERA.

If you want to enable the bootflag in your camera (550D, 600D, 50D, 60D, 5D2)  then go here:
Magic Lantern v2.3 - Install Guide
http://wiki.magiclantern.fm/install

For other cameras go here for a starting point.
RAW video & ML -- Beginners Guide, FAQ & Useful Links -- READ FIRST
http://www.magiclantern.fm/forum/index.php?topic=5520.0

HOW TO USE IT!

1. The modules are located in the EXPO tab:  Auto ETTR and Dual ISO
(http://s20.postimg.org/onoegailp/AETTR1.jpg)

2. Auto ETTR has a simple mode:

(http://s20.postimg.org/qn507pcx9/AETTR3.jpg)

Click on the Advanced mode to display all of the settings.

3. ... and an Advanced mode:

(http://s20.postimg.org/kapuxv9v1/AETTR0.jpg)

4. Trigger mode allows you to select three different methods for triggering the use of the AETTR.

    Press SET means that every time press the SET button the current scene is displayed in the LCD monitor with an analysis of the image.
    HalfS DblClick  means that every time double press the Half Shutter the current scene is displayed in the LCD monitor with an analysis of the image.
    Always on means that every time you take a picture the image is displayed in the LCD monitor with an analysis of the image.
    Auto Snap means that every time you take a picture the image is displayed in the LCD monitor with an analysis of the image, and that if the results are not adequate it will automatically take another image.

5. Slowest shutter: Set the slowest shutter that will allow for the current scene.

6. Exposure Target: A general exposure target for the scene,  cannot be set to zero but it could be set lower to expose darker.  This is not really used very much, usually left at -0.5

7.  Highlight ignore:  Percentage of (highlight) pixels to ignore when calculating ETTR.  This is used if you want to allow overexposure in the highlights, for example room lights.  Typical setting is 0.2% and means ignore almost nothing.   If you want to ignore more highlights try 1, 3, 5 or even 10%.

8.  Allow Clipping:  No clipping  This selection allows to select Clip Green channerl, and Clip ANY channel.   Only used if you want to allow clipping of higlights for any channel or only Green Channel specifically.  Some people will allow for some green channel clipping since there is more detail information on the other channels.  This would allow for the maximum exposure to the right and yet maintaining the highlight details.

9. Midtone SNR limit: Is defined in EV levels of noise in the Midtones form 1 to 8 EV.  The higher the SNR the less noise.  Typical settings from 4 to 8 EV.

10. Shadow SNR limit: Is defined in EV levels of noise form 1 to 4 EV.  The higher the SNR the less noise.  Typical settings from 2 to 4 EV.

11. Link to Canon shutter:  This links the Slowest shutter to the shutter value you set via small scroll wheel.  This is very useful for quickly changing the Slowest shutter without having to go into the ML menu.  Just set the shutter speed and on the next photo Slowest shutter = new shutter.

12.  Link to DUAL ISO: ON or OFF.  In ON position the camera will analyze the scene via Trigger mode (4) and decide if DUAL ISO is required or not.  Requires the DUAL ISO module to be enabled.
Note: If Link to DUAL ISO is set to OFF, the module will not calculate the required DUAL ISO and the image will only be set to meet the ETTR requirements.

13. Show debug info: ON OFF.  Will show some of the important calculation results of this module.

Convergence to results:

a. This module with require at least two images (sometimes three or four) to come up with the proper exposure.  Alternatively you can set the Trigger mode to Set in which case the camera will go to live view, analyze the scene, and return to photo mode with the correct settings.

b. When the algorithm cannot find an adequate exposure it will beep twice and give you a message in the LCD screen. ETTR: expo limits reached, indicating the ISO and speed limits used.

c. When the algorithm finds an adequate exposure it will beep once and give you a message in the LCD screen. ETTR settled at ISO xxx and the shutter speed.
Note: the image review time in the LCD is set via Canon menu in Image Review.  You may want to put 8 seconds so you can see the results in the LCD before it turns off.

Raw histogram use:

It is best to enable RAW Histograms via Global draw.  This will put a little histogram on the LCD during image review.  This histogram can show an ETTR hint (how many EVs are required to reach ETTR), or the Dyanmic Range of the image.  It will also show the clipped channels via colored numbered circles.

If you also enabled RAW zebras via Global draw, you will also see, if any, areas of the image are over-exposed.  Black will be completely overexposed, then you can see red, green, and blue channels clipped areas shown with their respective colors.  White will be dark areas completely under-exposed.

More about SNR Levels:

Here you can find some samples at different SNR levels:
http://www.magiclantern.fm/forum/index.php?topic=5200.msg70150#msg70150

Some test I did here:
http://www.magiclantern.fm/forum/index.php?topic=7835.0
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: chris_overseas on September 16, 2013, 01:57:18 AM
Thank you for this, it's fantastic. I picked up quite a few useful snippets of information and I'm sure I'll be referring back to this regularly while I figure out all the various options in detail.

One small typo: "You may want to put 8 or 8 second so you can see the results in the ..."  You haven't finished the sentence.

Would it be possible for you to expand a little on the SNR limits, in particular the pros/cons of the different values and when you might prefer one over the other?

Finally, am I right in thinking the main use case for Auto ETTR + Dual ISO be a scene where there is high dynamic range but there is also some movement in the scene (people, etc) that makes it unsuitable for bracketing + HDR/blending/Exposure Fusion etc instead? Are there other cases where it might be useful too?
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: RenatoPhoto on September 16, 2013, 02:29:49 AM
Quote from: chris_overseas on September 16, 2013, 01:57:18 AM
Thank you for this, it's fantastic. I picked up quite a few useful snippets of information and I'm sure I'll be referring back to this regularly while I figure out all the various options in detail.

One small typo: "You may want to put 8 or 8 second so you can see the results in the ..."  You haven't finished the sentence.

Would it be possible for you to expand a little on the SNR limits, in particular the pros/cons of the different values and when you might prefer one over the other?

Finally, am I right in thinking the main use case for Auto ETTR + Dual ISO be a scene where there is high dynamic range but there is also some movement in the scene (people, etc) that makes it unsuitable for bracketing + HDR/blending/Exposure Fusion etc instead? Are there other cases where it might be useful too?
You are welcome, every user of ML should contribute if possible.
I fixed the typo, thank you.
I have expanded a little near the bottom.
Yes, high dynamic range can only be captured in ONE picture only by the use of DUAL ISO.
Yes, perfect application for movement in high dynamic range scene.
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: Audionut on September 16, 2013, 06:30:39 AM
Quote from: chris_overseas on September 16, 2013, 01:57:18 AM
Finally, am I right in thinking the main use case for Auto ETTR + Dual ISO be a scene where there is high dynamic range but there is also some movement in the scene (people, etc) that makes it unsuitable for bracketing + HDR/blending/Exposure Fusion etc instead? Are there other cases where it might be useful too?

I use it for tone mapping in camera.  As I am predominantly a portrait shooter, skin tones are very important for me, but I also like to respect the highlights in the scene (not blow them to white).

With AETTR, I have very fine white point control.
Dual ISO allows lifting of the tones below the white point.
SNR limits allow me to accomplish this without thinking about it on location.

There are many times where the scene you are capturing might only have 9EV or so of dynamic range, but in this scene, the skin tones might be getting metered incorrectly (Canon likes to save highlight detail and will underexpose midtones to accomplish this), pale skin could end up at -2EV-0EV (from a midtone standpoint), or even worse, dark skin tones could be right down at -4EV.  This is still within the dynamic range capabilities of all cameras within the last few years (it's still within the dynamic range limits of what most people would call acceptable noise levels, let alone scientific SNR measurements where SNR is measured from 0), but most portrait shooters will know that the most important detail (the skin tone) has been pushed to far towards the shadows.
You can lift the skin tones in post, but the tonal range has been destroyed from being captured to far towards the shadows, and fine detail is also lost (to noise).  The other (better) option is to place more priority on the skin tones when making your exposure decision and suffer the highlight loss to white.

Note:  Like everything in photography, tonal range also works in stops.  A 14bit raw file has 16,384 available levels of tone.  1 stop below overexposure and this gets reduced to 8192 available levels of tone.  In other words, the very top stop of exposure gets reproduced with 8192 levels of tone, and the other combined 10 stops of exposure only get the remaining 8192 levels of tone.  In the example above where the pale skin tones have been captured at -2EV (-6EV from white), we are only left with around 256 levels of tone.  To make matters worse, as the skin tones have been underexposed by 3 stops, we need to lift the exposure in post to compensate, and in doing so, we only have 256 levels of tone to map to this new brightness level.

With AETTR (SNR limits)/dual ISO, we gain a number of advantages.

First, we have very fine white point control with AETTR.  We can decide to keep all highlights in the scene, or we can allow a limited amount of highlight overexposure (with the possibility of regaining some detail in post).

We have SNR limits that we can use for automatic exposure of the midtones (less thinking about exposure and more thinking about composition).

And then we have dual ISO for lifting the midtones.  In the example above where skin tones have been underexposed by 3 stops, we can use +3EV for the recovery ISO.  Of course, we have the option of using less separation of ISOs for better highlight control (where needed), or more separation for even better skin tone exposure.  And we can control this automatically with SNR limits.

We then have both ISOs mapped into 16bit DNG (16bit image files have 65,536 levels of tone) with it's greater precision.


Further reading:
http://www.normankoren.com/digital_tonality.html
http://dpanswers.com/content/tech_zonesystem.php
http://www.fredparker.com/ultexp1.htm
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: chris_overseas on September 16, 2013, 10:15:09 AM
Quote from: Audionut on September 16, 2013, 06:30:39 AM
I use it for tone mapping in camera.  As I am predominantly a portrait shooter, skin tones are very important for me, but I also like to respect the highlights in the scene (not blow them to white).

Interesting, thanks for explaining that, makes sense. I don't do much in the way of portrait shooting so didn't appreciate the issue with underexposed skin tones but I can see how the same reasoning would apply to similar situations. Basically whenever the subject is at the lower end of the scene's dynamic range, even if the entire DR is within the sensor's capabilities since more signal (via higher ISO) can give better S/N - as per standard Auto ETTR without dual ISO.

Quote from: Audionut on September 16, 2013, 06:30:39 AM
We then have both ISOs mapped into 16bit DNG (16bit image files have 65,536 levels of tone) with it's greater precision.

This I'm not so convinced about. Data is only captured with 14 bit precision at best. There's still noise which probably shaves off a couple of meaningful bits from the low ISO data, plus the high ISO data ends up underexposed by a few stops, each stop shaving off a bit (which was probably also noise anyway). cr2hdr interpolates the data into a 16 bit DNG but that doesn't mean you end up with 16 bits of accuracy in the resultant DNG, just precision.
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: Audionut on September 17, 2013, 04:27:55 AM
Quote from: chris_overseas on September 16, 2013, 10:15:09 AM
Interesting, thanks for explaining that, makes sense. I don't do much in the way of portrait shooting so didn't appreciate the issue with underexposed skin tones but I can see how the same reasoning would apply to similar situations. Basically whenever the subject is at the lower end of the scene's dynamic range, even if the entire DR is within the sensor's capabilities since more signal (via higher ISO) can give better S/N - as per standard Auto ETTR without dual ISO.

Yes exactly.  And we can ETTR the midtones/shadows of the image while still respecting the white point.


Quote from: chris_overseas on September 16, 2013, 10:15:09 AM
This I'm not so convinced about. Data is only captured with 14 bit precision at best..................  cr2hdr interpolates the data into a 16 bit DNG but that doesn't mean you end up with 16 bits of accuracy in the resultant DNG, just precision.

Each ISO is captured with 14bits at best.  It's my understanding that bitdepth (all but) = DR.
But we have 2 captures, that are by design increasing the DR (bitdepth).  We are not just mapping 11bits (9 useable) of signal into a 16bit container with it's greater precision, we are actually mapping 14.5 (or so) bits into a 16bit container.  Here, the greater precision is helping with the accuracy.  Because our shadows which would otherwise be mapped into 1-4bits of tonal precision (in a 14bit container), are now being mapped into a higher bitdepth.

Higher bitdepth is higher accuracy.  And we are mapping actual detail into a higher bitdepth.  Start tone mapping that data (especially the shadow data), and the increased precision will allow much greater freedom.


Quote from: chris_overseas on September 16, 2013, 10:15:09 AM
There's still noise which probably shaves off a couple of meaningful bits from the low ISO data, plus the high ISO data ends up underexposed by a few stops, each stop shaving off a bit (which was probably also noise anyway).

I don't understand how the high ISO data is being underexposed?
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: Danne on September 17, 2013, 07:42:52 AM
i must say this aettr module combined with dual-iso is one of the greatest functions in my camera right now. The accuracy of this modules are simply astonishing. Huge thanks Alex.
Also thanks for this tutorial. I learned a thing or two. Question. What camera are you using @Renatophoto? You mention "auto snap" but I don,t seem to find this option on my 5d mark 3?
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: Audionut on September 17, 2013, 08:48:47 AM
Quote from: RenatoPhoto on September 16, 2013, 01:04:18 AM
4. Trigger mode allows you to select three different methods for triggering the use of the AETTR.

    Press SET means that every time press the SET button the current scene is displayed in the LCD monitor with an analysis of the image.
    HalfS DblClick  means that every time double press the Half Shutter the current scene is displayed in the LCD monitor with an analysis of the image.
    Always on means that every time you take a picture the image is displayed in the LCD monitor with an analysis of the image.
    Auto Snap means that every time you take a picture the image is displayed in the LCD monitor with an analysis of the image, and that if the results are not adequate it will automatically take another image.

It's there.
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: Danne on September 17, 2013, 01:53:54 PM
Thanks, will try it out when I get home
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: chris_overseas on September 17, 2013, 06:31:52 PM
Quote from: Audionut on September 17, 2013, 04:27:55 AM
Each ISO is captured with 14bits at best.  It's my understanding that bitdepth (all but) = DR.
But we have 2 captures, that are by design increasing the DR (bitdepth).  We are not just mapping 11bits (9 useable) of signal into a 16bit container with it's greater precision, we are actually mapping 14.5 (or so) bits into a 16bit container.  Here, the greater precision is helping with the accuracy.  Because our shadows which would otherwise be mapped into 1-4bits of tonal precision (in a 14bit container), are now being mapped into a higher bitdepth.

Higher bitdepth is higher accuracy.  And we are mapping actual detail into a higher bitdepth.  Start tone mapping that data (especially the shadow data), and the increased precision will allow much greater freedom.

Well... yes and no. I haven't worked through all the math (and don't intend to) but it's more complex than what you're stating above. For example, mapping 14.5 bits into a 16 bit container makes the accuracy worse. It's similar to the problems faced with representing a decimal number like 0.2 in binary. You end up with 0.00110011... recurring, so have to truncate it somewhere. That introduces roundoff error and you lose some accuracy in the process (yet you gain precision). Of course in some cases that might mitigate the additional quantisation error introduced during the ADC process, in some cases it may make it worse. With regards to bit depth, yes it is somewhat related to dynamic range but again it's not a straightforward relationship since noise plays a very important role too. There's a couple of good articles on the topic here:

http://theory.uchicago.edu/~ejm/pix/20d/tests/noise/noise-p3.html
http://francoismalan.com/2011/10/raw-12bit-or-14bit-lossy-or-lossless/

Personally I'm not too fussed about trying to understand exactly what gains and losses there are in terms of accuracy, precision, noise, dynamic range or whatever. If anyone wants to debate it or even prove it mathematically then be my guest but I'm staying out of it. The basic theory is sound and the results of dual ISO speak for themselves which is good enough for me!

Quote from: Audionut on September 17, 2013, 04:27:55 AM
I don't understand how the high ISO data is being underexposed?

Sorry, my fault for being sloppy with my terminology. By "underexposed" I meant the process of cr2hdr pulling down the high ISO data by a few stops (and discarding the low order bits in the process), such that it is now exposed correctly.
Title: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: akumiszcza on September 17, 2013, 06:58:22 PM
AETTR+Dual ISO works great on 50D, too. I've tested it in churches  — before these functions I had to bracket and combine the photos as hdr. Not working for now: auto snap, always on (these work in tragic lantern builds, but no aettr+dual iso combination there yet) and beeps for good/bad ettr and no message if ettr is settled.
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: britom on September 18, 2013, 01:50:35 AM
@RenatoPhoto and everybody Thank you very much for all the info in this thread!
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: pedrosuarez on September 30, 2013, 03:35:57 AM
My apologies if this has been covered, I haven't been able locate enough information about it. I intend to try out the practices in question, I'm just curious if anyone has had previous success.

I've been trying to utilize AETTR + Dual ISO for daytime / astro time lapse and am having a few problems. My goal is to be able to complete a 24+ hour time lapse incorporating a 5 axis slider while maintaining proper exposure. Ideally, I would like to get around 2900 dual ISO frames in a 24 hour period, and end up with 1450 merged files. I'm having trouble with synchronization and exposure, though, so I've only been patch together 6-9 hour segments at a time.

First, I can't seem to expose the scene properly at night. The auto exposure immediately jumps to ISO 12800 in dark scenes, which usually overexposes my shot by more than 3 stops and blows out elements of fine detail (stars, etc). Is it possible limit the max ISO with AETTR and/or Dual ISO? I'd like to take advantage of faster glass and longer exposures to pull out as much detail as possible, but at 30" / f2.8 ISO 12800, the night sky is overexposed beyond recovery.

Second, I'd like to time the moves on my slider to be at consistent intervals between shots. I haven't found an issue when the unit stationary; AETTR and ML's intervalometer can be set to cap at a 32" exposure and, say, a ten second interval. The camera will continuously calculate exposure and take pictures. However, I'm not sure how to time the motors on my slider to move during each interval. For instance, if AUTOSNAP is engaged, the camera might need to take three or four pictures to find exposure. If I'm taking a 32" picture, the delay has to be set to over 2 minutes between shots so the slider doesn't move while the shutter is released. For a 24 hour sequence, that results in 720 pictures, or 30 seconds of film. The problem at night, again, is that my shots end up too overexposed, so only about 15-20 seconds of that film is usable.

Most Recent Settings:

Trigger mode. Auto Snap
Slowest shutter: 32"
Highlight ignore: 0.1%
Allow clipping: OFF
Midtone SNR limit: 6EV
Shadow SNR limit: 2EV
Link to Canon Shutter: OFF
Link to Dual ISO: ON
Shadow metered areas: ON
Show debug info: ON

Dual ISO (enabled)

Intervalometer / Slider: Exposure: 32", Interval - 1:40m (to allow for AUTOSNAP)

Post Deflicker:
Sidecar file type: Adobe XMP
Deflicker percentile: 50%
Deflicker target level : -4EV

Does anyone have advice as to better improve this workflow? I will continue to try out different settings, but I would love it if I could shorten the move interval to 1 minute and double my number of exposures. Not sure if that's possible with AUTOSNAP engaged, and I'm not sure if I need it engaged, so let me know if that's the case. Like I said, the main goal is 2900 dual ISO frames with 1 minute delay between moves (every other frame). It's okay if the frame pairs are ISO 100/100, etc. before merging, I'm just trying to capture greater dynamic range when possible.

Thanks in advance, and thanks to all the devs for your hard work.
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: Audionut on September 30, 2013, 05:31:54 AM
AETTR should not be creating overexposure above the limits you have set.  Can you try with just AETTR and then with AETTR+Dual ISO with no ISO speed limits.
Having said that, if your only highlights are the stars in your night shots, it's possible that 0.1% highlight ignore might be enough for AETTR to completely ignore the stars, in which case if the next brightest object is significantly darker then the stars the exposure will be much higher creating the overexposure.
You could try 0.0% highlight ignore, and allow some clipping in the green channel. 
Once you have your highlights under control, tweak the midtone/shadow settings.

Dual ISO can be limited with the "auto ISO" setting in Canon menu.
AETTR can be limited with the "ISO speed range" setting in Canon menu.

Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: ShootingStars on September 30, 2013, 10:11:09 AM
Any image samples?
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: RenatoPhoto on September 30, 2013, 02:21:19 PM
Quote from: pedrosuarez on September 30, 2013, 03:35:57 AM
For instance, if AUTOSNAP is engaged, the camera might need to take three or four pictures to find exposure.

I never used Autosnap for timelapse, I only use Always ON.  XMP will carry the exposure adjustment required to defllicker.  Also I never set my intervalometer above 1 min because the motion becomes too jerky.  I have also noted if intervalometer is higher than 1 min, and the exposure change is very fast, ETTR cannot properly deflicker so I keep intervalomenter at 1 min or less.

Also I am not sure what you mean by merged files...  It would seem like you are reducing the number of shots but I am not familiar with this process.  In any way if you are merging shots it is probably required to do it after deflickering is applied, otherwise exposure will not match from shot to shot.

I dont know if this helps but these are some tips I can provide with my limited experience.
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: akumiszcza on October 03, 2013, 11:56:45 PM
I've tried aettr+dualiso on latest nightly on 50D. The messages after each shot (in autosnap) are slower now, which makes it harder to be sure the exposure is settled (no beeps here). Besides, turning raw zebras on shows underexposed areas and draws it quite slowly in image review + making it hard to see the photo – screenshot: (http://i.imgur.com/BmllHSP.png). Turning it off doesn't help in message speed, though.
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: akumiszcza on October 04, 2013, 06:07:56 AM
Nvm my prev post. I think the speed of showing histogram and ettr message was slower, because I used slower CF card.
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: djronbxs on October 10, 2013, 06:17:51 AM
when taking hdr photos is it better to switch off ETT and dual iso ? Can you tell me the best workflow for taking hdr please ?

thanks
ron
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: mranch on October 17, 2013, 08:32:30 PM
Good Morning,
I have ML loaded on my 600D/T3i. I then loaded the Dual ISO Module.  Now the ETTR is gone from the menu. Is it possible to  use both ETTR and Dual ISO on the 600D/T3i? I've search and could not find any info on the subject. Thanks for any enlightenment.
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: martareis on October 30, 2013, 01:57:45 AM
Hi,

I can't precise the build I was using on my 60D but I had AETTR feature until I decide to uprage to the latest nightly build  (2013-10-29 23:15:09 +0000).

I presume it was removed due to some problems. Can anyone confirm that information?

In which cameras is that feature (AETTR) working properly?

Can any one provide a list of features for 60D latest nightly build?

Thx
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: a1ex on October 30, 2013, 08:00:33 AM
According to the compile log, it's there: http://builds.magiclantern.fm/ and http://nanomad.magiclantern.fm/jenkins/features.html
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: Critical Point on November 23, 2013, 05:16:19 PM
I have Tragic Lantern v1 installed because I need the H.264 GOP and bitrate controlls, can I install also this module with dual iso ?
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: Lupo_wolfi on December 29, 2013, 06:01:21 PM
Problem,
I have horizontal lines recording on Dual ISO and ETTR. Got the last ML release of Dec 28.

I followed your post and read all of the ETTR menu meanings.

Too bad that the final result got this


Thanks for any help!
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: RenatoPhoto on December 29, 2013, 06:41:52 PM
Quote from: Lupo_wolfi on December 29, 2013, 06:01:21 PM
Problem,
I have horizontal lines recording on Dual ISO and ETTR. Got the last ML release of Dec 28.

That means your images are DUAL ISO and you need to do further processing to merge the ISO...  follow this thread

Dual ISO - massive dynamic range improvement
http://www.magiclantern.fm/forum/index.php?topic=7139.0
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: ibrahim on February 15, 2019, 12:43:52 AM
For the past weeks I've intensively gone through all threads regarding dual iso and ettr and I still haven't been able to know exactly a step-by step approach in how to use both for video in camera and when to use or not to use the histogram for this purpose.
I've understood all parts, but still how do they work together 'in practice' (on camera) is something that I have been struggling with. Anyone mind sharing through an example with concrete values?  :)
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: Luther on April 05, 2019, 07:47:16 AM
Quote from: ibrahim on February 15, 2019, 12:43:52 AM
For the past weeks I've intensively gone through all threads regarding dual iso and ettr and I still haven't been able to know exactly a step-by step approach in how to use both for video in camera and when to use or not to use the histogram for this purpose.
I've understood all parts, but still how do they work together 'in practice' (on camera) is something that I have been struggling with. Anyone mind sharing through an example with concrete values?  :)

Here's how I use it:
- Enable Raw Histogram (don't enable yet DualISO)
- Set your FPS and Shutter, don't change after that
- Use ISO and Aperture to bring the exposure to the maximum, without clipping.*
- Look your histogram, the right side should not be crushed
- Enable DualISO. Set the recovery ISO to +2 EV.
- That's it.

After you process the file, it will be overexposed, so you should bring it back to normal exposure (also using histogram to guide you).

* Whenever possible and appropriate, I personally set the aperture to the "sweet spot" (see the MTF chart for your lens, it's normally between f/2.8 and f/5.6). Then I set the lowest ISO that crushes the right of the histogram just a little bit and, finally, bring back with a Variable ND filter. This way you have the best precision and highest SNR and DR.
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: mlrocks on August 01, 2021, 11:39:13 PM
Is there a way to tell the camera to meter on human subjects' skin tones like face and eyes as the basis, then auto ETTR and dual ISO accordingly?
I used auto ETTR and dual ISO together, and found out that they are good for the whole scene, like a street with high rising buildings under the noon sun, but the human faces may be darkened.
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: yokashin on August 02, 2021, 07:01:51 PM
Quote from: mlrocks on August 01, 2021, 11:39:13 PM
Is there a way to tell the camera to meter on human subjects' skin tones like face and eyes as the basis, then auto ETTR and dual ISO accordingly?
I used auto ETTR and dual ISO together, and found out that they are good for the whole scene, like a street with high rising buildings under the noon sun, but the human faces may be darkened.

Try with the zebra turned on. Maybe you can align it correctly by looking at the zebra.
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: mlrocks on August 03, 2021, 06:39:20 AM
Quote from: yokashin on August 02, 2021, 07:01:51 PM
Try with the zebra turned on. Maybe you can align it correctly by looking at the zebra.

This is a good idea.
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: stef7 on August 03, 2021, 08:57:50 AM
IMHO Spot meter would be the best. You can set exposure very precisely. In other cameras would use False color. But on the tiny low res LCD of EOS M or Canon 5D Mark III with ML spot meter function would be my friend when trying to set correct exposure on human faces.

In my experience ML RAW is like Canon RAW photos. It has more latitude toward underexposure than overexposure. Which means you can miss and recover more stops when underexposed than when overexposed. That's why I never use ETTR method with ML RAW. ETTR is mainly for log profiles on modern cameras where you need to overexpose at least 1 stop even 2 in order to get rid of the noise.

Lack of monitoring in more interesting and high image quality modes as crop is the reason why I rarely use 5D Mark III and EOS M with ML nowadays. It's a major pain in the a.. . In 1080p can use external monitor which is much more comfortable for setting exposure and focus and even more importantly - framing. Every cheap Chinese monitor has False color and wave form as tools. False color is by far my favorite one, perfect for exposure of people and skin tones. I never missed correct exposure with False Color. Never, not even once. But again in ML land external monitors work only in normal 1080p mode. And are not usable or even work with higher image quality modes as crop and anamorphic.
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: mlrocks on August 04, 2021, 05:32:47 AM
Quote from: stef7 on August 03, 2021, 08:57:50 AM
IMHO Spot meter would be the best. You can set exposure very precisely. In other cameras would use False color. But on the tiny low res LCD of EOS M or Canon 5D Mark III with ML spot meter function would be my friend when trying to set correct exposure on human faces.

In my experience ML RAW is like Canon RAW photos. It has more latitude toward underexposure than overexposure. Which means you can miss and recover more stops when underexposed than when overexposed. That's why I never use ETTR method with ML RAW. ETTR is mainly for log profiles on modern cameras where you need to overexpose at least 1 stop even 2 in order to get rid of the noise.

Lack of monitoring in more interesting and high image quality modes as crop is the reason why I rarely use 5D Mark III and EOS M with ML nowadays. It's a major pain in the a.. . In 1080p can use external monitor which is much more comfortable for setting exposure and focus and even more importantly - framing. Every cheap Chinese monitor has False color and wave form as tools. False color is by far my favorite one, perfect for exposure of people and skin tones. I never missed correct exposure with False Color. Never, not even once. But again in ML land external monitors work only in normal 1080p mode. And are not usable or even work with higher image quality modes as crop and anamorphic.

Thanks a lot for your great explanation and tips, Stef7.
When using ML spot meter for human skin tones, what choice do you recommend, like raw ev, percent, 0-255, etc?
ML also has false color like Marshall and SmallHD etc. ML also has waveform and vectoscope. You prefer external monitor's similar functions, is it because ML ones are too small or not accurate enough?
In terms of ETTR, I agree with you that 5D3 is actually good for underexposure but not so great for highlight. From my experience, if I do manual ETTR in a street scene with complicated lighting and fast pacing, I tend to overexpose some area. When I use ML's auto ETTR module in such a situation, it works much more accurately than my manual mode, i.e., much less possible to overexpose. As you mentioned, ETTR helps a lot with the shadow noise. I can see noticeable improvement in the shadow area.
From your experience, it seems that ETTR is not that important when taking human subject related shots, like portrait, event, etc? From my experience, I rarely think about using ETTR in event shooting, because there is no time, otherwise, I may lose the decisive moment. If using an ML camera, I may put the auto ETTR always on, then maybe it is practical to use ETTR for event shooting. Otherwise, manual ETTR in event shooting is very difficult to implement.

Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: stef7 on August 07, 2021, 07:03:26 PM
Spot meter show %. But it basically correspond to IRE on the waveform.
40% is 18% gray. Actually measured 42-44% with Canon 5D Mark III and ML spot meter, but fairly close

For linear video profile as Canon RAW, typical values for human skin tones are:

Lightest skin: 60 - 65 IRE or 62-67% on the spot meter
Darkest skin:  45 - 50 IRE or 47-52% on the spot meter

It is easy to check those values if you load a part of the movie or video in resolve and check values on waveform scope. You'll see they fall most of the time within those values.

You have to put the spot meter on the brightest part of the face as it is rarely evenly lit

The nice thing with False color is that with a single glance I can also check if there are part of the image which are overexposed or underexposed and also if skin tones are within the range.

Why not use False Color in ML ? Many reasons:
1. False Color requires processing power so everything else slows down.
2. Many clicks to switch it on and off. On a monitor it is just one click of a button or on the touch screen. Maybe it can be assigned to a button on ML as well. Never tried. While spot meter is on all the time and you can immediately see the value. 
3. Low resolution LCD not practical for the purpose
4. Small LCD on the back of the camera - leads to limited monitoring and camera movements. Uncomfortable to monitor, frame and shoot that way unless on a tripod or monopod with a LCD viewfinder on LCD
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: mlrocks on August 11, 2021, 05:24:20 PM
Quote from: stef7 on August 07, 2021, 07:03:26 PM
Spot meter show %. But it basically correspond to IRE on the waveform.
40% is 18% gray. Actually measured 42-44% with Canon 5D Mark III and ML spot meter, but fairly close

For linear video profile as Canon RAW, typical values for human skin tones are:

Lightest skin: 60 - 65 IRE or 62-67% on the spot meter
Darkest skin:  45 - 50 IRE or 47-52% on the spot meter

It is easy to check those values if you load a part of the movie or video in resolve and check values on waveform scope. You'll see they fall most of the time within those values.

You have to put the spot meter on the brightest part of the face as it is rarely evenly lit

The nice thing with False color is that with a single glance I can also check if there are part of the image which are overexposed or underexposed and also if skin tones are within the range.

Why not use False Color in ML ? Many reasons:
1. False Color requires processing power so everything else slows down.
2. Many clicks to switch it on and off. On a monitor it is just one click of a button or on the touch screen. Maybe it can be assigned to a button on ML as well. Never tried. While spot meter is on all the time and you can immediately see the value. 
3. Low resolution LCD not practical for the purpose
4. Small LCD on the back of the camera - leads to limited monitoring and camera movements. Uncomfortable to monitor, frame and shoot that way unless on a tripod or monopod with a LCD viewfinder on LCD

Thank you very much for the insightful explanation, Stef7. Regards,
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: mlrocks on August 27, 2021, 08:25:12 PM
From my initial testing, without an external monitor, with an LCDVF, 5D3's 5.7k 1x3 and 3.5k 1x1 centered modes are very useful, can be practical enough for real world shooting. Thanks Danne for his great work.
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: mlrocks on September 09, 2021, 09:22:50 PM
I did more tests, the external monitor has an anamorphic mode, but the HDMI outputs only the real time live view. Unless the real time live view has the correct framing, the in monitor anamorphic mode is not good for framing.

On 5D3 with Dnne's latest ML version, neither 1x3 5.8k nor 1x1 3.5k centered mode exports correct frame preview to an external evf. I test this with a Zacuto EVF. So external monitor is still not working with higher resolution presets on 5D3. Also, changing between presets freezes the camera. Sometimes I have to remove battery. Sometimes I have to recopy ML files from the computer onto the CF card to solve the issue. 650D is much more robust in terms of changing the presets.
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: mlrocks on September 10, 2021, 07:08:29 AM
"Lack of monitoring in more interesting and high image quality modes as crop is the reason why I rarely use 5D Mark III and EOS M with ML nowadays. It's a major pain in the a.. . In 1080p can use external monitor which is much more comfortable for setting exposure and focus and even more importantly - framing. Every cheap Chinese monitor has False color and wave form as tools. False color is by far my favorite one, perfect for exposure of people and skin tones. I never missed correct exposure with False Color. Never, not even once. But again in ML land external monitors work only in normal 1080p mode. And are not usable or even work with higher image quality modes as crop and anamorphic."

650D's 1x3 modes, UHD, 4K, 4.3K, 4.5K, have correct framing real time previews, in camera, and in external monitor/evf. I tested these modes with a Zacuto EVF. No in monitor anamorphic mode is needed.
https://www.magiclantern.fm/forum/index.php?topic=25323.0
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: An147 on June 09, 2022, 11:25:50 AM
Quote from: Luther on April 05, 2019, 07:47:16 AM

After you process the file, it will be overexposed, so you should bring it back to normal exposure (also using histogram to guide you).


Strange, I do the same thing, trying not to clip highlights at the skies, but also tried +3EV (100/800 dual ISO) and still get bad results. My shadows is very noisy, what I'm doing wrong?
Shoot on canon 700D, 50 FPS, DualISO on (100/800 ISO), the aperture is about f/11 or f/13 to not clip highlights.
And yes, my video is underexposed after converting from DualISO in MLV App  ::)
Title: Re: AETTR + DUAL ISO: The Ultimate Automated Perfect Image Exposure-Beginners'Guide
Post by: Walter Schulz on June 09, 2022, 11:59:49 AM
May I ask about your video mode settings in Canon menu and in ML?